minimaxir
minimaxir OP t1_jann3ze wrote
Reply to comment by Sea_Alarm_4725 in [D] OpenAI introduces ChatGPT and Whisper APIs (ChatGPT API is 1/10th the cost of GPT-3 API) by minimaxir
4k
minimaxir OP t1_jajcf4s wrote
Reply to comment by LetterRip in [D] OpenAI introduces ChatGPT and Whisper APIs (ChatGPT API is 1/10th the cost of GPT-3 API) by minimaxir
It's safe to assume that some of those techniques were already used in previous iterations of GPT-3/ChatGPT.
minimaxir OP t1_iy4ew5t wrote
Reply to [P] Stable Diffusion 2.0 and the Importance of Negative Prompts for Good Results (+ Colab Notebooks + Negative Embedding) by minimaxir
- Negative Embedding: https://huggingface.co/minimaxir/wrong_embedding_sd_2_0
- General SD 2.0 inference notebook (also leveraging the negative embedding): https://colab.research.google.com/github/minimaxir/stable-diffusion-negative-prompt/blob/main/sd_2_0_base.ipynb
- Notebook for the labeled 3x3 grids: https://colab.research.google.com/github/minimaxir/stable-diffusion-negative-prompt/blob/main/sd_2_0_grid_3x3.ipynb
minimaxir t1_ir6bisc wrote
Reply to comment by incrediblediy in [R] Google Colab alternative by Zatania
The amount of tokens in the input. Sequence length requires quadratic scaling compute.
Pretrained BERT takes in a maximum of 512 tokens.
minimaxir t1_ir6bbja wrote
Reply to comment by [deleted] in [R] Google Colab alternative by Zatania
The biggest obstacle to using ScaNN over FAISS is that ScaNN is Linux only.
FAISS can also use the GPU for larger workloads.
For ANN in practice they are close enough.
minimaxir OP t1_jaru4ch wrote
Reply to comment by Bluebotlabs in [D] OpenAI introduces ChatGPT and Whisper APIs (ChatGPT API is 1/10th the cost of GPT-3 API) by minimaxir
More cumulatively than exponentially but yes.
With the new prices that's not a big deal.