Submitted by noellarkin t3_10rhprm in MachineLearning
Hyper1on t1_j6xn5do wrote
> AI21's Jurassic 178B seems to be comparable to GPT3 davinci 001.
This is actually a compliment to AI21, since davinci001 is fine-tuned from original 175B davinci on human feedback over generations:
https://platform.openai.com/docs/model-index-for-researchers
The better comparison is with plain davinci, and you would expect 001 to be better and 003 to be significantly better (the latter is trained with RLHF).
There are currently no open source RLHF models to compete with davinci 003, but this will change in 2023.
Viewing a single comment thread. View all comments