Viewing a single comment thread. View all comments

Defiant-Ranger t1_jdap72v wrote

Reply to comment by plunki in [P] One of the best ChatGPT-like models (possibly better than OpenAssistant, Stanford Alpaca, ChatGLM and others) by [deleted]

I used Google Colab notebook for the training, pro version. GPU, high-ram. My Macbook would probably die just by loading the model

1

Balance- t1_jdapkca wrote

Wait you got that trained in one day on a single GPU? This stuff is going so fast

1

plunki t1_jdapmzf wrote

Cool, I got the weights and see people have had some success running on single GPU's using 8bit instead of 16bit etc, but haven't tried myself yet

1