Viewing a single comment thread. View all comments

roselan t1_jecbcr4 wrote on March 30, 2023 at 11:40 PM

Results from the demo are amazingly good for a 13b model. I'm floored!

I wonder how much memory the demo needs to run.

maizeq t1_jedcga5 wrote on March 31, 2023 at 4:44 AM

~6.5gb if 4bit quantised.