Submitted by Business-Lead2679 t3_1271po7 in MachineLearning
roselan t1_jecbcr4 wrote
Results from the demo are amazingly good for a 13b model. I'm floored!
I wonder how much memory the demo needs to run.
maizeq t1_jedcga5 wrote
~6.5gb if 4bit quantised.
Viewing a single comment thread. View all comments