head_robotics
head_robotics t1_j9spe5y wrote
This looks like it could be pretty cool:
https://github.com/lutzroeder/netron
head_robotics OP t1_j99tts4 wrote
Reply to comment by Disastrous_Elk_6375 in [D] Large Language Models feasible to run on 32GB RAM / 8 GB VRAM / 24GB VRAM by head_robotics
Did you use something like bitsandbytes for the 8bit inference?
How did you implement it?
head_robotics t1_j14e1fn wrote
Another question could be what is the minimal sized language model that could be useful?
If the largest models can't be reasonably run, what about smaller models that could be?
Any chance of getting usable results for reasonable speed?
head_robotics t1_jb4djzx wrote
Reply to [D] Ethics of minecraft stable diffusion by NoLifeGamer2
You could do a version for Minetest or Terasology
https://www.minetest.net/
https://terasology.org/