Submitted by RadioFreeAmerika t3_122ilav in singularity
turnip_burrito t1_jdsoxo1 wrote
Reply to comment by RadioFreeAmerika in Why is maths so hard for LLMs? by RadioFreeAmerika
Yeah, we're really waiting for electricity costs to fall if we want to implement things like this in reality.
Right now the roughly current rate of $0.10/(1000tokens)/minute/LLM will, per hour, cost us $6 per hour to run a single LLM. If you have some ensemble of LLMs checking each other's work and working in parallel, say 10 LLMs, that's $60/hr, or $1440/day. Yikes, I can't afford that. And that will maybe have performance and problem solving somewhere between a single LLM and one human.
Once the cost falls by a factor of 100, that's $14.40/day. Expensive, but much more reasonable.
RadioFreeAmerika OP t1_jdufzz4 wrote
But even with $60/h, this might already be profitable if you replace a job that has a higher hourly wage. Lawyers, e.g. At 14.4/h, you beat minimum wage. For toying around, yeah, that's a bit expensive.
turnip_burrito t1_jduhcoa wrote
Yeah for an individual it's no joke .
For a business it may be worth it, depending on the job.
Viewing a single comment thread. View all comments