Submitted by Tom_Lilja t3_z83h2v in singularity
FirstOrderCat t1_iybm4dy wrote
Reply to comment by Sigura83 in Better Language Models Without Massive Compute by Tom_Lilja
>First in a MMO like setting, then the real world.
nop, this transition is very hard because of following reason:
current wave of AI can approximate giant datasets, that's something it is doing very well. So, all your examples is: they throw terrabites of data on neural network, and it learns patterns. But this kind AI can't generalize and do abstract thinking which means it can't learn from very few examples.
Meaning yes, they can ask AI to play MMO 100 millions times and it will learn from its own mistakes, but you would need to do the same 100 million times in real world, which is not very feasible.
Another issue is that: MMO has much smaller level of freedom than real world, which makes MMO is not a good benchmark.
Viewing a single comment thread. View all comments