Viewing a single comment thread. View all comments

DarkCeldori t1_jeepkok wrote

This long training time with massive resources is by virtue of backpropagation and use of llm.

The human brain runs at about 100Hz at like 2% activity, and within a few years you can have a prodigy doing calculus, chemistry, chess and playing instruments with grasp of multiple languages. It is estimated the brain does the equivalent of around 100 trillion operations per second.

These models are being trained with the equivalent of millions of years of training on what is likely hw far more powerful than the brain.

It is likely brain like algorithms can allow far more modest hw to train in realtime and achieve agi performance.

1