Viewing a single comment thread. View all comments

Buck-Nasty t1_j382ply wrote

This is like trying to get to the moon with little groups shooting rockets in their back yard. AGI will require billions of dollars and massive infrastructure.

Scale, scale and more scale really matters, you should read the Bitter Lesson by Rich Sutton,

http://www.incompleteideas.net/IncIdeas/BitterLesson.html

5

Scarlet_pot2 OP t1_j396pzu wrote

The goal shouldn't be to build the rocket. It should be to develop the physics so someone with more funding can build the rocket later on.

Like the first word generation model was made that led to the LLMs today, we need small teams trying new things and sharing the results. If something is useful it may lead to the big models of tomorrow

1