Scarlet_pot2
Scarlet_pot2 OP t1_j39e8ao wrote
Reply to comment by KSRandom195 in We need more small groups and individuals trying to build AGI by Scarlet_pot2
The goal shouldn't be to develop AGI, The goal should be to make discoveries that could lead to parts of AGI when extrapolated out.. Like the first word generation model was made that led to the LLMs today, we need small teams trying new things and sharing the results.
Let's assume "guess the next word" fills the part of the brain for prediction down the line for when AGI is developed. Maybe a small group develops the first thing that will later on fit another part of the brain, like how to make memory work. or how to develop reasoning. or any other parts.
and at least some of those can be found by small groups trying new approaches. John Carmack said that all the code of AGI would be able to fit on a USB. the goal should be to find parts of that code.
It won't be easy or quick, but I'm sure if we had 100k people with beginner-intermediate base understanding of the subjects related to AI, all trying different approaches and sharing their results, some working together, after a few years we would probably have at least a few new methods worth trying that may lead to a part of AGI.
Scarlet_pot2 OP t1_j39cjh8 wrote
Reply to comment by Cryptizard in We need more small groups and individuals trying to build AGI by Scarlet_pot2
it was a small group of engineers at google. Not highly funded. They were trying to make something for google translate when they figured out they can make a program that guesses the next word.
Scarlet_pot2 OP t1_j39b08w wrote
Reply to comment by footurist in We need more small groups and individuals trying to build AGI by Scarlet_pot2
IMO, guess the next word isn't going to lead to AGI alone, but it most likely will play a part. Let's assume "guess the next word" fills the part of the brain for prediction down the line for when AGI is developed. Maybe a small group develops the first thing that will later on fit another part of the brain, like how to make memory work. or how to develop reasoning. or any other parts.
The goal should be to make discoveries that could lead to parts of AGI when extrapolated out.. and at least some of those can be found by small groups trying new approaches. John Carmack said that all the code of AGI would be able to fit on a USB. the goal should be to find parts of that code.
Scarlet_pot2 OP t1_j39a7ok wrote
Reply to comment by ChronoPsyche in We need more small groups and individuals trying to build AGI by Scarlet_pot2
The fact that there are people at these companies trying new approaches shouldn't stop you from trying to. They aren't going to be trying what you are. Even if what you try comes up short, then we know one more path that isn't towards AGI
The goal should be to try as many different approaches as possible so we can identify the ones that show promise. It won't be easy or quick, but I'm sure if we had 100k people with beginner-intermediate base understanding of the subjects related to AI, all trying different approaches and sharing their results, some working together, after a few years we would probably have at least a few new methods worth trying that may lead to a part of AGI.
Scarlet_pot2 OP t1_j399d9f wrote
Reply to comment by Cryptizard in We need more small groups and individuals trying to build AGI by Scarlet_pot2
doesn't take 8 phds. Take courses on programming, college math, AI, and psychology. A beginner-intermediate understanding of these is all you need to start fiddling and trying new approaches
Scarlet_pot2 OP t1_j398xn5 wrote
Reply to comment by footurist in We need more small groups and individuals trying to build AGI by Scarlet_pot2
The expectations should be tampered. the foundations of AGI aren't going to be made in a couple of hours, but just as "guess the next word" was found out and led to LLMs, I'm sure there are many of simple small discoveries waiting to be found. And many diverse groups trying different things and sharing their results could lead to some of those. It may not be you that builds the million dollar model, but you could make the first simple program that shows promise and ends up being the base idea for large models a few years down the line, by someone.
Scarlet_pot2 OP t1_j397wnk wrote
Reply to comment by Cryptizard in We need more small groups and individuals trying to build AGI by Scarlet_pot2
Yes making large models is expensive, but coming across the next discovery like "guess the next word" isn't. That small discovery led to all the LLMs we post about today, and it was made from a small group of people. The goal shouldn't be to train million dollar massive models. The goal should be to find new novel approaches.
A small group could make the next discovery like guess the next word, and I'm sure there are many discoveries to be made. building massive models from it may happen years later, from the creators or a better funded group.
Scarlet_pot2 OP t1_j396pzu wrote
Reply to comment by Buck-Nasty in We need more small groups and individuals trying to build AGI by Scarlet_pot2
The goal shouldn't be to build the rocket. It should be to develop the physics so someone with more funding can build the rocket later on.
Like the first word generation model was made that led to the LLMs today, we need small teams trying new things and sharing the results. If something is useful it may lead to the big models of tomorrow
Scarlet_pot2 OP t1_j396aqv wrote
Reply to comment by TheDavidMichaels in We need more small groups and individuals trying to build AGI by Scarlet_pot2
No, I just actually believe in myself. Which is a trait more people should have.
Scarlet_pot2 OP t1_j3961c1 wrote
Reply to comment by ChronoPsyche in We need more small groups and individuals trying to build AGI by Scarlet_pot2
I'm not talking about LLMs. I'm talking about new, novel approaches. LLMs were started because a small group figured out they could make a program that could guess the next word. small groups trying new things could develop the next program like that, which is something people could try.
You may try new things and make a simple discovery that leads to new advanced AIs a couple years later
Scarlet_pot2 OP t1_j395goa wrote
Reply to comment by Lopsided-Basket5366 in We need more small groups and individuals trying to build AGI by Scarlet_pot2
The fact it is still in its infancy is more of a reason to get involved.. Get in early and you have more of a chance to make an impact. You don;t need to fully move into the field, you can do it for an hour a day as a hobby, keeping your regular job. Maybe it'll lead to a programmer / AI job in the future. Maybe you'll stumble across the next simple discover like "guess the next word" that will lead to advanced models down the line
Scarlet_pot2 OP t1_j394x4d wrote
Reply to comment by HeronSouki in We need more small groups and individuals trying to build AGI by Scarlet_pot2
It doesn't have to be. Think of the first word generation model that lead to all the new LLMs we post about. It was a simple new thing we discovered we can do with code ( guess the next word) . Things like that could definitely be developed by small groups, and it could lead to many new advanced AIs a few years down the line
Scarlet_pot2 OP t1_j394ekc wrote
Reply to comment by 3deal in We need more small groups and individuals trying to build AGI by Scarlet_pot2
See that is an idea worth trying. Study it more and try to implement it in code, and build it into a model. a group with this model may build something thats akin to the first small word generation model of LLMs. That is one idea worth trying and I'm sure there is countless others people could try
Scarlet_pot2 OP t1_j393z6j wrote
Reply to comment by EOE97 in We need more small groups and individuals trying to build AGI by Scarlet_pot2
I'm for it! We could share resources, help each other learn, etc. We could start a discord server, make a post about it with the mission or goal, and then people who want to contribute can join. It's doable and once one group starts more can follow
When you look at the start of LLMs, it was a small team learning they
could build a model to generate the next word, and later that was extrapolated
out to chatGPT, image generation and more. We could try to find a change like that. a new method that later can lead to many new AIs
Scarlet_pot2 OP t1_j3937vf wrote
Reply to comment by ChronoPsyche in We need more small groups and individuals trying to build AGI by Scarlet_pot2
Whatever group is made, they can self fund. I'm sure most of us work, and it doesn't cost much to learn and try new approaches. you don't need to train a multi-million dollar model. There's many other ways to contribute
Scarlet_pot2 OP t1_j392tjr wrote
Reply to comment by AsheyDS in We need more small groups and individuals trying to build AGI by Scarlet_pot2
Agreed. the Innovation we need will require out of the box thinking, so sticking to current AI trends and methods isn't necessary. We should tinker with the fundamentals and figure out new ways to do things. When you look at the start of LLMs, it was a small team learning they could build a model to generate the next word, and that was extrapolated out to chatGPT, image generation and more. We need more advancements like that, and those type of advancements are totally possible for small teams and individuals
Also a jack of all trades approach would help with new ideas and trying them out. Knowing about human and animal cognition yes, and studying human psychology and its development. Using theories like these, trying to recreate in code in new novel ways can lead to advancements. small groups can make these advancements and more without needing billions in funding
Scarlet_pot2 OP t1_j391hyr wrote
Reply to comment by QuietOil9491 in We need more small groups and individuals trying to build AGI by Scarlet_pot2
I'm saying specifically for AI. I won't be pushed by stakeholders to train LLMs, to push out products to generate revenue, to constantly trying to please the funders. By no profit motive I mean building solely for the purpose of AI advancement. Willing to lose money and time for it, not expecting to make it back next quarter.
I'm not saying a group of amateurs or people with intermediate experiences could build it. But they could make small advancements over time, and over years it could get better, leading to an Open-Source AI made from many people contributing over time
Scarlet_pot2 t1_j36kgnd wrote
from my understanding, editing an embryo is much simpler then editing a full grown human. By simpler I mean less complications
Scarlet_pot2 t1_j2vbk7k wrote
Reply to Your favorite series about AI? by DJswipeleft
BladeRunner 2049
Scarlet_pot2 t1_j2vbfi8 wrote
Reply to Your favorite series about AI? by DJswipeleft
"do it yourself!!" anime set during the singularity. But its mostly about a group of girls deciding to build things themselves
Scarlet_pot2 t1_j2aerkk wrote
I'm down. lets do it
Scarlet_pot2 t1_j1xx9ij wrote
Reply to comment by crumbaker in Some side effects of ai that many haven't really thought of, coming very soon. by crumbaker
Sure and trump is the rightful president of the US. He'll take back the office any day now. And a jewish cabal runs the media, banks, and government etc. sure buddy. And oh all other problems are due to immigrants and socialism, can't forget that.
Scarlet_pot2 t1_j1xx1te wrote
Reply to comment by XPao in What is the sub's prevailing political ideology? (post singularity) by 4e_65_6f
-Says the guy with free healthcare, free college and high unionization rates.
Scarlet_pot2 t1_j1x03ui wrote
The way to fight this would be to start, fund, and contribute to Open-source AI projects. Stability AI is one, but we need more like it
Scarlet_pot2 OP t1_j39g574 wrote
Reply to comment by Cryptizard in We need more small groups and individuals trying to build AGI by Scarlet_pot2
https://en.wikipedia.org/wiki/Word2vec
"Word2vec is a technique for natural language processing (NLP) published in 2013 (Google). The word2vec algorithm uses a neural network model to learn word associations from a large corpus of text."
This was the first "guess the next word" model.
https://towardsdatascience.com/attention-is-all-you-need-discovering-the-transformer-paper-73e5ff5e0634
This next link is the "Attention is all you need" paper that describes how to build a transformer model for the first time.
These two discoveries didn't take millions or billions in funding. Made by small groups of passionate people, and their work led to the LLMs of today. We need to find new methods that would be similarly disruptive when extrapolated out.. and the more people we have working on it, the better chance we have of finding things like these. IMO these are parts of the future AGI, or at least important steps towards it. It doesn't take ungodly amounts to make the important innovations like these