lorepieri t1_j1z4zp5 wrote
Some thoughts and then some references to neuro-symbolic approaches:
The reality is that AGI has become (always been?) an engineering problem [For intellectual honesty: this is not consensus, e.g. among neuroscientists. See comments below]. Many times in the past we have seen less theoretically scalable methods outperform more principles ones, so nobody can predict which one will win in the short term. LLMs are promising since they can leverage all the hardware acceleration and the pre-existing work of different fields (NLP, Computer Vision, RL). So it may very well be that DL will be enough to achieve great results and more investment and optimisation will pile-in, making symbolic approaches comparatively less attractive to fund in the short term.
Who knows, maybe the right symbolic architecture has already been proposed 20-30 years ago and nobody took the effort to put into a modern GPU accelerated codebase.
https://arxiv.org/abs/2012.05876 Neurosymbolic AI: The 3rd Wave
https://arxiv.org/abs/2105.05330 Neuro-Symbolic Artificial Intelligence: Current Trends
https://arxiv.org/abs/2002.00388 A Survey on Knowledge Graphs: Representation, Acquisition and Applications
valdanylchuk OP t1_j1zb36a wrote
> Who knows, maybe the right symbolic architecture has already been proposed 20-30 years ago and nobody took the effort to put into a modern GPU accelerated codebase.
I also half-expect that in ten years, what current LLMs do on racks of GPUs, will fit in a phone chip, because many advances in efficiency come from utilizing old simple techniques like Monte Carlo and nearest neighbors.
lorepieri t1_j1zniuo wrote
Exactly, it's not just a matter of software architecture, but also of preexisting optimised libraries, hardware acceleration, economic incentives, funding. Very hard to predict how it will end up.
master3243 t1_j20v8i9 wrote
> The reality is that AGI has become (always been?) an engineering problem.
I would not state this as fact, I'd say the majority of neuroscientists and cognitive scientists will disagree with this (or say we don't know yet), and a fair number of AI researchers would too.
I doubt any but a few researchers would be comfortable saying "Yes it's definitely an engineering problem".
lorepieri t1_j23iett wrote
You are correct, edited to clarify that this is not consensus.
Viewing a single comment thread. View all comments