Viewing a single comment thread. View all comments

Liberty2012 t1_j9u3ov6 wrote

Reply to comment by strongaifuturist in The Sentient Search Engine? How ChatGPT’s Insane Conversation Reveals the Limits and Potential of Large Language Models by strongaifuturist

> Now it's only a matter of time before the kinks get ironed out.

Yes, that is the point of view of some. However, it is not the point of view of all. Meaning that if this is a core architecture problem of LLMs, it will not be solvable without a new architecture. So, yes it can be solved, but it won't be an LLM that solves it.

But yes, I'm more concerned about the implications of what comes next when we do solve it.

1

strongaifuturist OP t1_j9u8es5 wrote

I’m not saying that architectural changes aren’t needed. The article outlines some of the alternatives being explored. My favorite is one from Yann LeCun based on a technique called H-JEPA.

1