Representative_Pop_8 t1_j9wp2cc wrote on February 25, 2023 at 2:31 AM

Reply to comment by FpRhGf in What are the big flaws with LLMs right now? by fangfried

I think ChatGPT has finer grained data. in fact I did teach Spanish piglatin ( geringoso) to ChatGPT and it did learn it after about a dozen promts even though it insisted that it didn't know and couldn't learn it.

i had to ask to play role as a person that knew the piglatin I tought him. Funny thing is it ranted about not being able to do the translation, and they l that I wanted to know I could v apply the rules muy self! but next paragraph it said something like. " but the person would have said..." followed by a pretty decent translation

FpRhGf t1_j9xuv93 wrote on February 25, 2023 at 10:06 AM

I think understanding and generating are different things. I remember seeing an article days ago on this sub that says LLMs could translate languages they weren't trained on, so I'm not too surprised if you say it could translate Geringoso.

However it can't generate. When I tried to get it to write in Pig Latin, the sentences were incoherent and it contained words that aren't real words. But at least they all end with “ay” and the output was better than my initial approach.

My initial approach was to get ChatGPT to move the first letter of each word to the last (Pig Latin without the “ay”) to see if it's a viable way of avoiding the filter. And it completely failed. It ended up giving me sentences where every word is a typo like “Myh hubmurger js veyr dliecsoius” instead of “Ym amburgerh si eryv eliciousd”. On top of that, the filters could still detect the content with all those typos, so it was a failed experiment for me.