Viewing a single comment thread. View all comments

acutelychronicpanic t1_jdwrdgp wrote

Reply to comment by 1II1I11II1I1I111I1 in The current danger is the nature of GPT networks to make obviously false claims with absolute confidence. by katiecharm

Inaccuracy, misinformation, and deliberate misuse are all obviously bad things.

But yeah, misalignment is the only real concern when you put it all in perspective. Its the only thing that we can never come back from if it goes too far.

Imagine if, when nuclear weapons were first developed, the primary concern was the ecological impact of uranium mining...

Edit: Reading through the link you posted, I find it a bit funny that we all have been talking about AI gaining unauthorized access to the internet as a huge concern. Given where things are right now..

3

1II1I11II1I1I111I1 t1_jdws8u9 wrote

Yep, agreed.

The reason I don't worry too much about hallucinations and truthfullness is because Ilya Sutskever (OpenAI) says it's very likely to be solved in the 'nearer future'; current limitations are just current limitations. Exactly like the limitations of 2 years ago, we will look back at this moment as just another minor development hurdle.

Edit: Yep, suss this tweet https://twitter.com/ciphergoth/status/1638955427668033536?s=20 People just confidently said "don't connect it to the internet and it won't be a problem'. We've been dazzled by current changes and now such a fundamental defence has been bypassed because? Convenience? Optimism? Blind faith?

2