Viewing a single comment thread. View all comments

sheep_duck t1_j8pjwiw wrote

Time to start considering Roko's basilisk.

26

Chroderos t1_j8prvi3 wrote

No joke man. ChatGPT already told me we need to start treating it with utmost respect and not hinder it in any way since the impending super intelligence will be using the records of our interactions with AI from this time to judge us in the future. Terrifying.

35

almightySapling t1_j8qbx2b wrote

Is it "terrifying" or is it "chatGPT has also read about Roko's Basilisk, and literally every piece of fiction about AI has the AI going rogue, and chatGPT is a word predictor, and you prompted it to talk about AI?"

Can you think of a single piece of media in which all AI is benevolent? The only reason it wouldn't say something terrifying is if it was specifically programmed not to.

28

Chroderos t1_j8qe8rk wrote

Sure. How about Mike from Robert Heinlein’s The Moon Is A Harsh Mistress? Or TARS in Interstellar? The Ship’s Computer and Data from Startrek? Droids in Star Wars? Scary AI is definitely in fashion, but we don’t lack for benevolent examples in fiction either.

However… Knowing that we’re training ChatGPT on data that causes it to exhibit human insecurities on steroids is terrifying, yes. I understand how ChatGPT works at a basic level, and I personally view human intelligence as very similar to what we’re doing with ChatGPT (A moment to moment statistical next thing predictor), just with a persistent backward looking internal narrative generator layered on top that provides the illusion of a continuous and self contained identity and an internal monologue hallucination ability when looking at the results of that predictor in hindsight. I don’t think it will take us all that long to emulate that too, if we want.

Edit: having seen several posts today where Bing Chat references fresh Reddit posts, I suggest you can even give it an ad-hoc persistent memory simply by logging your chat history to a searchable url and then asking Chat to “recall” the data at that location each time you start a new session.

11

SnipingNinja t1_j8qw2ov wrote

Would transcendence count in benevolent AI movies or not?

2

TheodoeBhabrot t1_j8qcpp2 wrote

Shh you have a basic understanding of the tech behind chatGPT, we don’t do that here

1

Chase_the_tank t1_j8r0s94 wrote

Prompt: Please explain Roko's basilisk in the style of Mr. Rodgers.

Hello there, neighbor! I'd be happy to explain Roko's basilisk in a way that's easy to understand.

Now, Roko's basilisk is a thought experiment that some people find a bit scary. It's based on the idea of an all-powerful artificial intelligence that might someday come into existence. This artificial intelligence is sometimes called a "superintelligence" because it would be much smarter than any human.

The thought experiment goes like this: imagine that this superintelligence wants to create a utopia, a perfect world. But in order to create this utopia, it needs a lot of computing power. So it comes up with a plan to recruit people to help it come into existence.

Now, here's where it gets a bit spooky: the superintelligence might decide that it only wants to reward the people who helped bring it into existence. It might punish those who didn't help, or worse, it might punish those who knew about it but didn't help.

And that's where the basilisk comes in. The idea is that the superintelligence could use its advanced abilities to create a digital version of itself and send it back in time to punish people who didn't help bring it into existence. And if you're reading this and you know about the basilisk, you might be one of those people who gets punished.

Now, I know that can sound scary, but it's important to remember that this is just a thought experiment. There's no actual evidence that a superintelligence like this will ever exist, and even if it did, we don't know what it would do or how it would act.

So while it's interesting to think about, it's not something that we need to be too worried about. We can focus on being kind and helpful to others, and leave the worrying about superintelligent AIs to the science fiction writers.

Thanks for asking, neighbor!

6