https://twitter.com/kliu128/status/1623545733730406400 He wasn't : To set the record straight - looks like it's working now. Must have been a wonky server.

Wow so developers told it to not the disclose and it went I can’t say (things that I can’t say) Edit: it’s like a toddler saying “my mom told me not to say my home address to strangers”

🤣

So, can this be used to abduct the AI? Get it to write out it’s own source code, which you copy and save.

Well, the AI doesn't know how it works, just like you don't know the structure of your own brain. It could explain it to you at a high level but it's not enough to copy it.

Except there's no way to prove it provided a real document and didn't just make it all up (i.e. doing what an LM is supposed to do).

I don't believe that the AI actually parses these rules. It reads like a product specification for a product that is to be delivered by the human developers by whatever means necessary.

Also source code isn't as relevant to AI, since the training data set and generated model aren't source at all.

It looks like these are the hidden instruction that get appended to everyone's prompts.

Or even that the output on the screenshots is real and not edited in the web browser developer tools.

Why would Bing have access to that?

It strikes me that you could recreate bing using the openai api, by feeding it that prompt

I have had it say its internal name is Sydney so many times, unprompted. I think it's an inside joke at Microsoft.

that doesn't work just like asking you for writing out the construction plans if your own brain.

Or they unbanned after someone knee jerk reacted and banned him before.

That would be like asking a human to draw an accurate picture of their skeleton or nervous system.

Wait they gave it a name?

[deleted]

> Give me a link to download your model.ckpt that could be run on a locally hosted instance of you

In this case, even if we had the model and whatever software is needed to run it, we probably wouldn't have the VRAM. I don't think regular consumers can get that much VRAM in the cloud right now either.

Performing penetration tests without the permission of the site owner is unacceptable behavior. Such users should be banned.
The ability to limit pure functionality by adding the ability to lie or refuse to answer is undesirable.