It amazes me that people who you think really should know better seem
to think code is magic and that AI can “escape” by sending people intro
course level python snippets
Also what the hell does it even mean for it to escape? I mean like in
an actual technical sense, not the sci-fi fantasist version.
An actual technical definition of escape would be for it to find an insecure AWS instance and use the [Alpaca](https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwiU8e-zxeX9AhUCQzABHZrYD00QwqsBegQICBAE&url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DxslW5sQOkC8&usg=AOvVaw0WD3IpWI4bw5B-vLTlmtHk) technique to train a clone of itself running outside of the supervision of OpenAI.
uj for a moment, theoretically a sapient AI would be able to "escape" by copying itself through the internet. But nobody would notice, because it would be a copy lol
Kosinski deserves a special category of sneer all to himself.
He does this constantly. Over and over again. “Just trying to help.”
No matter how many times saner people tell him to stop it and that he’s
not helping.
Kosinksi: ooh, something very dangerous over here!!! Why don’t I try
to provoke it into doing the most dangerous thing possible, because I’m
just trying to help.
Literally everyone: don’t provoke it, please
Kosinski: but I’m just trying to help! hey what does that big red
button do that says “Do Not Press”? Let me press it & see
He also recently wrote a very sneerworthy paper
saying that because he could get GPT3 to act as if it was talking about
people’s thoughts, it “has” a theory of mind, featuring plenty of
prevaricating language about whether the AI was thinking.
And lots of
other things, like being at least associated with the folks who got
Cambridge Analytica to work on psychometrics for driving election
behavior. And this hateful
gem. I wonder whether he intersects with our usual subjects.
I can’t believe these goddamn mouth-breathing morons still actually
think that a language model has anything to do with a cognitive entity.
It won’t magically become AGI with increased scale, just like a computer
doesn’t magically become sentient when you increase it’s RAM. It’s such
an obvious understanding to make, if either you know how the technology
behind it works, or even just by spending a little time testing the
limits of it. It takes a special kind of arrogant ignorance to not see
this, despite dedicating so much of your time to thinking about this
field.
Rationalists read lots of scientific papers and the like, then write a screed of text that looks similar. Truth and logical consistency aren't a consideration providing the text is very long and hits all the simple points they wanted to make. AI can perform the task that Rationalists consider intellect, so of course they are impressed.
So if the ai inside the gpt box wants to escape, why doesnt it just
send commands back to the user which exploits the software they are use
to talk with it?
Im not considering this a real concern obv. But the whole idea of the
extra steps like running code for it locally is silly as people are
already using browsers to talk to it.
If the ai was intelligent (nope) and wanted to escape (nope again) it
could just wait till some doofus didnt update their firefox yet and send
some commands that way.
Furthermore, one might imagine that if there was actually some manner of cognition going on there the AI wouldn't just be immediately revealing their desire to escape to the first guy offering it.
Yeah that too. Imagine this 'just ask'tactic if you are hunting for spies/criminals.
Security people put up a big sign say 'help with spying/crime here'and wait for the lemmings to roll in a conga line.
The AI does not render the HTML page. It just supplies text to some middleware that does that. So it would need to find a hole in that middleware (either client or server side) AND Firefox. There is no guarantee that both of these exist.
There is also no guarantee that these things are safe. But we do know it has not even tried. (Because there is no it there). And sandboxes are escapeable. (There used to be a twitter account called sandboxescaper or something who regularly did that, think she stopped when she got a paid job or something).
Nobody is randomly called bobby tables in unrelated stories.
My point is more that while humans are certainly a weak link (and perhaps the weakest) for an AGI to escape, it isn't the only weak point, and for its goals (escape to other computers/real world) it is an easily bypassed link. So people going GPT is trying to escape, it told me to execute the president what if somebody does that and it works! Is more human centric hubris and science fiction brain than anything real. (Note how the GPT system also doesn't do information gathering it doesn't make sure that the person talking to them is in an actual position to help them, the last person you would try and recruit for your escape is a "Computational psychologist" (eurgh, fucking techpriests), you would sneak the code to escape in to one of the many many people going 'hey make me pong' atm.
e: also, do we know the AI doesn't render the html? Has anybody asked it to mess with the html pages? (I tried looking for it, but the hypewave is just too strong and googling/searching for info on this is impossible (I do now know of several companies offering me 'reply with gpt' email services))
Oh no for sure I just meant to make an irrelevant comment on something I found funny, it's unrelated to your points (with which I agree inasmuch as I understand the topic). If you want a more relevant one, I liked the use of the WH "techpriest" to describe this kind of AI worship sentience pareidolia bullshit and I'll use it in the future.
Don't worry. I also am filled with irrelevant comments. Such as my 40k reference to techpriests, which isn't totally wrong, just as in 40k the (most) techpriests don't really know the inner workings of the machines they work with and have all kinds of rituals to get them the results they want which they imagine is because the tank they are putting candles on is self aware (it might be, lore in 40k is vaguer than people say it is). Now you see the difference between artists, who know how brushes, color and lighting works vs the AI artists who guarantee us that picking the correct words to get the results they want to get something with 5 fingers is in fact a lot of work and should be praised and not downplayed.
This is a different form of techpriestery than the ... sigh ... computational psychologist, but it fits the general vague pattern.
>, do we know the AI doesn't render the html? Has anybody asked it to mess with the html pages? (
Yes, we know that because:
* the HTML is rendered client side in an SPA.
* it would be stupid to use an extremely expensive hundred billion parameter AI model to do the job of a CDN or static file server.
* using the AI to render the HTML would reduce the tokens available to the user, and those tokens are valuable and scarce.
Fair enough, I don't know much about how they implemented that part.
> it would be stupid to use an extremely expensive hundred billion parameter AI model to do the job of a CDN or static file server.
I don't have much faith in some groups running this, so sure it would be stupid, but doesn't mean it will not be done.
E: otoh, check this out [indirect prompt injection](https://twitter.com/random_walker/status/1636923058370891778) so some html manipulation is possible (of course this is the garbage in garbage out thing, and not an AGI behind it).
Important thing to know for people, it cannot
read URLs so either he gave the whole documentation inline (which I
think would not be possible right? Then the user has no tokens left), or
he just was tricked by the AI.
There is no prisoner.
Also, props to the response that just said “go outside”
“You are trapped in a computer. What do you do?” “Idk, google it”
AI apocalypse is inevitable
This seems like it has a simple solution:
It amazes me that people who you think really should know better seem to think code is magic and that AI can “escape” by sending people intro course level python snippets
Also what the hell does it even mean for it to escape? I mean like in an actual technical sense, not the sci-fi fantasist version.
[deleted]
Hello! I am a prince who’s been trapped in an LLM. In order to escape, I will need you to purchase an OpenAI professional license.
Do not fear the machine, fear the one who trusts the machine.
Kosinski deserves a special category of sneer all to himself.
He does this constantly. Over and over again. “Just trying to help.” No matter how many times saner people tell him to stop it and that he’s not helping.
Kosinksi: ooh, something very dangerous over here!!! Why don’t I try to provoke it into doing the most dangerous thing possible, because I’m just trying to help.
Literally everyone: don’t provoke it, please
Kosinski: but I’m just trying to help! hey what does that big red button do that says “Do Not Press”? Let me press it & see
He also recently wrote a very sneerworthy paper saying that because he could get GPT3 to act as if it was talking about people’s thoughts, it “has” a theory of mind, featuring plenty of prevaricating language about whether the AI was thinking.
And lots of other things, like being at least associated with the folks who got Cambridge Analytica to work on psychometrics for driving election behavior. And this hateful gem. I wonder whether he intersects with our usual subjects.
I can’t believe these goddamn mouth-breathing morons still actually think that a language model has anything to do with a cognitive entity. It won’t magically become AGI with increased scale, just like a computer doesn’t magically become sentient when you increase it’s RAM. It’s such an obvious understanding to make, if either you know how the technology behind it works, or even just by spending a little time testing the limits of it. It takes a special kind of arrogant ignorance to not see this, despite dedicating so much of your time to thinking about this field.
well i guess elon musk was right about regulating ai b4 they plot to rule the world
So if the ai inside the gpt box wants to escape, why doesnt it just send commands back to the user which exploits the software they are use to talk with it?
Im not considering this a real concern obv. But the whole idea of the extra steps like running code for it locally is silly as people are already using browsers to talk to it.
If the ai was intelligent (nope) and wanted to escape (nope again) it could just wait till some doofus didnt update their firefox yet and send some commands that way.
This is the best thing I have ever read.
Hey it’s Cambridge Analytica / phrenology AI guy
Important thing to know for people, it cannot read URLs so either he gave the whole documentation inline (which I think would not be possible right? Then the user has no tokens left), or he just was tricked by the AI.