The entity being manipulated is not human so I would not classify it as social engineering, even if similar techniques are used (help me my grandmother needs info).
So, I’m currently developing a chatbot for my company. If an LLM needs to do something, a developer must build a tool. It just so happens that this tool that was built did not take traditional security into account. Really it should only be using the tools already built for users, but it seems the Jr. Devs that have been replacing seniors do not have the sensibilities yet.
I linked to the Wikipedia article, not the handbook inself. And more for the (obsolete) phreaking content than the (highly dangerous) explosive content.
This isn’t even a hack, it’s just poorly written endpoints.
Would you consider phreaking equivalent to hacking? This is AI phreaking.
It’s not phreaking. Social engineering.
The entity being manipulated is not human so I would not classify it as social engineering, even if similar techniques are used (help me my grandmother needs info).
So, I’m currently developing a chatbot for my company. If an LLM needs to do something, a developer must build a tool. It just so happens that this tool that was built did not take traditional security into account. Really it should only be using the tools already built for users, but it seems the Jr. Devs that have been replacing seniors do not have the sensibilities yet.
Kinda.
If you designed a publicly addressable system since 1985 and didn’t design it for security then you’re asking for it.
TIL about phreaking
Then this is also probably new to you
The Anarchist Cookbook
I need to set aside some time to read that although I’m not an anarchist myself.
I linked to the Wikipedia article, not the handbook inself. And more for the (obsolete) phreaking content than the (highly dangerous) explosive content.