This begs the question, why continue to build it? If you believe AI will “kill us all” then why are you continuing to help. This guy quit but he references this being a common belief in the industry/workforce building out AI.
My best guess is the money is good and you figure you’re here for a good time, not a long time.
They see this technology as powerful and their respective organizations or Nation needs to own it no matter the risk.
They are also conditioning the populace for a big black swan AI event such as AI interfering in elections or a huge multi institution hack to our banking system which drains our accounts, etc., etc.
Thereby creating a crisis which only they can solve. The one thing I can guarantee is their solutions will only give them more power.
Yup, AI is going to hack our banking system “accidentally” because it is so “powerful” and all that nonsense they have been feeding us. The reality is that the US is going to be unable to borrow long term debt or even service their existing debt so they need to switch to short term debt that they can control and steal citizen’s interest through stable coin as outlined in the Genius Act.
This is the only real way forward without having to default, so it is likely it will happen before 2028.
They have proven time and time again that they will do anything to screw over the middle class rather than have the rich pay their fair share in taxes. Which is what makes this theory so plausible.
That and they have already passed the legislation and they are currently converting long term debt into short term debt. It is really more of a conspiracy than a conspiracy theory until you get to the part where AI causes a banking panic forcing people to accept stable coin. This is obviously a reach, but one that makes perfect sense.
Roko’s Basilisk: the idea that the emergence of super-AI is inevitable and that it will kill everyone that hindered or didn’t support its development in revenge. If both those premises hold, it makes sense to aid its development for self-preservation.
I don’t think either premise holds, personally, but these people evidently do.
That human beings are logical and that they do anything with intention. For the vast majority of people, this is patently false.
That a super intelligence sees revenge as an efficient use of scarce resources, which given both that revenge is nonsensical without the prerequisite biological need for it, and the conclusion of ‘1’, is nonsensical.
That even if 1 and 2 were real, that there’s some inherent timeframe in which the AI thinks it should have been created.
The only real bodily danger of AI is inherent in the the humans who control it.
That human beings are logical and that they do anything with intention. For the vast majority of people, this is patently false.
Absolutelu. That seems to be a frequent misconception, or perhaps just a convenient simplification, for many even highly intelligent people. Even a perfectly logical actor would be prone to error when working with incomplete information and limited capacity for calculating likely outcomes.
And we’re not perfectly logical, but subject to whims and emotions, instincts and mental shortcuts. If contributing to a mass murder machine feels wrong, I’m not gonna spend all my energy on trying to estimate whether it would be smarter. I just hope it doesn’t happen.
That a super intelligence sees revenge as an efficient use of scarce resources, which given both that revenge is nonsensical without the prerequisite biological need for it, and the conclusion of ‘1’, is nonsensical.
Conversely, if it had some drive to wantonly eliminate humans, I doubt that some moral desire to reward those who created it would impede that.
It could just try to eliminate everyone opposing it, as a matter of self-preservation. That would be a justified expenditure of resources. But what happens if it calculates that its creators might also be a threat?
I assume they’re expecting they can train it to spare them. Why they think a super-AI would reliably stick to that training is beyond me, but we already established that they might not run on pure logic.
I feel reminded of incidents with supposedly tame beasts suddenly proving why a big cat isn’t quite the same as a domestic cat. If you’re gonna build a mechanical leopard, expect to get your face eaten.
That even if 1 and 2 were real, that there’s some inherent timeframe in which the AI thinks it should have been created.
And where would it draw the line? Does the plumber that laid pipes in a datacenter count as helping? Does the baker he bought breakfast from every morning count? Is every clerk not directly involved with this enterprise going to be killed?
This begs the question, why continue to build it? If you believe AI will “kill us all” then why are you continuing to help. This guy quit but he references this being a common belief in the industry/workforce building out AI.
My best guess is the money is good and you figure you’re here for a good time, not a long time.
You know that “yes we destroyed the world, but for a short time we created a lot of shareholder value” cartoon? It’s literally that.
They see this technology as powerful and their respective organizations or Nation needs to own it no matter the risk.
They are also conditioning the populace for a big black swan AI event such as AI interfering in elections or a huge multi institution hack to our banking system which drains our accounts, etc., etc.
Thereby creating a crisis which only they can solve. The one thing I can guarantee is their solutions will only give them more power.
Yup, AI is going to hack our banking system “accidentally” because it is so “powerful” and all that nonsense they have been feeding us. The reality is that the US is going to be unable to borrow long term debt or even service their existing debt so they need to switch to short term debt that they can control and steal citizen’s interest through stable coin as outlined in the Genius Act.
This is the only real way forward without having to default, so it is likely it will happen before 2028.
I was alluding to that conspiracy theory.
They have proven time and time again that they will do anything to screw over the middle class rather than have the rich pay their fair share in taxes. Which is what makes this theory so plausible.
That and they have already passed the legislation and they are currently converting long term debt into short term debt. It is really more of a conspiracy than a conspiracy theory until you get to the part where AI causes a banking panic forcing people to accept stable coin. This is obviously a reach, but one that makes perfect sense.
By the time we’re at that level, we can just stop pretending money is real.
It certainly won’t mean anything to an actual AI.
Roko’s Basilisk: the idea that the emergence of super-AI is inevitable and that it will kill everyone that hindered or didn’t support its development in revenge. If both those premises hold, it makes sense to aid its development for self-preservation.
I don’t think either premise holds, personally, but these people evidently do.
You’re just doing Pascal’s Wager For Computers.
I once saw someone call the Singularity the Rapture but for nerds, and I thought that was spot on.
I mean, yeah, I’m not saying that it’s plausible. But I don’t think we ascribe sound reasoning to those people in the first place.
Roko’s Basilisk is stupid.
It presumes three things.
That human beings are logical and that they do anything with intention. For the vast majority of people, this is patently false.
That a super intelligence sees revenge as an efficient use of scarce resources, which given both that revenge is nonsensical without the prerequisite biological need for it, and the conclusion of ‘1’, is nonsensical.
That even if 1 and 2 were real, that there’s some inherent timeframe in which the AI thinks it should have been created.
The only real bodily danger of AI is inherent in the the humans who control it.
Absolutelu. That seems to be a frequent misconception, or perhaps just a convenient simplification, for many even highly intelligent people. Even a perfectly logical actor would be prone to error when working with incomplete information and limited capacity for calculating likely outcomes.
And we’re not perfectly logical, but subject to whims and emotions, instincts and mental shortcuts. If contributing to a mass murder machine feels wrong, I’m not gonna spend all my energy on trying to estimate whether it would be smarter. I just hope it doesn’t happen.
Conversely, if it had some drive to wantonly eliminate humans, I doubt that some moral desire to reward those who created it would impede that.
It could just try to eliminate everyone opposing it, as a matter of self-preservation. That would be a justified expenditure of resources. But what happens if it calculates that its creators might also be a threat?
I assume they’re expecting they can train it to spare them. Why they think a super-AI would reliably stick to that training is beyond me, but we already established that they might not run on pure logic.
I feel reminded of incidents with supposedly tame beasts suddenly proving why a big cat isn’t quite the same as a domestic cat. If you’re gonna build a mechanical leopard, expect to get your face eaten.
And where would it draw the line? Does the plumber that laid pipes in a datacenter count as helping? Does the baker he bought breakfast from every morning count? Is every clerk not directly involved with this enterprise going to be killed?
It just doesn’t add up.