I do not like those sticks of RAM. I do not like them, Sam I am.
I hate living in the variant of the universe where Sam Altman came out from his mother as a baby instead of a piece of shit like he was supposed to
“Rent-seeking psychopath desires all the rent”
Literally the mentality of the English land-owning gentry enclosing the ancient commons and driving people off the land into dependency on them. It was bullshit then, and it’s bullshit now.
It’s straight up kleptoparasite mentality.
It’s been the central mentality of the owning class since the ability to individually own the means of production was conceived.
They won’t care about rent-seeking without their brains. There’s a simple solution to these problems, we just have to do it. It’s easy and fun, so I hear. I’m willing to be the first, I’ll accept those dirty hands
It is the cyberfeudal lord’s wet dream. Can we skip the dark ages and go straight to the French Revolution?
Uhh that’s exactly what they want. The French revolution was just more rich assholes taking control. In this case it was the merchant class. The Techbro class definitely wants to take control. Also, the majority of people beheaded in the French revolution were commoners.
Digital Maoism Intensifies
Funny how »global allocation efficiency« always ends with everyone renting access from the company whose CEO wants to do the allocating. Local AI offers privacy, independence, and no monthly tollbooth. Apparently the real waste of RAM is letting people control what they own.
Local AI offers privacy, independence, and no monthly tollbooth.
Sam Altman, reading your comment, hissing in agony three times like someone poured holy water on him…
Perhaps we should apply the same theory to petrol and cars. Everyone should take the bus - having a lump of metal rusting outside your front door is a waste.
I wonder how far that logic would work with US republicans?
Altman argued that ongoing memory supply chain woes were because selfish individuals wanted to run their AI models locally instead of leaving the remaining AI chips alone for hyperscalers to hoard in data centers.
Selfish? We’re selfish?
Goooo fuck yourself. You’re the problem you fucking cunt, and you know that.
“Don’t get tap water at home. Drink the water I sell”
Fuck this guy
Pipes are inefficient. If you want water, you should buy it from my big lake. Also, I should be able to set the price of water. Also, fuck these three people in particular, for using water in a way I don’t like.
Cory Doctorow predicted this fifteen years ago, although in a different context (transcript here).
Soo-soo sook!
I mean the analogy he’s making is more like “nobody should pump their own water, all water should be gotten from the municipal circuit”, but it’s obviously a faulty comparison that falls apart when you realise that 1. OpenAI is for profit and 2. different AI is not equivalent the way water is
Uuuummm… Tap water is literally pooled resources.
I hate the idea of Sam Altman and I’d like to RAM a data center up his ass
He’d enjoy it.
I would rather Sam Altman gets hit with a car, but here we are.
You can take my ram from my cold dead hands.
I hate the idea of Sam Altman not being in prison
Why should we continue allowing him to drain us like the parasite he is? He’s okay with ending our species if he’s able to generate the most capital and control of any organization in history, why is it so unacceptable that we simply end him instead?
Rich people are safe and comfortable in prison, and their influence slips through the bars
I prefer putting him in a certain prison…
The prison that he had been in before he was born
Beware this guy.
He wants to rule the world for serious.
He’s probably moving more money than anybody else. He’s absolutely burning more money than anybody else.
If nobody stops him, then it’s going to be bad times that we cannot imagine yet.
We’re gonna end up living in Altmanverse. 🤭
Ready Player Garbage.
Literally the point of AI is to get everyone to store everything in the cloud so they can do to all your data what Facebook did to your social profile (and worse)
And CHARGE YOU FOR IT. Sell it to insurers, surge pricing at stores, and anyone else that will raise your prices because of “behaviors” they deem chargeable. That’s what they want.
I mean, he has a point. Hardware is used way more efficiently in the data center, and any sort of deficit is best resolved in a centralized system due to more efficient resource allocation. The same setup could be used like 2 hours a day for your personal needs, or 24 hours a day to serve many people.
THAT SAID, their greed and unsatiable desire to make the number go up by hooking us into subscription economy with ever rising costs is what led us here and it leaves us with little choice but to accept the less efficient way and host these things ourselves.
Remember the times not so long ago when self-hosting was an enthusiast hobby instead of necessity? Barely anyone non-geeky bothered with it, because what existed served people well. Now, having to build our own services remains the only sane choice, and the only way out of the nightmare Sam, among others, has built with his own hands.
Hardware is used way more efficiently in the data center, and any sort of deficit is best resolved in a centralized system due to more efficient resource allocation. The same setup could be used like 2 hours a day for your personal needs, or 24 hours a day to serve many people.
Only for a rather narrow definition of efficiency, though. For raw compute power, yes, but you’d also be adding a whole bunch of overhead from all the network traffic and routing that would be necessary for that sort of thing to work in the first place.
If people used their desktops like in the old days where you’d connect to a mainframe or master computer, you’d end up needing computing hardware on both ends anyway, since the user side would need to be enough to be able to connect and send all the interactions to the master computer. At that point, you could just buff up the client computer, and do all that in the user’s home.
There’s also an argument that some of the basic problems would still apply anyway. A data centre does not fully utilise 100% of its capacity. There’d always be some reserve to have failover if a server dies, or there’s a sudden spike in load, like with a home machine.
It doesn’t fulfill the same user case. One can be used offline, the other cannot. One can be used without a subscription, the other cannot. One needs to be running constantly to meet targets, the other can be run whenever I want. One has that memory being used by very specific services, the other has that memory being used for whatever I want to use it for. Why should we care about an efficiency factor that really only benefits Sam Altman and ignores all other metrics?
If you think he has a point, I think you are being dazzled by the inherent proposition of an implementation in the ideal egalitarian society, which we do not live in nor is he really interested in providing.
In theory it can be more efficient but the consumer market never was going to contribute to the scarcity, and the bigger problem is the “must build AI datacenters” by all comers whether or not they actually have a plan to bring up and utilize.
Altman kicked off a corporate hoarding storm by committing half of the world’s DRAM manufacturing supply, then every other corporate had to get in on it.
The result according to a report I read is that over half of the technology delivered to these folks are sitting disused. Because they couldn’t get the right power to the datacenter, or maybe they did get all that lined up but don’t have the business relationship with whomever actually would use the capacity, or they otherwise botched things so their setup is not viable.
The far bigger culprit is the bad datacenter buildout. Vilifying the consumer market is just a better narrative for his agenda.
No
Care to elaborate?
Ah, yes, sorry. No, he does not have a point. A data center is not more “effective” nor in fact economical or sensible. Even logically, rationally, ethically, scientifically… like, I refute his point, in its entirety. Mostly because i’m not a hypercapitalist but also because compute pooling seriously is not a good idea to begin with. It’s fragile. It’s insecure. Dangerous in so many ways. If people do not fight against cloud control, they will eat up our final rights and consume entire humans. I don’t like megacorp entities and the way they listen with hidden microphones and fingerprint us, just for perverse sharing as a literal commodity, with no shame because a demonic autonomous system cannot feel. It can only grow. I just meant no to that.
Thanks for sharing.
In that sense, I like the idea brought by one of the commenters to make BOINC-like decentralized computing network that would utilize idle hardware on people’s computers. This can be tailored for LLMs, too.
This way, everyone could access the technology without having to pay billionaires and without all that datacenter buildout, and the people-owned hardware would be put to good use.
It’s important to own means to compute. Queuing and blasting gpus and cpus att 100% is a trick notion, in reality it will be used for less important jobs due to the economy of priority, and the hardware is worn down. The proposed network can be used for things like fold @ home type efforts, or communal efforts. But nobody wants a device screaming in their home, and if you gain points or crypto or similar it probably attracts an investments crowd. I just don’t believe in the idea at all. It’s been possible to make for a long time, and is clearly only attractive to this fool because he is a pseudo intellectual advertisers for hyperscalers that think owning compute means owning the world. They’re not only morally corrupt, they are incorrect and idiots that will lose their attempt and be punished by their respective megacorp demonic entities and replaced with new pseudo intellectual advertising personalities
I think you mean effectively not efficiently, the resources use is the same if I local host or use a provider.
I might argue with centralized systems being the only ones that allocate resources most efficiently. You can have nearly same efficiency with decentralized models, except they are more complicated to implement, but the diversification is often worth it.
In another timeline where RAM and GPUs were still largely consumer accessible, I wouldn’t doubt there would already be a SETI-like decentralized alternative for LLMs.
I don’t know about that, mostly because the structure of LLMs at the moment make them incredibly bandwidth-hungry, and also quite sensitive to latency.
You do have some small-scale versions of that, where people link a few smaller computers together to run a larger model, but that usually exists in the form of things like connecting machines via USB4/Thunderbolt, or Oculink, which are much faster and lower latency than a typical internet connection.
There is something a bit like that, with the Kobold AI Horde, but that is still people hosting an entire model and sharing that over the internet, rather than something like Folding/SETI@Home, where you’re doing part of the actual calculations yourself.
I was actually thinking more like participants who can offer computational power during periods of no use, accrue reputation the more they contribute, and can use that reputation to offload computation to the cloud. If your PC was not powerful enough to run local LLMs, it would need to contribute a lot more, or perhaps it would just be limited to clouds of people running powerful enough GPUs for the local LLMs being used so they could get an added benefit to leaving it running at night.
An LLM model running over across multiple PCs across the Internet would not really be workable, no, but their product is.
The capacity requirement decreases immensely when the setup process isn’t just tap a thing on the app store and then talk to it.
Hard disagree. It makes sense for certain use cases and not for others, like when you are near to a large pool of data to process, or running latency sensitive processes, or want security around the data being used. None of those use cases are going away.
deleted by creator
ye if he wasnt the ceo of useless tech that hurt ppl id agree
The one swallowing up all the RAM and creating the shortage: “There’s a RAM shortage, so none of you should have any because I need it all!”
So we’d own a basic terminal, and pay a subscription for our computing needs.
Gosh, who’d’a thunkit? Never saw that one coming.
Especially not when he said how he envisions ai to someday be a utility like water or electricity, that everyone will pay for
Shocked, I tell you. I’m utterly shocked
So we’d own a basic terminal, and pay a subscription for our computing needs.
No.
We would rent a proprietary terminal that also needs a paid subscription to a computing service.
But yes, it would be pretty basic.
“In this supply-constrained environment, efficiency of centralized control only makes sense!”
“For whom? Also, why is the supply constrained in the first place?”
“Well, we used hype from central bank-level investors to lend us enough to buy up all the supply. We have sooo much debt that we need every penny of efficiency we can get.”
“In this supply-constrained environment, efficiency of centralized control only makes sense!”
“For whom?
Makes (financial) sense for the central controller’s business model to succeed.
But do you think it’s a WISE idea?
You mean a Wyze idea? 😉
Actually we both got it wrong. Its Wyse
That we did! 😂
