… is the ram used in data centers even compatible with desktop PC. I hear a lot “cheap ram when bubble bursts”
You must log in or # to comment.
If/when the bubble bursts we’ll have bigger problems than the price of RAM.
*when
The resources they’re exhausting aren’t the physical components, it’s the production capacity.
The shit being fed into this ‘AI’ grift will have very limited reuse potential when their universe implodes.
What we’re seeing is a confluence of unconstrained parasitic consumption, and artificially constrained cartel production.
The parallels I see are with OPEC in 1973. JEDEC have found themselves in a position of power at the choke point of a Crucial industry, and are leveraging it to maximise profit and influence.
Unions of individuals are good for society, cartels of corporations are carcinogenic.
No, in addition to the reasons brought up by the other commenters, I’m starting to think that “computers as a service” will start to be a thing.
Google’s Stadia by all accounts wasn’t horrible, but it was pricey and the selection was subpar.
But what if Amazon, Azure, and Google start up some post-AI burst equivalent that provides a use case for all that processing power? Sure, the GPUs used by commercial AI aren’t designed for gaming, but Nvidia could see the writing on the wall and start partnering with hyper scalers to create massive racks of gaming GPUs. And it would be one step closer to the ultimate goal of removing personal ownership of things! Pay a subscription for a cloud gaming PC or try your luck on building your own.
The RAM that has been sold will not be viable for desktop systems, but especially with manufacturing capacity build up, you’d have memory vendors a bit more desperate to find a target market for new product. Datacenter clients will still exist but they could actually subsist on the hypothetical leftovers of a failed buildout, so consumer space may be their best bet.
I’m assuming RAM factories are investing in new production lines to meet the increased demand. This means there should be ample capacity to spare when demand decreases. That’s the ideal time to purchase those 500 GB of RAM for all your Chrome tabs.
The plan is that when interest rates rise again, investors won’t have access to cheap loans and AI companies won’t be able to build more data centres. This should lead to a demand collapse and manufacturers being left with surplus capacity. I doubt they can reduce production quickly enough, so they’ll likely push cheap products onto the market for a while.
Haven’t seen this mentioned yet: the RAM they are making for these AI chips are built to burn up after 6 years. The RAM is built into the processing units to reduce latency but the whole unit is designed with short planned obsolescence so burning out after 5-6 years is expected. The assumption is that by the time they burn up they you will replace them with a more energy efficient unit.
How do you know it’s going to burn out in 6 years?
It’s an accounting thing. They can deduct the value of the hardware over its expected usable lifespan. So they have to replace it after 4-6 years even if it’s still working fine. Sometimes they sell it used, and you can buy it pretty cheap, but dollar for dollar, consumer grade stuff that’s current will usually consume less power and game better than a 6 year old server. Now if you need a home NAS or VM host…
Trump also changed the depreciation law as part of the BBB, so I think companies pay less tax by buying this year. https://www.bdo.com/insights/tax/one-big-beautiful-bill-act-expands-100-depreciation-expensing-opportunities
It could be different but that is what the companies are stating as their operational life span when they report their financials. They used to say they would only last 4 years…
No. Its ecc ram and most PC motherboards aren’t compatible with it. If it crashes we might have cheap GPUs and cheap cloud gaming.
Those of us running home labs will have a field day upgrading our own servers.
Unfortunately not even then. Nowadays the GPUs are a pretty alien form factor, usually not pcie cards. SXM and now HGX.
Datacenter gear has resembled consumer systems less and less after a period of getting closer in the 90s and 2000s.
Not only ecc, but registered. Most AMD systems would be compatible with ecc u-dimm, but not with the r-dimm found in servers
Why would companies lower their prices after consumers have been forced to get used to them?
In order to maximize revenue. Selling 1,000 units at $50 profit apiece makes you more money than selling 400 units at $100 profit each.
But if you fire half your staff while only making 400 units…
Now you’re thinking like a capitalist!
Sure, but what if you guranteed your customers through loosely organized collusion and endless consolidation/buyouts that there is no other practical place to buy ram?
That works during a bubble. What happens though after the bubble when demand presumably plummets?
It is not compatible with desktop PC. It is a different manufactured kind of ram. The increase price is from companies flooding in high amounts of large orders. So consumer ram for PCs is getting backlogged so to say. Or just slowed down
Specifically, desktop RAM is slabs of silicon, placed into little packages, soldered onto circuit boards in DIMM form or similar, to be plugged into a motherboard slot for RAM.
The AI demand is for the silicon itself, using advanced packaging techniques to put them on the same package as the complex GPUs with very high bandwidth. So these same pieces of silicon are not even being put into DIMMs, so that if they fall out of use they’ll be pretty much intertwined with chips in form factors that a consumer can’t easily make use of.
There’s not really an easy way to bring that memory back into the consumer market, even after the AI bubble bursts.
The only reason why memory might get repurposed is because the demand for AI has collapsed. The bubble that’s most likely to burst is a financial bubble, and is unlikely to reduce the demand for AI from users… So I wouldn’t count on it.
If it bursts we’ll get a lot of data centers looking for something to do. And RAM prices will come down but … What’s causing the bottle neck right now is that your average RAM factory needs a couple of years from designed to built to working. So the supply is limited right now while the demand is high. While us end users can’t use the data center gear, in a pinch they could use ours. So the bottle neck gets tighter. So if the bubble collapses, supply will increase and that will bring prices down. If it bursts about two years from now, all the hastily built RAM factories will churn out cheap RAM. But none of this is guaranteed, not the busting and not the dead cheap prices. Because the demand for RAM will not drop off a cliff, it will most likely decrease slowly. All this processing power in post-burst idle data centers will find a way to be used - with what I do not know. There will still be a higher demand for RAM compared to pre-ChatGPT times. So RAM will not flood the market, we will just return to a relative equilibrium of the market.
