One good thing about the AI boom is that it’s flooding capital into ram development and ram production. Once the bubble pops all these ram companies will have a glut of cheap high performance memory to sell to anyone who can buy it in cash. The question is if the bubble popping triggers a full blown recession will anyone have any cash to buy.
I was watching a video on this and they mentioned the possibility of 128 and 256 gb consumers grade sticks and i almost laughed out loud at the absurdity of being able to afford them.
I can’t wait to buy my grandkid a 256GB stick for his 18th birthday, at which point he will thank me and his dad will have to sit him down and explain that i am old and don’t know that’s not even enough to play the upcoming GTA VII, reminding him i probably had to cash in a large chunk of my retirement fund just for that.
This makes it official, I’m skipping DDR5. I have ryzen 5700 and 32 GiB of DDR4, it’ll hold me over for a few more years. When I finally upgrade, it’s going to be at least 128 GiB.
I’m probably skipping DDR5 as well at this rate. My Ryzen 2700 could use an upgrade, but I think I can survive with it until memory prices regain a little sanity. And I expect DDR6 will hit before that happens.
Or if you’re 100 Rabbits and you live on a boat powered by solar so you’re actively limited by available electricity so you write tools based on your home-made tiny VM.
i would not use ai for anything. too many errors and falsehoods come from them. and theyre now out there hacking other systems because nobody reins them in
It’s KINDA being done in the ways we run MoE models. Strata makes more efficient use of limited VRAM if you have a decent amount of RAM, but you don’t even need to keep the entire model in RAM with it, it can keep the least frequently used experts on disk instead (said disk being an NVMe SSD hopefully, otherwise if you hit those experts, good luck)
I hope that one day I can afford a ticket to an exhibition where we all gather around a security-glass display case with a stick of one of those in it and bask in its presence.
DDR6 has no official launch date. Many believe 2029 is a realistic target for commercialization. However, in the current state of things, it would be a miracle if DDR6 had no setbacks.
It will, it’s coming next summer/fall unless it comes earlier. If the AI industry continues on in its current state until 2029 without popping, then it won’t pop. It means they stabilized their debt and financing.
I firmly believe it will based on the financials. I am just saying if it’s 2029 and it “hasn’t happened yet” then it won’t happen. It’s coming within the next year, I would bet money on it. Not my life savings, but a chunk. In fact I have bet some money on it.
GDDR versioning doesn’t necessarily line up like that. For instance, GDDR7 is technologically akin to LPDDR5X, just with a different set of configuration tradeoffs.
Since limited waver space (because HBM takes so much of it at the same capacity) is one of the main driving factors for the Ram-apocalyse, this might actually help. And the performance looks actually great (the comparison to the DDR4 i am running shows some parameters being 10x better, this is actually a meaningful upgrade), meaning that some applications that currently use HBM might be able to just use DDR6 instead, causing a greater allocation of wavers towards that.
Maybe the AI bubble will burst before they can buy up the next decade’s worth of production capacity of DDR6 to manufacture scarcity and it will end up being cheaper than DDR5?
Cool the world is going back to ddr4 and ddr3. Who cares at this point? If it’s not going to be affordable and we already have all these pre existing computers that are working just fine anyway.
Nobody is going back to ddr3 except maybe the 3rd world and a few home servers. DDR4 maybe, but I imagine most people aren’t buying new machines just for cheaper RAM, can you really say “going back to DDR4” if you were never on DDR5?
DDR6 will get you much better performance for models that don’t fit entirely in your VRAM so it’s going to be very helpful for people running local models.
And when the memory market normalises, which could be pretty soon if nvidia stops ordering a ton of HBM it doesn’t even need, we should get back to the price per GB going down over time. CXMT is now apparently getting 90% yield on DDR5 which is excellent and the big 3 should be getting their first new foundries up next year since they started building them in around 2022 when the LLM boom started and they take about 4-5 years to finish.
So any time you see a headline saying the memory crisis is only getting worse, it’s because the members of the memory cartel REALLY want you to buy right now. Because they can’t keep up the grift for much longer.
DDR6 will get you much better performance for models that don’t fit entirely in your VRAM so it’s going to be very helpful for people running local models.
For those of us who are not running after AI shit, DDR4 is fine.
I mean DDR2 is fine too, it’ll do everything you NEED to do and is available in big enough capacity, DDR would probably not offer enough capacity on a standard 4 slot desktop motherboard.
Anything above that is for your own enjoyment (speeding things up).
Two of my Pc’s run ddr5, and the rest of the Armada are on ddr4. DDR3 still exists in plenty of Appliance devices and reliably running Legacy systems, and I keep a handful of DDR3 sticks around just in case I get to revive something older.
I can say with confidence that I have acquired three DDR4 minipc’s since I acquired my DDR5 PC. I think that is “going back to.”
And our collective point is that DDR3 is still in implementation and relied upon across consumer markets and devices we handle. Trying to be snobbish and gatekeep RAM types is so embaressing a take to make, aloud.
Go ahead and downvote. It’s still embaressing for you.
A Steam Deck is a highly capable little machine. Even if a bit dated, it still has a 4 core 8 thread CPU and 16GB of RAM (which goes a lot further on Linux). When my gaming PC was out of order for a few weeks I hooked it up to my monitor and used it exclusively as my workstation and it handled it great.
I just had my 7 year old DDR4 break and am going through RMA now. so far Corsair has been surprisingly easy to work with and are going to ship me a replacement kit. I have yet to have the new ram in hand, but it’s looking like it’s going to happen.
thank bob for that lifetime warranty too. the kit originally cost 169 and the replacement goes for almost 340 today.
I guess the point of my story is to check your warranty! most reputable ram makers have lifetime warranties.
I’m still on DDR4. Fuck me, first make the RAM affordable, and then I might consider fully upgrading my PC (as it would need a CPU and motherboard upgrade too at that point).
So far I haven’t felt the limit of my 5600x and 32 GB of DDR4.
So many non-gaming workloads these days are capacity driven more than bandwidth driven. Any AI, LLM, image generation, video editing, etc. would be much better off with 32GB of DDR3 than 8GB of DDR4/5.
Same, I built my current rig a few years ago, right before the AI slop hype exploded. Built basically the best DDR4 system possible, 5800X3D, AMD 9070xt.
I typically do a major system upgrade every 3-4 years, but I will be sticking with my current setup for much longer given the circumstances. It’s more than enough for anything I want to play.
Grab a new CPU and Mainboard while they are still somewhat affordable. Get a case and maybe a power supply too because none of that is getting cheaper even when RAM might in a couple years.
Very unlikely. We‘re talking about a span of 3 to 5 years. Your DDR4 RAM works in your DDR5 slot and your Gen 5 SSD sits comfortably in a Gen 4 slot. When GPUs and RAM become more affordable, people will fight over other components. The companies still making those will notice a massive surge in demand after several really bad years. Some manufacturers may have switched to make other parts by then and won’t be able to supply like they used to. So while your RAM may half in price, your power supply or main board could double.
They realized enshittifying and gouging customers was far cheaper than R&D new products. So instead of improving something, just hike the price and cut services.
I mean a TiB of RAM sounds awesome, until you realize what a nightmare that would make setting up the swap partition if you ever use hibernate.
Plus I never even come close to using all of my whopping 64GiB, and even if I did I could still (theoretically) upgrade to 128GiB using the same slots (if I had a million dollars, at least).
Swap for hibernation does not need to be the same size as the RAM. It only needs to be big enough to hold what is currently loaded at that time. So in many cases you can get by with only a couple of GB or less.
What even is the point of using hibernate anymore? Used to be that it started up slightly faster on Windows since it’d skip a lot of the startup bloat, but in the year of our lord 2026, even Windows starts pretty fast on modern hardware, let alone Linux
I don’t know, I haven’t booted a windows system in several years.
I also haven’t used hibernate yet, but normally I put my laptop to sleep and if it’s not plugged in it’ll still die within 24 hours.
Sometimes I have lots of documents and windows open cause I’m mentally fucked in the head and I never close anything, so I’m usually reluctant to shut down because it doesn’t all reopen on startup the way it’s supposed to (I use KDE’s “save session” option, which I love, but a few things like Pluma and LibreOffice don’t work with it perfectly).
Ah, well, I use a desktop PC and get power outages occasionally, so I just need to factor in sudden loss of power. My IDE auto saves every time I stop typing for a few seconds (default functionality actually) and LibreOffice has my shit in recovery if I didn’t save it. But I also hit ctrl + s religiously. Something my friend told me I should be doing when I was playing Skyrim and complained that I lost half an hour progress when the game crashed. “You gotta keep hitting F5 religiously in that game”. I just apply it to everything I do now.
I actually disabled the save session option on Plasma though, it keeps me honest with what I actually need open. Turns out I didn’t need 20 terminal windows, one window with 5 tabs is enough half the time.
Have you considered getting a UPS-enabled backup battery?
And yeah I stopped using multiple tabs on Konsole because it’ll overwrite the Bash history from your other tabs with the last one you close
I just have a lot of lists, but unfortunately Pluma opens a blank session after rebooting. LibreOffice will remember what I had open, but even if it was all saved it’ll ask me if I want to open the recovery files, which just confuses me and makes me paranoid
Most memory makers will still dump all their resources into the newest HBM for datacenters, they can’t afford resources for providing people with RAM, those peasants won’t even use to their fullest!
Comments
One good thing about the AI boom is that it’s flooding capital into ram development and ram production. Once the bubble pops all these ram companies will have a glut of cheap high performance memory to sell to anyone who can buy it in cash. The question is if the bubble popping triggers a full blown recession will anyone have any cash to buy.
There is always people with money to buy
“…and you definitely won’t be able to afford it”
I was watching a video on this and they mentioned the possibility of 128 and 256 gb consumers grade sticks and i almost laughed out loud at the absurdity of being able to afford them.
I can’t wait to buy my grandkid a 256GB stick for his 18th birthday, at which point he will thank me and his dad will have to sit him down and explain that i am old and don’t know that’s not even enough to play the upcoming GTA VII, reminding him i probably had to cash in a large chunk of my retirement fund just for that.
This makes it official, I’m skipping DDR5. I have ryzen 5700 and 32 GiB of DDR4, it’ll hold me over for a few more years. When I finally upgrade, it’s going to be at least 128 GiB.
Right there with you but just rocking the Ryzen 3600X, hasn’t limited me in anything I care to do since 2019.
I’m probably skipping DDR5 as well at this rate. My Ryzen 2700 could use an upgrade, but I think I can survive with it until memory prices regain a little sanity. And I expect DDR6 will hit before that happens.
Only $1,000,000 per gigabyte, think of the performance!
when will they go back to optimizing software to run in the available ram, rather than continuing to increase ram size?
When the devs run out of available RAM.
Or if you’re 100 Rabbits and you live on a boat powered by solar so you’re actively limited by available electricity so you write tools based on your home-made tiny VM.
Who are “they”?
The Stonecutters, obviously. https://youtu.be/fI4bRqjobbw
Who rigs every Oscar night?
who builds software?
Governments, corporations, military, startups, communities, hobbyists…
If you’re able to optimize AI tools to run larger models in less RAM, you’ll have a lucrative future ahead of you.
i would not use ai for anything. too many errors and falsehoods come from them. and theyre now out there hacking other systems because nobody reins them in
It’s KINDA being done in the ways we run MoE models. Strata makes more efficient use of limited VRAM if you have a decent amount of RAM, but you don’t even need to keep the entire model in RAM with it, it can keep the least frequently used experts on disk instead (said disk being an NVMe SSD hopefully, otherwise if you hit those experts, good luck)
I hope that one day I can afford a ticket to an exhibition where we all gather around a security-glass display case with a stick of one of those in it and bask in its presence.
I hear superyachts are pretty nice too.
One can only hope the bubble pops before 2029.
It will, it’s coming next summer/fall unless it comes earlier. If the AI industry continues on in its current state until 2029 without popping, then it won’t pop. It means they stabilized their debt and financing.
The bubble will pop, unless it doesn’t. Noted.
I firmly believe it will based on the financials. I am just saying if it’s 2029 and it “hasn’t happened yet” then it won’t happen. It’s coming within the next year, I would bet money on it. Not my life savings, but a chunk. In fact I have bet some money on it.
One can only hope the bubble pops before 2029.
8GB is only 2,762.89 before taxes. Act now, limited quantities.
I’ll buy 1TB, then have AI build a house for me to live in. It’s fool …proof.
Great how real RAM development starts the moment nobody but a handful of billionaires can afford it.
Ddr6 is nothing new tho. Look at your gpu . It had it for years at this point.
GDDR versioning doesn’t necessarily line up like that. For instance, GDDR7 is technologically akin to LPDDR5X, just with a different set of configuration tradeoffs.
Electron apps will still be slow.
At this point it doesn’t matter anymore if it were DDR99 with 578644.7 GT/s modules as we, consumers, won’t see them again in real life
Since limited waver space (because HBM takes so much of it at the same capacity) is one of the main driving factors for the Ram-apocalyse, this might actually help. And the performance looks actually great (the comparison to the DDR4 i am running shows some parameters being 10x better, this is actually a meaningful upgrade), meaning that some applications that currently use HBM might be able to just use DDR6 instead, causing a greater allocation of wavers towards that.
Wafer
Thanks, will change it in the future! (not gonna ninja edit that lol)
I generally edit my comments like this:
So that is fixed for the next reader but the comment chain still makes sense.
Generative ML inference isn’t so dramatically bandwidth limited anymore, either, so the “demand” for HBM isn’t as clear.
Eh the really big models want a lot of bandwidth still, otherwise you just don’t make use of all the compute power you have.
and yet, you can only sell so many kidneys
Slight correction, you can only sell so many of your own kidneys. But there’s no limit otherwise!
Some 16 billions would be the hard limit, this year.
Don’t forget about pig kidneys. Innovation!
Xenotransplantation for the win! So many kidneys 😁!
oh, I wasn’t talking about mine !
In this economy ?
its the refrigerant cost that really get you.
Global warming and ai are both fucking honest to goodness ol’ kidney harvester’s on that one.
Maybe the AI bubble will burst before they can buy up the next decade’s worth of production capacity of DDR6 to manufacture scarcity and it will end up being cheaper than DDR5?
all hope isn’t lost
probably too late lol
Cool the world is going back to ddr4 and ddr3. Who cares at this point? If it’s not going to be affordable and we already have all these pre existing computers that are working just fine anyway.
Nobody is going back to ddr3 except maybe the 3rd world and a few home servers. DDR4 maybe, but I imagine most people aren’t buying new machines just for cheaper RAM, can you really say “going back to DDR4” if you were never on DDR5?
DDR6 will get you much better performance for models that don’t fit entirely in your VRAM so it’s going to be very helpful for people running local models.
And when the memory market normalises, which could be pretty soon if nvidia stops ordering a ton of HBM it doesn’t even need, we should get back to the price per GB going down over time. CXMT is now apparently getting 90% yield on DDR5 which is excellent and the big 3 should be getting their first new foundries up next year since they started building them in around 2022 when the LLM boom started and they take about 4-5 years to finish.
So any time you see a headline saying the memory crisis is only getting worse, it’s because the members of the memory cartel REALLY want you to buy right now. Because they can’t keep up the grift for much longer.
lol I guess I am third world now.
For those of us who are not running after AI shit, DDR4 is fine.
I mean DDR2 is fine too, it’ll do everything you NEED to do and is available in big enough capacity, DDR would probably not offer enough capacity on a standard 4 slot desktop motherboard.
Anything above that is for your own enjoyment (speeding things up).
Raises hand
Two of my Pc’s run ddr5, and the rest of the Armada are on ddr4. DDR3 still exists in plenty of Appliance devices and reliably running Legacy systems, and I keep a handful of DDR3 sticks around just in case I get to revive something older.
And howich of that have you bought in the last, say, 2 years?
“Going back to” implies switching to.
Sounds like you didn’t start buying DDR3 to replace DDR5, so can you really say you “went back to” DDR3?
I can say with confidence that I have acquired three DDR4 minipc’s since I acquired my DDR5 PC. I think that is “going back to.”
And our collective point is that DDR3 is still in implementation and relied upon across consumer markets and devices we handle. Trying to be snobbish and gatekeep RAM types is so embaressing a take to make, aloud.
Go ahead and downvote. It’s still embaressing for you.
The progress must go on, supply will catch up eventually - hopefully, at least.
How nice for data centers. If my DDR4 PC breaks my backups are a chromebook and retro handhelds.
My back up is my steam deck :(
A Steam Deck is a highly capable little machine. Even if a bit dated, it still has a 4 core 8 thread CPU and 16GB of RAM (which goes a lot further on Linux). When my gaming PC was out of order for a few weeks I hooked it up to my monitor and used it exclusively as my workstation and it handled it great.
Look at this guy with his fancy expensive new steam deck, me over here with my 3DS
You lucky bastard
https://lemmy.dbzer0.com/pictrs/image/ba2d4370-9699-4294-bea0-79e185394267.webp
You have a game and watch? I only have a watch!
Hey that 3ds is a fantastic little device. Respect it!
I… Uh… Have both. ^^;
My primary is my steam deck…
Hugs
Just repurpose that old abacus that’s gathering dust in your attic and let your imagination serve as the GPU
I just had my 7 year old DDR4 break and am going through RMA now. so far Corsair has been surprisingly easy to work with and are going to ship me a replacement kit. I have yet to have the new ram in hand, but it’s looking like it’s going to happen.
thank bob for that lifetime warranty too. the kit originally cost 169 and the replacement goes for almost 340 today.
I guess the point of my story is to check your warranty! most reputable ram makers have lifetime warranties.
I’m still on DDR4. Fuck me, first make the RAM affordable, and then I might consider fully upgrading my PC (as it would need a CPU and motherboard upgrade too at that point).
So far I haven’t felt the limit of my 5600x and 32 GB of DDR4.
So many non-gaming workloads these days are capacity driven more than bandwidth driven. Any AI, LLM, image generation, video editing, etc. would be much better off with 32GB of DDR3 than 8GB of DDR4/5.
32GB of DDR4 is a good sweet spot to be in today.
LLM workloads become faster with higher bandwidth, which directly translates to token per second. So it does matter for daily use.
But you are right that more and slightly slower is still better than less but fast.
32 GB of DDR4 here, would much rather have more and faster tbh. LLMs are slow when running cpu-moe mode or Strata
I wish I bought 64gb when I built my rig.
DDR3 here 🥲
Same, I built my current rig a few years ago, right before the AI slop hype exploded. Built basically the best DDR4 system possible, 5800X3D, AMD 9070xt.
I typically do a major system upgrade every 3-4 years, but I will be sticking with my current setup for much longer given the circumstances. It’s more than enough for anything I want to play.
Grab a new CPU and Mainboard while they are still somewhat affordable. Get a case and maybe a power supply too because none of that is getting cheaper even when RAM might in a couple years.
The hardware you hoard now will depreciate in value though and might be outdated by the time you decide to turn it into a full build.
Very unlikely. We‘re talking about a span of 3 to 5 years. Your DDR4 RAM works in your DDR5 slot and your Gen 5 SSD sits comfortably in a Gen 4 slot. When GPUs and RAM become more affordable, people will fight over other components. The companies still making those will notice a massive surge in demand after several really bad years. Some manufacturers may have switched to make other parts by then and won’t be able to supply like they used to. So while your RAM may half in price, your power supply or main board could double.
Nice try, but i can play dwarf fortress on a potato.
4 times the bandwidth, 16 times the price?
Optimist over here
DDR6?
I’m on a desktop from 2012 because I can’t afford to upgrade.
There’s dozens of us… DOZENS!
$5000/stick or something.
I swear covid made the dumbasses in charge of major corporations realize that bigger numbers exist and that they could be put on price tags.
They realized enshittifying and gouging customers was far cheaper than R&D new products. So instead of improving something, just hike the price and cut services.
1x 64 GB stick for only 10k USD.
I mean a TiB of RAM sounds awesome, until you realize what a nightmare that would make setting up the swap partition if you ever use hibernate.
Plus I never even come close to using all of my whopping 64GiB, and even if I did I could still (theoretically) upgrade to 128GiB using the same slots (if I had a million dollars, at least).
Swap for hibernation does not need to be the same size as the RAM. It only needs to be big enough to hold what is currently loaded at that time. So in many cases you can get by with only a couple of GB or less.
Ha, amateur! I opened 16 new browser tabs while writing this comment!
Oh, I see. Good to know.
What even is the point of using hibernate anymore? Used to be that it started up slightly faster on Windows since it’d skip a lot of the startup bloat, but in the year of our lord 2026, even Windows starts pretty fast on modern hardware, let alone Linux
I don’t know, I haven’t booted a windows system in several years.
I also haven’t used hibernate yet, but normally I put my laptop to sleep and if it’s not plugged in it’ll still die within 24 hours.
Sometimes I have lots of documents and windows open cause I’m mentally fucked in the head and I never close anything, so I’m usually reluctant to shut down because it doesn’t all reopen on startup the way it’s supposed to (I use KDE’s “save session” option, which I love, but a few things like Pluma and LibreOffice don’t work with it perfectly).
Ah, well, I use a desktop PC and get power outages occasionally, so I just need to factor in sudden loss of power. My IDE auto saves every time I stop typing for a few seconds (default functionality actually) and LibreOffice has my shit in recovery if I didn’t save it. But I also hit ctrl + s religiously. Something my friend told me I should be doing when I was playing Skyrim and complained that I lost half an hour progress when the game crashed. “You gotta keep hitting F5 religiously in that game”. I just apply it to everything I do now.
I actually disabled the save session option on Plasma though, it keeps me honest with what I actually need open. Turns out I didn’t need 20 terminal windows, one window with 5 tabs is enough half the time.
Have you considered getting a UPS-enabled backup battery?
And yeah I stopped using multiple tabs on Konsole because it’ll overwrite the Bash history from your other tabs with the last one you close
I just have a lot of lists, but unfortunately Pluma opens a blank session after rebooting. LibreOffice will remember what I had open, but even if it was all saved it’ll ask me if I want to open the recovery files, which just confuses me and makes me paranoid
Like it’s going to even be released the public. Lmao. Most we will get is in laptops and it’ll be $6000.
Who wants a laptop witb 1KB of DDR6 RAM?
Even Bill wouldn’t be willing to settle for less than 640Kb.
Still less space than a nomad. Lame.
(jk the nomad was 6gb)
wtf. I laughed so much at this. Omfg 😂
Most memory makers will still dump all their resources into the newest HBM for datacenters, they can’t afford resources for providing people with RAM, those peasants won’t even use to their fullest!
I’m tired boss.
Who cares? It’s not like you can afford to buy it.
Sign in to comment. Sign in