This is a most excellent place for technology news and articles.
To anyone complaining about non-replaceable RAM: This machine is for AI, that is why.
Think of it like a GPU wirh a CPU on the side, vs the other way around.
Inference requires very fast ram transfer speed, and that is only possible (currently) on soldered buses. Even this is pretty slow at 256Gb/s, but it's RAM size of 96GB to GPU makes it interesting for larger models.
I'm excited for how these GPU-centric machines will also be used for non-AI stuff, because it means fully embracing parallelism. I want video encoders limited by disk speed.
I don't get the point. Framework laptops are interesting because they are modular but for desktop PCs that's the default. And Framework's PCs are less modular than a standard PC because the RAM is soldered
Soldered on ram and GPU. Strange for Framework.
Apparently AMD couldn’t make the signal integrity work out with socketed RAM. (source: LTT video with Framework CEO)
IMHO: Up until now, using soldered RAM was lazy and cheap bullshit. But I do think we are at the limit of what’s reasonable to do over socketed RAM. In high performance datacenter applications, socketed RAM is on it’s way out (see: MI300A, Grace-{Hopper,Blackwell},Xeon Max), with onboard memory gaining ground. I think we’ll see the same trend on consumer stuff as well. Requirements on memory bandwidth and latency are going up with recent trends like powerful integrated graphics and AI-slop, and socketed RAM simply won’t work.
It’s sad, but in a few generations I think only the lower end consumer CPUs will be possible to use with socketed RAM. I’m betting the high performance consumer CPUs will require not only soldered, but on-board RAM.
Finally, some Grace Hopper to make everyone happy: https://youtube.com/watch?v=gYqF6-h9Cvg
There's even the next iteration already happening: Cerebras is maling wafer-scale chipa with integrated SRAM. If you want to have the highest memory-bandwith to your cpu core it has to lay exactly next to it ON the chip.
Ultimately RAM and processor will probably be indistinguishable with the human eye.
Sound like a downgrade to me I rather have capability of adding more ram than having a soldered limited one doesn't matter if it's high performance. Especially for consumer stuff.
Looking at my actual PCs built in the last 25 years or so, I tend to buy a lot of good spec ram up front and never touch it again. My desktop from 2011 has 16GB and the one from 2018 has 32GB. With both now running Linux, it still feels like plenty.
When I go to build my next system, if I could get a motherboard with 64 or 128GB soldered to it, AND it was like double the speed, I might go for that choice.
We just need to keep competition alive in that space to avoid the dumb price gouging you get with phones and Macs and stuff.
Calling it a gaming PC feels misleading. It's definitely geared more towards enterprise/AI workloads. If you want upgradeable just buy a regular framework. This desktop is interesting but niche and doesn't seem like it's for gamers.
I think it’s like Apple-Niche
Question about how shared VRAM works
So I need to specify in the BIOS the split, and then it's dedicated at runtime, or can I allocate VRAM dynamically as needed by workload?
On macos you don't really have to think about this, so wondering how this compares.
"To enable the massive 256GB/s memory bandwidth that Ryzen AI Max delivers, the LPDDR5x is soldered," writes Framework CEO Nirav Patel in a post about today's announcements. "We spent months working with AMD to explore ways around this but ultimately determined that it wasn’t technically feasible to land modular memory at high throughput with the 256-bit memory bus. Because the memory is non-upgradeable, we’re being deliberate in making memory pricing more reasonable than you might find with other brands."
😒🍎
Edit: to be clear, I was only trying to point out that "we’re being deliberate in making memory pricing more reasonable than you might find with other brands" is clearly targeting the Mac Mini, because Apple likes to price-gouge on RAM upgrades. ("Unamused face looking at Apple," get it? Maybe I emoji'd wrong.) My comment is not meant to be an opinion about the soldered RAM.
Framework releasing a Mac Mini was certainly not on my bingo card for this year.
