this post was submitted on 25 Feb 2025
633 points (98.5% liked)

Technology

63375 readers
5731 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
633
Framework’s first desktop is a strange—but unique—mini ITX gaming PC (arstechnica.com)
submitted 2 days ago by [email protected] to c/[email protected]
272 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 5 hours ago (1 children)

To anyone complaining about non-replaceable RAM: This machine is for AI, that is why.

Think of it like a GPU wirh a CPU on the side, vs the other way around.

Inference requires very fast ram transfer speed, and that is only possible (currently) on soldered buses. Even this is pretty slow at 256Gb/s, but it's RAM size of 96GB to GPU makes it interesting for larger models.

[–] mindbleach 1 points 1 hour ago

I'm excited for how these GPU-centric machines will also be used for non-AI stuff, because it means fully embracing parallelism. I want video encoders limited by disk speed.