199
submitted 1 day ago* (last edited 1 day ago) by inari@piefed.zip to c/technology@lemmy.world
you are viewing a single comment's thread
view the rest of the comments
[-] eicker@lemmy.world 9 points 22 hours ago

The upside is that unified memory is genuinely different from traditional RAM. The CPU, GPU and Neural Engine all share the same memory pool, so data doesn’t need to be copied back and forth. That reduces latency, improves efficiency and lets AI models, graphics and other workloads access much larger datasets. It also uses less power and saves board space. The downside is obvious: because it’s integrated into the chip, you have to choose the right amount upfront, since it can’t be upgraded later.

[-] NotMyOldRedditName@lemmy.world 4 points 21 hours ago* (last edited 21 hours ago)

Ya, these high memory amounts and ever increasing memory bandwidth are heavily (but not only) targeting people wanting to run local large AI models like a full deepseek on their machines.

You might not be able to train as well on them as NVIDIA + CUDA, but for local inference, they're an alternative to NVIDIA and more reasonably priced for the model sizes you can run, and each iteration they get better as the bandwidth increases.

this post was submitted on 14 Jul 2026
199 points (93.8% liked)

Technology

86333 readers
3252 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS