you are viewing a single comment's thread
view the rest of the comments
[–] 32 points 2 months ago (16 children)

1.5 TB of unified memory sounds less like a computer and more like Apple preparing for the moment your local AI starts asking for a raise. Plot twist: by 2028 the RAM upgrade still costs more than the rest of the machine combined.

  • source
  • hideshow 16 child comments
  • [–] 13 points 2 months ago (5 children)

    Remember this is “unified”, it’s not like you can upgrade, nor is it available in the “cheap” packaging we’re used to.

    You’ll get whatever Apple puts on the SoC, and you’ll be happy with it

  • source
  • parent
  • hideshow 5 child comments
  • [–] 12 points 2 months ago (1 child)

    The upside is that unified memory is genuinely different from traditional RAM. The CPU, GPU and Neural Engine all share the same memory pool, so data doesn’t need to be copied back and forth. That reduces latency, improves efficiency and lets AI models, graphics and other workloads access much larger datasets. It also uses less power and saves board space. The downside is obvious: because it’s integrated into the chip, you have to choose the right amount upfront, since it can’t be upgraded later.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 4 points 2 months ago*

    Ya, these high memory amounts and ever increasing memory bandwidth are heavily (but not only) targeting people wanting to run local large AI models like a full deepseek on their machines.

    You might not be able to train as well on them as NVIDIA + CUDA, but for local inference, they're an alternative to NVIDIA and more reasonably priced for the model sizes you can run, and each iteration they get better as the bandwidth increases.

  • source
  • parent
  • [–] 7 points 2 months ago (2 children)

    Apples memory has never been cheap, it's always been a very expensive upgrade.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 2 months ago (2 children)

    Plot twist: by 2028 the RAM upgrade still costs more than the rest of the machine combined.

    Won't at least China have production capacities ready by then that make the price drop?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 2 months ago (6 children)

    Doesn't big companies try open models. Microsoft was testing deepseek.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 3 points 2 months ago (5 children)

    Everyone is. Open weight and source is the way to go in my opinion.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 1 point 2 months ago (4 children)

    But I bet next they will close it after gaining bigger foothold. I wonder how would you prevent this.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 2 months ago (3 children)

    I don’t think open-weight models can be prevented, as ‘everyone’ knows how distillation works these days and, clearly, no one can do anything to stop it.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 2 months ago (2 children)

    No turn deepseek and others to proprietary models

  • source
  • parent
  • hideshow 2 child comments