Apple wants AI to run directly on its hardware instead of in the cloud::iPhone maker wants to catch up to its rivals when it comes to AI.

you are viewing a single comment's thread
view the rest of the comments
[–] 12 points 2 years ago (1 child)

I've been playing with llama.cpp a bit for the last week and it's surprisingly workable on a recent laptop just using the CPU. It's not really hard to imagine Apple and others adding (more) AI accelerators on mobile.

  • source
  • parent
  • hideshow 1 child comment