286
Everything Apple iOS 18 Will Do, Android Already Does (gizmodo.com)
submitted 2 years ago by to c/technology@lemmy.world
232 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[+] -8 points 2 years ago (11 children)

A private local LLM

Running on a phone? No way, not without being absolutely horrible, slow or making your phone churn through your battery anyway.

Good LLMs are olready slow on a GTX 1080, which is already miles faster than any phone out there

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 11 child comments
    •
  • [–] 17 points 2 years ago (4 children)

    I hear you, but also I would be shocked if Apple were to roll this out and it be an absolutely terrible experience. Like their MO is “luxury” products with “premium” experiences, it would not be fitting of the brand to have a piece of crap experience on their flagship announcement.

    I’m willing to give them the benefit of the doubt on this one.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 0 points 2 years ago

    You might wanna check with siri on that. Apple regularly failed at that even under the leadership of Jobs. And Tim Cook is no Steve Jobs. It's already looking like it's going to be just standard remote chat GPT. Hallucinations and all.

  • permalink
  • fedilink
  • source
  • parent
  • [+] -9 points 2 years ago (2 children)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 6 points 2 years ago

    Apple Maps was bad, yes. But they had their hand forced. Google started charging for their API (enough to cripple their app), and they had very little time to create one of their own.

    That’s not happening here. No one is forcing their hand. If they didn’t release an updated Siri this year, nothing would happen.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 13 points 2 years ago (2 children)

    It's not a LLM, it's a much smaller model (~3B) which is closer to what Microsoft labels as a SLM (Small Language Models, e.g. MS Phi-3 Mini).

    https://machinelearning.apple.com/research/introducing-apple-foundation-models

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 2 years ago* (last edited 2 years ago) (1 child)

    Microsoft's penchant for making up names for thing that already have names is neither here nor there. It is an LLM, in fact its already twice as large as chatGPT2 (1.5B params).

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 3 points 2 years ago

    I do think it's a useful distinction considering open models can be more than 100B+ nowdays and GPT4 is rumored to be 1.7T params. Plus this class of models are far more likely to be on-device.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 8 points 2 years ago

    You would be surprised. If you haven’t tried to run a LLM on Apple silicon, it’s pretty snappy but like all others, RAM can be a significantly limiting factor unless the model is trimmed down to do very specific things to reduce the size.

  • permalink
  • fedilink
  • source
  • parent