you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 4 months ago*

It would be better if the damn LLM was local, i tried to do it on a crappy 300€ phone, it worked, the LLM was one of those stupid ones but it did a deceny job for a 300€ phone, so i can guess that with flagships it would be good, heck, if we had a processing unit dedicated to LLM stuff it wouldn't be that bad probably

  • source
  • parent