you are viewing a single comment's thread
view the rest of the comments
[–] 8 points 2 years ago

You would be surprised. If you haven’t tried to run a LLM on Apple silicon, it’s pretty snappy but like all others, RAM can be a significantly limiting factor unless the model is trimmed down to do very specific things to reduce the size.

  • source
  • parent