you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 4 months ago* (last edited 4 months ago)

When I update my M1 Pro, I'll definitely be getting another MacBook with enough ram to run some decent models. The way they keep improving the memory bandwidth each generation is pretty great and by the time I do get one, it'll be a pretty wonderful inference machine for local AI.

Also, aside from my development workflows hitting the 16gb ram limit before AI today, it still runs amazingly, so i imagine a high ram laptop would be fine for a very very very long time minus wanting to run even bigger AI models.

  • source
  • parent