you are viewing a single comment's thread
view the rest of the comments
[–] [S] 5 points 3 months ago

ATLAS has some benchmarks in the repo, and it's comparable to opus 4.6, you don't actually even need 128gb model for that. An 8 bit quantized model will run with around 32gb and still perform quite well.

  • source
  • parent