Basically the title.

For me, a dense model around 20b, with an additional engram table of 10-20b, or a sparse MoE around 80b would be amazing.

you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 6 days ago*

Oh hell yeah

I'm on my 1070 8gb copium so we're twinsies

Maybe they release a huge moe model with non-uniform quants and then we can get even more quality on those cute little cards

  • source
  • parent