I get around 40 token/s and it frequently has become reliable enough to drop sonnet for me. So take that as you will
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I get around 40 token/s and it frequently has become reliable enough to drop sonnet for me. So take that as you will