You might be doing something wrong, models that size shouldn't be that slow if properly configured on a 32gb m2

You need a metal optimized client and model, not the same models you'd run on your desktop machine.