It's not magic these models are big and you can't just squeeze them onto smaller devices. Quantisation isn't magic either it's literally reducing the accuracy of a larger model to fit on a smaller device reducing its performance. If the data doesn't exist in the model weights then the model will perform worse and you can only compress data so much. The only meaningful tech shift in the space is unified memory but it's not going to be enough for anything this is fundamentally going to need silly quantities of ram for any effective model to run.