I assume these are local models? What GPU do you run them with?

Tbh, I just use their chat interfaces. Haven't really felt the need to do a local setup. But yeah they can be setup locally.

Edit: sorry I somehow skipped over your question. Sadly I don't have much knowledge on the technical aspects of ai so I wouldn't be much help there.