Yes, the private key never leaves your machine.

You send them a certificate signing request with your public key, they put their verification stamp on it and send it to you.

The only part they have to play is verifying that your certificate is trusted by a root certificate.