Yes, except all bulky plugs are designed for plugging into an outlet with the ground at the bottom.

Not really. Most plugs I see have ground at the bottom and there's no official standard for orientation.

No. Ground is on the bottom. Almost always. Unless it's sideways.

Then just take it out and flip it around. It's not hard. Just turn off the the circuit at the junction box first.