Sure, the Kentucky governor could replace him with a Democrat

No, he couldn't. The KY legislature passed the "fuck Andy Beshear in particular" act in 2023, requiring the seat to remain vacant until a special election.