Reactor fuel and bomb fuel are very different things. Current reactors use U-235 enriched to between ~2-5% with some of the new SMR designs using fuel enriched to ~20%. Bombs use ~90% enrichment. You can't make a bomb with less than that enrichment. The physics just don't work. No one is going to think that your rocket carrying a reactor bound for the moon is secretly a bomb headed to a city.
Also the total amount of fuel you would need for something like a 100MW reactor would be on the order of 100kg. Maybe up to 500kg depending on design. A tiny fraction of a rockets payload. You could easily let international inspectors look at it before launch to ease any fears.