if we stuck a suitably shaped non-critical amount of plutonium in the firebox.
Non-critical? There isn't much energy released from natural decay compared to criticality. We created things like this to power space probes like the Voyager I and II craft. 4.5kg of this Plutonium created about 2500w of thermal energy the the beginning of its life and the power declines from there.