"the Prime Directive is not just a set of rules. It is a philosophy, and a very correct one."
(i.imgur.com)
In TOS Kirk really leans into not interfering with the “healthy” development of a civilization. If it isn’t healthy in his judgement, he interferes. So, essentially when it comes to Kirk if it offends his sensibilities he assumes free reign change it while paying lip service to the idea of non-intervention.