It's indeed not neutral. It always takes work to move heat from a cold area to a hotter area, so there's always energy (and therefore heat) being added every cycle. https://en.m.wikipedia.org/wiki/Heat_pump_and_refrigeration_cycle