Modern heat pumps work down to -30C, at which point the furnace supplements with electric heat which is built into the unit.
My electricity costs dropped 50% over my builder-grade piece-of-shit electric furnace & AC unit -- and I even increased from a 2 ton to a 2.5 ton system. The initial cost was about $12k, and it will take 8 to 10 years to break even, less if the cost electricity keeps increasing the way it has over the last 10 years.
Also, you may not want A/C now, but you will shortly -- heat waves are getting more severe each year.