If that was the case then we'd have legislation that taxes property speculators - we do not. In fact I keep hearing how they want to protect "mom and pop" landlords, or how landlords are doing a service by providing rentals.

ONLY the provincial Green Party has proposed doing fuck all about speculators. Speculators became a larger segment of the market than first time buyers a few years back.