The effect of this would be a massive disincentive for landlords to engage in major remodels or reconstructions to rental units, impeding growth in housing and remodeling of units beyond the kind of basic paint and sweep that is typical between tenants.
Just increase the land value tax.