Crushing the confederacy wasn't about freeing enslaved people, it was about ending the slave plantation production model and replacing it with the industrial factory employment mode of production. The northern bourgeois had a more efficient system that pushed a lot of the responsibilities of the slave owner back onto the employee, they did not give a shit about the plight of the slave.