There is nothing preventing anyone from starting a worker-owned collective. The fact that they don’t, while having the freedom to do so, indicates that the typical arrangement of wage labor is consensual. It’s what people choose.
If socialism requires an arrangement other than the one they would freely choose, then socialism requires a non-free market where people are forced into economic arrangements they wouldn’t freely choose.
So socialist may not in principle have anything against markets, but the fact that the implementation of socialism requires curtailing markets means it does have something against markets in practice.