That's just natural. Discord has a huge weight of numbers. People stay where they already are, unless there is significant motivation to move.

Matrix would have to be MUCH better than Discord in terms of features to attract people to move their whole communities and friend groups, not just simply on-par. And that's pretty tough.

So yes - we're basically waiting for Discord to continue its slow march into enshittification.