They said it's mostly about the amount of moderation action they've had to take against users from those instances. Maybe lemmy.ml has less users who behave badly outside their server?

I could also see there being a reticence to defederate from the "canonical" instance so to speak.