...sometimes it does feel like this.
Have you ever blocked anyone at all? Or a community, or perhaps your feed is always set to Subscribed? Most of us readily forget what Lemmy looks like to a day-1 account. It takes a bit of effort to clean it up, and if they don't see the value in remaining then they won't put in that effort to learn, rather than simply leave.