I don't get why the Fediverse decided to take on the legal risk and storage cost of downloading every attachment to local servers to be honest.

Privacy. Lemmy leaks your ip all over the internet. Mastodon does server fetch.