In my experience, it really depends. Like, for the Arch Linux iso it's basically the same, but for some more niche distros, there might not be many seeds so direct download from a local mirror might be faster.