I mean it's not pointless pointless? The point is that you don't want someone who isn't you to be able to log in from anywhere else, by just entering your email or phone number, even if they know those pieces of information. They have to also have access to those things, giving the second factor. It's not "totally secure", but just a second factor or hurdle that they have to get over in order to gain access to what you have, right.
So if someone already has your phone or email compromised/in possession, then yeah, of course, that factor is totally rendered inoperative. 😁
Or would you say there's something I'm missing here? 😅