If you're working in a team and they have to wait for you so they can start, sure. If there's some fixed appointment with others, absolutely. If you can't get your stuff done on time, definitely. But if your work isn't that time sensitive, it really doesn't matter if you start painting the wall or doing paperwork ten minutes later.
3 hours late
We're talking about 10 minutes.
On the other hand, did that coworker's work have to be done synchronously? If it's something he could do on his own at midnight and hand in whenever it's done, why care when he does it?
Again. If his tardiness results in work not getting done, I get it. I'm just arguing against the normality of expecting fixed working hours from people for no other reason than normalcy.