That's hardly a good reason to continue doing it. I consider it easiest to just let me work whenever I want to and stop worrying about how much.

If there's no big consequence to starting a few minutes later, Employers shouldn't be so anal about it. It's a waste of everyone's time and will probably cost more time and productivity than those few minutes I wasn't gonna be super productive anyway.