This. Our entire campaign is home-brewed using the 5e ruleset, but the application of those rules is selective when it needs to be.
For the most part, we're following them, but if there's a rule that results in a level of attention to detail that we simply don't care to implement, or would have less fun trying to religiously adhere too, we just scrap it in favour of something a bit more light-touch and call it a house rule.
Rules provide a great framework to base your game on, but the ultimate aim is to create an enjoyable experience and have fun, so bend them and break them when and where you need to for the benefit of all involved.