It's a cult and you just joined it ;-)

There's a ton of reading on all these topics. If you're interested in browsing what the actual process of tinkering on watches and clocks entails, archive.org has scans of relevant books, like https://archive.org/details/practicalwatchre0000deca and https://archive.org/details/watchclockmaking0000wjga. If lending your eyeballs to the algorithm is more your thing, https://www.youtube.com/watch?v=dJxnP0qA2hU&list=PL7q4FTKNfQj-bcGk0JfUXioeq6KNtyhVA is a neat playlist.

There's a bunch of videos on probably one of the most interesting devices in history, the Harrison H4 marine chronometer. Whether it was the first or the best is probably less important than that there is a juicy story about this nerd that comes out of nowhere and officials refusing to hand over the large pot of money that the British promised to whoever could make a clock precise enough to be used on a ship for navigation.

An actual modern watch making hero is George Daniels, who essentially built watches by hand from scratch - bars of gold, steel, brass entered his shop and working watches came out (at the tune of maybe one a year). A bunch of documentaries were made about his life and work and I think they're all quite cool.

Lemme know if you need more :P