Yes, it has given me pause to reconsider, but I am no longer in my youth, and I have found no counterpoint in all these years that has turned me on the concept. The fact that children come up with the idea independently is just a testament to how simple the concept is, not evidence.
I do distinguish this from spiritual fatalism. Fatalism seems to be the concept that any path taken will always lead to a given destiny. I think I identify more with causal determinism, wherein there is only one path. In this way, I see the universe like an incredibly complex algorithm with an uncountable number of parameters. The state of the universe is based solely upon the previous state and the laws of nature. My "choices" are based on the many complex inputs of my past. If I was given the same inputs twice, including exact identical states of everything down to the atoms, for what reason would I expect a different result?
What are your thoughts?