Ok think of it this way.
Let's say that you're a musician on the furthest left of the orchestra in the hall.
You keep rhythm by listening to the musician next to you.
They listen to the musician next to them.
That musician listens to the musician next to them.
This occurs for 50 to 100 other musicians, all the way to the other side of the hall.
You might be in time with the musician next to you but due to micro differences across each of those musicians listening to the musician next to them, you and the musician on the other side of the hall are totally out of sync with one another.
By looking at a conductor, the entire orchestra has 1 single point of reference for timing, instead of hundreds of different points of reference that lead to different sides of the hall being out of time.