Imagine humanity in 1000 years. We would be among the stars.
Now imagine humanity in 10000 years, 100000 years or even 1000000 years.
A million years is still a fraction in the cosmic timescale.
It would be nearly impossible to have other civilizations be on exactly the same technological level as us. They would indeed be either much less advanced, or much more advanced.