even better: walk upstream ideally until you find the source, and drink from there. Water straight from the ground is generally incredibly clean, thanks to being filtered as it passes through the soil.
Like, that's how wells work, you dig down until water seeps out from the ground around the hole.