Most Nordic countries, Greece and Malta have crosses on their flags for example.
Those crosses don't carry any religious meaning, they're simple historical artifacts. It's akin to how I still say things like "oh my god" or "go to hell", despite being a militant atheist.