I speak a couple of languages with enough fluency to spot accents (including English, having lived in Britain for more than a decade) and in my experience even small countries have lots of distinct regional accents.
That which you describe is pretty much true everywhere with all languages - people from abroad who don't speak the language can't really spot accents unless they're at the fluency level of speaking that language and even those from countries were the same language is spoken can't really tell apart most of the accents in that different country beyond rough categories (so for the British Isles that would be "English" accent, "Scottish" accent and "Irish" accent).