Yeah it is different in places outside Anglo countries, I've noticed that. Dominican people I've known will associate whiteness specifically with skin color, regardless of the person's ancestry, language, etc.
Places outside the USA haven't had as strict of a racial divide and so yeah I can see how it would get muddled.
You mentioned showing people pictures. There's a test I do with Americans sometimes. I'll show them a picture of Bashar al-Assad, who they probably don't recognize. I'll ask what he is, and they'll always say he's a white guy. I tell them he's a Muslim and the president of Syria, then they instantly change their answer.