Eurovision is organised by the European Broadcasting Union, which includes basically all countries in the European Broadcasting Area (basically Europe + all of the Mediterranean). Those include Morocco, Tunisia, Egypt, Israel, Armenia, etc. They have always been allowed to participate. Australia is an outlier. They just got a special invitation.