That's half the explanation.
The economic and social decline makes people susceptible to populists.

But the other half is this:
They're not the only populists.
To vote for outright, obvious Neo-Nazis you also have to ok with Neo-Nazis.