A poor person is not to be seen as a victim of unjust society or even a fellow human being down on his luck. If you are poor it must be somehow, however indirectly or even ontologically your fault and you are automatically in morally questionable state by being poor. While a rich man must be by his earthly wealth blessed and among the god's elect. Rich man can and should be left to do what he wants because he is inherently virtuous/capable, while with the poor the attitude should be at least that of scrutiny or be that of educating them to be better or at the worst end make sure they suffer more because they deserve it.
This is pretty much the philosophical/theological underpinning of the thinking of these people.