What are some things that just get under your skin about games?
For me, it's games that do not allow controller rebinding. I have neuropathy and my fingers don't all work. If I can't rebind buttons so that I have necessary moves (for example: parry) be on buttons I can reliably press the entire game becomes unplayable.
And on console, where I can't refund a game after I downloaded it (fuck you Sony) then it really screws me over wasting what limited funds I have on games I just can't play.
You are failing to see that people with some sort of disability are already against impossible odds, not only in the game but in life. They already know that feeling you talk about, why not let them partake in this piece of art? It will still be a challenge.
If your worry is that normies would exploit this and not "earn" their victory, it also does not affect your experience of the game at all. Just like nobody is going to force you to do a SL1 run - that's a choice-, why not have that the other way arround? :)