The main difference in difficulty between the modes is the parry window. If your problem is the parry window, switch to normal mode.

I find in normal mode the game is not very hard for main quests, but extremely punitive with the many optional bosses. So if you still want a challenge, they're right there.