I think I would hate playing a caster or paladin if I couldn’t roll all 8d6 or 5d8 or 6d10 or my damage at once.

Especially once you hit level 5, casters really want that second set. It can slow down combat a fair amount too and some stuff (like Empowered Metamagic) relies on you being able to see your entire dice roll.