The line is drawn by the community themselves. They decide what the rules for the category are.

This is how all speedrunning communities work. They make rules for each category. Mods aren’t the only thing that can skip large chunks of a game. Major glitches are as well. Many, many speedrun categories prohibit major glitches that skip large sections of the game.