Sure but you don't normally run GCC or Clang directly; you make, and that normally does optimise. I think a closer example is CMake which doesn't enable release mode by default.

MSVC is usually run from Visual Studio which makes it obvious which mode is being used so the default doesn't matter so much.

As for "all the other compilers", Go optimises by default. It does seem to be the exception though...