It is part of science, it's an untested (and currently untestable) hypothesis. Such thought experiments can be very useful. Running through the consequences (and possible experiments) can sometimes give useful insights into other areas of physics.

The problem is when layman take the scientific equivalent of a debate joke and treat it as gospel. It's similar to what happened with the flat earth society (started out as a debating joke, and got overrun by idiots).