George Lucas is the perfect example what happens when you don't do world building. The Star Wars universe is basically just retcons stacked onto other retcons.
And I am a firm believer that even short stories in a fantasy or SciFi setting don't work without at least a certain amount of world building.
The number of fantasy and SciFi stories where the author thought they could get away without thinking their world through and which ended up badly is amazingly high.