That's only true of badly (or barely) written musicals like Cats.

Great musicals like Les Miserables or Hedwig and the Angry Inch have plots as good as the songs or, in the latter case, even better!