They likely are not cheaper than an ICE car. Batteries on an EV are a significant portion of the BOM and I don't think there is a comparable component on a ICE.
But I can see that EVs are comparable to a PHEV or Hybrid for a similar vehicle/ chassis.