Yup. A huge part of the cost is the batteries, the electric motors, the sensors and controllers that manage charging and discharging.
Looking around at home battery backup solutions, for example, simply having the same storage capacity as an EV (50-75 kwh) can cost almost as much as an EV itself.
Jackery has add on batteries for about $1000 for 5 kwh, Ecoflow and Anker Solix cost $2000 for 6 kwh.
At those prices, a 60kwh battery pack in an EV basically represents $12,000 to $20,000 in battery cost alone, plus a whole system around charging it and using it for an electric motor, and then a whole car around that.
It's not a perfect comparison, but it does show that the actual material cost of what goes into an EV is primarily the electric drivetrain and battery.