Not necessarily. Usually your bank will have ATMs you can use fee-free. And often partner bank ATMs as well.

Out of network ATMs can charge fees, which you will prompted to accept before withdrawing, but that's not from your bank. That's the company running the ATM. Generally $3-5

I guess some shitty banks could charge fees on top of that....

Mine charges no fees and actually reimburses ATM fees (a certain amount per month)