Not being able to retract it has nothing do with being unhygienic - poor self-care is what is what is unhygienic. Just use a shower head and mild soap if necessary and you're all good.

Source: I have it, I get a checkup done every year and it's been fine. No buildup or issues whatsoever.