Ok, if you unplug then lamp, does the light go out immediately?

If it does, but it doesn't when you hit the switch, the switch is broken and arguably unsafe.

It it doesn't, it's the bulb that's causing the delay.