Wiki does say tastes bad for birds. Maybe some irritant? I know spiders don't have taste buds, but chemical sensing hairs near the mouth instead doing the closest spider equivalent.

Edit: their feet taste too? Damn.