Oh man. I've had this kind of thing. I started inviting people I knew wouldn't come. I wouldn't feel bad when they didn't. But I'd occasionally get a couple that I didn't expect and had a good time.

My girlfriend hates hearing no though so she only invites those she knows will say yes. It's a bit of a bummer. Because I always enjoy the surprise of someone I didn't expect.