One of my special interests is humor (probably because of my difficulties with it) and I like to know why things work. If you can't put it into words, that's fine. It's a fairly common response, to the point where "it isn't funny if you have to explain it" is a common saying.

Don't tell people it's not important if they ask. That just makes people feel excluded because it's clearly important to them.