Why I think it's gatekeeping:
You're essentially implying people haven't been in libraries by your last sentence if they haven't seen what you've seen. That's gatekeeping, like it or not.
EDIT: In case it isn't clear, what you said was essentially:
"You're not a library-goer because [reasons]."
That's gatekeeping, my person.