In my experience, I find that talking about it can actually lead to a lot of good conversations and friends. One of my close friends I met during a discussion of religion, and I have another great friend who is Pagan and we have been able to bond over that, though I do also understand the wish to keep it private and respect that preference 100%.
Edit to add: community was also extremely important in a lot of pagan traditions and being open about it can help one find others to practise with.