Yeah, no one at my work would care as long as you're not making it weird, I think before I got here people were probably reading 59 shades of grey or other "spicy" books.
I think it's hypocritical to call some books as not appropriate for school or work while allowing religious texts that have that in it.