Here is my line of thinking. Say someone bought the books 20 years ago and donated them to a second hand book store, and you picked them up there, you aren't supporting the person who bought the books originally, you aren't supporting joanne either.
I know a lot of people are polarized on the separate the art from the artist line of thought. Some people say you can, others say you can't.