Basically yes. There are problematic elements but it's not rape. Also it's fiction where things happen in service to a plot that, unlike real life, comes to a resolution. So even if a woman does enjoy reading about rape, that doesn't mean she wants it. In fact, it's often read for cathartic reasons to deal with trauma. It's about overcoming a situation she can identify with, not wallowing in the assault (caveat: healing is different for different people. I can't speak for everyone, but I understand my wife pretty well).

You're looking for delineation and distinction where the right wing doesn't. 50 shades was a book about fucking rich people doing whatever they wanted and the woman accepting it. That's the stereotypical impression from people who don't read.