I recently read a fantasy novel called Silver Under Nightfall that has to be one of the first proper poly novels I've ever seen
The main character has an obvious attraction to a woman, and a confused lust for her husband. Both the husband and wife are into the main character. It's not high literature but I had a blast reading it anyway