So energy remaining and radioactivity are separate. The isotope that it becomes has a decently long half life, but it might only be a few protons or neutrons away from something really radioactive.
I do believe that the fuel rods count towards that pile of waste. I think the US has laws or rules that make it hard or impossible to recycle these back into the good stuff, but it's very doable. France does it to a high degree.