Basically, sometimes extra filesystem cache in your physical RAM is so valuable that something else gets evicted to swap for it
like say your web browser's code for handling h264 video when you have no videos playing, unused memory like that can be moved to swap