The skill point cost exists so you need to invest in more slots, as opposed to minmaxing thoughts for free. I agree that it shouldn't cost a point to remove a thought, but there also shouldn't be a limit on how many thoughts you can have. By the time you've reached 12 levels, the game is openly very easy and the limit only makes things less fun.