Counterpoint: You go to the store to buy the saw you think you'll need, come home, cut the first piece -- boom, same realization. Same time-sink to go back to the store. I don't think that's a concern unique to tool libs.
need one weird tool
Well, yeah. We're talking more expensive things that you only need for one project, or maybe a couple of times. Not the screwdriver set that you use for everything from box-cutting to adjusting the screws on your cabinet doors when they seem wonky.