Fuel taxes aren’t random government money grabs, they directly fund roads, bridges, and other highway infrastructure.

That's the budget the revenue from them goes into, but it's only a drop in the bucket compared to the total cost of that infrastructure. The road system is massively subsidized from sources other than driver user fees.