They have the lowest potential fiber content of all the other carbs. You can always have whole grain rice, bread, and noodles. Potatoes are just tubers.

That said

I like to dip vegetables into mashed potatoes, or make Sheppard's pie, or make potato shipwreck, or top a plate of fries with spicy chili or use crunchy air fried hash browns as topping in salad or wraps. The humble potato is a companion food that helps all the other foods work together.