I think this is a case of Autistic hypo vs. hyper sensitivity - we are all different in how we experience things. Texture is another important factor.

Baked potatoes have a lot of flavour - our family (all neurodivergent) love baked potatoes, but we all like different toppings and presentations. One likes just salt on it, one just baked beans, and so on. I like margarine, salt and pepper, beans and cheese. I find the potato is a nice contrast to the more flavoured ingredients.