You don't even need to swap wheels. If a car is sold with multiple wheel size options, there's a solid chance that the speedo is calibrated for one size only.
My car is a 2012 model and the speedo is off by at least 10% compared to speed radar displays I've driven by.