At first if look at the day of. On the day of prediction how do the high and lows compare against the predicted values for that day. It's kind of a check, how much can I trust what they say. One store is saying I need to prep for rain, another that it'll be clear, they aren't usually that extreme but it's come close.

And I've considered getting a weather station and doing my own comparison since some stations arent very close.

All of those are basically front-ends for the National Weather Service and other mostly(?) public institutions that have actual weather satellites and generate the actual data.

I'm a fan of Windy because it lets you choose and compare/contrast forecast models. You can even compare which model has been more accurate for your location in particular.