If you request data from a server, chances are that your server needs to request that data from another server - which is 'upstream'.

There can be multiple upstream servers involved in responding to your single request