Most Fertilizer is made from Oil.

Most farming (especially in the US, which is hugelly dependent on hybrid corn, which requires fertilizer since it grows with such a high density of plants that the natural fertility of the soil isn't enough) uses fertilizer.

So the lack of Oil will hit Food Production upstream from transportation, especially in the US.