Walled cities typically had fruit orchards and sometimes vegetable plots inside their walls. Everything else was grown outside (and for larger cities most vegetables and fruits too).