Putting in a bioregion or something like a USDA zone (better if it's Trewartha) would be very helpful for folks to know what to recommend. Here is a spreadsheet I made from the appendix in Edible Forest Gardens Vol. 2 if you would like too many options. This list is geared for the Northeastern US, so it is not exhaustive and may not apply to your circumstances.
Something I enjoy growing is Carolina Allspice, Calycanthus floridus. We strip and dry the bark for use as a cinnamon-y allspice type spice, whether grated or just used to stir a drink