I've found that smaller local asian, Indian and Mexican stores have lots of great vegan options for much less than big name grocery stores. For example, I can get a huge bag of chili peppers for less than a jar of chili powder, and they taste 100x better. I also buy rice, beans, tofu, nutritional yeast and VWG in bulk, and I make my own seitan super cheap.