I had a similar problem in my mid-20s: no obvious job prospects, no employment history outside seasonal and college-sponsored things, long employment gaps. I felt like a whole bunch of the possible jobs out there were places I didn't want to be seen.

Eventually, I got to the point where that ultra-self-awareness was weaker than the desire to get employment. It ended up being a dead-end job, but that didn't bother me. Many of these dead-end jobs were either something I could learn from, or something I could meet people through (a HUGE amount of the social terrain just follows personal association in the workplace), or something that paid the bills and wasn't psychologically taxing.