Half the people I’ve met who use the word ‘based’ have nothing to do with 4chan, they’re just young. The first time I heard it was in reference to Mark Bunker during the Scientology protests in 08. Which, while certainly connected to 4chan, I don’t think can really be cast in the same light as all the Gamergate crap and everything that came after.
Also probably important to note that even being connected to 4chan isn't always a bad thing. The web (particularly youtubers) have made 4chan as a whole to be some boogeyman website full of hackers and nazis, but it's a loosely connected web of forums (known as boards), many of which don't have anything to do with another apart from being anonymous. It's kind of like lemmy in that regard. I've browsed it in my time, and while it is definitely quite a toxic site, most if not all the toxicity originates from a select dozen-or-so boards, and only 3 or 4 of them are even popular (b, pol, r9k, x). Hell, if you go right now to /a/, you'll probably just see a bunch of weebs discussing anime like any other forum.
note: this isn't to say 4chan is safe like beehaw. The whole culture of the site is very archaic and a lot of people on there are still there saying slurs and being generally offensive, but when you stay away from hellholes like /b/ or /pol/, I've seen worse on reddit.
If some stranger on the street told me they used 4chan, without specifying what board, I mean I might be suspicious of which boards they're using (depending on context clues) but it's not a buzzword that translates to "white supremacist"