Yeah, they existed, but they weren't mainstream and were mostly just simple image macros. In 2004, if you talked about memes in public, it meant you browsed 4 Chan or Something Awful, which made you a loser to most people.