Just gonna say it, back in like 2019-2023, I was EXTREMELY pro AI. I messed around with OpenAI's playground thing, messed around with that Dall-E Mini/craiyon thing, and was one of the first to hop on ChatGPT when it came out.

I had this really dumb opinion that it's just fun stuff to mess around with! This isn't gonna do any real harm! Thinking, stupidly, that most people wouldn't use it to like replace writers or just do their work for them.

It was around 2024 I became a lot more skeptical of it. I kept seeing slop art in like local restaurants and even this one club I used to hit up that I absolutely don't anymore. And the amount of time people say "I asked ChatGPT" drives me up the wall.

Like are you third partying your thinking!? And seeing it just dominate Facebook, Reddit, Twitter, and TikTok also made me begin to lose it. It was literally the Dead Internet Theory becoming a fact. I felt like such an idiot for being pro-AI and thinking people would use it wisely.

That said, I'm not exactly anti-AI, to be fair. I have local LLM models on my computer running through LMStudio if I ever have want or need of these chatbots. It makes it way harder to use it and my poor gaming laptop screams for mercy every time I want to use Qwen, so I dunno.

I guess I'd say I'm AI-Skeptical and leaning more toward negative. But this isn't about me, it's about you. What do you feel about generative AI?

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 10 hours ago* (last edited 9 hours ago)

Thing is, my specs are really good. Again, my laptop is a beast and it ran like 100% CPU, 100% GPU, and 100% of my 64gb of DDR5 Ram! Seeing it and how hot it made my computer

Local llm usage depends on your VRAM, your GPU. It sounds like you tried to run a model your laptop can't handle. If you also need your RAM, then it is going to be super slow no matter what. The number each model has is important to determine if your GPU can handle it, also the quantization. If you run something significantly smaller like 2B* rather than say gemma 31B, then a laptop might be able to handle it. Your laptop is not a beast (for LLM usage) unless it has more than 24 GB of VRAM on it so don't assume you can run any model on it. Look for smaller numbers with quantization. Running a local llm for me on my desktop is similar to running a video game, it doesn't slow to a crawl or cause 100% on CPU or RAM because only the VRAM is touched.

*or 4B even, just depends on your GPU

  • source
  • parent