324
RTX 4070 Super launch day sales are rumored to be a ‘disaster’ – what’s going on with Nvidia’s new GPU? (www.techradar.com)
submitted 2 years ago by to c/technology@lemmy.world
141 comments fedilink hide all child comments
 

Do PC gamers feel 12GB of VRAM is simply not enough for the money in 2024?

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 2 years ago (2 children)

Thanks, that was going to be exactly my question. I don’t see anyone choosing low memory for video but had no idea what ai needs

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 2 years ago (1 child)

    You can run Stable Diffusion XL on 8GB of VRAM (to generate images). For beginners, there's e.g. the open source software Fooocus, which handles quite a lot of work for you - it sends your prompt to a GPT-2 model (running on your PC) to do some prompt engineering for you and then uses that to generate your images and generally features several presets, etc. to get going easily.

    Jan (basically an open source software that resembles ChatGPT and allows you to use several AI models) can run in 8GB, but only for 3B models or quantized 7B models. They recommend at least 16GB for regular 7B models (which they consider "minimum usable models"). Then there are larger, more sophisticated models, that require even more.

    Jan can run on CPU in your regular RAM. Since it's chatting with you, it's not too bad, when it spits out words slowly, but GPU is / would be nice here...

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •