Damn, I hope this is not goodbye to uncensored models 😒

top 50 comments

sorted by: hot top controversial new old
[–] 29 points 3 days ago

Ok, how come these public utility databases are owned to be sold like that eg gitgub, twitter without any regulator pushback? Oh yea...

  • source
  • [–] 8 points 2 days ago (1 child)

    Anybody got a good list of models we should download right now before they start disappearing?

  • source
  • hideshow 2 child comments
  • [–] 3 points 2 days ago

    They wont disappear. hugging face is two things. its a model repo and a compute provider. hugging face has paid plans to run models on their systems. nvidia will use this to run on their backend. this is how they plan to make money from hugging face. its in their best interest to keep the repo stuff as is.

  • source
  • parent
  • [–] 66 points 3 days ago (7 children)

    The core llama.cpp maintainers also work at HF and will now work for Nvidia I guess. Llama.cpp is a pretty significant part of the local LLM stack, especially since other tools like Ollama and LMStudio are just GUIs built on top.

    Local LLMs have gotten to the point where they are a serious threat to Anthropic and OpenAI, and Nvidia has a lot of skin in the game. If Nvidia wanted to do some serious damage to local LLMs, they are now in a position to do so.

    I’m also imagining they may try to squeeze out support for other GPU vendors. I’m using an AMD 7900 XTX to run Qwen 3.8 27B that I downloaded from HF to run on llama.cpp, which currently works like a dream. The 7900 XTX is the only sanely priced 24GB GPU left in 2026 (under $1k vs. $2k, $3k, $4k for Nvidia 24-32GB cards). Combined with OpenCode or Pi, a setup like this basically eliminates the need to use Anthropic or OpenAI products in the same way Jellyfin eliminates the need to use streaming services.

    I’m sure Nvidia and their buddies don’t like one thing I’ve said in this comment and may very well be plotting to put a stop to it, so the community may need to step up our game and get our eggs out of the big tech basket.

  • source
  • hideshow 9 child comments
  • [–] 16 points 3 days ago (4 children)

    Well the good news is they can't take away from you what you already have. It being an open source project, I'm assuming if they do anything to deliberately gut AMD performance, it'll get forked.

    Also

    The 7900 XTX is the only sanely priced 24GB GPU left in 2026 (under $1k vs. $2k, $3k, $4k for Nvidia 24-32GB cards).

    Not on sale anymore, at least not at any vendor in my country, I searched an aggregate pricing website. Amazon has a few used ones left of some models, but that's probably a 2 or 3 digit figure across SKUs. Hold on to yours with an iron grip.

    What kind of tok/s are you getting with it on Qwen 3.8 27B and how's the output quality? I may consider getting one if I can find one used or import from abroad.

  • source
  • parent
  • hideshow 4 child comments
  • load more comments (4 replies)
  • [–] 3 points 2 days ago (1 child)

    The core llama.cpp maintainers also work at HF and will now work for Nvidia I guess. Llama.cpp is a pretty significant part of the local LLM stack, especially since other tools like Ollama and LMStudio are just GUIs built on top.

    I guess that explains why features like quantized KV caches are lagging behind. Maintainers are purposely dragging their feet.

    the community may need to step up our game and get our eggs out of the big tech basket.

    The community has chosen to not fight at all, which is worse. Anti-AI sentiment is at an all-time high.

    Publicly. Privately, these hypocrites still whisper in ChatGPT's ear when they get lazy enough. Or use some feature in Photoshop or some other software that they didn't even understand was AI-driven.

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (1 reply)
  • load more comments (5 replies)
    [–] 247 points 4 days ago (9 children)

    Remember, the whole AI scheme exists to take the very concept of ownership from us. This takeover is hostile.

  • source
  • hideshow 10 child comments
  • [–] 30 points 3 days ago (3 children)

    Why do we need a centralized hub for AI models anyway? I've never figured this out. We flock to these big "friendly" fucking companies with obviously unsustainable business models trying to own and sell things that should be shared in a decentralized, democratized mesh anyway. AI models should all be distributed magnet links, not hosted files. Why do we do this to ourselves?

    The way things are going at Huggingface now, I imagine we probably will have to start building the infrastructure we need to handle AI models as distributed links sooner rather than later. Let the enshittification begin, we'll move on to a different tactic for sharing AI models while cheerfully they squeeze cash out of people and businesses too lazy to adapt. Everything working as it should, I guess.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 16 points 3 days ago*

    For real, this is the perfect application for torrent. If I were building a registry that had to have sustainable cost for an open source community it would use torrents as a file transfer backend. If I were building something that I was planning to sell to a monopoly firm that has monopoly money... HTTP and cloud storage all thw way! πŸ˜„

  • source
  • parent
  • load more comments (2 replies)
  • load more comments (8 replies)
    [–] 27 points 3 days ago
    [–] 132 points 4 days ago (3 children)

    They should put up a back up torrent of all the currently available models before transferring ownership. Thus opening the doors for future websites.

    NVIDIA is probably trying to shutdown the LLM-at-home market (which means you don't need huge clouds of graphics cards or even an Internet connection). Sad day for people who like to control their data.

  • source
  • hideshow 4 child comments
  • load more comments (2 replies)
    [–] 57 points 4 days ago* (20 children)

    So they are just slapping random price tags on things now. It's a database of AI questions. They have paid 13 billion dollars for a database, and everyone's acting like that's a perfectly rational sensible thing to do. No one in the financial industry has any sense anymore.

    A company that's only product is something that people either don't want or actively hate has paid an eye-watering amount of money for a database to train their product on, this training will have no effect whatsoever on whether people want it.

    I have this nice bridge with lots of training examples if anybody's interested, 100 trillion dollars please

  • source
  • hideshow 21 child comments
  • load more comments (19 replies)
    [–] 4 points 2 days ago (1 child)

    Pick up as many uncensored models as you can store ASAP. Those will absolutely be the first to go.

  • source
  • hideshow 2 child comments
  • [–] 96 points 4 days ago (2 children)

    We just can't have nice things can we.

  • source
  • hideshow 3 child comments
  • load more comments (1 reply)
    [–] 81 points 4 days ago (3 children)

    I fail to understand the use of the term open source when the resource itself can be bought by oligarchs. Like organic vegetables, or clean coal.

  • source
  • hideshow 3 child comments
  • load more comments (3 replies)
    [–] 65 points 4 days ago (1 child)

    Get ready for the model purge

  • source
  • hideshow 2 child comments
  • [–] 22 points 4 days ago (3 children)

    Is there something unique about hugging face that the models cannot be hosted elsewhere? I see open source as more important to Nvidia than anyone else because it sells hardware. The services’ motivations are only partially aligned with Nvidia.

  • source
  • parent
  • hideshow 4 child comments
  • load more comments (2 replies)
  • [–] 3 points 2 days ago*

    I would be less concerned about it being the end of uncensored models than I would be Nvidia finding ways to make sure there are no free models hosted there that work well on anything but Nvidia hardware for the foreseeable future.

  • source
  • [–] 7 points 3 days ago

    The Spark isn't a bad computer, and they haven't completely gotten rid of local GPUs, so Nvidia does somewhat care about local llms, but power corrupts and this is just more of it.

  • source
  • [–] 2 points 2 days ago

    gets a face hugger

  • source
  • [–] 33 points 4 days ago

    Ed Zitron is going to have an aneurysm.

  • source
  • [–] 41 points 4 days ago (4 children)

    Real money or pretend AI money

  • source
  • hideshow 5 child comments
  • load more comments (3 replies)
    [–] 27 points 4 days ago (2 children)

    Ahhhh, this is what they meant by "the circular economy"

  • source
  • hideshow 3 child comments
  • load more comments (1 reply)
    [–] 5 points 3 days ago

    let the fuckening begin!

    lol

  • source
  • [–] 16 points 4 days ago (4 children)
  • load more comments (3 replies)

    It was only a matter of time

  • source
  • [–] 18 points 4 days ago (7 children)

    I know huggingface. I don't know of anything they sell, though.

  • source
  • hideshow 7 child comments
  • load more comments (7 replies)
    [–] 24 points 4 days ago (3 children)

    My question is what their motivation is.

    • Do they want to close down open models so more is directed at the frontier/closed companies (OpenAI/Anthropic)?
    • Or are they trying to diversify and push open models as a safety net for when the bubble bursts
  • source
  • hideshow 4 child comments
  • load more comments (2 replies)
    load more comments
    view more: next β€Ί