79
DeepSeek's Liang Wenfeng Breaks His Silence: In a rare four-hour talk, the reclusive founder reveals an almost Daoist philosophy of AI—AGI as a tide no company can own... (www.fredgao.com)
submitted 1 month ago* (last edited 1 month ago) by to c/technology@lemmy.world
25 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 58 points 1 month ago (15 children)

I think it’s important to note that these models are open-WEIGHT and not open-SOURCE. Open-source would mean we could explore the training data itself. Open-weight models are great, but please let’s not call them open-source.

  • permalink
  • fedilink
  • source
  • hideshow 15 child comments
    •
  • [–] 14 points 1 month ago (6 children)

    Yeah, it's like an open-source distro that won't work without an accompanying opaque binary blob.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 4 points 1 month ago (5 children)

    What distros are like this?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 2 points 1 month ago (3 children)

    It is more a question of what hardware is like that and if you look up firmware blobs for Linux you'll find a lot, starting with graphic cards.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 2 points 1 month ago (2 children)

    That's the hardware not the distro

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 1 month ago

    Distro was the wrong word. I should have said "package" (though there are also distros that attempt to eliminate blobs within their packages). Examples include manufacturer-issued device drivers, software that allows integration of GPUs, several parts of Android that integrate with the underlying hardware, firmware of various sorts, and I can't be arsed to remember more at the moment.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 1 month ago

    Nemotron Ultra is a open source and already gives DeepSeek R1 performance (admittedly not that good anymore). NVIDIA has open sourced the entire training process, including raw datasets and synthetic data generation. The raw data is mostly curated web crawl data.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 1 month ago (4 children)

    The EU's AI Act calls them open source, so that ship has sailed.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] [S] 1 point 1 month ago (1 child)

    Perfect shouldn’t become the enemy of better. Open Weight AI isn’t Open Source AI, but it’s a huge improvement over Closed AI where you get neither the weights nor the training pipeline.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 3 points 1 month ago

    But to put it another way, what would you say to stalling tactics on the climate? What we need is “perfect” and they are only offering us bottom line-friendly “better”?

    “X-1” doesn’t solve the equation “x-1(x/1000),” know what I mean?

  • permalink
  • fedilink
  • source
  • parent