you are viewing a single comment's thread
view the rest of the comments
[–] 18 points 1 month ago (2 children)

I'd take a model whose training data is open source and legitimately obtained. The only ones I know about are Apertus and OLMo, and they aren't really competitive.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 6 points 1 month ago (1 child)

    Unfortunately not yet, no, true FOSS models are likely many years away, but I would argue that that follows typical FOSS lifecycles. Emerging technology is typically outperformed by proprietary endeavors, which creates an audience, and then that audience undertakes a FOSS implementation that initially underperforms, then just about competes, then eventually overtakes (i.e, GNU/Linux).

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 month ago

    Interesting point... In this case, I have a hunch that the requirements in terms of training data and hardware to run the training on would remain prohibitive, but I do wonder how much could be actually achieved using a distributed scheme of sorts.

  • source
  • parent