you are viewing a single comment's thread
view the rest of the comments
[–] 18 points 1 week ago* (2 children)

It doesn't say anything about how this works. "No data retention" suggests that data is going to a server that's processing it but then not retaining it. That's bad, this type of feature should run entirely on the client.

Also, there's a proprietary AI model doing the work, even if inference is in the client. It says "open weight" but that's like letting people download a program as a compiled binary, the exact opposite of what FOSS is supposed to mean. It's an open/free model only if the training data and algorithms are also public, not just the trained weights.

  • source
  • hideshow 2 child comments
  • [–] 1 point 1 week ago (1 child)

    Issue is that local AI hog vram, are slow and small models. Or if you don't have a compatible GPU, it uses the CPU which is even slower.

    If AI is the future, I really hope it's local, but with the equipment people have at home, local AIs are a non-starter.

    IMO it's enough to justify not shipping those AI features at all but I guess that's where FF execs disagree.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 week ago

    AI inference is doable on home equipment. AI training is less feasible, but nobody builds their whole Debian distro from source either. It's enough that the source is available and you can rebuild any component if you want ot do so.

  • source
  • parent