you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 2 months ago (2 children)

It's not the average consumer spending thousands on tokens. Even my work just had a meeting about how "the free lunch is over" now that AI costs are expanding, and they bought their own hardware to investigate hosting local models.

Linux is widely used in the enterprise world. It's the home consumer world that doesn't use it as much and even that is rapidly changing as things enshitify.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 2 months ago

    they bought their own hardware to investigate hosting local models.

    That's going to be incredibly hard to make economical I bet, unless you have the ability to basically max out the utilization of the hardware around the clock.

  • source
  • parent