17
Topcoat: The full full-stack framework for Rust (github.com)
submitted 2 months ago by to c/rust@programming.dev
15 comments fedilink hide all child comments
 

cross-posted from: https://lemmy.bestiver.se/post/1232439

Comments

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 1 point 2 months ago* (5 children)

I'm using it locally, with models my existing computer can handle. I think, but I'm not sure, that it's better for the environment than buying into some massive model hosted in a data centre. And I don't want to lose my skills so I still try to do as much as I can without calling on it.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 2 points 2 months ago* (1 child)

    I will say that using a super efficient cloud model (deepseek for me, v4 flash is very cheap) is probably more efficient than using a local model in most cases, especially if you need strong capabilities. The question is whether your own grid or the provider's grid is more environmentally friendly (hint: china's energy mix is about 50% fossil fuels while the US's mix is around 75% fossil fuels overall)

    Training is of course expensive still, but Chinese labs have all but caught up to US labs despite much lower compute resources being available to them.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 2 months ago (2 children)

    did you generate your model locally?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] [S] 1 point 2 months ago (1 child)

    No, and I do understand that training is the most energy-intensive part of the process. I don't know how exactly it divides up: how much of the work of massive data centres is training and how much is running people's queries on finished models.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •