▲ 17 ▼ Topcoat: The full full-stack framework for Rust (github.com) submitted 2 months ago by floofloof@lemmy.ca to c/rust@programming.dev 15 comments fedilink hide all child comments cross-posted from: https://lemmy.bestiver.se/post/1232439 Comments
[–] BB_C@programming.dev 11 points 2 months ago (16 children) ⚠TRIGGER WARNING⚠ two tokio-rs repos (this and toasty) have AGENTS.md files. permalink fedilink source hideshow 16 child comments replies: [–] floofloof@lemmy.ca [S] 0 points 2 months ago* (15 children) These days we have to expect many projects will have them. It's really a question of how responsibly and carefully AI is used. Some people just throw in their requirements, have the AI spit out code, do a cursory check to see if it seems to work, and that's it. Other people take responsibility for the architecture and the code quality, using AI in a focused way and reviewing the results carefully. I'd look at the quality of the architecture and code before judging. I confess I have not done that yet with this one; I just thought it sounded potentially interesting. There are quite a few ways to write web applications with Rust these days, and while this sounds like it has potential, I'd still pick frameworks that are a little more mature for my own projects. permalink fedilink source parent hideshow 15 child comments replies: [+] natecox@programming.dev 13 points 2 months ago* (last edited 1 week ago) (4 children) [deleted] permalink fedilink source parent hideshow 4 child comments replies: [–] tatterdemalion@programming.dev -1 points 2 months ago (3 children) How do you know it was built irresponsibly without reading the code, which is something you should be doing when adopting a dependency anyway? permalink fedilink source parent hideshow 3 child comments replies: [+] natecox@programming.dev 3 points 2 months ago* (last edited 1 week ago) (2 children) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] tatterdemalion@programming.dev -2 points 2 months ago (1 child) You don't know the direct impact of this project on data center usage because you haven't observed the development process. And you don't know whether it infringes on copyright because you haven't read the code. permalink fedilink source parent hideshow 1 child comment replies: [+] natecox@programming.dev 2 points 2 months ago* (last edited 1 week ago) [deleted] permalink fedilink source parent [–] foenkyfjutschah@programming.dev 3 points 2 months ago (9 children) you got me at "responsibly" burning resources. permalink fedilink source parent hideshow 9 child comments replies: [–] Hexarei@beehaw.org 4 points 2 months ago (2 children) Not everyone uses big data center powered LLM inference though. Running some models locally uses less power than playing a video game. permalink fedilink source parent hideshow 2 child comments replies: [–] foenkyfjutschah@programming.dev 1 point 2 months ago (1 child) now where have these models been trained? permalink fedilink source parent hideshow 1 child comment replies: [–] Hexarei@beehaw.org 3 points 2 months ago The existing local models already exist, and new releases will happen because the companies want to sell you inference. They receive no profit or incentive to release the models as open weights but they do it anyway - There is no coherent ethical delimma against using them locally, as it has no effect on whether the companies will or will not be encouraged to do more training. permalink fedilink source parent [–] floofloof@lemmy.ca [S] 1 point 2 months ago* (5 children) I'm using it locally, with models my existing computer can handle. I think, but I'm not sure, that it's better for the environment than buying into some massive model hosted in a data centre. And I don't want to lose my skills so I still try to do as much as I can without calling on it. permalink fedilink source parent hideshow 5 child comments replies: [–] HoloPengin@lemmy.world 2 points 2 months ago* (1 child) I will say that using a super efficient cloud model (deepseek for me, v4 flash is very cheap) is probably more efficient than using a local model in most cases, especially if you need strong capabilities. The question is whether your own grid or the provider's grid is more environmentally friendly (hint: china's energy mix is about 50% fossil fuels while the US's mix is around 75% fossil fuels overall) Training is of course expensive still, but Chinese labs have all but caught up to US labs despite much lower compute resources being available to them. permalink fedilink source parent hideshow 1 child comment replies: [–] floofloof@lemmy.ca [S] 1 point 2 months ago That's a fair point. Where I am is about 28% fossil fuels I believe, so it's a slightly different calculation. permalink fedilink source parent [–] foenkyfjutschah@programming.dev 1 point 2 months ago (2 children) did you generate your model locally? permalink fedilink source parent hideshow 2 child comments replies: [–] floofloof@lemmy.ca [S] 1 point 2 months ago (1 child) No, and I do understand that training is the most energy-intensive part of the process. I don't know how exactly it divides up: how much of the work of massive data centres is training and how much is running people's queries on finished models. permalink fedilink source parent hideshow 1 child comment replies: [–] foenkyfjutschah@programming.dev 1 point 2 months ago maybe ask the vendor to let him pay the actual cost plus a proper profit margin to figure that out? permalink fedilink source parent
[–] floofloof@lemmy.ca [S] 0 points 2 months ago* (15 children) These days we have to expect many projects will have them. It's really a question of how responsibly and carefully AI is used. Some people just throw in their requirements, have the AI spit out code, do a cursory check to see if it seems to work, and that's it. Other people take responsibility for the architecture and the code quality, using AI in a focused way and reviewing the results carefully. I'd look at the quality of the architecture and code before judging. I confess I have not done that yet with this one; I just thought it sounded potentially interesting. There are quite a few ways to write web applications with Rust these days, and while this sounds like it has potential, I'd still pick frameworks that are a little more mature for my own projects. permalink fedilink source parent hideshow 15 child comments replies: [+] natecox@programming.dev 13 points 2 months ago* (last edited 1 week ago) (4 children) [deleted] permalink fedilink source parent hideshow 4 child comments replies: [–] tatterdemalion@programming.dev -1 points 2 months ago (3 children) How do you know it was built irresponsibly without reading the code, which is something you should be doing when adopting a dependency anyway? permalink fedilink source parent hideshow 3 child comments replies: [+] natecox@programming.dev 3 points 2 months ago* (last edited 1 week ago) (2 children) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] tatterdemalion@programming.dev -2 points 2 months ago (1 child) You don't know the direct impact of this project on data center usage because you haven't observed the development process. And you don't know whether it infringes on copyright because you haven't read the code. permalink fedilink source parent hideshow 1 child comment replies: [+] natecox@programming.dev 2 points 2 months ago* (last edited 1 week ago) [deleted] permalink fedilink source parent [–] foenkyfjutschah@programming.dev 3 points 2 months ago (9 children) you got me at "responsibly" burning resources. permalink fedilink source parent hideshow 9 child comments replies: [–] Hexarei@beehaw.org 4 points 2 months ago (2 children) Not everyone uses big data center powered LLM inference though. Running some models locally uses less power than playing a video game. permalink fedilink source parent hideshow 2 child comments replies: [–] foenkyfjutschah@programming.dev 1 point 2 months ago (1 child) now where have these models been trained? permalink fedilink source parent hideshow 1 child comment replies: [–] Hexarei@beehaw.org 3 points 2 months ago The existing local models already exist, and new releases will happen because the companies want to sell you inference. They receive no profit or incentive to release the models as open weights but they do it anyway - There is no coherent ethical delimma against using them locally, as it has no effect on whether the companies will or will not be encouraged to do more training. permalink fedilink source parent [–] floofloof@lemmy.ca [S] 1 point 2 months ago* (5 children) I'm using it locally, with models my existing computer can handle. I think, but I'm not sure, that it's better for the environment than buying into some massive model hosted in a data centre. And I don't want to lose my skills so I still try to do as much as I can without calling on it. permalink fedilink source parent hideshow 5 child comments replies: [–] HoloPengin@lemmy.world 2 points 2 months ago* (1 child) I will say that using a super efficient cloud model (deepseek for me, v4 flash is very cheap) is probably more efficient than using a local model in most cases, especially if you need strong capabilities. The question is whether your own grid or the provider's grid is more environmentally friendly (hint: china's energy mix is about 50% fossil fuels while the US's mix is around 75% fossil fuels overall) Training is of course expensive still, but Chinese labs have all but caught up to US labs despite much lower compute resources being available to them. permalink fedilink source parent hideshow 1 child comment replies: [–] floofloof@lemmy.ca [S] 1 point 2 months ago That's a fair point. Where I am is about 28% fossil fuels I believe, so it's a slightly different calculation. permalink fedilink source parent [–] foenkyfjutschah@programming.dev 1 point 2 months ago (2 children) did you generate your model locally? permalink fedilink source parent hideshow 2 child comments replies: [–] floofloof@lemmy.ca [S] 1 point 2 months ago (1 child) No, and I do understand that training is the most energy-intensive part of the process. I don't know how exactly it divides up: how much of the work of massive data centres is training and how much is running people's queries on finished models. permalink fedilink source parent hideshow 1 child comment replies: [–] foenkyfjutschah@programming.dev 1 point 2 months ago maybe ask the vendor to let him pay the actual cost plus a proper profit margin to figure that out? permalink fedilink source parent
[+] natecox@programming.dev 13 points 2 months ago* (last edited 1 week ago) (4 children) [deleted] permalink fedilink source parent hideshow 4 child comments replies: [–] tatterdemalion@programming.dev -1 points 2 months ago (3 children) How do you know it was built irresponsibly without reading the code, which is something you should be doing when adopting a dependency anyway? permalink fedilink source parent hideshow 3 child comments replies: [+] natecox@programming.dev 3 points 2 months ago* (last edited 1 week ago) (2 children) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] tatterdemalion@programming.dev -2 points 2 months ago (1 child) You don't know the direct impact of this project on data center usage because you haven't observed the development process. And you don't know whether it infringes on copyright because you haven't read the code. permalink fedilink source parent hideshow 1 child comment replies: [+] natecox@programming.dev 2 points 2 months ago* (last edited 1 week ago) [deleted] permalink fedilink source parent
[–] tatterdemalion@programming.dev -1 points 2 months ago (3 children) How do you know it was built irresponsibly without reading the code, which is something you should be doing when adopting a dependency anyway? permalink fedilink source parent hideshow 3 child comments replies: [+] natecox@programming.dev 3 points 2 months ago* (last edited 1 week ago) (2 children) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] tatterdemalion@programming.dev -2 points 2 months ago (1 child) You don't know the direct impact of this project on data center usage because you haven't observed the development process. And you don't know whether it infringes on copyright because you haven't read the code. permalink fedilink source parent hideshow 1 child comment replies: [+] natecox@programming.dev 2 points 2 months ago* (last edited 1 week ago) [deleted] permalink fedilink source parent
[+] natecox@programming.dev 3 points 2 months ago* (last edited 1 week ago) (2 children) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] tatterdemalion@programming.dev -2 points 2 months ago (1 child) You don't know the direct impact of this project on data center usage because you haven't observed the development process. And you don't know whether it infringes on copyright because you haven't read the code. permalink fedilink source parent hideshow 1 child comment replies: [+] natecox@programming.dev 2 points 2 months ago* (last edited 1 week ago) [deleted] permalink fedilink source parent
[–] tatterdemalion@programming.dev -2 points 2 months ago (1 child) You don't know the direct impact of this project on data center usage because you haven't observed the development process. And you don't know whether it infringes on copyright because you haven't read the code. permalink fedilink source parent hideshow 1 child comment replies: [+] natecox@programming.dev 2 points 2 months ago* (last edited 1 week ago) [deleted] permalink fedilink source parent
[+] natecox@programming.dev 2 points 2 months ago* (last edited 1 week ago) [deleted] permalink fedilink source parent
[–] foenkyfjutschah@programming.dev 3 points 2 months ago (9 children) you got me at "responsibly" burning resources. permalink fedilink source parent hideshow 9 child comments replies: [–] Hexarei@beehaw.org 4 points 2 months ago (2 children) Not everyone uses big data center powered LLM inference though. Running some models locally uses less power than playing a video game. permalink fedilink source parent hideshow 2 child comments replies: [–] foenkyfjutschah@programming.dev 1 point 2 months ago (1 child) now where have these models been trained? permalink fedilink source parent hideshow 1 child comment replies: [–] Hexarei@beehaw.org 3 points 2 months ago The existing local models already exist, and new releases will happen because the companies want to sell you inference. They receive no profit or incentive to release the models as open weights but they do it anyway - There is no coherent ethical delimma against using them locally, as it has no effect on whether the companies will or will not be encouraged to do more training. permalink fedilink source parent [–] floofloof@lemmy.ca [S] 1 point 2 months ago* (5 children) I'm using it locally, with models my existing computer can handle. I think, but I'm not sure, that it's better for the environment than buying into some massive model hosted in a data centre. And I don't want to lose my skills so I still try to do as much as I can without calling on it. permalink fedilink source parent hideshow 5 child comments replies: [–] HoloPengin@lemmy.world 2 points 2 months ago* (1 child) I will say that using a super efficient cloud model (deepseek for me, v4 flash is very cheap) is probably more efficient than using a local model in most cases, especially if you need strong capabilities. The question is whether your own grid or the provider's grid is more environmentally friendly (hint: china's energy mix is about 50% fossil fuels while the US's mix is around 75% fossil fuels overall) Training is of course expensive still, but Chinese labs have all but caught up to US labs despite much lower compute resources being available to them. permalink fedilink source parent hideshow 1 child comment replies: [–] floofloof@lemmy.ca [S] 1 point 2 months ago That's a fair point. Where I am is about 28% fossil fuels I believe, so it's a slightly different calculation. permalink fedilink source parent [–] foenkyfjutschah@programming.dev 1 point 2 months ago (2 children) did you generate your model locally? permalink fedilink source parent hideshow 2 child comments replies: [–] floofloof@lemmy.ca [S] 1 point 2 months ago (1 child) No, and I do understand that training is the most energy-intensive part of the process. I don't know how exactly it divides up: how much of the work of massive data centres is training and how much is running people's queries on finished models. permalink fedilink source parent hideshow 1 child comment replies: [–] foenkyfjutschah@programming.dev 1 point 2 months ago maybe ask the vendor to let him pay the actual cost plus a proper profit margin to figure that out? permalink fedilink source parent
[–] Hexarei@beehaw.org 4 points 2 months ago (2 children) Not everyone uses big data center powered LLM inference though. Running some models locally uses less power than playing a video game. permalink fedilink source parent hideshow 2 child comments replies: [–] foenkyfjutschah@programming.dev 1 point 2 months ago (1 child) now where have these models been trained? permalink fedilink source parent hideshow 1 child comment replies: [–] Hexarei@beehaw.org 3 points 2 months ago The existing local models already exist, and new releases will happen because the companies want to sell you inference. They receive no profit or incentive to release the models as open weights but they do it anyway - There is no coherent ethical delimma against using them locally, as it has no effect on whether the companies will or will not be encouraged to do more training. permalink fedilink source parent
[–] foenkyfjutschah@programming.dev 1 point 2 months ago (1 child) now where have these models been trained? permalink fedilink source parent hideshow 1 child comment replies: [–] Hexarei@beehaw.org 3 points 2 months ago The existing local models already exist, and new releases will happen because the companies want to sell you inference. They receive no profit or incentive to release the models as open weights but they do it anyway - There is no coherent ethical delimma against using them locally, as it has no effect on whether the companies will or will not be encouraged to do more training. permalink fedilink source parent
[–] Hexarei@beehaw.org 3 points 2 months ago The existing local models already exist, and new releases will happen because the companies want to sell you inference. They receive no profit or incentive to release the models as open weights but they do it anyway - There is no coherent ethical delimma against using them locally, as it has no effect on whether the companies will or will not be encouraged to do more training. permalink fedilink source parent
[–] floofloof@lemmy.ca [S] 1 point 2 months ago* (5 children) I'm using it locally, with models my existing computer can handle. I think, but I'm not sure, that it's better for the environment than buying into some massive model hosted in a data centre. And I don't want to lose my skills so I still try to do as much as I can without calling on it. permalink fedilink source parent hideshow 5 child comments replies: [–] HoloPengin@lemmy.world 2 points 2 months ago* (1 child) I will say that using a super efficient cloud model (deepseek for me, v4 flash is very cheap) is probably more efficient than using a local model in most cases, especially if you need strong capabilities. The question is whether your own grid or the provider's grid is more environmentally friendly (hint: china's energy mix is about 50% fossil fuels while the US's mix is around 75% fossil fuels overall) Training is of course expensive still, but Chinese labs have all but caught up to US labs despite much lower compute resources being available to them. permalink fedilink source parent hideshow 1 child comment replies: [–] floofloof@lemmy.ca [S] 1 point 2 months ago That's a fair point. Where I am is about 28% fossil fuels I believe, so it's a slightly different calculation. permalink fedilink source parent [–] foenkyfjutschah@programming.dev 1 point 2 months ago (2 children) did you generate your model locally? permalink fedilink source parent hideshow 2 child comments replies: [–] floofloof@lemmy.ca [S] 1 point 2 months ago (1 child) No, and I do understand that training is the most energy-intensive part of the process. I don't know how exactly it divides up: how much of the work of massive data centres is training and how much is running people's queries on finished models. permalink fedilink source parent hideshow 1 child comment replies: [–] foenkyfjutschah@programming.dev 1 point 2 months ago maybe ask the vendor to let him pay the actual cost plus a proper profit margin to figure that out? permalink fedilink source parent
[–] HoloPengin@lemmy.world 2 points 2 months ago* (1 child) I will say that using a super efficient cloud model (deepseek for me, v4 flash is very cheap) is probably more efficient than using a local model in most cases, especially if you need strong capabilities. The question is whether your own grid or the provider's grid is more environmentally friendly (hint: china's energy mix is about 50% fossil fuels while the US's mix is around 75% fossil fuels overall) Training is of course expensive still, but Chinese labs have all but caught up to US labs despite much lower compute resources being available to them. permalink fedilink source parent hideshow 1 child comment replies: [–] floofloof@lemmy.ca [S] 1 point 2 months ago That's a fair point. Where I am is about 28% fossil fuels I believe, so it's a slightly different calculation. permalink fedilink source parent
[–] floofloof@lemmy.ca [S] 1 point 2 months ago That's a fair point. Where I am is about 28% fossil fuels I believe, so it's a slightly different calculation. permalink fedilink source parent
[–] foenkyfjutschah@programming.dev 1 point 2 months ago (2 children) did you generate your model locally? permalink fedilink source parent hideshow 2 child comments replies: [–] floofloof@lemmy.ca [S] 1 point 2 months ago (1 child) No, and I do understand that training is the most energy-intensive part of the process. I don't know how exactly it divides up: how much of the work of massive data centres is training and how much is running people's queries on finished models. permalink fedilink source parent hideshow 1 child comment replies: [–] foenkyfjutschah@programming.dev 1 point 2 months ago maybe ask the vendor to let him pay the actual cost plus a proper profit margin to figure that out? permalink fedilink source parent
[–] floofloof@lemmy.ca [S] 1 point 2 months ago (1 child) No, and I do understand that training is the most energy-intensive part of the process. I don't know how exactly it divides up: how much of the work of massive data centres is training and how much is running people's queries on finished models. permalink fedilink source parent hideshow 1 child comment replies: [–] foenkyfjutschah@programming.dev 1 point 2 months ago maybe ask the vendor to let him pay the actual cost plus a proper profit margin to figure that out? permalink fedilink source parent
[–] foenkyfjutschah@programming.dev 1 point 2 months ago maybe ask the vendor to let him pay the actual cost plus a proper profit margin to figure that out? permalink fedilink source parent
[–] idealpink@feddit.nu 1 point 2 months ago Looks like pretty nice dx. Will keep an eye out permalink fedilink source
all 18 comments