▲ 724 ▼ ‘The cost of compute is far beyond the costs of the employees’: Nvidia exec says right now AI is more expensive than paying human workers (fortune.com) submitted 4 months ago by Gsus4@mander.xyz to c/world@lemmy.world 106 comments fedilink hide all child comments
[–] Knock_Knock_Lemmy_In@lemmy.world 1 point 4 months ago* (1 child) Thanks for the link, but disagree with your summary. The Spend on inference has passed the Spend on training. Training is the monopoly product and even the cheapest known model (deepseek) cost 10s of millions to train. permalink fedilink source parent hideshow 2 child comments replies: [–] porous_grey_matter@lemmy.ml 1 point 4 months ago (1 child) That's got nothing to do with how expensive it is to serve models to customers which is what was being discussed. permalink fedilink source parent hideshow 2 child comments replies: [–] Knock_Knock_Lemmy_In@lemmy.world 1 point 4 months ago We are discussing cost. There is fixed cost (training) and variable cost (inference). Both components being discussed. permalink fedilink source parent
[–] porous_grey_matter@lemmy.ml 1 point 4 months ago (1 child) That's got nothing to do with how expensive it is to serve models to customers which is what was being discussed. permalink fedilink source parent hideshow 2 child comments replies: [–] Knock_Knock_Lemmy_In@lemmy.world 1 point 4 months ago We are discussing cost. There is fixed cost (training) and variable cost (inference). Both components being discussed. permalink fedilink source parent
[–] Knock_Knock_Lemmy_In@lemmy.world 1 point 4 months ago We are discussing cost. There is fixed cost (training) and variable cost (inference). Both components being discussed. permalink fedilink source parent