133
submitted 6 days ago by silence7@slrpnk.net to c/climate@slrpnk.net
you are viewing a single comment's thread
view the rest of the comments
[-] Grimy@lemmy.world 16 points 6 days ago* (last edited 6 days ago)

God I hate these fake science calculation posts.

His prompts were each using 2.9 million token. That's a massive amount, he was basically purposefully using complex tasks that needed massive amounts of data parsing. We're talking about like 1 percent of users that are using 2.9 million per prompt.

The method used to calculate doesn't include batching. These companies aren't running one request per gpu here. Even the authors of the method admit it over estimates by 4 to 20x.

[-] boonhet@sopuli.xyz 9 points 6 days ago

2.9 million per prompt

Hmmmm wait a moment

The max context window of most of the big players is 1 million right now. Author almost certainly means per turn. But the whole context gets included with every prompt sent to the API. If you're using like 200k context, which is not unheard of with a large codebase and without compacting often, 2-3 million input tokens per turn to the agent is actually not THAT much. But most of it would be cached tokens, which are cheaper and presumably more energy efficient than fresh input tokens.

E.g I just had a debugging session with 6 turns, shows me about 580k input tokens, but over 20 million cached input tokens, ~60k output tokens. But it also took like an hour with all the test runs and everything. 6 prompts to a chatbot takes like a minute or two in comparison.

this post was submitted on 05 Aug 2026
133 points (98.5% liked)

Climate

8891 readers
333 users here now

Discussion of climate, how it is changing, activism around that, the politics, and the energy systems change we need in order to stabilize things.

As a starting point, the burning of fossil fuels, and to a lesser extent deforestation and release of methane are responsible for the warming in recent decades: Graph of temperature as observed with significant warming, and simulated without added greenhouse gases and other anthropogentic changes, which shows no significant warming

How much each change to the atmosphere has warmed the world: IPCC AR6 Figure 2 - Thee bar charts: first chart: how much each gas has warmed the world.  About 1C of total warming.  Second chart:  about 1.5C of total warming from well-mixed greenhouse gases, offset by 0.4C of cooling from aerosols and negligible influence from changes to solar output, volcanoes, and internal variability.  Third chart: about 1.25C of warming from CO2, 0.5C from methane, and a bunch more in small quantities from other gases.  About 0.5C of cooling with large error bars from SO2.

Recommended actions to cut greenhouse gas emissions in the near future:

Anti-science, inactivism, and unsupported conspiracy theories are not ok here.

founded 3 years ago
MODERATORS