606
top 50 comments
sorted by: hot top new old
[-] TheFeatureCreature@lemmy.ca 148 points 2 weeks ago

Lol. Lmao even. Rofl perhaps.

[-] ivanafterall@lemmy.world 30 points 2 weeks ago

But it stops clearly short of roflmao, I infer?

[-] gedfromgont@piefed.ca 23 points 2 weeks ago
[-] some_kind_of_guy@lemmy.world 27 points 2 weeks ago

The roflcopter has left the pad. No sleep til LOLWTFBBQ

load more comments (3 replies)
[-] alansuspect@quokk.au 13 points 2 weeks ago
[-] dgriffith@aussie.zone 11 points 2 weeks ago

Roflcopter?

Hey hey hey hey hey whoa whoa let's just keep the big guns in reserve for now, ok?

load more comments (1 replies)
[-] buddascrayon@lemmy.world 12 points 2 weeks ago

Albuquerque New Mexico...

IYKYK

[-] Supamanc@sopuli.xyz 8 points 2 weeks ago

Albuquerque New Mexico period period period exclamation mark

load more comments (1 replies)
[-] adespoton@lemmy.ca 86 points 2 weeks ago

Something I’ve been noticing recently is that while the cost per token on specific models hasn’t gone up, the provided interfaces for using those models are starting to chew up significantly larger numbers of tokens for the same tasks that used fewer tokens with older versions of the interface software just a few months ago. Likely the interfaces are applying more expensive guardrail prompts and charging the end user for those tokens — but the end result is that it costs 4x as much to get the same work done.

[-] Zwuzelmaus@feddit.org 19 points 2 weeks ago

"Tokens" are just made up.

These "tokens" that are used to "measure" how much you use, they are not a real dimension that can be measured. Just an artificial counter that goes up when they decide that it should go up.

They can change the "size" of a "token" every day, and every second, and every microsecond....

[-] some_kind_of_guy@lemmy.world 53 points 2 weeks ago* (last edited 2 weeks ago)

Not entirely wrong, but tokens are not just "fake" in the way, for example, an in-game currency is. They're the fundamental "units" of data, both input and output, processed by the model. For most models, tokens are just a certain number of characters or words. So they're not completely untethered from the model. If we're both using Clankerbot v5.1: Sloppy Logic Edition™️, your tokens are defined in the same way mine are.

This is near the edge of my limited understanding, but AFAIK, yeah they can mess with token costs and billing schemes all they want. They could theoretically charge us 2 different costs per token, or do surge pricing or some shit.

if they wanted to change the actual size/definition of what a token is though, that would require a whole new model (or at least a major revision).

[-] Zwuzelmaus@feddit.org 24 points 2 weeks ago

You aren't totally wrong. Such a unit exists and it is also called tokens, that can measure the capability of a model and the size of a running operation in a model.

But what they use for calculating your bill is something different today.

[-] hubobes@sh.itjust.works 10 points 2 weeks ago

That doesn't make much sense. When Anthropic moved to Sonnet 5 they introduced a new tokenizer which increased token use up to 35%. If these would be unrelated kinds of tokens why would the usage go up when the process of tokenization changes?

load more comments (1 replies)
load more comments (1 replies)
[-] nitroemdash@lemmy.wtf 17 points 2 weeks ago

Tokens are well-defined groups of bytes ranged by frequency of occurrence in texts to efficiently translate them into a sequence of 32 or 64-bit binary integers, an LLM-optimised form if compression. They are well-known, you can play with them here: https://gpt-tokenizer.dev/

[-] keimevo@lemmy.world 6 points 2 weeks ago

It's not like that. Tokens are an inherent computational property of how a model calculates the probabilities and such to generate text.

Having said that, what a token means in terms of computation varies wildly between models and is not directly comparable. So attributing a money value to tokens in general, independently of the model, is weird by nature.

And even within a model, the number of tokens needed to generate a response is very variable too, depending of the model itself and the parameters with which it has been configured (thinking mode, temperature, etc.).

So yeah, companies can pretty much set any price they want and there's not much anyone can do about it.

load more comments (1 replies)
[-] floofloof@lemmy.ca 6 points 2 weeks ago

Maybe you're confusing tokens with the "credits" you pay for. Tokens have a technical meaning, but some companies are charging per AI credit, where they don't tell you the conversion rate of credits to tokens, so they can change this at any time, or vary it between models, etc.

load more comments (8 replies)
[-] _wizard@lemmy.world 10 points 2 weeks ago

My CLAUDE.md file bloated significantly. It tried to load unnecessary skills and would retain throughout the whole session. Fixing that, maintaining good wikis and using clear often really helped fixed my personal token burn.

load more comments (7 replies)
load more comments (3 replies)
[-] Zulu@lemmy.world 61 points 2 weeks ago

How is it too expensive? Surely it's generating way more profit than it would cost in value. How else could it be propping up the entire economy?

Itd have to be some kind of bubble and that would mean we were in a lottttt of danger and should reasses our use of it.

Nah we should just reduce our use because its too expensive and then stop thinking about it beyond that.

[-] grue@lemmy.world 19 points 2 weeks ago

Itd have to be some kind of bubble and that would mean we were in a lottttt of danger and should reasses our use of it.

Well yeah, but if it were the only sector propping up the whole economy and we reassessed it, the economy would be in a loooooot of danger anyway.

Luckily, that would never happen...

load more comments (2 replies)
[-] funkyshoe@piefed.social 35 points 2 weeks ago

That's funny now that whole workflows are automated with it. Oops hit the quota, I'm off

[-] grue@lemmy.world 23 points 2 weeks ago

You mean those workflows that could've been traditional scripting and CI/CD, if not for management forcing AI into them? Those workflows?

[-] funkyshoe@piefed.social 8 points 2 weeks ago

Those workflows

load more comments (2 replies)
[-] dgriffith@aussie.zone 6 points 2 weeks ago* (last edited 2 weeks ago)

"Sorry boss, quota resets this evening at 8. See you tomorrow!"

"But it's 9am!"

*shrugs* "Quota. Got none. Seeya."

load more comments (1 replies)
load more comments (1 replies)
[-] WolfmanEightySix@piefed.social 32 points 1 week ago

I’m confused. I thought employers loved AI and it was the future.

[-] dustyData@lemmy.world 10 points 1 week ago* (last edited 1 week ago)

They loved it too much and now it costs more than paying a living wage to a human being. The end goal of AI was always to cut cost and layoff people. The best sabotage right now is to setup a script that constantly prompts an LLM for something useless. I would recommend it if it didn't waste so much energy and clean water. But it would send a message. AI is not cheaper, it never was. Even with today's outrageous token prices, LLM companies are still bleeding money per user. It will only get more expensive as data center contracts fall through and the investment craze fizzles out.

[-] Tollana1234567@lemmy.today 7 points 1 week ago

the AI companies are hoping the ones buying the LLM subscriptions to be the suckers and losers.

load more comments (2 replies)
[-] DupaCycki@lemmy.world 8 points 1 week ago

They love money. AI was good money for a while. Or at least it looked like good money until you looked at it for longer than 3 seconds, which greatly surpasses the average attention span of an executive. And also the average executive's iq.

load more comments (2 replies)
[-] jaykrown@lemmy.world 32 points 2 weeks ago

This is actually how the bubble begins to pop, we're seeing it happen now.

load more comments (1 replies)
[-] GoatSynagogue@lemmy.world 29 points 2 weeks ago
load more comments (1 replies)
[-] iltoroargento@startrek.website 22 points 2 weeks ago

We can only hope this helps kill the fad. I know companies won't be taking any realistic lesson from this, but at least this can force them to abandon a lot of this crap.

[-] BarneyPiccolo@lemmy.today 18 points 2 weeks ago

All over America, employees are saying "But YOU said..."

[-] aloofPenguin@piefed.world 18 points 2 weeks ago

I smell a bubble about to burst...

[-] Goldholz@lemmy.blahaj.zone 10 points 2 weeks ago

Im drooling over that idea

[-] angstylittlecatboy@reddthat.com 16 points 2 weeks ago

Uplifting News

[-] phutatorius@lemmy.zip 13 points 1 week ago

So it has a negative ROI and anyone who brought it into their firm is a clueless twat who uncritically bought a sales pitch.

If corporate governance were not a joke, C-level heads would roll.

[-] DarkCloud@lemmy.world 12 points 2 weeks ago* (last edited 2 weeks ago)

The millionaires following the stupidity of billionaires and wondering why they're not becoming billionaires too.

Give them 50 years and maybe they'll start to wonder why people doing "how to get rich" seminars aren't retiring... And why podcasters telling everyone how to get women seem like such losers.

[-] Eternal192@anarchist.nexus 12 points 2 weeks ago

This is why these companies should go bankrupt.

We had a system that works and they thought if they got rid of the actual workforce with the needed knowledge and replace them with lower paid AI retards it would make them more money, fucking karma.

load more comments (2 replies)
[-] chilicheeselies@lemmy.world 11 points 2 weeks ago

I don't really understand how people are using so many tokens. At work I haven't even hit $200 I spend per month. Wtf are people doing with these things that burns so many tokens?

[-] ThirdConsul@lemmy.zip 18 points 1 week ago* (last edited 1 week ago)

If you run "agentic coding harness" or any kind of goal oriented loop then tokens goe brrrr.

And LLM sellers are pushing for that (duh), as they managed to convince people to use infinite monkeys typewriting until they make Hamled.

(Type made on purpose)

[-] fyzzlefry@retrolemmy.com 11 points 1 week ago

I do it on purpose

[-] FlexibleToast@lemmy.world 6 points 1 week ago

Some companies had leaderboards and encouraged AI usage until they got their bills.

[-] ammonium@lemmy.world 6 points 1 week ago

A big context costs a lot more

load more comments (21 replies)
[-] muusemuuse@sh.itjust.works 10 points 2 weeks ago

What’s this echoey sound? As if someone warned us about this exact fucking thing.

Curious.

[-] SharkAttak@kbin.melroy.org 10 points 2 weeks ago

The first half of the title got me worried...

load more comments (2 replies)
[-] ms_lane@lemmy.world 7 points 2 weeks ago

Maybe they should get AI to do the AI prompts so they can cut down on costs XD

[-] julysfire@lemmy.world 7 points 1 week ago

My company recently converted our PMs into Vine Engineers right after laying off actual engineers. They don't even know what git is or how to use it. 3 of them alone are using $7k a month in Claude tokens and they have not raised so much as a single PR.

load more comments (1 replies)
load more comments
view more: next ›
this post was submitted on 03 Jul 2026
606 points (99.2% liked)

Technology

86401 readers
2808 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS