1104
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 08 Jul 2026
1104 points (99.6% liked)
Technology
86160 readers
3854 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
Have you heard about "Tokenmaxxing"?
Since many AI companies didn't have a reasonable limit on the number of tokens for the amount of money you paid, companies started telling their employees to use as many tokens as possible. LLMs improve with more tokens (although there are diminishing returns).
So users tried to exploit the 'lure offer', and AI companies had to change the billing. It's still below the real cost, but no longer this insanely expensive option.
It's particularly funny because I'm pretty sure AI companies are still selling the service below cost to try to retain market share (and drive small competitors out of business). They just aren't taking quite as big a loss on every token with the increased prices.
Pretty much the model for so many internet services or streaming services.
Yeah. It certainly pays off sometimes. Amazon did it. It just, y'know, also crashes and burns sometimes, and I'm not sanguine about the way this is shifting its investment money from venture capitalists to, y'know, passive index fund investors.
So, they're earning money on token generation but not overall (including training)?
Openai had 2025 6billion in revenue and 20 billion costs on compute. So just to run the models to get 6billion they need to pay 20billion r&d and marketing etc get on top of that
I’m sure there’s a term for it but this is like when a company keeps securing funding from investors so they keep growing to try to outpace costs with the illusion that you’re profitable when in reality you’re not. Just like WeWork.
It's just a Ponzi scheme with extra steps.
Venture capital
Private credit. Get ready for the tsunami.
No, my understanding is that they're bringing in revenue on token generation, but it's exceeded by the costs of token generation (running data centers, so, electricity and cooling). They definitely want to make a profit on token generation, but they're afraid that raising costs that high too quickly would drive customers to switch to other providers. So they've reduced the amount they're subsidizing token costs, but not switched over to making a profit.
I can't find a good citation for this, though, so it's possible I'm mistaken. They also have huge costs associated with buying new GPUs and building new datacenters, so they're operating at a massive loss either way, and it's a little hard to find articles which tease apart the two aspects.
In any case, operating at a massive loss for the first few years is practically standard operating procedure in silicon valley at this point, and sometimes it eventually leads to a profitable, even wildly profitable, business (e.g. Amazon). But it does require a steady stream of investors and a steadily increasing market valuation. That's...we'll have to see what happens on that front.
Yeah it’s basically the enshitification model
With the quirk that the service was shit to begin with.
Maybe but it’s like crack for CEOs
It's just newsworthy when it happens to companies.
Is this real life, or is it just fantasy?
It’s such a perfect grift