The inference cost doesn’t actually drop in reality.

My comment was about this which is just completely wrong.

OpenAI is the scummiest company on earth but everyone is ready to believe them when they say shit like "our 20$ plan lets you run up the equivalent of a billion dollars in API fees. Giggles. It's a good plan for you but not for us ;) "

The main thing bringing up costs is stuff like Sam Altman spending all the "inference" money on raw wafers just to strangle consumer GPU sales.

It's not a good business model because of how cheap inference actually is. Once you have open models and the moat is broken, the only thing left to do is regulatory capture, upping the demand for the hardware and little charades like these.