I don’t know if it’s still going, but they were giving out free first month sub recently. You can grab it, cancel immediately, and cost them a few hundred dollars in tokens over the month using Codex.
I mean, that was the joke for Amazon for years, but…look where they are now.
But I just don’t understand the massive hype around LLMs. The cost per 1M tokens has dropped, significantly, since 2023 or so. And I don’t think there is any reason to expect it not to continue. If you host it yourself, it’s basically free other than hardware and electricity.
Sure, with agents like claude code, you may use a bit more tokens or use it more often, etc, and the best models are more expensive. But not every task needs the best model or even a paid model at all. And people seem to be finding ways to fan out things to prefer local models for simple stuff, escalate to something paid, etc.
I just don’t get the business model at all, but maybe I’m just too stupid to understand. It’s also possible we have an Enron-style situation, but spanning multiple companies and/or industries…
Amazon was building a platform, that now they use as a rentier. Bad for society, good for Amazon.
But LLM models don’t have that. You can swap one out for another with little effort - hell, I do it daily. And with that, it means that you’re a commodity . . . which also means you can’t ever get those initial losses back if your competitor (like Chinese models) doesn’t have them.
Have you seen openrouter.ai? They are more or less based around that idea, I think. Routing to whatever is best fit - most likely on price, I’d think (?) and/or currently up.
I have not set it up myself, but I think there is a way to have opencode or the like prefer local models for certain things, then escalate to something remote (presumably paid) if needed.
Also, opencode.ai gives you so many free tokens per day on some of their models.
The cost per 1M tokens has dropped, significantly, since 2023 or so.
The problem is that it’s just not commercially viable, because you can’t just say “We make money on inference”, because that’s a stupid thing to say. That’s like saying the cash register at the supermarket is really profitable, because you sell a product for a higher price than it costs you to buy it. It may be true, but that’s not how any of this works.
You can’t just stop developing new products, because if you do, your existing product becomes worthless. If Ford just started selling their current models, they would make a lot of profit right now… and then none in a few years as their competitors sell newer, fancier cars. If OpenAI stops training new models, they will make a lot of money right now, and then nothing in 3 to 6 months from now.
Token pricing could double, and be free for OpenAI, and it still wouldn’t save them, because you can’t judge a business on how much money they earn at the cash register.
I just don’t get the business model at all, but maybe I’m just too stupid to understand
There is no businessmodel. The trick to keep burning cash, keep the stock high, keep the compensation for the people at the top flowing. The company can burn all the capital it wants, because the people at the top will keep getting paid.
One layer below that, there’s a whole bunch of business idiots who think LLMs will let them save on paying their employees, so they’re very invested in it.
One layer below that are a bunch of senior managemers who are just as stupid, but whose performance goals were just tied LLM use, so they’ve got a great reason to push it on everyone.
I mean, that was the joke for Amazon for years, but…look where they are now.
indeed, i refused to buy stock because it was costing $1 to make 80c in sales, what sort of business is that? and yet here we are, to be fair their cloud business is the big profit centre and that came later
OpenAI is starting to look like the world’s most expensive experiment in proving that revenue and profitability are two very different things. The technology is impressive, but if every new customer brings another mountain of computing costs, scaling up might just mean losing money faster.
According to their own plans they expect to lose several hundred billions between 2026-2030, but revenue will catch up to the losses somewhere along the way?
$10b revenue for quarter ($40b annualized), with claim of $50b annualized for september (not october claimed in OP)
It is also having massive fundraising problems, getting $11b-$15b out of targetted $30b, covering about 1 quarter of losses ($10.5b this quarter up despite about 50% revenue growth over last quarter). It’s forced compute spending increasing a lot next quarter, and then it pays Oracle $15b/quarter extra for compute in 2027. It’s optimistic gross margins on inference at the end of the year were 50% even as they cut prices.
Industry growth is slowing overall. OpenAI would need to average 20.3% revenue growth/quarter to break even at end of 2029. That is higher than their projected 2029 revenue, which with $250b/year in forced compute purchases then, would still leave them burning $70b/year.
It’s a problem they’re running headlong into. Anthropic basically is going to suck all the money out of the market and their IPO suggests they’re going on a spending spree and will issue more debt, which makes it even tighter.
It’s going to be an absolute shitshow if it’s anything at all like dot-com bubble. Having things lose 80% of their value or go to zero even may be something edgelords think is exciting and/or hilarious, but the fallout is something all of us will feel.
What I cannot understand is that the cost per 1M of tokens keeps going down.
This stuff is converging on nearly free, especially if you don’t use the most expensive model and even more especially if you opt to host your own infrastructure and run models yourself.
As someone who doesn’t know much about their paid tiers, if you host it on your hardware, are there really some that are worth paying for vs just using one that’s available for free? I kind of assumed there wasn’t much of a difference and that’s why they were trying to ban ones who had “outside influence.”. Because in the end they’ll all be using mostly the same data sets and the differences will be who is manipulating the answers to influence the end users, which has some profit to it, but not nearly as much as they would need
I’m not an expert either. I mostly use Opus at work and I don’t pay for it - the company does. I’ve noticed Fable almost seems like a waste for a lot of tasks, so mostly I don’t use it. I’ve not tried dialing it down to Sonnet or even Haiku to see how things fare, but keep meaning to try that out.
You’ll see Fable 5.2 is at the very top with 61.1. Even Opus is 58.7.
Here, you can see the very top is 54.9 from Kimi and I’m not sure which of these you can host yourself. My understanding is that just because something is open weight doesn’t mean you can download it and in some instances, even when you can, the hardware to run it is not something exactly consumer-class (but a company might choose to build or rent that hardware themselves).
When you remember how people went gaga over this in 2022…imagine using a model that “lags” some of the top-tier stuff but applied to more mundane things - it’s not like the capabilities from 2022 or whatever evaporated. Suppose you assume you can run something at decent enough speeds, but it “lags” the others by 6 months to a year?
At some point, it just seems to me there will be diminishing returns to keep paying for the most expensive option. My company offers me Fable now and I don’t find that I need it for day to day things. For all I know, Haiku might be enough for some things.
We gotta see if any of the CEOs running these companies are connected to old money somehow (either in the US or overseas). Why can’t it ever be nice people that are running the show?
Just as DoD harrassed ANT over full skynet permissions, you don’t need old money/old politician control vectors, the bond villains just need to understand that life is easier (well paid) for them if they cooperate with skynet.
What do you consider old money when it comes to the internet age? For the last good while it seems all the money surrounding PayPal/Oracle/Amazon seem to be the medium age money now. Old might be considered Jobs/Gates.
That said Powell (Steve Jobs Wife) was appointed to the board of Skydance last month.
When you’re building an ever higher building by excavating the foundation to keep stacking things on top … eventually, you’re going to run out of material.
Comments
Fucking crash already.
If you invent something people want, they’ll buy it. If you invent something nobody wanted or asked for then you’re going to have some trouble.
Not to mention shoving it down our fucking throats!
It’s also a product that is more expensive to produce the more people actually use it.
I don’t know if it’s still going, but they were giving out free first month sub recently. You can grab it, cancel immediately, and cost them a few hundred dollars in tokens over the month using Codex.
Oh hell yeah.
Just pop already FFS
We lose money on every sale we make… but we make up for it in volume.
I mean, that was the joke for Amazon for years, but…look where they are now.
But I just don’t understand the massive hype around LLMs. The cost per 1M tokens has dropped, significantly, since 2023 or so. And I don’t think there is any reason to expect it not to continue. If you host it yourself, it’s basically free other than hardware and electricity.
Sure, with agents like claude code, you may use a bit more tokens or use it more often, etc, and the best models are more expensive. But not every task needs the best model or even a paid model at all. And people seem to be finding ways to fan out things to prefer local models for simple stuff, escalate to something paid, etc.
I just don’t get the business model at all, but maybe I’m just too stupid to understand. It’s also possible we have an Enron-style situation, but spanning multiple companies and/or industries…
Amazon was building a platform, that now they use as a rentier. Bad for society, good for Amazon.
But LLM models don’t have that. You can swap one out for another with little effort - hell, I do it daily. And with that, it means that you’re a commodity . . . which also means you can’t ever get those initial losses back if your competitor (like Chinese models) doesn’t have them.
Have you seen openrouter.ai? They are more or less based around that idea, I think. Routing to whatever is best fit - most likely on price, I’d think (?) and/or currently up.
I have not set it up myself, but I think there is a way to have opencode or the like prefer local models for certain things, then escalate to something remote (presumably paid) if needed.
Also, opencode.ai gives you so many free tokens per day on some of their models.
The problem is that it’s just not commercially viable, because you can’t just say “We make money on inference”, because that’s a stupid thing to say. That’s like saying the cash register at the supermarket is really profitable, because you sell a product for a higher price than it costs you to buy it. It may be true, but that’s not how any of this works.
You can’t just stop developing new products, because if you do, your existing product becomes worthless. If Ford just started selling their current models, they would make a lot of profit right now… and then none in a few years as their competitors sell newer, fancier cars. If OpenAI stops training new models, they will make a lot of money right now, and then nothing in 3 to 6 months from now.
Token pricing could double, and be free for OpenAI, and it still wouldn’t save them, because you can’t judge a business on how much money they earn at the cash register.
There is no businessmodel. The trick to keep burning cash, keep the stock high, keep the compensation for the people at the top flowing. The company can burn all the capital it wants, because the people at the top will keep getting paid.
One layer below that, there’s a whole bunch of business idiots who think LLMs will let them save on paying their employees, so they’re very invested in it.
One layer below that are a bunch of senior managemers who are just as stupid, but whose performance goals were just tied LLM use, so they’ve got a great reason to push it on everyone.
indeed, i refused to buy stock because it was costing $1 to make 80c in sales, what sort of business is that? and yet here we are, to be fair their cloud business is the big profit centre and that came later
“The money we lose increases volumetrically.”
They will never be profitable, it’s completely obvious at this point.
good
OpenAI is starting to look like the world’s most expensive experiment in proving that revenue and profitability are two very different things. The technology is impressive, but if every new customer brings another mountain of computing costs, scaling up might just mean losing money faster.
According to their own plans they expect to lose several hundred billions between 2026-2030, but revenue will catch up to the losses somewhere along the way?
Yes, it’s under step 2: “A miracle happens here”
It is also having massive fundraising problems, getting $11b-$15b out of targetted $30b, covering about 1 quarter of losses ($10.5b this quarter up despite about 50% revenue growth over last quarter). It’s forced compute spending increasing a lot next quarter, and then it pays Oracle $15b/quarter extra for compute in 2027. It’s optimistic gross margins on inference at the end of the year were 50% even as they cut prices.
Industry growth is slowing overall. OpenAI would need to average 20.3% revenue growth/quarter to break even at end of 2029. That is higher than their projected 2029 revenue, which with $250b/year in forced compute purchases then, would still leave them burning $70b/year.
There’s no obvious escape for OpenAI.
Where are they raking the money from? Who is giving them billions of dollar? Are all investors and CEOs dumb as a bucket?
I’m so confused.
It’s a problem they’re running headlong into. Anthropic basically is going to suck all the money out of the market and their IPO suggests they’re going on a spending spree and will issue more debt, which makes it even tighter.
I was looking at their own info on their IPO, and their profit is a negative $23.3 billion.
https://ipo.anthropic.com/us/
Bubble will be even more glorious when it bursts
It’s going to be an absolute shitshow if it’s anything at all like dot-com bubble. Having things lose 80% of their value or go to zero even may be something edgelords think is exciting and/or hilarious, but the fallout is something all of us will feel.
I don’t think it will be at all glorious.
Well, it’s a lot bigger than dot com. Concerning.
I can enjoy the failings of billionaires while being concerned for the common people at the same time.
The billionaires are going to be basically unaffected
Some of us have lived through bubbles bursting, and it’s never fun for us normal folks. You might want to temper your expectations a little bit.
Yes, I too have lived through many of those bubbles. Did it suck for me? Yes. Do I still enjoy seeing my enemies fail? Yes.
I can have it both ways even if you cannot.
I probably can because I’m most likely not in danger of losing my job and apartment. This time.
That can’t be said for everyone, and I guess I’ve got enough empathy to give a shit about that
What I cannot understand is that the cost per 1M of tokens keeps going down.
This stuff is converging on nearly free, especially if you don’t use the most expensive model and even more especially if you opt to host your own infrastructure and run models yourself.
As someone who doesn’t know much about their paid tiers, if you host it on your hardware, are there really some that are worth paying for vs just using one that’s available for free? I kind of assumed there wasn’t much of a difference and that’s why they were trying to ban ones who had “outside influence.”. Because in the end they’ll all be using mostly the same data sets and the differences will be who is manipulating the answers to influence the end users, which has some profit to it, but not nearly as much as they would need
I’m not an expert either. I mostly use Opus at work and I don’t pay for it - the company does. I’ve noticed Fable almost seems like a waste for a lot of tasks, so mostly I don’t use it. I’ve not tried dialing it down to Sonnet or even Haiku to see how things fare, but keep meaning to try that out.
If you look at leaderboards like:
https://llm-stats.com/leaderboards/llm-leaderboard
You’ll see Fable 5.2 is at the very top with 61.1. Even Opus is 58.7.
Here, you can see the very top is 54.9 from Kimi and I’m not sure which of these you can host yourself. My understanding is that just because something is open weight doesn’t mean you can download it and in some instances, even when you can, the hardware to run it is not something exactly consumer-class (but a company might choose to build or rent that hardware themselves).
https://llm-stats.com/leaderboards/open-llm-leaderboard
When you remember how people went gaga over this in 2022…imagine using a model that “lags” some of the top-tier stuff but applied to more mundane things - it’s not like the capabilities from 2022 or whatever evaporated. Suppose you assume you can run something at decent enough speeds, but it “lags” the others by 6 months to a year?
At some point, it just seems to me there will be diminishing returns to keep paying for the most expensive option. My company offers me Fable now and I don’t find that I need it for day to day things. For all I know, Haiku might be enough for some things.
Thinking the whole industry is preticated on the assumption of a government bailout in exchange for unprecedented surveillance.
We gotta see if any of the CEOs running these companies are connected to old money somehow (either in the US or overseas). Why can’t it ever be nice people that are running the show?
Just as DoD harrassed ANT over full skynet permissions, you don’t need old money/old politician control vectors, the bond villains just need to understand that life is easier (well paid) for them if they cooperate with skynet.
What do you consider old money when it comes to the internet age? For the last good while it seems all the money surrounding PayPal/Oracle/Amazon seem to be the medium age money now. Old might be considered Jobs/Gates.
That said Powell (Steve Jobs Wife) was appointed to the board of Skydance last month.
Bugatti oil changes ain’t cheap!
[deleted]
When you’re building an ever higher building by excavating the foundation to keep stacking things on top … eventually, you’re going to run out of material.
Like Jenga!
Sign in to comment. Sign in