Margin, not growth, is the real scoreboard in AI software

Growth used to be the scoreboard in software. In the AI era, it is table stakes, and the metric that actually separates businesses from bonfires is gross margin.

The pattern is visible across the datasets we have covered this week. Bessemer’s State of AI puts its fastest cohort, the Supernovas that reach $100 million ARR in about 18 months, at roughly 25 percent gross margins, with sometimes fragile retention. Its steadier Shooting Stars run near 60 percent. And the standouts in health AI clear 70 percent with software-like economics. Same revenue milestone, three completely different businesses.

Why AI margins run thin

Classic SaaS sold software that cost almost nothing to serve. AI products carry a cost of goods that scales with usage: every request burns inference. When the product is a thin layer over a foundation model, the margin belongs to the model provider and the cloud, not the application. Thicker products, with proprietary workflows, data advantages and the ability to route work to cheaper models, keep more of it.

The questions that now matter in diligence

Three replace the old growth worship. What is the fully loaded inference cost per dollar of revenue, and is it falling? Does retention hold when the novelty fades? And can the company swap underlying models without rewriting the product, the application-layer version of the lock-in problem enterprises face? Margins answer whether a company owns its economics or rents them.

What to watch

Watch whether falling inference prices flow to application margins or get competed away, and whether the first Supernova to IPO gets priced like software or like a reseller. That listing will set the multiple for the whole cohort. Two recent moves show the margin question playing out in real time: Cursor pricing its in-house coding model at a tenth of frontier rates, and OpenAI shifting Codex to consumption billing, both bets that owning unit economics beats subsidizing usage indefinitely.