Training a model costs once. Inference costs every day, every user, every agent. That simple sentence describes the silent inversion that rewrote the economics of AI over the last three years. We have watched this shift up close with corporate clients — and the signal is unanimous: whoever still budgets AI as a one-time training cost is budgeting the project wrong.
The silent inversion of the center of gravity
In 2023, training was the bottleneck. Whoever had GPU dominated the game. Inference was residual, about one-third of AI compute. The reading changed fast. According to Deloitte, in TMT Predictions 2026, inference went from 33% to two-thirds of all AI compute. In three years, the center of gravity migrated from training to inference.
The shift is not only technical — it is financial. The FinOps Foundation sees the same curve in the wallet. According to the State of FinOps 2026, inference accounts for 80 to 90% of total AI spend in production. Training is still necessary, but it became residual CapEx. Inference became perpetual OpEx.
Training is CapEx. Inference is perpetual OpEx.
The distinction matters for budgeting. Training a model is a capital investment with a beginning, middle, and end: you provision GPU, train, validate, archive the checkpoint. The cost is finite and predictable. Inference is the opposite: every active user, every document processed, every agent executed generates tokens. The cost compounds monthly and grows with real product usage.
That is why the pilot costs little and production surprises. The pilot runs with few users, few workloads, few agents. Production scales with every active user and every new integration. Inference cost is not linear in time — it is linear in usage, and usage only grows when the product works.
The multiplier is agentic
The factor that accelerates the flip is the agentic multiplier. According to McKinsey, in July, agentic tasks consume about 1,000 times more tokens than chat or code-reasoning tasks. According to Gartner, in March, that is 5 to 30 times more tokens than a standard chatbot, per task. The numbers do not contradict each other — they measure different comparisons. McKinsey compares agents against chat and code-reasoning; Gartner compares agents against a standard chatbot. Both point in the same direction: agents change the order of magnitude of token consumption.
Budgeting against the chatbot baseline is the most common mistake. The team projects cost based on simple chat interactions, launches an autonomous agent in production, and discovers that real consumption is 10x or 100x higher. The agentic multiplier has to enter the TCO before any architecture decision.
The bill nobody calculated
The data confirms the shock. According to Gartner, 58% of companies exceeded AI cost estimates by 40% or more. According to IDC, 96% of organizations reported AI infrastructure costs higher than expected when migrating from pilot to production. This is not an isolated problem — it is a structural pattern.
The consequence is budgetary. AI used to be an infrastructure project with a beginning, middle, and end. Today it is monthly operational cost that compounds with every customer served, every document processed, every agent executed. The financial model changed, but many budgets have not kept up.
FinOps for AI as a discipline
This is where FinOps for AI enters as a discipline. Measuring spend after it arrives is too late. The work begins before: model cost per token, per user, per workload, before the architecture commit. It means separating training from inference in budget categories, projecting TCO per workload, implementing spend governance with showback and chargeback before the bill surprises.
We, at Tech86, have been working with corporate clients at this exact point. Separate training from inference, project TCO per workload, implement spend governance before the bill surprises. The work is preventive — once inference spend shows up on the spreadsheet, the optimization lever is already reactive, not proactive.
Conclusion
The inversion already happened. Whoever still treats AI as a one-time training cost is budgeting the project wrong. Training is residual CapEx; inference is perpetual OpEx that accounts for 80 to 90% of total AI spend in production. The agentic multiplier amplifies the problem by orders of magnitude. FinOps for AI is not optional — it is the discipline that separates those who scale AI with predictability from those who discover the cost only when the bill arrives.