tech
Tokens or humans? The new corporate trade-off
AI is costing far more than companies expected, forcing CFOs into a new trade-off between tokens and humans and posing a risk the market hasn't priced in.
TL;DR
- Enterprise AI budgets are being exhausted rapidly, with annual budgets depleted in one to two months.
- The cost of AI, particularly per token, has increased with each new model release.
- Companies are now facing a trade-off between investing in AI technology and maintaining human staff.
- AI's inefficiency means its current value generation lags behind business costs.
- A significant portion of enterprise AI usage (95%) relies on expensive frontier models for tasks that could be handled by cheaper alternatives.
- Optimizing AI spend involves routing tasks to the most cost-effective model, offering potential for substantial savings.