Are the costs of AI agents also rising exponentially? (2025)
3 days ago
- #AI Costs
- #Time Horizon
- #Exponential Growth
- The METR time horizon trend shows exponential growth in the length of tasks AI agents can perform, but the cost of achieving these tasks is often overlooked.
- Costs may also be rising exponentially due to increasing model sizes (parameters) and compute usage (tokens), potentially making cutting-edge AI less cost-competitive with humans.
- The 'hourly' cost of AI agents is defined as the cost to complete a task at the model's 50% time horizon divided by the task duration in human hours, revealing significant variations.
- Analysis of METR's cost-performance chart indicates that even the best hourly rates for AI agents vary widely, from $0.40 to $40 per hour, with some models approaching or exceeding human costs at peak performance.
- There is evidence of a positive correlation between task duration and cost, suggesting that future AI capabilities might be economically impractical initially, lagging behind METR's headline trend.