Google tells employees it must double capacity every 6 months to meet AI demand
14 hours ago
- #Tech Competition
- #AI Infrastructure
- #Data Centers
- Google and OpenAI are struggling to build AI infrastructure fast enough to meet demand.
- Google's AI infrastructure head, Amin Vahdat, stated the company must double its serving capacity every six months.
- Google aims to scale its compute capacity by 1000x in 4-5 years while maintaining the same cost and energy levels.
- Unclear if AI demand is organic or driven by integration into existing services like Search and Gmail.
- OpenAI plans to build six massive data centers in the US, investing over $400 billion in three years.
- OpenAI faces constraints serving 800 million weekly ChatGPT users, with paid subscribers hitting usage limits.
- AI infrastructure competition is the most critical and expensive part of the AI race, according to Vahdat.
- Google's goal is to build more reliable, performant, and scalable infrastructure than competitors.