- Google's foundational AI paper 'Attention Is All You Need' introduced the transformer architecture that underpins modern AI models like ChatGPT.
- Despite nearly being disrupted by its own technology, Google continues to openly share AI research and models, such as Gemma, rather than locking them down.
- Google's strategy is not to win the 'smartest model' race but to integrate AI as ubiquitous infrastructure, like electricity, across its products and platforms.
- By embedding AI (e.g., Gemini Nano) on-device in Android, Google shifts compute costs to users' devices, reducing its own operational expenses.