Amazon launches Trainium3
9 days ago
- #AI Chips
- #Cloud Computing
- #AWS
- AWS introduced Trainium3, a new AI training chip with impressive specs.
- Trainium3 UltraServer system offers 4x faster performance and 4x more memory for AI training and inference.
- Thousands of UltraServers can be linked to provide up to 1 million Trainium3 chips, 10x the previous generation.
- Trainium3 chips and systems are 40% more energy efficient than the previous generation.
- AWS customers like Anthropic and others have significantly cut inference costs using Trainium3.
- AWS teased Trainium4, already in development, which will support Nvidia’s NVLink Fusion technology.
- Trainium4 systems will interoperate with Nvidia GPUs while using Amazon’s lower-cost server rack tech.
- No timeline announced for Trainium4, but likely updates at next year’s conference.