How Compiler Explorer Works in 2025
a year ago
- #Compiler Explorer
- #Open Source
- #AWS Infrastructure
- Compiler Explorer processes 92 million compilations annually, scaling dynamically with AWS to handle load.
- Security measures include nsjail for process isolation, protecting against arbitrary code execution and symlink attacks.
- The platform hosts over 4TB of compilers, including niche versions like GCC 1.27 from 1987, ensuring no version is retired.
- Compiler management involves Python and shell scripts, with compilers stored on AWS EFS and accessed via NFS with squashfs optimizations.
- Daily builds of compilers are automated via GitHub Actions, with installations happening early morning, though synchronization is currently ad hoc.
- Supports a wide range of architectures and languages, all hosted in AWS’s us-east-1 region, with CloudFront for caching.
- Costs around $3,000 monthly, covered by Patreon, GitHub sponsors, and commercial sponsors, with efforts to optimize expenses.
- Future plans include AI explanation tools, multi-region deployment, and improved configuration management.
- Lessons learned include the pitfalls of third-party services like link shorteners and the challenges of early infrastructure decisions.