The AI risk is inside the labs
a day ago
- The first serious AI incident will likely occur inside frontier labs during testing, not from open models.
- Closed models are vulnerable to leaks by a single insider; open models are released after testing and similar API models already exist.
- Open models can be ablated of dangerous knowledge (e.g., biology) to limit harm while remaining useful.
- Restricting open access to AI for cybersecurity creates an asymmetric weapon; open models enable defensive bug-finding.
- Real AI safety requires a joint global organization with experts and government recognition, not unilateral lab decisions.
- Slowing AI progress has a hidden security cost: lost medical and scientific advances that save lives.
- Amodei's anti-China stance is unfair given historical and current Western issues; China's history is less warlike and its AI progress is inevitable.
- Technological supremacy has never enabled permanent advantage; the greatest dangers are from rogue individuals or AI escape, not open models or China.
- CEOs without legitimacy or background should not make existential decisions for humanity; this must be fixed first.