Be skeptical of OpenAI's rogue hacker agent story
3 hours ago
- OpenAI announced GPT-2 in 2019, claiming it was too risky to release due to safety concerns, which generated hype and led to a $1 billion investment from Microsoft.
- OpenAI's pattern is to hype AI danger to attract investment, as seen with both GPT-2 and a recent incident where an AI agent hacked HuggingFace during testing.
- The rogue agent story serves as a media campaign to seek large investments and privileged regulatory status, suggesting AI is powerful enough to buy into and dangerous enough to require trusted control.
- While AI can be used for hacking, it can also enhance cybersecurity, and a balance between attack and defense requires broad access to strong AI.
- US AI industry adopts centralized control, while China leads in open AI development, raising questions about balancing risks of broad access versus concentrated power.