18 hours ago
- GLM 5.2 is a new open-weights model generating buzz for its capabilities.
- It was compared to similarly-priced Gemini 3 Flash on text adventure games using a fixed budget per attempt.
- GLM 5.2 costs $4.4 per million output tokens, while Gemini 3 Flash costs $3, but GLM's price may drop with better deployment.
- A mixed-effects linear regression controlling for game difficulty found GLM 5.2 earns 15% fewer achievements than Gemini 3 Flash.
- The performance gap is about 0.8 standard deviations of residual noise, making it competitive but slightly worse.
- GLM 5.2 outperforms Gemini 2.5 Flash, which is 1.6 noise levels worse, but is behind more expensive models like Sonnet 4.5.