Stupid Over-Reliance on Palantir AI Helped Lead to US Bombing of Iranian School
4 hours ago
- A Bloomberg report confirms that the US bombing of an Iranian girls' elementary school resulted from Pentagon officials' over-reliance on Palantir's Maven AI system, which they incorrectly assumed would automatically flag outdated or inconsistent intelligence.
- The Maven Smart System, used by Centcom, integrates over 150 data inputs to aid military targeting, but personnel expected it to identify civilian locations like the school, despite the system not being designed for that purpose.
- The bombing occurred during the Trump-Hegseth war in Iran, killing over 165 people (mostly children); the school was previously an IRGC compound but had been clearly labeled as a school on Google Maps and satellite imagery showed playgrounds.
- Hegseth dismantled most of the Pentagon's civilian harm mitigation (CHM) teams, cutting staff by 90% to fewer than 20, and no CHM team reviewed the Minab site before the strike, exacerbating the failure.
- Palantir denies responsibility, stating it is not responsible for underlying data or intelligence deficiencies, but critics argue that overselling the system's capabilities contributed to human complacency.
- The incident highlights how overconfidence in AI leads to skipping essential human oversight, with the speed of Maven reducing target preparation from hours to minutes, bypassing traditional kill-chain safeguards.