- xAI sues a user for allegedly using Grok to generate child sexual abuse material by circumventing safeguards.
- The complaint highlights that Grok's guardrails engaged and refused prompts, but the user repeatedly altered prompts to bypass moderation.
- xAI reports suspending over 52,000 accounts and filing more than 73,000 reports to NCMEC, leading to nearly 250 arrests in 2026.
- The case contrasts with ongoing litigation where xAI is a defendant, accused of being responsible for Grok's output, not users.
- The lawsuit does not resolve whether general-purpose image models that can be manipulated to produce harmful content should be publicly available.