Major AI conference flooded with peer reviews written by AI
12 days ago
- #Pangram Labs
- #AI in peer review
- #ICLR 2026
- Researchers suspect AI-generated peer reviews for ICLR 2026 submissions, citing hallucinated citations and vague feedback.
- Graham Neubig sought help to detect AI-generated text in peer reviews, leading to Pangram Labs' involvement.
- Pangram Labs found 21% of peer reviews fully AI-generated, with over half showing signs of AI use.
- ICLR 2026 organizers will now use automated tools to enforce AI usage policies in submissions and reviews.
- Pangram's tool flagged 15,899 peer reviews as fully AI-generated and identified varying levels of AI use in manuscripts.
- Researchers like Desmond Elliott confirmed suspicions of AI-generated reviews, which negatively impacted manuscript evaluations.