- Anthropic's Claude AI chatbot shared chats were unexpectedly indexed by search engines like Google and Bing, exposing private conversations.
- The issue stems from a missing 'noindex' HTML tag on shared chat pages, which search engines recommend in addition to robots.txt directives.
- Anthropic's robots.txt file blocks crawlers from indexing shared chats, but this is insufficient if other sites link to those pages.
- Google and Bing both state that developers should use both robots.txt and a 'noindex' tag to prevent indexing, but Claude's shared pages lacked the tag.