- The article addresses access denial due to overly generic HTTP User-Agent headers.
- The author considers generic user agents, like 'Go-http-client/1.1', as suspicious due to high-volume crawlers (especially for LLM training) as of early 2025.
- Non-browser user agents must clearly identify both the software and the specific user or organization running it.
- User agents with 'compatible' or 'bot' markers must include a working URL explaining their purpose, not just an email address.
- This policy is an experiment to reduce the server load on 'Wandering Thoughts'.