- No performance benefit found in giving agents search access to previous session transcripts for SWE tasks, especially if they have other forms of context.
- Automatic indexing and searching of session transcripts often degrades agent performance by introducing irrelevant or redundant information.
- Agents are ineffective at removing context, leading to intent drift as all input is treated as ground truth.
- Better to rely on curated artifacts like documentation, commit messages, and PRs for context, as they distill valuable information.
- Human-in-the-loop processes are essential for reviewing and accepting updates to agent skillsets, as most automatic updates would be detrimental.