Is Grep All You Need? How Agent Harnesses Reshape Agentic Search
4 hours ago
- #Retrieval Strategies
- #LLM Agents
- #Empirical Study
- Compares grep and vector retrieval methods in LLM agentic search systems.
- Uses a custom agent harness (Chronos) and provider-native CLI harnesses (Claude Code, Codex, Gemini CLI).
- Evaluates performance on LongMemEval dataset with different tool output presentation methods.
- Examines impact of distracting conversation history on retrieval accuracy.
- Finds grep generally yields higher accuracy than vector retrieval in tested scenarios.