Recursive Language Models
4 months ago
- #Language Models
- #Long-context Processing
- #Artificial Intelligence
- Proposes Recursive Language Models (RLMs) for processing arbitrarily long prompts.
- RLMs treat long prompts as an external environment, allowing decomposition and recursive calls.
- Handles inputs up to two orders of magnitude beyond standard model context windows.
- Outperforms base LLMs and common long-context scaffolds in diverse tasks.
- Maintains comparable or cheaper cost per query.