Response Healing: Reduce JSON defects by 80%+
a day ago
- #LLM
- #API
- #JSON
- OpenRouter introduces Response Healing to automatically fix malformed JSON responses from LLMs.
- Gemini 2.0 Flash saw an 80% reduction in JSON defects, while Qwen3 235B saw a 99.8% reduction.
- A small improvement in JSON reliability can significantly reduce defects, bugs, and support tickets.
- Common JSON issues include trailing commas, unescaped control characters, and missing closing brackets.
- Response Healing is opt-in and free, adding less than 1ms of latency to typical responses.
- The feature does not fix schema adherence issues or work with streaming requests currently.
- OpenRouter aims to provide reliable structured outputs to reduce errors and improve user experience.