Shared Dictionaries: compression that keeps up with the agentic web

10 hours ago

Web pages are growing heavier yearly due to more frameworks, interactivity, and media, with increased rebuilds and client requests driven by agents.
Shared dictionaries reduce asset transfers by allowing servers to send only diffs using cached versions, speeding up page loads, especially for returning users.
Agents account for nearly 10% of Cloudflare's requests (March 2026), increasing deploys and reducing caching efficiency, leading to redundant data transfers.
Shared dictionaries use delta compression, turning cached versions into dictionaries to send minimal diffs, saving bandwidth across frequent updates.
Past attempts like Google's SDCH failed due to security issues (e.g., compression side-channel attacks) and architectural problems, but modern RFC 9842 addresses these with same-origin restrictions.
Cloudflare is rolling out shared dictionary support in three phases: passthrough headers, managed compression via rules, and automatic dictionary generation.
Phase 1 beta starts April 30, 2026, requiring specific browsers (Chrome/Edge 130+), with internal tests showing up to 97% reduction in asset sizes and faster download times.
Phase 2 automates dictionary management for customers, while Phase 3 aims for automatic dictionary generation based on network traffic patterns.
Shared dictionaries make compression stateful, reducing redundant bytes in an era of frequent agent-driven deploys and automated client traffic.

Hasty Briefsbeta