A chatbot's worst enemy is page refresh
8 days ago
- #chatbots
- #infrastructure
- #real-time-messaging
- Chatbots struggle with page refreshes due to stateless request-response paradigms.
- Claude UI uses Server-Sent Events (SSE) which loses token streams on refresh until the response is saved to a database.
- A minimal chat example using WebSockets and Pub/Sub channels (backed by Ably) handles refreshes seamlessly without persistent state.
- SSE has limitations in handling reconnection, multiple devices/users, and efficient token streaming.
- Pub/Sub messaging platforms offer better solutions with features like message.append for token streaming, reconnection handling, and presence awareness.
- The infrastructure for AI models hasn't kept pace with advancements in model performance, leading to suboptimal user experiences.