Patterns for token streaming, cancelation, and resilient chat UI states.
Intended use
Apply when building chat surfaces that must feel instant while calling remote LLM APIs.
Server-sent streaming patterns for responsive chat UX with OpenAI-compatible APIs.
Patterns for token streaming, cancelation, and resilient chat UI states.
Apply when building chat surfaces that must feel instant while calling remote LLM APIs.