711
Dictionary

Streaming

Returning tokens as they are generated instead of waiting for completion.

1 min readupdated 2026-07-04

/ quick answer

Streaming (SSE or chunked HTTP) lets the UI render partial output within ~200ms, dropping perceived latency dramatically even when total generation time is unchanged. Returning tokens as they are generated instead of waiting for completion.

Returning tokens as they are generated instead of waiting for completion. Streaming (SSE or chunked HTTP) lets the UI render partial output within ~200ms, dropping perceived latency dramatically even when total generation time is unchanged. In practice: ChatGPT's typewriter effect is server-sent event streaming.
Definition
Streaming (SSE or chunked HTTP) lets the UI render partial output within ~200ms, dropping perceived latency dramatically even when total generation time is unchanged.
Example
ChatGPT's typewriter effect is server-sent event streaming.

/ frequently asked

What is Streaming?

Streaming (SSE or chunked HTTP) lets the UI render partial output within ~200ms, dropping perceived latency dramatically even when total generation time is unchanged.

What is an example of Streaming?

ChatGPT's typewriter effect is server-sent event streaming.

Why does Streaming matter?

Returning tokens as they are generated instead of waiting for completion.

What should I learn after Streaming?

Open the related workflows and prompts further down this page: they show how this idea is applied in a real task, step by step.

/ topics#ai#ux

/ continue exploring

Related concepts

The vocabulary this page depends on.

  • →AI Voice Agent Latency

    AI voice agent latency refers to the delay between a user speaking and an AI voice agent's response, critically impacting the naturalness and effectiveness of real-time voice interactions.

all dictionary →

Related workflows

Turn this into a repeatable process.

all workflows →

Related tool stacks

The tools that run it in production.

all tool stacks →

Comparisons & alternatives

Pick between the options.

all comparisons →

Long-form guides on this topic