Skip to content

Anthropic launches Message threads beta for Messages API

Anthropic

The feature caches conversations on the server, allowing developers to pass only new messages and a message ID instead of full conversation histories.

Key points

  • Reduces median time to first token by about 35% on requests spanning 500K to 1M tokens.
  • Cuts median request payload sizes in long conversations from roughly 800 KB to 1.8 KB.
  • Available at standard token rates on Claude Platform, AWS, Microsoft Foundry, and Google Cloud via a beta header and thread parameter.

Why it matters

Developers building multi-turn applications with Claude can cut network overhead and latency without manually maintaining full conversation context on every API call.

Sources