Beta docs: the shipped API is POST /api/v1/generate for gemini and sarvam. Some pages below describe planned features. See the shipped quick start.

Resources

Changelog

Everything that ships, in the order it ships.

v0.4.1 — beta refresh

  • Normalized usage now returns cumulative totals across provider fallback.
  • The x-ratelimit-* header family is now returned on every response.
  • SDK: chat.stream() stops the provider call immediately on AbortController.

v0.4.0 — unified responses

  • Response normalization landed for all providers; choices is always an array.
  • provider field added to chat responses and errors.
  • Automatic routing now considers message language, enabling Sarvam routing out of the box.

v0.3.0 — providers

  • Sarvam (in-1) came online alongside Anthropic and Google.
  • Internal retries with exponential backoff on provider 429s.
  • Dashboard gained per-provider latency, reliability, and token reporting.

Roadmap

  • v0.5 — webhooks with HMAC signatures.
  • v0.6 — scoped API keys and per-provider key budgets.
  • v1.0 — region selection per key and a public SDK typings freeze.

Keep the changelog honest

Maintenance

This page must mirror the releases page. If a version ships without its changelog entry, treat that as a release-blocker.