
The gateway console overview: request, token, and spend totals for the selected period, daily spend, request volume, top virtual keys, and requests by model.
What the gateway provides
- Stable model aliases such as
fast,smart,vision, andembed. - OpenAI-compatible chat completions, Responses, embeddings, and streaming.
- Scoped API keys per organization, application, and environment.
- RPM, TPM, request-size, model, endpoint, and capability limits.
- Monetary budget enforcement with usage and cost reporting.
- Weighted routing, retries, provider fallbacks, and cooldowns.
- Prometheus metrics, readiness probes, structured logs, and budget alerts.
Choose your path
Connect an application
Point an OpenAI SDK at an existing gateway and make your first request.
Deploy the gateway
Run the supported Docker Compose topology in your own cloud account.
Keys and budgets
Create scoped keys and spend budgets, by console or by API.
Administration
The current release supports a private operator console plus authenticated APIs and command-line helpers. See the Console guide for model, key, budget, and usage workflows. It is not a public self-service control plane.Client API
The OpenAI-compatible surface available to application keys.
Capabilities and limitations
What is supported today and what is not.