For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.
API types
Supported LLM API endpoint types and route configurations
Agentgateway natively supports multiple LLM API endpoint types. These are automatically exposed on the gateway, and translated as appropriate based on the provider.
The following API types have dedicated guides.
Chat completions
Send chat completion requests through agentgateway using the OpenAI Chat Completions API.
Responses
Send requests through agentgateway using the OpenAI Responses API.
Messages
Send requests through agentgateway using the Anthropic Messages API.
Gemini
Send requests through agentgateway in the native Gemini wire format, including streaming and token …
Embeddings
Send embedding requests through agentgateway using the OpenAI-compatible Embeddings API.
OpenAI Realtime
Proxy OpenAI Realtime API WebSocket traffic and track token usage.
Rerank
Send rerank requests through agentgateway using the Cohere-compatible Rerank API.
Passthrough
Forward requests to the upstream provider without transformation.
Models
List available models through agentgateway using the OpenAI-compatible Models API.
Token count
Count tokens through agentgateway using the Anthropic Messages token-count API.
