35 docs tagged with "AI Gateway"

Learn how to configure Traefik Hub AI Gateway middlewares for OpenAI Responses API workloads.

Reference for the flags, environment variables, token features, and endpoints of the Traefik Hub Administration UI deployment.

Configure automatic failover between LLM providers using the Traefik Hub AI Gateway.

Traefik Hub - Learn how to configure the Amazon Bedrock Guardrails middleware for the AI Gateway.

Traefik Hub - Learn how to configure the Azure Content Safety middleware for the AI Gateway.

Traefik Hub - Learn how to configure the Azure Prompt Shield middleware for the AI Gateway.

Traefik Hub – Configure the Bedrock Mantle middleware for the AI Gateway.

Traefik Hub – Configure the Chat Completion middleware for the AI Gateway.

Traefik Hub – Configure GenAI metrics and trace attributes for the AI Gateway middlewares.

Traefik Hub - Learn how to configure the Content Guard middleware for the AI & API gateway.

Traefik Hub - Learn how to configure the GCP Model Armor middleware for the AI Gateway.

Traefik Hub – Configure the Google Agent Platform middleware for the AI Gateway.

Complete guide for integrating IBM Granite Guardian models with Traefik Hub AI Gateway LLM Guard middleware for advanced AI content security and topic control.

Deploy the Traefik Hub Administration UI next to your gateway on Kubernetes, protect it with authentication, and verify it can read your gateway.

Traefik Hub - Learn how to configure the LLM Guard middleware for flexible content security in the AI Gateway.

Connect the Traefik Hub Administration UI to a GitHub repository so that creating, editing, and deleting AI routes, MCP servers, and HTTP resources opens a pull request.

View gateway status, monitor cost, performance, and security analytics, manage routes through a GitOps workflow, and chat with your gateway from the Traefik Hub Administration UI.

Traefik Hub – Configure the Messages API middleware for the AI Gateway.

Traefik Hub - Configure the MCP middleware for secure access control and governance of MCP servers.

Track token consumption from streamed and non-streamed AI responses, enable Responses API semantic caching, and measure tokens saved by cache hits.

Complete guide for integrating NVIDIA NIMs with Traefik Hub AI Gateway LLM Guard middleware for advanced AI content security and topic control.

Traefik Hub - Learn how to configure the Parallel LLM Guard middleware to run multiple LLM guards concurrently in the AI Gateway.

Traefik Hub – Configure the Responses API middleware for the AI Gateway.

Use model access policies to control which AI models a caller can reach and what a model list shows them.

Traefik Hub - Configure the NeMo Switchyard middleware for the AI Gateway.

Traefik Hub - Learn how to configure the Semantic Cache middleware for the AI gateway.

Send gateway metrics to a metrics store and connect the Traefik Hub Administration UI to it to display cost, performance, and security analytics.

Deploy the Traefik MCP Server and connect the Administration UI to a model so that you can ask questions about your live gateway configuration and telemetry.

Traefik Hub - Learn how to configure the Token Rate Limit and Quota middlewares for the AI gateway.

Use Traefik Hub AI Gateway metrics to attribute LLM token spend by team, visualize costs in Grafana, set budget alerts, and enforce hard spending caps.

Traefik Hub - Learn how to configure the AI Gateway.

Get a tamper-evident record of your Traefik Hub logs and access logs, so you can prove later that nothing was changed or deleted.

Configuration reference for Traefik Hub transparency logs: storage driver, signing key, witnesses, and checkpoint interval.

Learn how to configure Traefik Hub AI Gateway middlewares for Anthropic Messages API workloads.

Configure Claude Code, Codex, and custom coding agents to run through Traefik Hub AI Gateway.