Gateway / Routing
Envoy AI Gateway
Envoy-based gateway extension purpose-built for LLM traffic — token-aware rate limiting, load balancing, and routing.
Editorial compatibility: these components can be used together in representative deployments. That's not a requirement or a validated implementation. For real deployments, see the sourced reference architectures.