Gateway / Routing
LiteLLM
Open-source proxy that gives a unified, OpenAI-compatible API across serving backends and model providers.
Editorial compatibility: these components can be used together in representative deployments. That's not a requirement or a validated implementation. For real deployments, see the sourced reference architectures.