Inference Stack
Back to the interactive map
Serving & Orchestration

Triton Inference Server

nvidia

Production-grade model server with dynamic batching and multi-model support

Official docs

Editorial compatibility: these components can be used together in representative deployments. That's not a requirement or a validated implementation. For real deployments, see the sourced reference architectures.

Compatible from earlier layers

Compatible with later layers