Know what actually runs together before you build it

The AI inference stack

Nine layers — application, agent framework, workload, inference framework, gateway, serving & orchestration, accelerator software stack, accelerator hardware, and cloud instance — across NVIDIA, AMD, Google TPU, AWS Trainium/Inferentia, and Intel Gaudi. See what's compatible at each layer, not just what's available.

9 layers70 components5 silicon vendors

An AI inference stack spans everything between a user's request and a model running on silicon — the serving framework, the orchestration layer routing it, the accelerator software stack, and the accelerator hardware and cloud instance underneath. Read the guides, or trace your own stack below — or as a dependency graph.