Accelerator Hardware

Trainium2

aws

AWS's 2nd-gen custom training/inference accelerator — 96 GB HBM3e, 667 TFLOPS BF16, AWS-exclusive

Editorial compatibility: these components can be used together in representative deployments. That's not a requirement or a validated implementation. For real deployments, see the sourced reference architectures.

Compatible from earlier layers

AWS Neuron SDK

Compatible with later layers

AWS Trn2 (Trainium2)