Bring More to Cloud. Do More with AI.

Move and modernize your workloads on AWS, automate operations, and build intelligent experiences with Agentic AI.

Strategic Alliances

Amazon Web Services
Dynabizz Technologies
Karnovation Inc Pvt Ltd

What's Happening

SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints

November 6, 2026

Amazon SageMaker Inference now supports GPU partitioning with NVIDIA Multi-Instance GPU (MIG), which divides one GPU into hardware-isolated partitions so you can run a different model in each or take a right-sized fraction of a newer accelerator. This post shows how two optional API fields place one model per partition, and what we measured against a whole older GPU.

Read more