Recommended GPU Instances
A GPU instance is recommended for most deep learning purposes. Training new models will be faster on a GPU instance than a CPU instance. You can scale sub-linearly when you have multi-GPU instances or if you use distributed training across many instances with GPUs. To set up distributed training, see Distributed Training.
The size of your model should be a factor in selecting an instance. If your model exceeds an instance's available RAM, select a different instance type with enough memory for your application.
-
Amazon EC2 P3 Instances
have up to 8 NVIDIA Tesla V100 GPUs. -
Amazon EC2 P2 Instances
have up to 16 NVIDIA NVIDIA K80 GPUs. -
Amazon EC2 G3 Instances
have up to 4 NVIDIA Tesla M60 GPUs. -
Amazon EC2 G4 Instances
have up to 4 NVIDIA T4 GPUs. -
Amazon EC2 P4 Instances
have up to 8 NVIDIA Tesla A100 GPUs. -
Check out EC2 Instance Types
and choose Accelerated Computing to see the different GPU instance options.
DLAMI instances provide tooling to monitor and optimize your GPU processes. For more information on overseeing your GPU processes, see GPU Monitoring and Optimization.
Next Up
