Recommended GPU Instances

A GPU instance is recommended for most deep learning purposes. Training new models will be faster on a GPU instance than a CPU instance. You can scale sub-linearly when you have multi-GPU instances or if you use distributed training across many instances with GPUs.

Note

The size of your model should be a factor in selecting an instance. If your model exceeds an instance's available RAM, select a different instance type with enough memory for your application.

• Amazon EC2 P3 Instances have up to 8 NVIDIA Tesla V100 GPUs.

• Amazon EC2 P2 Instances have up to 16 NVIDIA NVIDIA K80 GPUs.

• Amazon EC2 G3 Instances have up to 4 NVIDIA Tesla M60 GPUs.

• Amazon EC2 G4 Instances have up to 4 NVIDIA T4 GPUs.

• Check out EC2 Instance Types and choose Accelerated Computing to see the different GPU instance options.

Next Up

Recommended CPU Instances