Recommended CPU Instances - Deep Learning AMI

Recommended CPU Instances

Whether you're on a budget, learning about deep learning, or just want to run a prediction service, you have many affordable options in the CPU category. Some frameworks take advantage of Intel's MKL DNN, which speeds up training and inference on C5 (not available in all regions), C4, and C3 CPU instance types. For information on CPU instance types, see EC2 Instance Types and select Compute Optimized.

Note

The size of your model should be a factor in selecting an instance. If your model exceeds an instance's available RAM, select a different instance type with enough memory for your application.

  • Amazon EC2 C5 Instances have up to 72 Intel vCPUs. C5 instances excel at scientific modelling, batch processing, distributed analytics, high-performance computing (HPC), and machine/deep learning inference.

  • Amazon EC2 C4 Instances have up to 36 Intel vCPUs.