Recommended CPU Instances
Whether you're on a budget, learning about deep learning, or just want to run a
prediction service, you have many affordable options in the CPU category. Some
frameworks take advantage of Intel's MKL DNN, which speeds up training and inference on
C5 (not available in all Regions), C4, and C3 CPU instance types. For information about CPU
instance types, see EC2 Instance Types
The size of your model should be a factor in selecting an instance. If your model exceeds an instance's available RAM, select a different instance type with enough memory for your application.
Amazon EC2 C5 Instances
have up to 72 Intel vCPUs. C5 instances excel at scientific modeling, batch processing, distributed analytics, high-performance computing (HPC), and machine and deep learning inference. Amazon EC2 C4 Instances have up to 36 Intel vCPUs.
Next Up
Recommended Inferentia Instances
