Accelerated computing instances - Amazon EC2

Accelerated computing instances

Accelerated computing instances use hardware accelerators, or co-processors, to perform functions, such as floating point number calculations, graphics processing, or data pattern matching, more efficiently than is possible in software running on CPUs.

Available sizes

Instance type Available sizes
DL1 dl1.24xlarge
DL2q dl2q.24xlarge
F1 f1.2xlarge | f1.4xlarge | f1.16xlarge
G3 g3.4xlarge | g3.8xlarge | g3.16xlarge
G4ad g4ad.xlarge | g4ad.2xlarge | g4ad.4xlarge | g4ad.8xlarge | g4ad.16xlarge
G4dn g4dn.xlarge | g4dn.2xlarge | g4dn.4xlarge | g4dn.8xlarge | g4dn.12xlarge | g4dn.16xlarge | g4dn.metal
G5 g5.xlarge | g5.2xlarge | g5.4xlarge | g5.8xlarge | g5.12xlarge | g5.16xlarge | g5.24xlarge | g5.48xlarge
G5g g5g.xlarge | g5g.2xlarge | g5g.4xlarge | g5g.8xlarge | g5g.16xlarge | g5g.metal
Inf1 inf1.xlarge | inf1.2xlarge | inf1.6xlarge | inf1.24xlarge
Inf2 inf2.xlarge | inf2.8xlarge | inf2.24xlarge | inf2.48xlarge
P2 p2.xlarge | p2.8xlarge | p2.16xlarge
P3 p3.2xlarge | p3.8xlarge | p3.16xlarge
P3dn p3dn.24xlarge
P4d p4d.24xlarge
P4de p4de.24xlarge
P5 p5.48xlarge
Trn1 trn1.2xlarge | trn1.32xlarge
Trn1n trn1n.32xlarge
VT1 vt1.3xlarge | vt1.6xlarge | vt1.24xlarge

Platform summary

Instance type Hypervisor Processor type (architecture) Metal instances available Dedicated Hosts support Spot support Hibernation support Supported operating systems
DL1 Nitro Intel (x86_64) Linux
DL2q Nitro Intel (x86_64) Linux
F1 Xen Intel (x86_64) Linux
G3 Xen Intel (x86_64) Windows | Linux
G4ad Nitro AMD (x86_64) Windows | Linux
G4dn Nitro Intel (x86_64) Windows | Linux
G5 Nitro AMD (x86_64) Windows | Linux
G5g Nitro AWS Graviton (arm64) Linux
Inf1 Nitro Intel (x86_64) Linux
Inf2 Nitro AMD (x86_64) Linux
P2 Xen Intel (x86_64) Windows | Linux
P3 Xen Intel (x86_64) Windows | Linux
P3dn Nitro Intel (x86_64) Windows | Linux
P4d Nitro Intel (x86_64) Linux
P4de Nitro Intel (x86_64) Linux
P5 Nitro AMD (x86_64) Linux
Trn1 Nitro Intel (x86_64) Linux
Trn1n Nitro Intel (x86_64) Linux
VT1 Nitro Intel (x86_64) Linux

Performance specifications

Instance type Burstable Memory (GiB) Processor vCPUs CPU cores Threads per core Accelerators
DL1
dl1.24xlarge 768.00 Intel Xeon P-8275CL 96 48 2 8 x GPU
DL2q
dl2q.24xlarge 768.00 Intel Xeon Cascade Lake 96 48 2 8 x inference accelerator
F1
f1.2xlarge 122.00 Intel Xeon E5-2686v4 8 4 2 1 x FPGA
f1.4xlarge 244.00 Intel Xeon E5-2686v4 16 8 2 2 x FPGA
f1.16xlarge 976.00 Intel Xeon E5-2686v4 64 32 2 8 x FPGA
G3
g3.4xlarge 122.00 Intel Xeon E5-2686 v4 16 8 2 1 x GPU
g3.8xlarge 244.00 Intel Xeon E5-2686 v4 32 16 2 2 x GPU
g3.16xlarge 488.00 Intel Xeon E5-2686 v4 64 32 2 4 x GPU
G4ad
g4ad.xlarge 16.00 2nd Gen AMD EPYC 7R32 4 2 2 1 x GPU
g4ad.2xlarge 32.00 2nd Gen AMD EPYC 7R32 8 4 2 1 x GPU
g4ad.4xlarge 64.00 2nd Gen AMD EPYC 7R32 16 8 2 1 x GPU
g4ad.8xlarge 128.00 2nd Gen AMD EPYC 7R32 32 16 2 2 x GPU
g4ad.16xlarge 256.00 2nd Gen AMD EPYC 7R32 64 32 2 4 x GPU
G4dn
g4dn.xlarge 16.00 Intel Xeon P-8259L 4 2 2 1 x GPU
g4dn.2xlarge 32.00 Intel Xeon P-8259L 8 4 2 1 x GPU
g4dn.4xlarge 64.00 Intel Xeon P-8259L 16 8 2 1 x GPU
g4dn.8xlarge 128.00 Intel Xeon P-8259L 32 16 2 1 x GPU
g4dn.12xlarge 192.00 Intel Xeon P-8259L 48 24 2 4 x GPU
g4dn.16xlarge 256.00 Intel Xeon P-8259L 64 32 2 1 x GPU
g4dn.metal 384.00 Intel Xeon P-8259L 96 48 2 8 x GPU
G5
g5.xlarge 16.00 2nd Gen AMD EPYC 7R32 4 2 2 1 x GPU
g5.2xlarge 32.00 2nd Gen AMD EPYC 7R32 8 4 2 1 x GPU
g5.4xlarge 64.00 2nd Gen AMD EPYC 7R32 16 8 2 1 x GPU
g5.8xlarge 128.00 2nd Gen AMD EPYC 7R32 32 16 2 1 x GPU
g5.12xlarge 192.00 2nd Gen AMD EPYC 7R32 48 24 2 4 x GPU
g5.16xlarge 256.00 2nd Gen AMD EPYC 7R32 64 32 2 1 x GPU
g5.24xlarge 384.00 2nd Gen AMD EPYC 7R32 96 48 2 4 x GPU
g5.48xlarge 768.00 2nd Gen AMD EPYC 7R32 192 96 2 8 x GPU
G5g
g5g.xlarge 8.00 AWS Graviton2 Processor 4 4 1 1 x GPU
g5g.2xlarge 16.00 AWS Graviton2 Processor 8 8 1 1 x GPU
g5g.4xlarge 32.00 AWS Graviton2 Processor 16 16 1 1 x GPU
g5g.8xlarge 64.00 AWS Graviton2 Processor 32 32 1 1 x GPU
g5g.16xlarge 128.00 AWS Graviton2 Processor 64 64 1 2 x GPU
g5g.metal 128.00 AWS Graviton2 Processor 64 64 1 2 x GPU
Inf1
inf1.xlarge 8.00 Intel Xeon P-8259L 4 2 2 1 x inference accelerator
inf1.2xlarge 16.00 Intel Xeon P-8259L 8 4 2 1 x inference accelerator
inf1.6xlarge 48.00 Intel Xeon P-8259L 24 12 2 4 x inference accelerator
inf1.24xlarge 192.00 Intel Xeon P-8259L 96 48 2 16 x inference accelerator
Inf2
inf2.xlarge 16.00 AMD EPYC 7R13 4 2 2 1 x inference accelerator
inf2.8xlarge 128.00 AMD EPYC 7R13 32 16 2 1 x inference accelerator
inf2.24xlarge 384.00 AMD EPYC 7R13 96 48 2 6 x inference accelerator
inf2.48xlarge 768.00 AMD EPYC 7R13 192 96 2 12 x inference accelerator
P2
p2.xlarge 61.00 Intel Xeon E5-2686v4 4 2 2 1 x GPU
p2.8xlarge 488.00 Intel Xeon E5-2686v4 32 16 2 8 x GPU
p2.16xlarge 732.00 Intel Xeon E5-2686 v4 64 32 2 16 x GPU
P3
p3.2xlarge 61.00 Intel Xeon E5-2686 v4 8 4 2 1 x GPU
p3.8xlarge 244.00 Intel Xeon E5-2686 v4 32 16 2 4 x GPU
p3.16xlarge 488.00 Intel Xeon E5-2686 v4 64 32 2 8 x GPU
P3dn
p3dn.24xlarge 768.00 Intel Xeon Platinum 8175 96 48 2 8 x GPU
P4d
p4d.24xlarge 1152.00 Intel Xeon Platinum 8175 96 48 2 8 x GPU
P4de
p4de.24xlarge 1152.00 Intel Xeon Platinum 8175 96 48 2 8 x GPU
P5
p5.48xlarge 2048.00 AMD EPYC 7R13 192 96 2 8 x GPU
Trn1
trn1.2xlarge 32.00 Intel Xeon Ice Lake 8375C 8 4 2
trn1.32xlarge 512.00 Intel Xeon Ice Lake 8375C 128 64 2
Trn1n
trn1n.32xlarge 512.00 Intel Xeon Ice Lake 128 64 2
VT1
vt1.3xlarge 24.00 Intel Cascade Lake P-8259CL 12 6 2
vt1.6xlarge 48.00 Intel Cascade Lake P-8259CL 24 12 2
vt1.24xlarge 192.00 Intel Cascade Lake P-8259CL 96 48 2
Note

trn1n.32xlarge instances feature 16 Trainium Accelerators.

Trn1 instances feature the following number of Trainium Accelerators.

  • trn1.2xlarge — 1

  • trn1.32xlarge — 16

VT1 instances feature the following number of U30 Accelerators.

  • vt1.3xlarge — 1

  • vt1.6xlarge — 2

  • vt1.24xlarge — 16

Network specifications

Instance type Baseline / Burst bandwidth (Gbps) EFA ENA ENA Express Network cards Max. network interfaces per network card IP addresses per interface IPv6
DL1
dl1.24xlarge 4x 100 Gigabit 4 60 50
DL2q
dl2q.24xlarge 100 Gigabit 1 15 50
F1
f1.2xlarge 1 Up to 10 Gigabit 1 4 15
f1.4xlarge 1 Up to 10 Gigabit 1 8 30
f1.16xlarge 25 Gigabit 1 8 50
G3
g3.4xlarge 1 Up to 10 Gigabit 1 8 30
g3.8xlarge 10 Gigabit 1 8 30
g3.16xlarge 25 Gigabit 1 15 50
G4ad
g4ad.xlarge 1 2.0 / 10.0 1 2 4
g4ad.2xlarge 1 4.167 / 10.0 1 2 4
g4ad.4xlarge 1 8.333 / 10.0 1 3 10
g4ad.8xlarge 15 Gigabit 1 4 15
g4ad.16xlarge 25 Gigabit 1 8 30
G4dn
g4dn.xlarge 1 5.0 / 25.0 1 3 10
g4dn.2xlarge 1 10.0 / 25.0 1 3 10
g4dn.4xlarge 1 20.0 / 25.0 1 3 10
g4dn.8xlarge 50 Gigabit 1 4 15
g4dn.12xlarge 50 Gigabit 1 8 30
g4dn.16xlarge 50 Gigabit 1 4 15
g4dn.metal 100 Gigabit 1 15 50
G5
g5.xlarge 1 2.5 / 10.0 1 4 15
g5.2xlarge 1 5.0 / 10.0 1 4 15
g5.4xlarge 1 10.0 / 25.0 1 8 30
g5.8xlarge 25 Gigabit 1 8 30
g5.12xlarge 40 Gigabit 1 15 50
g5.16xlarge 25 Gigabit 1 8 30
g5.24xlarge 50 Gigabit 1 15 50
g5.48xlarge 100 Gigabit 1 7 50
G5g
g5g.xlarge 1 1.25 / 10.0 1 4 15
g5g.2xlarge 1 2.5 / 10.0 1 4 15
g5g.4xlarge 1 5.0 / 10.0 1 8 30
g5g.8xlarge 12 Gigabit 1 8 30
g5g.16xlarge 25 Gigabit 1 15 50
g5g.metal 25 Gigabit 1 15 50
Inf1
inf1.xlarge 1 5.0 / 25.0 1 4 10
inf1.2xlarge 1 5.0 / 25.0 1 4 10
inf1.6xlarge 25 Gigabit 1 8 30
inf1.24xlarge 100 Gigabit 1 11 30
Inf2
inf2.xlarge 1 2.083 / 15.0 1 4 15
inf2.8xlarge 1 16.667 / 25.0 1 8 30
inf2.24xlarge 50 Gigabit 1 15 50
inf2.48xlarge 100 Gigabit 1 15 50
P2
p2.xlarge High 1 4 15
p2.8xlarge 10 Gigabit 1 8 30
p2.16xlarge 25 Gigabit 1 8 30
P3
p3.2xlarge 1 Up to 10 Gigabit 1 4 15
p3.8xlarge 10 Gigabit 1 8 30
p3.16xlarge 25 Gigabit 1 8 30
P3dn
p3dn.24xlarge 100 Gigabit 1 15 50
P4d
p4d.24xlarge 4x 100 Gigabit 4 60 50
P4de
p4de.24xlarge 4x 100 Gigabit 4 60 50
P5
p5.48xlarge 3200 Gigabit 32 64 50
Trn1
trn1.2xlarge 1 3.125 / 12.5 1 4 15
trn1.32xlarge 8x 100 Gigabit 8 40 50
Trn1n
trn1n.32xlarge 16x 100 Gigabit 16 80 50
VT1
vt1.3xlarge 3.12 Gigabit 1 4 15
vt1.6xlarge 6.25 Gigabit 1 8 30
vt1.24xlarge 25 Gigabit 1 15 50
Note

1 These instances have a baseline bandwidth and can use a network I/O credit mechanism to burst beyond their baseline bandwidth on a best effort basis. Other instances types can sustain their maximum performance indefinitely. For more information, see instance network bandwidth.

Amazon EBS specifications

Instance type Baseline / Maximum bandwidth (Mbps) Baseline / Maximum throughput (MB/s, 128 KiB I/O) Baseline / Maximum IOPS (16 KiB I/O) NVMe EBS optimization 2
DL1
dl1.24xlarge 19000.00 2375.00 80000.00 default
DL2q
dl2q.24xlarge 19000.00 2375.00 80000.00 default
F1
f1.2xlarge 1700.00 212.50 12000.00 default
f1.4xlarge 3500.00 437.50 44000.00 default
f1.16xlarge 14000.00 1750.00 75000.00 default
G3
g3.4xlarge 3500.00 437.50 20000.00 default
g3.8xlarge 7000.00 875.00 40000.00 default
g3.16xlarge 14000.00 1750.00 80000.00 default
G4ad
g4ad.xlarge 1 400.00 / 3170.00 50.00 / 396.25 1700.00 / 13333.00 default
g4ad.2xlarge 1 800.00 / 3170.00 100.00 / 396.25 3400.00 / 13333.00 default
g4ad.4xlarge 1 1580.00 / 3170.00 197.50 / 396.25 6700.00 / 13333.00 default
g4ad.8xlarge 3170.00 396.25 13333.00 default
g4ad.16xlarge 6300.00 787.50 26667.00 default
G4dn
g4dn.xlarge 1 950.00 / 3500.00 118.75 / 437.50 3000.00 / 20000.00 default
g4dn.2xlarge 1 1150.00 / 3500.00 143.75 / 437.50 6000.00 / 20000.00 default
g4dn.4xlarge 4750.00 593.75 20000.00 default
g4dn.8xlarge 9500.00 1187.50 40000.00 default
g4dn.12xlarge 9500.00 1187.50 40000.00 default
g4dn.16xlarge 9500.00 1187.50 40000.00 default
g4dn.metal 19000.00 2375.00 80000.00 default
G5
g5.xlarge 1 700.00 / 3500.00 87.50 / 437.50 3000.00 / 15000.00 default
g5.2xlarge 1 850.00 / 3500.00 106.25 / 437.50 3500.00 / 15000.00 default
g5.4xlarge 4750.00 593.75 20000.00 default
g5.8xlarge 16000.00 2000.00 65000.00 default
g5.12xlarge 16000.00 2000.00 65000.00 default
g5.16xlarge 16000.00 2000.00 65000.00 default
g5.24xlarge 19000.00 2375.00 80000.00 default
g5.48xlarge 19000.00 2375.00 80000.00 default
G5g
g5g.xlarge 1 1188.00 / 4750.00 148.50 / 593.75 6000.00 / 20000.00 default
g5g.2xlarge 1 2375.00 / 4750.00 296.88 / 593.75 12000.00 / 20000.00 default
g5g.4xlarge 4750.00 593.75 20000.00 default
g5g.8xlarge 9500.00 1187.50 40000.00 default
g5g.16xlarge 19000.00 2375.00 80000.00 default
g5g.metal 19000.00 2375.00 80000.00 default
Inf1
inf1.xlarge 1 1190.00 / 4750.00 148.75 / 593.75 4000.00 / 20000.00 default
inf1.2xlarge 1 1190.00 / 4750.00 148.75 / 593.75 6000.00 / 20000.00 default
inf1.6xlarge 4750.00 593.75 20000.00 default
inf1.24xlarge 19000.00 2375.00 80000.00 default
Inf2
inf2.xlarge 1 1250.00 / 10000.00 156.25 / 1250.00 6000.00 / 40000.00 default
inf2.8xlarge 10000.00 1250.00 40000.00 default
inf2.24xlarge 30000.00 3750.00 120000.00 default
inf2.48xlarge 60000.00 7500.00 240000.00 default
P2
p2.xlarge 750.00 93.75 6000.00 default
p2.8xlarge 5000.00 625.00 32500.00 default
p2.16xlarge 10000.00 1250.00 65000.00 default
P3
p3.2xlarge 1750.00 218.75 10000.00 default
p3.8xlarge 7000.00 875.00 40000.00 default
p3.16xlarge 14000.00 1750.00 80000.00 default
P3dn
p3dn.24xlarge 19000.00 2375.00 80000.00 default
P4d
p4d.24xlarge 19000.00 2375.00 80000.00 default
P4de
p4de.24xlarge 19000.00 2375.00 80000.00 default
P5
p5.48xlarge 80000.00 10000.00 260000.00 default
Trn1
trn1.2xlarge 1 5000.00 / 20000.00 625.00 / 2500.00 16250.00 / 65000.00 default
trn1.32xlarge 80000.00 10000.00 260000.00 default
Trn1n
trn1n.32xlarge 80000.00 10000.00 260000.00 default
VT1
vt1.3xlarge 1 2375.00 / 4750.00 296.88 / 593.75 10000.00 / 20000.00 default
vt1.6xlarge 4750.00 593.75 20000.00 default
vt1.24xlarge 19000.00 2375.00 80000.00 default
Note

1 These instances can support maximum performance for 30 minutes at least once every 24 hours, after which they revert to their baseline performance. Other instances can sustain the maximum performance indefinitely. If your workload requires sustained maximum performance for longer than 30 minutes, use one of these instances.

2 default indicates that instances are enabled for EBS optimization by default. supported indicates that instances can optionally be enabled for EBS optimization For more information, see Amazon EBS–optimized instances.

Instance store specifications

Instance type Instance store volumes Instance store type Read / Write performance (IOPS) Needs initialization 1 TRIM support 2
DL1
dl1.24xlarge 4 x 1000 GB NVMe SSD 1,000,000 / 800,000
F1
f1.2xlarge 1 x 470 GB NVMe SSD
f1.4xlarge 1 x 940 GB NVMe SSD
f1.16xlarge 4 x 940 GB NVMe SSD
G4ad
g4ad.xlarge 1 x 150 GB NVMe SSD 10,417 / 8,333
g4ad.2xlarge 1 x 300 GB NVMe SSD 20,833 / 16,667
g4ad.4xlarge 1 x 600 GB NVMe SSD 41,667 / 33,333
g4ad.8xlarge 1 x 1200 GB NVMe SSD 83,333 / 66,667
g4ad.16xlarge 2 x 1200 GB NVMe SSD 166,666 / 133,332
G4dn
g4dn.xlarge 1 x 125 GB NVMe SSD 42,500 / 32,500
g4dn.2xlarge 1 x 225 GB NVMe SSD 42,500 / 32,500
g4dn.4xlarge 1 x 225 GB NVMe SSD 85,000 / 65,000
g4dn.8xlarge 1 x 900 GB NVMe SSD 250,000 / 200,000
g4dn.12xlarge 1 x 900 GB NVMe SSD 250,000 / 200,000
g4dn.16xlarge 1 x 900 GB NVMe SSD 250,000 / 200,000
g4dn.metal 2 x 900 GB NVMe SSD 500,000 / 400,000
G5
g5.xlarge 1 x 250 GB NVMe SSD 40,625 / 20,313
g5.2xlarge 1 x 450 GB NVMe SSD 40,625 / 20,313
g5.4xlarge 1 x 600 GB NVMe SSD 125,000 / 62,500
g5.8xlarge 1 x 900 GB NVMe SSD 250,000 / 125,000
g5.12xlarge 1 x 3800 GB NVMe SSD 312,500 / 156,250
g5.16xlarge 1 x 1900 GB NVMe SSD 250,000 / 125,000
g5.24xlarge 1 x 3800 GB NVMe SSD 312,500 / 156,250
g5.48xlarge 2 x 3800 GB NVMe SSD 625,000 / 312,500
P3dn
p3dn.24xlarge 2 x 900 GB NVMe SSD 700,000 / 340,000
P4d
p4d.24xlarge 8 x 1000 GB NVMe SSD 2,000,000 / 1,600,000
P4de
p4de.24xlarge 8 x 1000 GB NVMe SSD 2,000,000 / 1,600,000
P5
p5.48xlarge 8 x 3800 GB NVMe SSD 4,400,000 / 2,200,000
Trn1
trn1.2xlarge 1 x 474 GB NVMe SSD 107,500 / 45,000
trn1.32xlarge 4 x 1900 GB NVMe SSD 1,720,000 / 720,000
Trn1n
trn1n.32xlarge 4 x 1900 GB NVMe SSD 1,720,000 / 720,000

1 Volumes attached to certain instances suffer a first-write penalty unless initialized. For more information, see Optimize disk performance for instance store volumes.

2 For more information, see Instance store volume TRIM support.

Security specifications

Instance type EBS encryption Instance store encryption Encryption in transit AMD SEV-SNP NitroTPM Nitro Enclaves
DL1
dl1.24xlarge
DL2q
dl2q.24xlarge Instance store not supported
F1
f1.2xlarge
f1.4xlarge
f1.16xlarge
G3
g3.4xlarge Instance store not supported
g3.8xlarge Instance store not supported
g3.16xlarge Instance store not supported
G4ad
g4ad.xlarge
g4ad.2xlarge
g4ad.4xlarge
g4ad.8xlarge
g4ad.16xlarge
G4dn
g4dn.xlarge
g4dn.2xlarge
g4dn.4xlarge
g4dn.8xlarge
g4dn.12xlarge
g4dn.16xlarge
g4dn.metal
G5
g5.xlarge
g5.2xlarge
g5.4xlarge
g5.8xlarge
g5.12xlarge
g5.16xlarge
g5.24xlarge
g5.48xlarge
G5g
g5g.xlarge Instance store not supported
g5g.2xlarge Instance store not supported
g5g.4xlarge Instance store not supported
g5g.8xlarge Instance store not supported
g5g.16xlarge Instance store not supported
g5g.metal Instance store not supported
Inf1
inf1.xlarge Instance store not supported
inf1.2xlarge Instance store not supported
inf1.6xlarge Instance store not supported
inf1.24xlarge Instance store not supported
Inf2
inf2.xlarge Instance store not supported
inf2.8xlarge Instance store not supported
inf2.24xlarge Instance store not supported
inf2.48xlarge Instance store not supported
P2
p2.xlarge Instance store not supported
p2.8xlarge Instance store not supported
p2.16xlarge Instance store not supported
P3
p3.2xlarge Instance store not supported
p3.8xlarge Instance store not supported
p3.16xlarge Instance store not supported
P3dn
p3dn.24xlarge
P4d
p4d.24xlarge
P4de
p4de.24xlarge
P5
p5.48xlarge
Trn1
trn1.2xlarge
trn1.32xlarge
Trn1n
trn1n.32xlarge
VT1
vt1.3xlarge Instance store not supported
vt1.6xlarge Instance store not supported
vt1.24xlarge Instance store not supported