Optimize GPU settings on Amazon EC2 instances

Focus mode

Optimize GPU settings on Amazon EC2 instances - Amazon Elastic Compute Cloud

There are several GPU setting optimizations that you can perform to achieve the best performance on NVIDIA GPU instances. With some of these instance types, the NVIDIA driver uses an autoboost feature, which varies the GPU clock speeds. By disabling autoboost and setting the GPU clock speeds to their maximum frequency, you can consistently achieve the maximum performance with your GPU instances.

Configure the GPU settings to be persistent. This command can take several minutes to run.
```
[ec2-user ~]$ sudo nvidia-persistenced
```
[G3, and P2 instances only] Disable the autoboost feature for all GPUs on the instance.
```
[ec2-user ~]$ sudo nvidia-smi --auto-boost-default=0
```
Set all GPU clock speeds to their maximum frequency. Use the memory and graphics clock speeds specified in the following commands.

Some versions of the NVIDIA driver do not support setting the application clock speed, and display the error "Setting applications clocks is not supported for GPU...", which you can ignore.
- G3 instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 2505,1177
```
- G4dn instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 5001,1590
```
- G5 instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 6250,1710
```
- G6 and Gr6 instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 6251,2040
```
- G6e instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 9001,2520
```
- P2 instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 2505,875
```
- P3 and P3dn instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 877,1530
```
- P4d instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 1215,1410
```
- P4de instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 1593,1410
```
- P5 instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 2619,1980
```

Optimize GPU settings on Linux

Configure the GPU settings to be persistent. This command can take several minutes to run.
```
[ec2-user ~]$ sudo nvidia-persistenced
```
[G3, and P2 instances only] Disable the autoboost feature for all GPUs on the instance.
```
[ec2-user ~]$ sudo nvidia-smi --auto-boost-default=0
```
Set all GPU clock speeds to their maximum frequency. Use the memory and graphics clock speeds specified in the following commands.

Some versions of the NVIDIA driver do not support setting the application clock speed, and display the error "Setting applications clocks is not supported for GPU...", which you can ignore.
- G3 instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 2505,1177
```
- G4dn instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 5001,1590
```
- G5 instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 6250,1710
```
- G6 and Gr6 instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 6251,2040
```
- G6e instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 9001,2520
```
- P2 instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 2505,875
```
- P3 and P3dn instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 877,1530
```
- P4d instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 1215,1410
```
- P4de instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 1593,1410
```
- P5 instances:
```
[ec2-user ~]$ sudo nvidia-smi -ac 2619,1980
```

Open a PowerShell window and navigate to the NVIDIA installation folder.


PS C:\> cd "C:\Windows\System32\DriverStore\FileRepository\nvgridsw_aws.inf_*\"

[G3, and P2 instances only] Disable the autoboost feature for all GPUs on the instance.
```
PS C:\> .\nvidia-smi --auto-boost-default=0
```
Set all GPU clock speeds to their maximum frequency. Use the memory and graphics clock speeds specified in the following commands.

Some versions of the NVIDIA driver do not support setting the application clock speed, and display the error "Setting applications clocks is not supported for GPU...", which you can ignore.
- G3 instances:
```
PS C:\> .\nvidia-smi -ac "2505,1177"
```
- G4dn instances:
```
PS C:\> .\nvidia-smi -ac "5001,1590"
```
- G5 instances:
```
PS C:\> .\nvidia-smi -ac "6250,1710"
```
- G6 and Gr6 instances:
```
PS C:\> .\nvidia-smi -ac "6251,2040"
```
- G6e instances:
```
PS C:\> .\nvidia-smi -ac "9001,2520"
```
- P2 instances:
```
PS C:\> .\nvidia-smi -ac "2505,875"
```
- P3 and P3dn instances:
```
PS C:\> .\nvidia-smi -ac "877,1530"
```

Optimize GPU settings on Windows

Open a PowerShell window and navigate to the NVIDIA installation folder.


PS C:\> cd "C:\Windows\System32\DriverStore\FileRepository\nvgridsw_aws.inf_*\"

[G3, and P2 instances only] Disable the autoboost feature for all GPUs on the instance.
```
PS C:\> .\nvidia-smi --auto-boost-default=0
```
Set all GPU clock speeds to their maximum frequency. Use the memory and graphics clock speeds specified in the following commands.

Some versions of the NVIDIA driver do not support setting the application clock speed, and display the error "Setting applications clocks is not supported for GPU...", which you can ignore.
- G3 instances:
```
PS C:\> .\nvidia-smi -ac "2505,1177"
```
- G4dn instances:
```
PS C:\> .\nvidia-smi -ac "5001,1590"
```
- G5 instances:
```
PS C:\> .\nvidia-smi -ac "6250,1710"
```
- G6 and Gr6 instances:
```
PS C:\> .\nvidia-smi -ac "6251,2040"
```
- G6e instances:
```
PS C:\> .\nvidia-smi -ac "9001,2520"
```
- P2 instances:
```
PS C:\> .\nvidia-smi -ac "2505,875"
```
- P3 and P3dn instances:
```
PS C:\> .\nvidia-smi -ac "877,1530"
```

Warning Javascript is disabled or is unavailable in your browser.

To use the Amazon Web Services Documentation, Javascript must be enabled. Please refer to your browser's Help pages for instructions.

Document Conventions

Activate NVIDIA GRID Virtual Applications

Set up dual 4K displays on G4ad

Select your cookie preferences

Customize cookie preferences

Essential

Performance

Functional

Advertising

Unable to save cookie preferences

Optimize GPU settings on Amazon EC2 instances

Optimize GPU settings on Linux

Optimize GPU settings on Windows

Did this page help you?

Next topic:

Previous topic:

Need help?