Amazon Elastic Compute Cloud
User Guide for Windows Instances

The AWS Documentation website is getting a new look!
Try it now and let us know what you think. Switch to the new look >>

You can return to the original look by selecting English in the language selector above.

Optimizing GPU Settings

There are several GPU setting optimizations that you can perform to achieve the best performance on G3, G4, P2, and P3 instances. By default, the NVIDIA driver uses an autoboost feature, which varies the GPU clock speeds. By disabling the autoboost feature and setting the GPU clock speeds to their maximum frequency, you can consistently achieve the maximum performance with your GPU instances.

To optimize GPU settings

  1. Open a PowerShell window and navigate to the NVIDIA installation folder.

    cd "C:\Program Files\NVIDIA Corporation\NVSMI"
  2. Disable the autoboost feature for all GPUs on the instance.

    .\nvidia-smi --auto-boost-default=0

    Note

    GPUs on P3 and G4 instances do not support autoboost.

  3. Set all GPU clock speeds to their maximum frequency. Use the memory and graphics clock speeds specified in the following commands.

    Note

    Some versions of the NVIDIA driver do not allow setting application clock speed and throw a "Setting applications clocks is not supported for GPU …" error, which you can ignore.

    • G3 instances:

      .\nvidia-smi -ac "2505,1177"
    • G4 instances:

      .\nvidia-smi -ac "5001,1590"
    • P2 instances:

      .\nvidia-smi -ac "2505,875"
    • P3 instances:

      .\nvidia-smi -ac "877,1530"