Menu
Amazon Elastic Compute Cloud
User Guide for Linux Instances

Optimizing GPU Settings (P2 and G3 Instances Only)

There are several GPU setting optimizations that you can perform to achieve the best performance on P2 and G3 instances. By default, the NVIDIA driver uses an autoboost feature, which varies the GPU clock speeds. By disabling the autoboost feature and setting the GPU clock speeds to their maximum frequency, you can consistently achieve the maximum performance with your P2 and G3 instances. The following procedure helps you to configure the GPU settings to be persistent, disable the autoboost feature, and set the GPU clock speeds to their maximum frequency.

To optimize P2 or G3 GPU settings

  1. Configure the GPU settings to be persistent.

    Note

    This command may take several minutes to run.

    Copy
    sudo nvidia-smi -pm 1
  2. Disable the autoboost feature for all GPUs on the instance.

    Copy
    sudo nvidia-smi --auto-boost-default=0
  3. Set all GPU clock speeds to their maximum frequency. Use the memory and graphics clock speeds listed below.

    • For P2 instances: 2505,875

    • For G3 instances: 2505,1177

    Copy
    sudo nvidia-smi -ac 2505,1177