External metrics ingestion - AWS Compute Optimizer

External metrics ingestion

You can use the external metrics ingestion feature to configure AWS Compute Optimizer to ingest EC2 memory utilization metrics from one of the four observability products: Datadog, Dynatrace, Instana, and New Relic. When you enable external metrics ingestion, Compute Optimizer analyzes your external EC2 memory utilization metrics in addition to your CPU, disk, network, IO, and throughput data to generate EC2 rightsizing recommendations. These recommendations can provide you with additional savings and enhanced performance. For more information, see Configure external metrics ingestion.

Metric requirements

To generate EC2 rightsizing recommendations with external memory utilization metrics, Compute Optimizer requires at least 30 consecutive hours of memory utilization metrics from your observability product. If you don’t have enough hours of external memory utilization metrics, Compute Optimizer analyzes and generates recommendations from your CloudWatch metrics until you reach the external memory metric requirements.

Note

When external metrics ingestion is enabled, Compute Optimizer prioritizes your external memory utilization metrics over your CloudWatch memory data. If you opt out of external metrics ingestion, Compute Optimizer defaults back to analyze and generate recommendations based on your CloudWatch metrics.

Organization and account level

You can configure external metric ingestion at both the organization and account level. If you're a member account of an AWS organization that configured external metrics ingestion, you can opt out of this feature. For more information, see Opt out of external metrics ingestion.

Suppose that you're a new member of an AWS organization that already configured external metrics ingestion. Then, you must configure external metrics ingestion for your AWS account manually. For more information, see Configure external metrics ingestion.

Configure external metrics ingestion

Console
  1. Open the Compute Optimizer console at https://console.aws.amazon.com/compute-optimizer/.

  2. Choose Accounts in the navigation pane.

  3. In the Organization-level preferences for external metrics ingestion or the Account-level preferences for external metrics ingestion section, choose Edit.

    
                    Choose Edit
  4. In the prompt that appears, select your external metrics provider for EC2 instances. Then choose Confirm.

  5. In the Organization-level preferences for external metrics ingestion or the Account-level preferences for external metrics ingestion section, choose the external metrics source link.

    
                    Choose metrics source link
    Note

    This link navigates you to the external metrics provider’s website.

  6. Complete the configuration steps on your external metrics provider’s website.

CLI
  1. Open a terminal or command prompt window.

  2. Call the following API operation.

    • Replace myRegion with the source AWS Region.

    • Replace 123456789012 with your account ID.

    • Replace ExternalMetricsProvider with your external metrics provider.

    aws compute-optimizer put-recommendation-preferences --region myRegion --resource-type=Ec2Instance --scope='{"name":"AccountId", "value":"123456789012"}' --external-metrics-preference='{"source":"ExternalMetricsProvider"}'
  3. Open the Compute Optimizer console at https://console.aws.amazon.com/compute-optimizer/.

  4. Choose Accounts in the navigation pane.

  5. In the Organization-level preferences for external metrics ingestion or the Account-level preferences for external metrics ingestion section, choose the external metrics source link.

    
                    Choose metrics source link
    Note

    This link navigates you to the external metrics provider’s website.

  6. Complete the configuration steps on your external metrics provider’s website.

Opt out of external metrics ingestion

Console
  1. Open the Compute Optimizer console at https://console.aws.amazon.com/compute-optimizer/.

  2. Choose Accounts in the navigation pane.

  3. In the Organization-level preferences for external metrics ingestion or the Account-level preferences for external metrics ingestion section, choose Edit.

    
                    Choose Edit
  4. In the prompt that appears, select No external metrics provider. Then choose Confirm.

CLI
  1. Open a terminal or command prompt window.

  2. Call the following API operation.

    • Replace myRegion with the source AWS Region.

    • Replace 123456789012 with your account ID.

    aws compute-optimizer delete-recommendation-preferences --region myRegion --resource-type=Ec2Instance --recommendation-preference-names='["ExternalMetricsPreference"]' --scope='{"name":"AccountId", "value":"123456789012"}'