External metrics ingestion - AWS Compute Optimizer

External metrics ingestion

You can use the external metrics ingestion feature to configure AWS Compute Optimizer to ingest EC2 memory utilization metrics from one of the four observability products: Datadog, Dynatrace, Instana, and New Relic. When you enable external metrics ingestion, Compute Optimizer analyzes your external EC2 memory utilization metrics in addition to your CPU, disk, network, IO, and throughput data to generate EC2 rightsizing recommendations. These recommendations can provide you with additional savings and enhanced performance. For more information, see Configure external metrics ingestion.

Note

External metrics ingestion doesn't support EC2 instances that are part of Auto Scaling groups.

Metric requirements

To generate EC2 rightsizing recommendations with external memory utilization metrics, Compute Optimizer requires at least 30 consecutive hours of memory utilization metrics from your observability product. If you don’t have enough hours of external memory utilization metrics, Compute Optimizer analyzes and generates recommendations from your CloudWatch metrics until you reach the external memory metric requirements.

Note

When external metrics ingestion is enabled, Compute Optimizer prioritizes your external memory utilization metrics over your CloudWatch memory data. If you opt out of external metrics ingestion, Compute Optimizer defaults back to analyze and generate recommendations based on your CloudWatch metrics.

Organization and account level

You can configure external metric ingestion at both the organization and account level. If you're a member account of an AWS organization that configured external metrics ingestion, you can opt out of this feature. For more information, see Opt out of external metrics ingestion.

Suppose that you're a new member of an AWS organization that already configured external metrics ingestion. Then, you must configure external metrics ingestion for your AWS account manually. For more information, see Configure external metrics ingestion.

Configure external metrics ingestion

Console
  1. Open the Compute Optimizer console at https://console.aws.amazon.com/compute-optimizer/.

  2. Choose General in the navigation pane. Then, choose the External metrics ingestion tab.

  3. If you’re an individual AWS account holder, skip to step 4.

    If you’re the account manager or delegated administrator of your organization, you can opt-in all member accounts or an individual member account for external metrics ingestion.

    • To opt-in all member accounts, choose All opted-in accounts from the Preference level dropdown.

    • To opt-in an individual member account, choose Choose account from the Preference level dropdown. In the prompt that appears, select the account you want to opt-in. Then, choose Set account level.

    
                                    Choose preference level
  4. Choose Edit.

  5. In the prompt that appears, select your external metrics provider for EC2 instances. Then, choose Enable.

  6. Navigate to your external metrics provider's website. To do this, choose Configure with provider or the external metrics source link.

    
                                    Choose metrics source link
  7. Complete the configuration process on your external metrics provider’s website.

    Important

    If you don't complete the configuration process with your external metrics provider, Compute Optimizer can't receive your external metrics.

CLI
  1. Open a terminal or command prompt window.

  2. Call the following API operation.

    • Replace myRegion with the source AWS Region.

    • Replace 123456789012 with your account ID.

    • Replace ExternalMetricsProvider with your external metrics provider.

    aws compute-optimizer put-recommendation-preferences --region myRegion --resource-type=Ec2Instance --scope='{"name":"AccountId", "value":"123456789012"}' --external-metrics-preference='{"source":"ExternalMetricsProvider"}'
  3. Open the Compute Optimizer console at https://console.aws.amazon.com/compute-optimizer/.

  4. Choose Accounts in the navigation pane.

  5. In the Organization-level preferences for external metrics ingestion or the Account-level preferences for external metrics ingestion section, navigate to your external metrics provider's website. To do this, choose Configure with provider or the external metrics source link.

    
                                    Choose metrics source link
  6. Complete the configuration process on your external metrics provider’s website.

    Important

    If you don't complete the configuration process with your external metrics provider, Compute Optimizer can't receive your external metrics.

Opt out of external metrics ingestion

Console
  1. Open the Compute Optimizer console at https://console.aws.amazon.com/compute-optimizer/.

  2. Choose General in the navigation pane. Then, choose the External metrics ingestion tab.

  3. If you’re an individual AWS account holder, skip to step 4.

    If you’re the account manager or delegated administrator of your organization, you can opt out all member accounts or an individual member account for external metrics ingestion.

    • To opt out all member accounts, choose All opted-in accounts from the Preference level dropdown.

    • To opt out an individual member account, choose Choose account from the Preference level dropdown. In the prompt that appears, select the account you want to opt out. Then, choose Set account level.

  4. Choose Edit.

  5. In the prompt that appears, select No external metrics provider. Then, choose Confirm.

CLI
  1. Open a terminal or command prompt window.

  2. Call the following API operation.

    • Replace myRegion with the source AWS Region.

    • Replace 123456789012 with your account ID.

    aws compute-optimizer delete-recommendation-preferences --region myRegion --resource-type=Ec2Instance --recommendation-preference-names='["ExternalMetricsPreference"]' --scope='{"name":"AccountId", "value":"123456789012"}'