FND05-BP04 Configure standardized locations for logs, traces, and metrics
Security teams use logs and findings to analyze events that might indicate unauthorized activity or unintentional changes. Operations teams use logs, distributed traces, and metrics to understand system behavior and detect and mitigate issues early. Capture logs, traces, and metrics in standardized locations to correlate data points across all three signal types and simplify tool integrations.
Desired outcome:
-
You have a standardized approach to collect, analyze, and visualize log data, distributed traces, metrics, and security findings across workload accounts.
-
Security and operations teams can efficiently correlate, analyze, and visualize security data across disparate systems to discover potential issues and identify anomalies.
-
Security information and event management (SIEM) systems or other mechanisms are integrated to query and analyze log data for timely responses, tracking, and escalation of security events.
Common anti-patterns:
-
Teams independently own, manage, and collect logs and metrics in a way that is inconsistent with the organization's logging strategy.
-
Teams lack adequate access controls to restrict visibility and alteration of the data collected.
-
Teams don't govern their security logs, findings, and metrics as part of their data classification policy.
-
Teams neglect data sovereignty and localization requirements when configuring data collections.
Benefits of establishing this best practice:
-
Standardized collection and querying of log data improves the quality and speed of insights derived from analysis.
-
Automated lifecycle management for log data reduces storage costs and maintains compliance with retention requirements.
-
Fine-grained access controls protect sensitive log information and confirm that teams have appropriate access based on their operational needs.
-
Centralized logging supports integration with security and analytics tools to correlate events, visualize trends, and accelerate incident response.
-
Unified observability across logs, traces, and metrics supports faster root cause analysis by correlating multiple data types in a single location.
Level of risk exposed if this best practice is not established: Medium
Implementation guidance
Collecting activity data from distributed workloads for centralized analysis is challenging. Security teams use SIEM systems to collect data from these sources and perform correlation, analysis, and response workflows, but managing permissions for disparate data sources and operating ETL processes introduces overhead.
Aggregate all relevant sources of security log data into a
dedicated
Log Archive account, as described in
Organizing Your AWS Environment Using Multiple Accounts. Include
workload security data and AWS service logs
(AWS CloudTrail
Amazon CloudWatch Unified Data Store
Deploy security analytics tools that operate in AWS into a
Security Tooling account separate from your Log Archive account.
This separation implements defense in depth, protecting the
integrity and availability of logs and log management
independently from the tools that access them. Services like
Amazon Athena
Apply the same centralization and standardization principles to
distributed traces and metrics.
Application Observability (APM)
Metrics provide counts, rates, and durations that make anomalies
measurable.
Amazon CloudWatch
Implementation steps
-
Create the Log Archive and Security Tooling accounts: Using AWS Organizations
, create the Log Archive and Security Tooling accounts under a security organizational unit. If using AWS Control Tower , these accounts are created automatically. See AWS Control Tower account factory. Follow AWS SRA Logging Architecture guidance. -
Evaluate data sovereignty and compliance requirements: Determine whether your organization requires multiple log storage locations based on data residency laws
, regulatory scopes, or data classification policies. Workloads spanning multiple geographic regions with strict data localization requirements might need per-Region Log Archive accounts or Region-specific storage locations in a single account. Document retention requirements for different log types and sensitivity levels so they inform your storage and lifecycle configuration in later steps. -
Configure your standardized security data locations: Use Amazon CloudWatch Unified Data Store
as the destination for operational, security, and compliance telemetry, and cross-account cross-Region log centralization to aggregate log data across your organization. Capture security data from AWS Regions that are opted-in for your accounts, even when not actively in use. Pair the unified data store with raw log storage in Amazon S3 for long-term retention and integration with third-party data products where required. -
Configure data retention requirements: Establish appropriate lifecycles for each log source using Amazon S3 Lifecycle and Log retention in CloudWatch Logs. Typically, three to twelve months of logs are readily available, with retention up to seven years. Align these settings with your security requirements and regulatory mandates.
-
Configure data source publication to your standardized locations: Identify sources and configure them to publish to your standardized locations. Evaluate options that automatically export data in the desired format rather than requiring ETL. Use cross-account cross-Region log centralization to replicate log groups from member accounts into your CloudWatch Unified Data Store, and CloudWatch metric streams to deliver metrics into the same data store. Include compute and workload logs from Amazon EC2, Amazon ECS, Amazon EKS, and AWS Lambda so investigators can correlate API activity with what happened inside the workloads. Configure findings from AWS Security Hub CSPM, GuardDuty, and Amazon Inspector to flow into CloudWatch alongside raw logs, and publish third-party sources via their OCSF- or OpenTelemetry-compatible exporters.
-
Configure tools to access your standardized locations: Configure tools like Amazon Athena
, AWS Quick , Amazon OpenSearch Service , or third-party solutions with required access. Operate these tools out of the Security Tooling account with cross-account read access to the Log Archive account. Analysts can query the same OCSF- and OpenTelemetry-formatted data in the CloudWatch Unified Data Store from CloudWatch Logs Insights, Athena, OpenSearch Service, and third-party Iceberg-compatible platforms without duplicating data. -
Centralize traces and metrics alongside logs: Turn on AWS X-Ray for application tracing, or deploy the AWS Distro for OpenTelemetry
Collector for standardized telemetry that works across AWS and third-party backends. Configure CloudWatch cross-account observability so metrics, logs, and traces from workload accounts are visible in a central monitoring account. Use CloudWatch metric streams to deliver metrics into Amazon S3 for long-term retention and correlation with logs. -
Use logs for alerting: Configure alerting using Amazon GuardDuty
, AWS Security Hub CSPM , and AWS Config . Enable AWS Security Hub CSPM alongside Security Hub CSPM. AWS recommends enabling both services so Security Hub CSPM findings are routed to Security Hub CSPM automatically and correlated with findings from Amazon Inspector, Amazon Macie, and GuardDuty to generate exposure findings. Use custom alert generation engines for specific alerts relevant to your environment, and Amazon EventBridge for custom event-driven alerting.
Resources
Related best practices:
Related documents:
Related examples:
Related tools:
Related services: