Querying AWS service logs

This section includes several procedures for using Amazon Athena to query popular datasets, such as AWS CloudTrail logs, Amazon CloudFront logs, Classic Load Balancer logs, Application Load Balancer logs, Amazon VPC flow logs, and Network Load Balancer logs.

The tasks in this section use the Athena console, but you can also use other tools like the Athena JDBC driver, the AWS CLI, or the Amazon Athena API Reference.

For information about using AWS CloudFormation to automatically create AWS service log tables, partitions, and example queries in Athena, see Automating AWS service logs table creation and querying them with Amazon Athena in the AWS Big Data Blog. For information about using a Python library for AWS Glue to create a common framework for processing AWS service logs and querying them in Athena, see Easily query AWS service logs using Amazon Athena.

The topics in this section assume that you have configured appropriate permissions to access Athena and the Amazon S3 bucket where the data to query should reside. For more information, see Setting up and Getting started.

Topics

• Application Load Balancer
• Elastic Load Balancing
• CloudFront
• CloudTrail
• Amazon EMR
• Global Accelerator
• GuardDuty
• Network Firewall
• Network Load Balancer
• Route 53
• Amazon SES
• Amazon VPC
• AWS WAF

For information about querying Amazon S3 logs, see the following topics:

• How do I analyze my Amazon S3 server access logs using Athena? in the AWS Knowledge Center

• Querying Amazon S3 access logs for requests using Amazon Athena in the Amazon Simple Storage Service User Guide

• Using AWS CloudTrail to identify Amazon S3 requests in the Amazon Simple Storage Service User Guide