Ingesting, analyzing, and visualizing metrics with DevOps Monitoring Dashboard on AWS

Publication date: March 2021 (last update: April 2022)

Collecting performance and operational metrics in your continuous integration/continuous delivery (CI/CD) pipeline is important in order to measure your return on investment in DevOps automation. These metrics also inform you about how to improve your software delivery process. However, the process of aggregating, analyzing, and visualizing metrics from various components through the pipeline can be complex and time-consuming.

The DevOps Monitoring Dashboard on AWS solution automates the process for monitoring and visualizing CI/CD metric following AWS best practices. This solution allows organizations of all sizes to track and measure the activities of their development teams. This helps DevOps leaders measure the impact of their DevOps initiatives and make data-driven decisions to drive continuous improvement in their development teams.

This solution supports ingestion, analysis, and visualization of data from AWS Developer Tools as well as GitHub repository to calculate key DevOps metrics, such as mean time to recovery (MTTR), change failure rate, deployment, build activity, pipeline activity, and Code Change Volume. For more information about the metrics, refer to DevOps metrics list. These metrics are presented in Amazon QuickSight dashboards for visualization. For more information about data visualization, refer to Amazon QuickSight dashboards visuals.

You can also use other visualization tools, such as Tableau, to build visualizations from the Amazon Athena database. For more information, refer to Build visualizations with Amazon Athena and Tableau. To directly work with query results and output files in Amazon Athena, refer to Running queries and work with query results and output files in Amazon Athena.

This implementation guide describes architectural considerations and configuration steps for deploying this solution in the Amazon Web Services (AWS) Cloud. This solution’s AWS CloudFormation template launches and configures the AWS services required to deploy the solution using AWS best practices for security, availability, performance efficiency, and cost optimization.

This solution is intended for deployment in an enterprise by IT infrastructure architects, administrators, developers, and DevOps professionals who have practical experience with the AWS Cloud.