Best practices for performance tuning AWS Glue for Apache Spark jobs
Roman Myers, Takashi Onikura, and Noritaka Sekiyama, Amazon Web Services (AWS)
December 2023 (document history)
AWS Glue provides different options for tuning performance. This guide defines key topics for tuning AWS Glue for Apache Spark. It then provides a baseline strategy for you to follow when tuning these AWS Glue for Apache Spark jobs. Use this guide to learn how to identify performance problems by interpreting metrics available in AWS Glue. Then incorporate strategies to address these problems, maximizing performance and minimizing costs.
This guide covers the following tuning practices:
