Features and optimizations for programming AWS Glue for Spark ETL scripts

The following sections describe techniques and values that apply generally to AWS Glue for Spark ETL (extract, transform, and load) programming in any language.

Topics

• Connection types and options for ETL in AWS Glue for Spark
• Data format options for inputs and outputs in AWS Glue for Spark
• AWS Glue Data Catalog support for Spark SQL jobs
• Using job bookmarks
• Using Sensitive Data Detection outside AWS Glue Studio
• AWS Glue Visual Job API