AWS Glue PySpark transforms reference
AWS Glue provides the following built-in transforms that you can use in PySpark ETL operations. Your data passes from transform to transform in
a data structure called a DynamicFrame, which is an extension to an Apache
Spark SQL DataFrame
. The DynamicFrame
contains your data, and you
reference its schema to process your data.
Most of these transforms also exist
as methods of the DynamicFrame
class. For more information, see DynamicFrame transforms
.