Amazon EMR 6.6.0 releases - Amazon EMR

Amazon EMR 6.6.0 releases

The following Amazon EMR 6.6.0 releases are available for Amazon EMR on EKS:

Release notes for Amazon EMR 6.6.0

  • Supported applications ‐ Spark 3.2.0-amzn-0, Jupyter Enterprise Gateway (endpoints, public preview), Hudi 0.10.1-amzn-0, Iceberg 0.13.1.

  • Supported components ‐ aws-hm-client (Glue connector), aws-sagemaker-spark-sdk, emr-s3-select, emrfs, emr-ddb, hudi-spark.

  • Supported configuration classifications:

    Classifications Descriptions

    core-site

    Change values in Hadoop’s core-site.xml file.

    emrfs-site

    Change EMRFS settings.

    spark-metrics

    Change values in Spark's metrics.properties file.

    spark-defaults

    Change values in Spark's spark-defaults.conf file.

    spark-env

    Change values in the Spark environment.

    spark-hive-site

    Change values in Spark's hive-site.xml file.

    spark-log4j

    Change values in Spark's log4j.properties file.

    Configuration classifications allow you to customize applications. These often correspond to a configuration XML file for the application, such as spark-hive-site.xml. For more information, see Configuring Applications.

Known Issues

  • Spark pod template functionality with managed endpoints is not working in EMR on EKS release 6.4, 6.5, and 6.6.