Using Amazon Redshift integration for Apache Spark on Amazon EMR on EKS

With Amazon EMR release 6.9.0 and later, every release image includes a connector between Apache Spark and Amazon Redshift. This way, you can use Spark on Amazon EMR on EKS to process data stored in Amazon Redshift. The integration is based on the spark-redshift open-source connector. For Amazon EMR on EKS, the Amazon Redshift integration for Apache Spark is included as a native integration.

Topics

• Launching a Spark application using the Amazon Redshift integration for Apache Spark
• Authenticating with the Amazon Redshift integration for Apache Spark
• Reading and writing from and to Amazon Redshift
• Considerations and limitations when using the Spark connector