Using Amazon Redshift integration for Apache Spark on Amazon EMR Serverless

With Amazon EMR release 6.9.0 and later, every release image includes a connector between Apache Spark and Amazon Redshift. With this connector, you can use Spark on Amazon EMR Serverless to process data stored in Amazon Redshift. The integration is based on the spark-redshift open-source connector. For Amazon EMR Serverless, the Amazon Redshift integration for Apache Spark is included as a native integration.

Topics

• Launching a Spark application with the Amazon Redshift integration for Apache Spark
• Authenticating with the Amazon Redshift integration for Apache Spark
• Reading and writing from and to Amazon Redshift
• Considerations and limitations when using the Spark connector