Connecting to data - AWS Glue

Connecting to data

An AWS Glue connection is a Data Catalog object that stores login credentials, URI strings, virtual private cloud (VPC) information, and more for a particular data store. AWS Glue crawlers, jobs, and development endpoints use connections in order to access certain types of data stores. You can use connections for both sources and targets, and reuse the same connection across multiple crawler or extract, transform, and load (ETL) jobs.

AWS Glue supports the following connection types:

  • Amazon DocumentDB

  • Amazon OpenSearch Service, for use with AWS Glue for Spark.

  • Amazon Redshift

  • Kafka

  • Azure Cosmos, for use of Azure Cosmos DB for NoSQL with AWS Glue ETL jobs

  • Azure SQL, for use with AWS Glue for Spark.

  • Google BigQuery, for use with AWS Glue for Spark.

  • JDBC

  • MongoDB

  • MongoDB Atlas

  • SAP HANA, for use with AWS Glue for Spark.

  • Snowflake, for use with AWS Glue for Spark.

  • Teradata Vantage, when using AWS Glue for Spark.

  • Vertica, for use with AWS Glue for Spark.

  • Various Amazon Relational Database Service (Amazon RDS) offerings.

  • Network (designates a connection to a data source that is in an Amazon Virtual Private Cloud (Amazon VPC))

  • Aurora (supported if the native JDBC driver is being used. Not all driver features can be leveraged)

With AWS Glue Studio, you can also create a connection for a connector. A connector is an optional code package that assists with accessing data stores in AWS Glue Studio. For more information, see Using connectors and connections with AWS Glue Studio

For information about how to connect to on-premises databases, see How to access and analyze on-premises data stores using AWS Glue at the AWS Big Data Blog website.

This section includes the following topics to help you use AWS Glue connections: