What is AWS Data Exchange? - AWS Data Exchange User Guide

What is AWS Data Exchange?

AWS Data Exchange is a service that makes it easy for AWS customers to find, subscribe to, and use third-party data in the AWS Cloud.

As a subscriber, you can find and subscribe to thousands of products from qualified data providers. Then, you can use the AWS Data Exchange console or APIs to create, view, manage, and access data sets for use across a variety of AWS analytics and machine learning services. Anyone with an AWS account can be an AWS Data Exchange subscriber. For information about becoming a subscriber, see Subscribing to data products on AWS Data Exchange.

For providers, AWS Data Exchange eliminates the need to build and maintain any data delivery, entitlement, or billing technology. Providers in AWS Data Exchange have a secure, transparent, and reliable channel to reach AWS customers and grant existing customers their subscriptions more efficiently. The process for becoming an AWS Data Exchange provider requires a few steps to determine eligibility. For more information, see Providing data products on AWS Data Exchange.

In addition, anyone, with or without an AWS account, can find and use publicly available data sets that are part of the Open Data on AWS program. For more information, see Using Open Data on AWS data sets.

What is an AWS Data Exchange product?

A product is the unit of exchange in AWS Data Exchange that is published by a provider and made available for use to subscribers. When a provider publishes a product, that product is listed on the AWS Data Exchange product catalog as well as AWS Marketplace after being reviewed by AWS against our guidelines and terms and conditions. Each product you publish is uniquely identified by its product ID.

Note

When a product is initially created and published, all pre-existing finalized revisions within its data sets are published at the same time.

With AWS Data Exchange, providers publish data products and subscribers subscribe to those products.

Providers can publish and view their products using the AWS Data Exchange console. Providers can also list and view the details of their existing products using the AWS Marketplace Catalog API.

A product has the following parts:

  • Product details – This information includes name, descriptions (both short and long), logo image, and support contact information. Providers complete the product details.

  • Product offers – Offers define the terms that subscribers are agreeing to when they subscribe to a product. To make a product available on AWS Data Exchange, providers must define a public offer. This offer includes prices and durations, data subscription agreement, refund policy, and the option to create custom offers.

  • Data sets – A product can contain one or more data sets. A data set in AWS Data Exchange is a dynamic set of data which is versioned through the use of revisions. Each revision can contain multiple assets. The provider can decide which revisions within a data set are published to a product. The provider creates owned data sets, and a subscriber can get access to entitled data sets through a product subscription. When a subscriber subscribes to a product, they get access to the product’s data sets and some or all of the revisions that have been published to that product for the duration of their subscription.

Important

As of July 22, 2021, new and existing providers can automatically publish revisions to data sets. All new products on AWS Data Exchange default to automatic revision publishing. If you have existing products on AWS Data Exchange before July 22, 2021, you need to migrate them to automatic revision publishing.

For more information, see Migrating an existing product to automatic revision publishing.

Malware prevention

Security and compliance is a shared responsibility between you and AWS. To promote a safe, secure, and trustworthy service for everyone, AWS Data Exchange scans all S3 object files published by providers before they are made available to subscribers. If AWS detects malware, the affected asset is removed.

Important

AWS Data Exchange does not guarantee that the data you consume as a subscriber is free of any potential malware. We encourage that you conduct your own additional due diligence to ensure compliance with your internal security controls. You can find anti-malware and security products in AWS Marketplace.

Supported data sets

AWS Data Exchange takes a responsible approach to facilitating data transactions by promoting transparency through use of the service. AWS Data Exchange reviews permitted data types, restricting products that are not permitted. Providers are limited to distributing data sets that meet the legal eligibility requirements set forth in the Terms and Conditions for AWS Marketplace Sellers.

For more information about permitted data types, see Publishing guidelines.

Important

As an AWS customer, you are encouraged to conduct your own additional due-diligence to ensure compliance with any applicable data privacy laws. If you suspect that a product or other resources on AWS Data Exchange are being used for abusive or illegal purposes, report it using the Report Amazon AWS abuse form.

Accessing AWS Data Exchange

Subscribers

As a subscriber, you can explore available AWS Data Exchange products through the following options:

Providers

As an existing provider, you can access AWS Data Exchange through the following options:

  • Directly through the AWS Data Exchange console (Publish data)

  • Programmatically using the following APIs:

    • AWS Data Exchange API – Use the API operations to create, view, update, and delete data sets and revisions. You can also use these API operations to import and export assets to and from those revisions. For more information, see the AWS Data Exchange API Reference.

    • AWS Marketplace Catalog API – Use the API operations to view and update products on AWS Data Exchange and AWS Marketplace. For more information, see the AWS Marketplace Catalog API Reference.

Pricing

Your AWS Data Exchange subscriptions are displayed in the currency you specified for your AWS account. You can change your preferred currency for your AWS account in the AWS Billing and Cost Management console. For instructions, see Changing which currency you use to pay your bill in the AWS Billing User Guide.

Note

Changing your preferred currency changes your remittance instructions. To view updated remittance instructions, see your AWS Marketplace invoice or view the Account Settings page in the AWS Billing and Cost Management console.

For pricing information, see AWS Data Exchange pricing.

Supported Regions

AWS Data Exchange has a single, globally available product catalog offered by providers. Subscribers can see the same catalog regardless of which AWS Region they are using. The resources underlying the product (data sets, revisions, assets) are regional resources that you manage programmatically or through the AWS Data Exchange console in supported Regions. For information about which Regions are supported, see Global Infrastructure Region Table.

The following services are related to AWS Data Exchange:

  • Amazon S3 – One supported asset type for data sets is Amazon S3 object snapshots. Subscribers can export data sets to Amazon S3 programmatically. For more information, see What Is Amazon S3? in the Amazon Simple Storage Service User Guide.

  • Amazon API Gateway – Another supported asset type for data sets is APIs. Subscribers can call the API programmatically, call the API from the AWS Data Exchange console, or download the OpenAPI specification file. For more information, see What is Amazon API Gateway? in the Amazon API Gateway Developer Guide.

  • Amazon Redshift – AWS Data Exchange supports Amazon Redshift data sets. Subscribers can get read-only access to query the data in Amazon Redshift without extracting, transforming, and loading data. For more information, see Getting started with Amazon Redshift in the Amazon Redshift Getting Started Guide and Amazon Redshift system overview in the Amazon Redshift Database Developer Guide.

  • AWS Marketplace – AWS Data Exchange allows data sets to be published as products on AWS Marketplace. AWS Data Exchange providers must be registered as AWS Marketplace sellers, and can use the AWS Marketplace Management Portal or the AWS Marketplace Catalog API. For information about becoming an AWS Marketplace subscriber, see What Is AWS Marketplace? in the AWS Marketplace Buyer Guide. For information about becoming an AWS Marketplace seller, see What Is AWS Marketplace? in the AWS Marketplace Seller Guide.