View a markdown version of this page

Publish and subscribe to Amazon S3 data - Amazon SageMaker Unified Studio

Publish and subscribe to Amazon S3 data

In default projects, you can bring Amazon S3 data into the catalog, add business context to it, and share it with other projects in the same AWS account. Other projects find your data in the catalog and request access to it. When you approve a request, the requesting project can read the data, or read and write it, depending on the access you grant.

You can complete the entire process from your project: create or choose an Amazon S3 bucket or folder on the Data page, publish it to the catalog, add metadata, and approve requests from other projects.

Note

Your project needs an Amazon S3 connection. New default projects receive one automatically. For an existing project, update the project, and the connection is created for you.

Create an Amazon S3 bucket or folder

If the data you want to share isn't in Amazon S3 yet, you can create a bucket or folder from your project.

To create an Amazon S3 bucket or folder
  1. Open your project in Amazon SageMaker Unified Studio.

  2. In the left navigation pane, choose Data.

  3. Choose the S3 view, then choose your Amazon S3 connection.

  4. Do one of the following:

    • To create a bucket, choose Create bucket, enter a name, and choose Create.

    • To create a folder, choose the bucket, choose Create folder, enter a name, and choose Create.

  5. (Optional) Choose the folder, then choose Upload to add files.

Publish Amazon S3 data to the catalog

When you publish a bucket or folder, it appears in the catalog as an asset of type S3 Object Collection. Other projects in the domain can then find it and request access.

To publish Amazon S3 data to the catalog
  1. Open your project in Amazon SageMaker Unified Studio.

  2. In the left navigation pane, choose Data.

  3. Choose the S3 view, then choose the bucket or folder that you want to publish.

  4. Choose Actions, then choose Publish to catalog.

  5. In the confirmation window, choose Publish.

The asset is owned by your project. It appears under Catalog > Assets in your project, where you can add business names, descriptions, glossary terms, and metadata forms. For more information, see Curate and enrich asset metadata. If you edit the metadata after publishing, publish the asset again to make your changes visible. For more information, see Publish data.

Request access to Amazon S3 data

You request access to Amazon S3 data the same way as any other asset in the catalog. On the Discover page, find the asset, choose Subscribe, enter a reason, and submit the request. For the full procedure, see Request access to data.

Approve requests and choose the access level

Members of the project that owns the asset review requests from Catalog > Subscription requests. When you approve a request for Amazon S3 data, you choose the access level:

  • Read-only: the requesting project can read the data.

  • Read and write: the requesting project can read the data and write to it.

For the full procedure, see Approve and manage access.

Share Amazon S3 data directly

You can also give a project or IAM role access to published Amazon S3 data without waiting for a request.

To share Amazon S3 data directly
  1. In your project's left navigation pane, choose Catalog, then Assets.

  2. Choose the Amazon S3 asset that you want to share.

  3. Choose Actions, then choose Create subscription.

  4. Choose the projects or IAM roles to share with, then choose Next.

  5. Choose Read-only or Read and write access.

  6. Choose Create.

How access is granted

Amazon SageMaker Unified Studio grants access to Amazon S3 data using Amazon S3 Access Grants. In default projects, access is granted to the requesting project's execution role.

When access is revoked, a project member might still receive Amazon S3 Access Grants credentials for up to 5 minutes, and those credentials can be used for 15 minutes. As a result, a user might still have access to the data for up to 20 minutes after access is revoked.

You can share Amazon S3 data with projects in the same AWS account. For other features that aren't supported in default projects, see Catalog features not supported in default projects.