Configuring AWS DataSync transfers with an object storage system - AWS DataSync
PrerequisitesCreating your object storage transfer location

Beginning December 7, 2023, we will discontinue version 1 DataSync agents. Check the Agents page on the DataSync console to see if you have affected agents. If you do, replace those agents before then to avoid data transfer or storage discovery disruptions. If you need more help, contact AWS Support.

Configuring AWS DataSync transfers with an object storage system

To transfer data to or from your object storage system, you must create an AWS DataSync transfer location. DataSync can use this location as a source or destination for transferring data.

Prerequisites

Your object storage system must be compatible with the following Amazon S3 API operations for DataSync to connect to it:

  • AbortMultipartUpload

  • CompleteMultipartUpload

  • CopyObject

  • CreateMultipartUpload

  • DeleteObject

  • DeleteObjects

  • DeleteObjectTagging

  • GetBucketLocation

  • GetObject

  • GetObjectTagging

  • HeadBucket

  • HeadObject

  • ListObjectsV2

  • PutObject

  • PutObjectTagging

  • UploadPart

Creating your object storage transfer location

Before you begin, you need an object storage system that you plan to transfer data from.

To create an object storage location by using the console

  1. Open the AWS DataSync console at https://console.aws.amazon.com/datasync/.

  2. In the left navigation pane, expand Data transfer, then choose Locations and Create location.

  3. For Location type, choose Object storage.

    You configure this location as a source or destination later.

  4. For Agents, choose one or more DataSync agents.

    During the transfer, the agents securely connect to your object storage server.

  5. For Server, provide the domain name or IP address of the object storage server.

  6. For Bucket name, enter the name of the object storage bucket involved in the transfer.

  7. For Folder, enter an object prefix.

    DataSync only copies objects with this prefix.

  8. To configure the connection to the object storage server, expand Additional settings and do the following:

    1. For Server protocol, choose HTTP or HTTPS.

    2. For Server port, use a default port (80 for HTTP or 443 for HTTPS) or specify a custom port if needed.

    3. For Certificate, select Choose file to specify the certificates that are used to sign the object storage server's certificate.

      The file can be up to 32768 bytes (before base64 encoding) and also include the following:

      • The certificate of the signing certificate authority (CA)

      • Any intermediate certificates

      • A .pem extension

  9. If credentials are required to access the object storage server, select Requires credentials and enter the Access key and Secret key for accessing the bucket.

    The access key and secret key can be a user name and password, respectively.

  10. (Optional) Choose Add tag to tag your object storage location.

    Tags are key-value pairs that help you manage, filter, and search for your locations. We recommend creating at least a name tag for your location.

  11. Choose Create location.