AWS DataSync endpoints and quotas - AWS General Reference

AWS DataSync endpoints and quotas

The following are the service endpoints and service quotas for this service. To connect programmatically to an AWS service, you use an endpoint. In addition to the standard AWS endpoints, some AWS services offer FIPS endpoints in selected Regions. For more information, see AWS service endpoints. Service quotas, also referred to as limits, are the maximum number of service resources or operations for your AWS account. For more information, see AWS service quotas.

Service endpoints

DataSync transfers

Region Name Region Endpoint Protocol
US East (Ohio) us-east-2

datasync.us-east-2.amazonaws.com

datasync-fips.us-east-2.amazonaws.com

HTTPS

HTTPS

US East (N. Virginia) us-east-1

datasync.us-east-1.amazonaws.com

datasync-fips.us-east-1.amazonaws.com

HTTPS

HTTPS

US West (N. California) us-west-1

datasync.us-west-1.amazonaws.com

datasync-fips.us-west-1.amazonaws.com

HTTPS

HTTPS

US West (Oregon) us-west-2

datasync.us-west-2.amazonaws.com

datasync-fips.us-west-2.amazonaws.com

HTTPS

HTTPS

Africa (Cape Town) af-south-1 datasync.af-south-1.amazonaws.com HTTPS
Asia Pacific (Hong Kong) ap-east-1 datasync.ap-east-1.amazonaws.com HTTPS
Asia Pacific (Hyderabad) ap-south-2 datasync.ap-south-2.amazonaws.com HTTPS
Asia Pacific (Jakarta) ap-southeast-3 datasync.ap-southeast-3.amazonaws.com HTTPS
Asia Pacific (Malaysia) ap-southeast-5 datasync.ap-southeast-5.amazonaws.com HTTPS
Asia Pacific (Melbourne) ap-southeast-4 datasync.ap-southeast-4.amazonaws.com HTTPS
Asia Pacific (Mumbai) ap-south-1 datasync.ap-south-1.amazonaws.com HTTPS
Asia Pacific (Osaka) ap-northeast-3 datasync.ap-northeast-3.amazonaws.com HTTPS
Asia Pacific (Seoul) ap-northeast-2 datasync.ap-northeast-2.amazonaws.com HTTPS
Asia Pacific (Singapore) ap-southeast-1 datasync.ap-southeast-1.amazonaws.com HTTPS
Asia Pacific (Sydney) ap-southeast-2 datasync.ap-southeast-2.amazonaws.com HTTPS
Asia Pacific (Tokyo) ap-northeast-1 datasync.ap-northeast-1.amazonaws.com HTTPS
Canada (Central) ca-central-1

datasync.ca-central-1.amazonaws.com

datasync-fips.ca-central-1.amazonaws.com

HTTPS

HTTPS

Canada West (Calgary) ca-west-1

datasync.ca-west-1.amazonaws.com

datasync-fips.ca-west-1.amazonaws.com

HTTPS

HTTPS

Europe (Frankfurt) eu-central-1 datasync.eu-central-1.amazonaws.com HTTPS
Europe (Ireland) eu-west-1 datasync.eu-west-1.amazonaws.com HTTPS
Europe (London) eu-west-2 datasync.eu-west-2.amazonaws.com HTTPS
Europe (Milan) eu-south-1 datasync.eu-south-1.amazonaws.com HTTPS
Europe (Paris) eu-west-3 datasync.eu-west-3.amazonaws.com HTTPS
Europe (Spain) eu-south-2 datasync.eu-south-2.amazonaws.com HTTPS
Europe (Stockholm) eu-north-1 datasync.eu-north-1.amazonaws.com HTTPS
Europe (Zurich) eu-central-2 datasync.eu-central-2.amazonaws.com HTTPS
Israel (Tel Aviv) il-central-1 datasync.il-central-1.amazonaws.com HTTPS
Middle East (Bahrain) me-south-1 datasync.me-south-1.amazonaws.com HTTPS
Middle East (UAE) me-central-1 datasync.me-central-1.amazonaws.com HTTPS
South America (São Paulo) sa-east-1 datasync.sa-east-1.amazonaws.com HTTPS
AWS GovCloud (US-East) us-gov-east-1

datasync.us-gov-east-1.amazonaws.com

datasync-fips.us-gov-east-1.amazonaws.com

HTTPS

HTTPS

AWS GovCloud (US-West) us-gov-west-1

datasync.us-gov-west-1.amazonaws.com

datasync-fips.us-gov-west-1.amazonaws.com

HTTPS

HTTPS

DataSync Discovery

Region Name Region Endpoint Protocol
US East (Ohio) us-east-2 discovery-datasync.us-east-2.amazonaws.com HTTPS
US East (N. Virginia) us-east-1 discovery-datasync.us-east-1.amazonaws.com HTTPS
US West (Oregon) us-west-2 discovery-datasync.us-west-2.amazonaws.com HTTPS
Africa (Cape Town) af-south-1 discovery-datasync.af-south-1.amazonaws.com HTTPS
Asia Pacific (Hong Kong) ap-east-1 discovery-datasync.ap-east-1.amazonaws.com HTTPS
Asia Pacific (Mumbai) ap-south-1 discovery-datasync.ap-south-1.amazonaws.com HTTPS
Asia Pacific (Seoul) ap-northeast-2 discovery-datasync.ap-northeast-2.amazonaws.com HTTPS
Asia Pacific (Singapore) ap-southeast-1 discovery-datasync.ap-southeast-1.amazonaws.com HTTPS
Asia Pacific (Sydney) ap-southeast-2 discovery-datasync.ap-southeast-2.amazonaws.com HTTPS
Asia Pacific (Tokyo) ap-northeast-1 discovery-datasync.ap-northeast-1.amazonaws.com HTTPS
Canada (Central) ca-central-1 discovery-datasync.ca-central-1.amazonaws.com HTTPS
Europe (Frankfurt) eu-central-1 discovery-datasync.eu-central-1.amazonaws.com HTTPS
Europe (Ireland) eu-west-1 discovery-datasync.eu-west-1.amazonaws.com HTTPS
Europe (London) eu-west-2 discovery-datasync.eu-west-2.amazonaws.com HTTPS
Europe (Milan) eu-south-1 discovery-datasync.eu-south-1.amazonaws.com HTTPS
Europe (Paris) eu-west-3 discovery-datasync.eu-west-3.amazonaws.com HTTPS
Europe (Stockholm) eu-north-1 discovery-datasync.eu-north-1.amazonaws.com HTTPS
Middle East (Bahrain) me-south-1 discovery-datasync.me-south-1.amazonaws.com HTTPS
Middle East (UAE) me-central-1 discovery-datasync.me-central-1.amazonaws.com HTTPS
South America (São Paulo) sa-east-1 discovery-datasync.sa-east-1.amazonaws.com HTTPS

Service quotas

DataSync task quotas

The following table describes the quotas for DataSync tasks in a specific AWS account and AWS Region.

Resource Quota Adjustable

Maximum number of tasks you can create

100

Yes

(Enhanced mode tasks) Maximum number of source and destination objects that DataSync can work with per task execution

For more information, see How DataSync transfers files, objects, and directories

Virtually unlimited

N/A

(Basic mode tasks) Maximum number of source and destination files, objects, and directories that DataSync can work with per task execution between self-managed storage or other clouds and AWS services

For more information, see How DataSync transfers files, objects, and directories

50 million

Important

Remember the following about this quota:

  • If you transfer Amazon S3 objects with prefixes, the prefixes are treated as directories and count towards the quota. For example, DataSync would considers3://bucket/foo/bar.txt as two directories (./ and ./foo/) and one object (bar.txt).

  • If your task is transferring more than 20 million files, objects, or directories, make sure that you allocate a minimum of 64 GB of RAM to your DataSync agent. For more information, see agent requirements for transfers.

Yes

Tip

Instead of requesting an increase, you can create tasks that focus on specific directories using include and exclude filters. For more information, see Filtering the data transferred by AWS DataSync.

(Basic mode tasks) Maximum number of source and destination files, objects, and directories that DataSync can work with per task execution between AWS storage services

For more information, see How DataSync transfers files, objects, and directories

25 million

Important

If you transfer Amazon S3 objects with prefixes, the prefixes are treated as directories and count towards the quota. For example, DataSync would considers3://bucket/foo/bar.txt as two directories (./ and ./foo/) and one object (bar.txt).

Yes

Tip

Instead of requesting an increase, you can create tasks that focus on specific directories using include and exclude filters. For more information, see Filtering the data transferred by AWS DataSync.

Maximum throughput per task (for transfers that use a DataSync agent)

10 Gbps

No

Maximum throughput per task (for transfers that don't use a DataSync agent)

5 Gbps

No

Maximum number of characters you can include in a task filter

102,400 characters

Note

If you're using the DataSync console, this limit includes all the characters combined in your include and exclude patterns.

No
Maximum number of queued executions for a single task 50 No

Maximum number of concurrent Enhanced mode task executions

120

No
Number of days a task execution's history is retained 30 No

DataSync Discovery quotas

The following table describes the quotas for DataSync Discovery in a specific AWS account and AWS Region.

Resource Quota Adjustable

Maximum number of storage systems you can use with DataSync Discovery

10

No

Maximum number storage systems a DataSync agent can access at a time

4

No