AWS Data Pipeline endpoints and quotas
The following are the service endpoints and service quotas for this service. To connect programmatically to an AWS service, you use an endpoint. In addition to the standard AWS endpoints, some AWS services offer FIPS endpoints in selected Regions. For more information, see AWS service endpoints. Service quotas, also referred to as limits, are the maximum number of service resources or operations for your AWS account. For more information, see AWS service quotas.
Note
AWS recommends using Regional STS endpoints within your applications and avoid using the global (legacy) STS endpoint. Regional STS endpoints reduce latency, build in redundancy, and increase session token validity. For more information about configuring your applications to use the regional STS endpoint, see AWS STS Regionalized endpoints in the AWS SDKs and Tools Reference Guide. For more information about the global (legacy) AWS STS endpoint, including how to monitor for use of this endpoint, see How to use Regional AWS STS endpoints in the AWS Security blog.
Service endpoints
Region Name | Region | Endpoint | Protocol |
---|---|---|---|
US East (N. Virginia) | us-east-1 | datapipeline.us-east-1.amazonaws.com | HTTPS |
US West (Oregon) | us-west-2 | datapipeline.us-west-2.amazonaws.com | HTTPS |
Asia Pacific (Sydney) | ap-southeast-2 | datapipeline.ap-southeast-2.amazonaws.com | HTTPS |
Asia Pacific (Tokyo) | ap-northeast-1 | datapipeline.ap-northeast-1.amazonaws.com | HTTPS |
Europe (Ireland) | eu-west-1 | datapipeline.eu-west-1.amazonaws.com | HTTPS |
Service quotas
Name | Default | Adjustable | Description |
---|---|---|---|
Minimum delay between retry attempts in minutes | Each supported Region: 2 | No | The minimum delay between retry attempts in minutes. |
Minimum scheduling interval in minutes | Each supported Region: 15 | No | The minimum scheduling interval in minutes. |
Number of EC2 instances per Ec2Resource object | Each supported Region: 1 | No | The maximum number of EC2 instances per Ec2Resource object. |
Number of UTF8 bytes per field | Each supported Region: 10,240 | No | The maximum number of UTF8 bytes per field. |
Number of UTF8 bytes per field name or identifier | Each supported Region: 256 | No | The maximum number of UTF8 bytes per field name or identifier. |
Number of UTF8 bytes per object | Each supported Region: 15,360 | No | The maximum number of UTF8 bytes per object (including field names). |
Number of active instances per object | Each supported Region: 5 |
Yes |
The maximum number of active instances per object. |
Number of fields per object | Each supported Region: 50 | No | The maximum number of fields per object. |
Number of objects per pipeline | Each supported Region: 100 |
Yes |
The maximum number of objects that you can define per pipeline. |
Number of pipelines you can create | Each supported Region: 100 |
Yes |
The maximum number of pipelines that you can create. |
Number of roll-ups into a single object | Each supported Region: 32 | No | The maximum number of roll-ups into a single object. |
Rate of creation of an instance from an object | Each supported Region: 1 per 5 minutes | No | The rate of creation of an instance from an object per 5 minutes. |
Retries of a pipeline activity per task | Each supported Region: 5 | No | The maximum number of retries of a pipeline activity per task. |
For more information, see AWS Data Pipeline Quotas in the AWS Data Pipeline Developer Guide.