Request Syntax Request Parameters Response Syntax Response Elements Errors See Also

CreateIngestionJob

Creates an ingestion job that performs a one-time bulk ingestion of data from an Amazon S3 bucket into an index in an OpenSearch Serverless collection. An ingestion job scans the source bucket, indexes the documents it finds, and then completes. To continuously ingest new data as it arrives, use CreateIngestionStream instead.

Request Syntax


{
   "clientToken": "string",
   "collectionId": "string",
   "failureIndexName": "string",
   "indexName": "string",
   "ingestionJobName": "string",
   "source": { 
      "s3": { 
         "bucket": "string",
         "bucketOwnerAccountId": "string",
         "keyPrefix": "string"
      }
   },
   "tags": [ 
      { 
         "key": "string",
         "value": "string"
      }
   ]
}

Request Parameters

For information about the parameters that are common to all actions, see Common Parameters.

The request accepts the following data in JSON format.

clientToken

Unique, case-sensitive identifier to ensure idempotency of the request.

Type: String

Length Constraints: Minimum length of 1. Maximum length of 512.

Required: No

collectionId

The unique identifier of the collection to ingest data into.

Type: String

Length Constraints: Minimum length of 3. Maximum length of 40.

Pattern: [a-z0-9]{3,40}

Required: Yes

failureIndexName

The name of the index where documents that fail to be ingested are recorded.

Type: String

Length Constraints: Minimum length of 1. Maximum length of 255.

Pattern: [a-z0-9.][a-z0-9._-]*

Required: No

indexName

The name of the index to ingest documents into.

Type: String

Length Constraints: Minimum length of 1. Maximum length of 255.

Pattern: [a-z0-9.][a-z0-9._-]*

Required: Yes

ingestionJobName

The name of the ingestion job. The name must be unique within the collection.

Type: String

Length Constraints: Minimum length of 3. Maximum length of 32.

Pattern: [a-z][a-z0-9-]*

Required: Yes

source

The Amazon S3 source to ingest data from.

Type: IngestionJobSource object

Required: Yes

tags

An arbitrary set of tags (key–value pairs) to associate with the ingestion job.

Type: Array of Tag objects

Array Members: Minimum number of 0 items. Maximum number of 50 items.

Required: No

Response Syntax


{
   "ingestionJobDetail": { 
      "activeAlerts": [ 
         { 
            "code": "string",
            "message": "string"
         }
      ],
      "arn": "string",
      "collectionId": "string",
      "createdAt": number,
      "failureIndexName": "string",
      "failureReasons": [ 
         { 
            "code": "string",
            "message": "string"
         }
      ],
      "indexName": "string",
      "ingestionJobId": "string",
      "ingestionJobName": "string",
      "revision": number,
      "source": { 
         "s3": { 
            "bucket": "string",
            "bucketOwnerAccountId": "string",
            "keyPrefix": "string"
         }
      },
      "state": "string",
      "statistics": { 
         "s3": { 
            "objectsDiscovered": number,
            "objectsFailed": number,
            "objectsIngested": number
         }
      },
      "status": "string",
      "updatedAt": number
   }
}

Response Elements

If the action is successful, the service sends back an HTTP 200 response.

The following data is returned in JSON format by the service.

ingestionJobDetail

Details about the created ingestion job.

Type: IngestionJobDetail object

Errors

For information about the errors that are common to all actions, see Common Error Types.

ConflictException

When creating a resource, thrown when a resource with the same name already exists or is being created. When deleting a resource, thrown when the resource is not in the ACTIVE, FAILED, or UPDATE_FAILED state.

HTTP Status Code: 400

InternalServerException

Thrown when an error internal to the service occurs while processing a request.

HTTP Status Code: 500

ResourceNotFoundException

Thrown when accessing or deleting a resource that does not exist.

HTTP Status Code: 400

ServiceQuotaExceededException

Thrown when you attempt to create more resources than the service allows based on service quotas.

HTTP Status Code: 400

ValidationException

Thrown when the HTTP request contains invalid input or is missing required input.

HTTP Status Code: 400