Class: Aws::Comprehend::Types::DocumentClassifierInputDataConfig

Inherits:
Struct
  • Object
show all
Defined in:
gems/aws-sdk-comprehend/lib/aws-sdk-comprehend/types.rb

Overview

Note:

When making an API call, you may pass DocumentClassifierInputDataConfig data as a hash:

{
  data_format: "COMPREHEND_CSV", # accepts COMPREHEND_CSV, AUGMENTED_MANIFEST
  s3_uri: "S3Uri",
  test_s3_uri: "S3Uri",
  label_delimiter: "LabelDelimiter",
  augmented_manifests: [
    {
      s3_uri: "S3Uri", # required
      split: "TRAIN", # accepts TRAIN, TEST
      attribute_names: ["AttributeNamesListItem"], # required
      annotation_data_s3_uri: "S3Uri",
      source_documents_s3_uri: "S3Uri",
      document_type: "PLAIN_TEXT_DOCUMENT", # accepts PLAIN_TEXT_DOCUMENT, SEMI_STRUCTURED_DOCUMENT
    },
  ],
}

The input properties for training a document classifier.

For more information on how the input file is formatted, see how-document-classification-training-data.

Constant Summary collapse

SENSITIVE =
[]

Instance Attribute Summary collapse

Instance Attribute Details

#augmented_manifestsArray<Types::AugmentedManifestsListItem>

A list of augmented manifest files that provide training data for your custom model. An augmented manifest file is a labeled dataset that is produced by Amazon SageMaker Ground Truth.

This parameter is required if you set DataFormat to AUGMENTED_MANIFEST.



2155
2156
2157
2158
2159
2160
2161
2162
2163
# File 'gems/aws-sdk-comprehend/lib/aws-sdk-comprehend/types.rb', line 2155

class DocumentClassifierInputDataConfig < Struct.new(
  :data_format,
  :s3_uri,
  :test_s3_uri,
  :label_delimiter,
  :augmented_manifests)
  SENSITIVE = []
  include Aws::Structure
end

#data_formatString

The format of your training data:

  • COMPREHEND_CSV: A two-column CSV file, where labels are provided in the first column, and documents are provided in the second. If you use this value, you must provide the S3Uri parameter in your request.

  • AUGMENTED_MANIFEST: A labeled dataset that is produced by Amazon SageMaker Ground Truth. This file is in JSON lines format. Each line is a complete JSON object that contains a training document and its associated labels.

    If you use this value, you must provide the AugmentedManifests parameter in your request.

If you don't specify a value, Amazon Comprehend uses COMPREHEND_CSV as the default.

Returns:

  • (String)


2155
2156
2157
2158
2159
2160
2161
2162
2163
# File 'gems/aws-sdk-comprehend/lib/aws-sdk-comprehend/types.rb', line 2155

class DocumentClassifierInputDataConfig < Struct.new(
  :data_format,
  :s3_uri,
  :test_s3_uri,
  :label_delimiter,
  :augmented_manifests)
  SENSITIVE = []
  include Aws::Structure
end

#label_delimiterString

Indicates the delimiter used to separate each label for training a multi-label classifier. The default delimiter between labels is a pipe (|). You can use a different character as a delimiter (if it's an allowed character) by specifying it under Delimiter for labels. If the training documents use a delimiter other than the default or the delimiter you specify, the labels on that line will be combined to make a single unique label, such as LABELLABELLABEL.

Returns:

  • (String)


2155
2156
2157
2158
2159
2160
2161
2162
2163
# File 'gems/aws-sdk-comprehend/lib/aws-sdk-comprehend/types.rb', line 2155

class DocumentClassifierInputDataConfig < Struct.new(
  :data_format,
  :s3_uri,
  :test_s3_uri,
  :label_delimiter,
  :augmented_manifests)
  SENSITIVE = []
  include Aws::Structure
end

#s3_uriString

The Amazon S3 URI for the input data. The S3 bucket must be in the same region as the API endpoint that you are calling. The URI can point to a single input file or it can provide the prefix for a collection of input files.

For example, if you use the URI S3://bucketName/prefix, if the prefix is a single file, Amazon Comprehend uses that file as input. If more than one file begins with the prefix, Amazon Comprehend uses all of them as input.

This parameter is required if you set DataFormat to COMPREHEND_CSV.

Returns:

  • (String)


2155
2156
2157
2158
2159
2160
2161
2162
2163
# File 'gems/aws-sdk-comprehend/lib/aws-sdk-comprehend/types.rb', line 2155

class DocumentClassifierInputDataConfig < Struct.new(
  :data_format,
  :s3_uri,
  :test_s3_uri,
  :label_delimiter,
  :augmented_manifests)
  SENSITIVE = []
  include Aws::Structure
end

#test_s3_uriString

The Amazon S3 URI for the input data. The Amazon S3 bucket must be in the same AWS Region as the API endpoint that you are calling. The URI can point to a single input file or it can provide the prefix for a collection of input files.

Returns:

  • (String)


2155
2156
2157
2158
2159
2160
2161
2162
2163
# File 'gems/aws-sdk-comprehend/lib/aws-sdk-comprehend/types.rb', line 2155

class DocumentClassifierInputDataConfig < Struct.new(
  :data_format,
  :s3_uri,
  :test_s3_uri,
  :label_delimiter,
  :augmented_manifests)
  SENSITIVE = []
  include Aws::Structure
end