ProcessingS3Input - Amazon SageMaker Service

ProcessingS3Input

Information about where and how you want to obtain the inputs for an processing job.

Contents

LocalPath

The local path to the Amazon S3 bucket where you want Amazon SageMaker to download the inputs to run a processing job. LocalPath is an absolute path to the input data.

Type: String

Length Constraints: Maximum length of 256.

Pattern: .*

Required: Yes

S3CompressionType

Whether to use Gzip compression for Amazon S3 storage.

Type: String

Valid Values: None | Gzip

Required: No

S3DataDistributionType

Whether the data stored in Amazon S3 is FullyReplicated or ShardedByS3Key.

Type: String

Valid Values: FullyReplicated | ShardedByS3Key

Required: No

S3DataType

Whether you use an S3Prefix or a ManifestFile for the data type. If you choose S3Prefix, S3Uri identifies a key name prefix. Amazon SageMaker uses all objects with the specified key name prefix for the processing job. If you choose ManifestFile, S3Uri identifies an object that is a manifest file containing a list of object keys that you want Amazon SageMaker to use for the processing job.

Type: String

Valid Values: ManifestFile | S3Prefix

Required: Yes

S3InputMode

Whether to use File or Pipe input mode. In File mode, Amazon SageMaker copies the data from the input source onto the local Amazon Elastic Block Store (Amazon EBS) volumes before starting your training algorithm. This is the most commonly used input mode. In Pipe mode, Amazon SageMaker streams input data from the source directly to your algorithm without using the EBS volume.

Type: String

Valid Values: Pipe | File

Required: Yes

S3Uri

The URI for the Amazon S3 storage where you want Amazon SageMaker to download the artifacts needed to run a processing job.

Type: String

Length Constraints: Maximum length of 1024.

Pattern: ^(https|s3)://([^/]+)/?(.*)$

Required: Yes

See Also

For more information about using this API in one of the language-specific AWS SDKs, see the following: