Class: Aws::SageMaker::Types::ProcessingS3Input

Inherits:
Struct
  • Object
show all
Defined in:
gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb

Overview

Configuration for downloading input data from Amazon S3 into the processing container.

Constant Summary collapse

SENSITIVE =
[]

Instance Attribute Summary collapse

Instance Attribute Details

#local_pathString

The local path in your container where you want Amazon SageMaker to write input data to. LocalPath is an absolute path to the input data and must begin with /opt/ml/processing/. LocalPath is a required parameter when AppManaged is False (default).

Returns:

  • (String)


37184
37185
37186
37187
37188
37189
37190
37191
37192
37193
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 37184

class ProcessingS3Input < Struct.new(
  :s3_uri,
  :local_path,
  :s3_data_type,
  :s3_input_mode,
  :s3_data_distribution_type,
  :s3_compression_type)
  SENSITIVE = []
  include Aws::Structure
end

#s3_compression_typeString

Whether to GZIP-decompress the data in Amazon S3 as it is streamed into the processing container. Gzip can only be used when Pipe mode is specified as the S3InputMode. In Pipe mode, Amazon SageMaker streams input data from the source directly to your container without using the EBS volume.

Returns:

  • (String)


37184
37185
37186
37187
37188
37189
37190
37191
37192
37193
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 37184

class ProcessingS3Input < Struct.new(
  :s3_uri,
  :local_path,
  :s3_data_type,
  :s3_input_mode,
  :s3_data_distribution_type,
  :s3_compression_type)
  SENSITIVE = []
  include Aws::Structure
end

#s3_data_distribution_typeString

Whether to distribute the data from Amazon S3 to all processing instances with FullyReplicated, or whether the data from Amazon S3 is shared by Amazon S3 key, downloading one shard of data to each processing instance.

Returns:

  • (String)


37184
37185
37186
37187
37188
37189
37190
37191
37192
37193
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 37184

class ProcessingS3Input < Struct.new(
  :s3_uri,
  :local_path,
  :s3_data_type,
  :s3_input_mode,
  :s3_data_distribution_type,
  :s3_compression_type)
  SENSITIVE = []
  include Aws::Structure
end

#s3_data_typeString

Whether you use an S3Prefix or a ManifestFile for the data type. If you choose S3Prefix, S3Uri identifies a key name prefix. Amazon SageMaker uses all objects with the specified key name prefix for the processing job. If you choose ManifestFile, S3Uri identifies an object that is a manifest file containing a list of object keys that you want Amazon SageMaker to use for the processing job.

Returns:

  • (String)


37184
37185
37186
37187
37188
37189
37190
37191
37192
37193
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 37184

class ProcessingS3Input < Struct.new(
  :s3_uri,
  :local_path,
  :s3_data_type,
  :s3_input_mode,
  :s3_data_distribution_type,
  :s3_compression_type)
  SENSITIVE = []
  include Aws::Structure
end

#s3_input_modeString

Whether to use File or Pipe input mode. In File mode, Amazon SageMaker copies the data from the input source onto the local ML storage volume before starting your processing container. This is the most commonly used input mode. In Pipe mode, Amazon SageMaker streams input data from the source directly to your processing container into named pipes without using the ML storage volume.

Returns:

  • (String)


37184
37185
37186
37187
37188
37189
37190
37191
37192
37193
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 37184

class ProcessingS3Input < Struct.new(
  :s3_uri,
  :local_path,
  :s3_data_type,
  :s3_input_mode,
  :s3_data_distribution_type,
  :s3_compression_type)
  SENSITIVE = []
  include Aws::Structure
end

#s3_uriString

The URI of the Amazon S3 prefix Amazon SageMaker downloads data required to run a processing job.

Returns:

  • (String)


37184
37185
37186
37187
37188
37189
37190
37191
37192
37193
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 37184

class ProcessingS3Input < Struct.new(
  :s3_uri,
  :local_path,
  :s3_data_type,
  :s3_input_mode,
  :s3_data_distribution_type,
  :s3_compression_type)
  SENSITIVE = []
  include Aws::Structure
end