com.amazonaws.services.sagemaker.model

Class ShuffleConfig

java.lang.Object

com.amazonaws.services.sagemaker.model.ShuffleConfig

All Implemented Interfaces:

StructuredPojo, Serializable, Cloneable

@Generated(value="com.amazonaws:aws-java-sdk-code-generator")
public class ShuffleConfig
extends Object
implements Serializable, Cloneable, StructuredPojo

A configuration for a shuffle option for input data in a channel. If you use S3Prefix for S3DataType, the results of the S3 key prefix matches are shuffled. If you use ManifestFile, the order of the S3 object references in the ManifestFile is shuffled. If you use AugmentedManifestFile, the order of the JSON lines in the AugmentedManifestFile is shuffled. The shuffling order is determined using the Seed value.

For Pipe input mode, when ShuffleConfig is specified shuffling is done at the start of every epoch. With large datasets, this ensures that the order of the training data is different for each epoch, and it helps reduce bias and possible overfitting. In a multi-node training job when ShuffleConfig is combined with S3DataDistributionType of ShardedByS3Key, the data is shuffled across nodes so that the content sent to a particular node on the first epoch might be sent to a different node on the second epoch.

See Also:

AWS API Documentation, Serialized Form

Constructor Summary

Constructors

Constructor and Description
ShuffleConfig()

Method Summary

Modifier and Type	Method and Description
ShuffleConfig	clone()
boolean	equals(Object obj)
Long	getSeed() Determines the shuffling order in ShuffleConfig value.
int	hashCode()
void	marshall(ProtocolMarshaller protocolMarshaller) Marshalls this structured data using the given ProtocolMarshaller.
void	setSeed(Long seed) Determines the shuffling order in ShuffleConfig value.
String	toString() Returns a string representation of this object.
ShuffleConfig	withSeed(Long seed) Determines the shuffling order in ShuffleConfig value.

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

ShuffleConfig

public ShuffleConfig()

Method Detail

setSeed

public void setSeed(Long seed)

Determines the shuffling order in ShuffleConfig value.

Parameters:

seed - Determines the shuffling order in ShuffleConfig value.

getSeed

public Long getSeed()

Determines the shuffling order in ShuffleConfig value.

Returns:

Determines the shuffling order in ShuffleConfig value.

withSeed

public ShuffleConfig withSeed(Long seed)

Determines the shuffling order in ShuffleConfig value.

Parameters:

seed - Determines the shuffling order in ShuffleConfig value.

Returns:

Returns a reference to this object so that method calls can be chained together.

toString

public String toString()

Returns a string representation of this object. This is useful for testing and debugging. Sensitive data will be redacted from this string using a placeholder value.

Overrides:

toString in class Object

Returns:

A string representation of this object.

See Also:

Object.toString()

equals

public boolean equals(Object obj)

Overrides:

equals in class Object

hashCode

public int hashCode()

Overrides:

hashCode in class Object

clone

public ShuffleConfig clone()

Overrides:

clone in class Object

marshall

public void marshall(ProtocolMarshaller protocolMarshaller)

Description copied from interface: StructuredPojo

Marshalls this structured data using the given ProtocolMarshaller.

Specified by:

marshall in interface StructuredPojo

Parameters:

protocolMarshaller - Implementation of ProtocolMarshaller used to marshall this object's data.