Step 1: Adapt your training script to use the SMDDP collective operations

The training script examples provided in this section are simplified and highlight only the required changes to enable the SageMaker distributed data parallelism (SMDDP) library in your training script. For end-to-end Jupyter notebook examples that demonstrate how to run a distributed training job with the SMDDP library, see Amazon SageMaker data parallelism library examples.

Topics

• Use the SMDDP library in your PyTorch training script
• Use the SMDDP library in your PyTorch Lightning training script
• Use the SMDDP library in your TensorFlow training script (deprecated)