Modify Your Training Script Using SageMaker's Distributed Model Parallel Library - Amazon SageMaker

Modify Your Training Script Using SageMaker's Distributed Model Parallel Library

Use this section to learn how to customize your training script with Amazon SageMaker's distributed model parallel library-specific API functions and parameters. We recommend you use this documentation alongside the model parallel library API documentation.

The training script examples provided in these sections are simplified and designed to highlight the required changes you must make to use the library. For end to end, runnable notebook examples that demonstrate how to use a TensorFlow or PyTorch training script with the SageMaker distributed model parallel library, see Amazon SageMaker Distributed Training Notebook Examples.