Running jobs on SageMaker HyperPod clusters orchestrated by Amazon EKS
The following topics provide procedures and examples of accessing compute nodes and running ML workloads on provisioned SageMaker HyperPod clusters orchestrated with Amazon EKS. Depending on how you have set up the environment on your HyperPod cluster, there are many ways to run ML workloads on HyperPod clusters.
Tip
For hands-on experience and guidance on how to set up and use an SageMaker HyperPod cluster
orchestrated with Amazon EKS, we recommend taking this Amazon EKS Support in SageMaker HyperPod
Data scientist users can train foundational models using the EKS cluster set as the
orchestrator for the SageMaker HyperPod cluster. Scientists leverage the SageMaker HyperPod CLIkubectl
commands to find available SageMaker HyperPod clusters, submit
training jobs (Pods), and manage their workloads. The SageMaker HyperPod CLI enables job
submission using a training job schema file, and provides capabilities for job listing,
description, cancellation, and execution. Scientists can use Kubeflow Training
Operator