CreateClusterRequest
Types
Properties
The autoscaling configuration for the cluster. Enables automatic scaling of cluster nodes based on workload demand using a Karpenter-based system.
The name for the new SageMaker HyperPod cluster.
The Amazon Resource Name (ARN) of the IAM role that HyperPod assumes to perform cluster autoscaling operations. This role must have permissions for sagemaker:BatchAddClusterNodes
and sagemaker:BatchDeleteClusterNodes
. This is only required when autoscaling is enabled and when HyperPod is performing autoscaling operations.
The instance groups to be created in the SageMaker HyperPod cluster.
The mode for provisioning nodes in the cluster. You can specify the following modes:
The node recovery mode for the SageMaker HyperPod cluster. When set to Automatic
, SageMaker HyperPod will automatically reboot or replace faulty nodes when issues are detected. When set to None
, cluster administrators will need to manually manage any faulty cluster instances.
The type of orchestrator to use for the SageMaker HyperPod cluster. Currently, the only supported value is "eks"
, which is to use an Amazon Elastic Kubernetes Service cluster as the orchestrator.
The specialized instance groups for training models like Amazon Nova to be created in the SageMaker HyperPod cluster.
Custom tags for managing the SageMaker HyperPod cluster as an Amazon Web Services resource. You can add tags to your cluster in the same way you add them in other Amazon Web Services services that support tagging. To learn more about tagging Amazon Web Services resources in general, see Tagging Amazon Web Services Resources User Guide.
The configuration for managed tier checkpointing on the HyperPod cluster. When enabled, this feature uses a multi-tier storage approach for storing model checkpoints, providing faster checkpoint operations and improved fault tolerance across cluster nodes.
Specifies the Amazon Virtual Private Cloud (VPC) that is associated with the Amazon SageMaker HyperPod cluster. You can control access to and from your resources by configuring your VPC. For more information, see Give SageMaker access to resources in your Amazon VPC.