Use foundation models with the SageMaker Python SDK - Amazon SageMaker AI

Use foundation models with the SageMaker Python SDK

All JumpStart foundation models are available for programmatic deployment using the SageMaker Python SDK.

To deploy publicly available foundation models, you can use their model ID. You can find the model IDs for all publicly available foundation models in the Built-in Algorithms with pre-trained Model Table. Search for the name of a foundation model in the Search bar. Use the Show entries dropdown or the pagination controls to navigate the available models.

Proprietary models must be deployed using the model package information after subscribing to the model in AWS Marketplace.

You can find the list of JumpStart available models in Available foundation models.

Important

Some foundation models require explicit acceptance of an end-user license agreement (EULA). For more information, see EULA acceptance with the SageMaker Python SDK.

The following sections show how to fine-tune publicly available foundation models using the JumpStartEstimator class, deploy publicly available foundation models using the JumpStartModel class, and deploy proprietary foundation models using theModelPackage class.