Model servers for model deployment with Amazon SageMaker

You can use popular model servers, such as TorchServe, DJL Serving, and Triton Inference Server, to deploy your models on SageMaker. The following topics explain how.

Topics

• Deploy models with TorchServe
• Deploy models with DJL Serving
• Model deployment with Triton Inference Server