Monitoring a Model in Production - Amazon SageMaker

Monitoring a Model in Production

After you deploy a model into your production environment, use Amazon SageMaker model monitor to continuously monitor the quality of your machine learning models in real time. Amazon CloudWatch model monitor enables you to set up an automated alert triggering system when there are deviations in the model quality, such as data drift and anomalies. Amazon CloudWatch Logs collects log files of monitoring the model status and notifies when the quality of your model hits certain thresholds that you preset. AWS CloudTrail stores the log files to an Amazon S3 bucket you specify. Early and pro-active detection of model deviations through AWS model monitor products enables you to take prompt actions to maintain and improve the quality of your deployed model.

For more information about Amazon SageMaker model monitoring products, see Amazon SageMaker Model Monitor.

To start your machine learning journey with Amazon SageMaker, sign up for an AWS account at Set Up Amazon SageMaker.