You can create custom rules to monitor your training job using the Debugger rule APIs and
the open source smdebug
Python library
Prerequisites for creating a custom
rule
To create Debugger custom rules, you need the following prerequisites.
Your own custom rule python script
Amazon SageMaker Debugger image URIs for custom rule evaluators