Use Cases and Examples using Amazon A2I - Amazon SageMaker

Use Cases and Examples using Amazon A2I

You can use Amazon Augmented AI to incorporate a human review into your workflow for built-in task types, Amazon Textract and Amazon Rekognition, or your own custom tasks using a custom task type.

When you create a human review workflow using one of the built-in task types, you can specify conditions, such as confidence thresholds, that trigger a human review. The service (Amazon Rekognition or Amazon Textract) creates a human loop on your behalf when these conditions are met and supplies your input data directly to Amazon A2I to send to human reviewers. To learn more about the built-in task types, use the following:

When you use a custom task type, you create and start a human loop using the Amazon A2I Runtime API. Use the custom task type to incorporate a human review workflow with other AWS services or your own custom ML application.

The following table outlines a variety of Amazon A2I use cases that you can explore using SageMaker Jupyter notebooks. To get started with a Jupyter notebook, use the instructions in Use SageMaker Notebook Instance with Amazon A2I Jupyter Notebook. For more examples, see this GitHub repository.

Use Case Description Task Type

Use Amazon A2I with Amazon Textract

Have humans review single-page documents to review important form key value pairs, or have Amazon Textract randomly sample and send documents from your dataset to humans for review.

Built-in
Use Amazon A2I with Amazon Rekognition

Have humans review unsafe images for explicit adult or violent content if Amazon Rekognition returns a low confidence score, or have Amazon Rekognition randomly sample and send images from your dataset to humans for review.

Built-in

Use Amazon A2I with Amazon Comprehend

Have humans review Amazon Comprehend inferences about text data such as sentiment analysis, text syntax, and entity detection.

Custom

Use Amazon A2I with Amazon Transcribe

Have humans review Amazon Transcribe transcriptions of video or audio files. Use the results of transcription human review loops to create a custom vocabulary and improve future transcriptions of similar video or audio content.

Custom
Use Amazon A2I with Amazon Translate

Have humans review low-confidence translations returned from Amazon Translate.

Custom

Use Amazon A2I to review real time ML inferences

Use Amazon A2I to review real time, low-confidence inferences made by a model deployed to an SageMaker hosted endpoint and incrementally train your model using Amazon A2I output data.

Custom

Use Amazon A2I to review tabular data

Use Amazon A2I to integrate a human review loop into an ML application that uses tabular data.

Custom

Use SageMaker Notebook Instance with Amazon A2I Jupyter Notebook

For an end-to-end example that demonstrates how to integrate an Amazon A2I human review loop into a machine learning workflow, you can use a Jupyter notebook from this GitHub Repository in an SageMaker Notebook instance.

To use an Amazon A2I custom task type sample notebook in an Amazon SageMaker notebook Instance:

  1. If you do not have an active SageMaker notebook instance, create one by following the instructions in Step 2: Create an Amazon SageMaker Notebook Instance.

  2. When your notebook instance is active, choose Open JupyterLab to the right of the notebook instance's name. It may take a few moments for JupyterLab to load.

  3. Choose the icon to clone a GitHub repository into your workspace.

  4. Enter the amazon-a2i-sample-jupyter-notebooks repository HTTPS URL.

  5. Choose CLONE.

  6. Open the notebook that you would like to run.

  7. Follow the instructions in the notebook to configure your human review workflow and human loop and run the cells.

  8. To avoid incurring unnecessary charges, when you are done with the demo, stop and delete your notebook instance in addition to any Amazon S3 buckets, IAM roles, and CloudWatch Events resources created during the walkthrough.