Using Amazon Augmented AI for Human Review - Amazon SageMaker

Using Amazon Augmented AI for Human Review

When you use AI applications such as Amazon Rekognition, Amazon Textract, or your custom machine learning (ML) models, you can use Amazon Augmented AI to get human review of low confidence predictions or a random sample of predictions.

What is Amazon Augmented AI?

Amazon Augmented AI (Amazon A2I) makes it easy to build the workflows required for human review of ML predictions. Amazon A2I brings human review to all developers, removing the undifferentiated heavy lifting associated with building human review systems or managing large numbers of human reviewers.

Many machine learning applications require humans to review low-confidence predictions to ensure the results are correct. For example, extracting information from scanned mortgage application forms can require human review in some cases due to low-quality scans or poor handwriting. Building human review systems can be time-consuming and expensive because it involves implementing complex processes or workflows, writing custom software to manage review tasks and results, and in many cases, managing large groups of reviewers.

Amazon A2I makes it easy to build and manage human reviews for machine learning applications. Amazon A2I provides built-in human review workflows for common machine learning use cases, such as content moderation and text extraction from documents, which allows predictions from Amazon Rekognition and Amazon Textract to be reviewed easily. You can also create your own workflows for ML models built on SageMaker or any other tools. Using Amazon A2I, you can allow human reviewers to step in when a model is unable to make a high-confidence prediction or to audit its predictions on an ongoing basis.

Amazon A2I Use Case Examples

The following are examples of how you can use Amazon A2I to integrate a human review loop into your ML application. For each of these examples, you can find a Jupyter Notebook that demonstrates that workflow in Use Cases and Examples using Amazon A2I.

  • Use Amazon A2I with Amazon Textract – Have humans review single page documents to review important form key value pairs, or have Amazon Textract randomly sample and send documents from your dataset to humans for review.

  • Use Amazon A2I with Amazon Rekognition– Have humans review unsafe images for explicit adult or violent content if Amazon Rekognition returns a low confidence score, or have Amazon Rekognition randomly sample and send images from your dataset to humans for review.

  • Use Amazon A2I to review real time ML inferences – Use Amazon A2I to review real time, low-confidence inferences made by a model deployed to an SageMaker hosted endpoint and incrementally train your model using Amazon A2I output data.

  • Use Amazon A2I with Amazon Comprehend – Have humans review Amazon Comprehend inferences about text data such as sentiment analysis, text syntax, and entitiy detection.

  • Use Amazon A2I with Amazon Transcribe – Have humans review Amazon Transcribe transcriptions of video or audio files. Use the results of transcription human review loops to create a custom vocabulary and improve future transcriptions of similar video or audio content.

  • Use Amazon A2I with Amazon Translate – Have humans review low-confidence translations returned from Amazon Translate.

  • Use Amazon A2I to review tabular data – Use Amazon A2I to integrate a human review loop into an ML application that uses tabular data.

        Amazon Augmented AI - How It Works