Menu
Amazon Rekognition
Developer Guide

Types of Detection and Recognition

The following are the types of detection and recognition that the Rekognition Image API and Rekognition Video API can perform. For information about the APIs, see Image and Video Operations.

Labels

A label refers to any of the following: objects (for example, flower, tree, or table), events (for example, a wedding, graduation, or birthday party), concepts (for example, a landscape, evening, and nature) or activities (for example, getting out of a car). Amazon Rekognition can detect labels in images and videos. However activities are not detected in images. For more information, see Detecting Objects and Scenes.

To detect labels in images, use DetectLabels. To detect labels in stored videos, use StartLabelDetection.

Faces

Amazon Rekognition can detect faces in images and stored videos. With Amazon Rekognition you can get information about where faces are detected in an image or video, facial landmarks such as the position of eyes, and detected emotions such as happy or sad. You can also compare a face in an image with faces detected in another image. Information about faces can also be stored for later retrieval. For more information, see Detecting and Analyzing Faces.

To detect faces in images, use DetectFaces. To detect faces in stored videos, use StartFaceDetection.

Face Search

Amazon Rekognition can search for faces. Facial information is indexed into a container known as a collection. Face information in the collection can then be matched with faces detected in images, stored videos, and streaming video. For more information, Searching Faces in a Collection.

To search for known faces in images, use DetectFaces. To search for known faces in stored videos, use StartFaceDetection. To search for known faces in streaming videos, use CreateStreamProcessor.

People

Amazon Rekognition can track people in a stored video. Rekognition Video provides tracking, face details, and in-frame location information for people detected in a video. People cannot be detected in images. For more information, see Tracking People.

To detect people in stored videos, use StartPersonTracking.

Celebrities

Amazon Rekognition can recognize thousands of celebrities in images and stored videos. You can get information about where a celebrity's face is located on an image, facial landmarks and the pose of a celebrity's face. You can get tracking information for celebrities as they appear throughout a stored video. You can also get further information about a recognized celebrity. For more information, see Recognizing Celebrities.

To recognize celebrities in images, use RecognizeCelebrities. To recognize celebrities in stored videos, use StartCelebrityRecognition.

Unsafe Content

Amazon Rekognition can analyze images and stored videos for explicit or suggestive adult content. For more information, see Detecting Unsafe Content.

To detect unsage images, use DetectModerationLabels. To detect unsafe stored videos, use StartContentModeration.