Menu
Amazon Elastic MapReduce
Developer Guide (API Version 2009-03-31)

View Cluster Details

This documentation is for AMI versions 2.x and 3.x of Amazon EMR. See the Amazon EMR Release Guide for information about Amazon EMR releases 4.0.0 and above. For information about managing the Amazon EMR service in 4.x releases, see the Amazon EMR Management Guide.

After you start a cluster, you can monitor its status and retrieve extended information about its execution. This section describes the methods used to view the details of Amazon EMR clusters. You can view clusters in any state.

This procedure explains how to view the details of a cluster using the Amazon EMR console.

To view cluster details using the console

  1. Sign in to the AWS Management Console and open the Amazon EMR console at https://console.aws.amazon.com/elasticmapreduce/.

  2. You have the option to view details in the Cluster List page. By selecting the arrow icon next to each cluster, the row view expands and gives some details and actions for the cluster you chose:

    Cluster information

  3. For more details, choose the cluster link to open the Cluster Details page. The Summary section displays detailed information about the selected cluster.

    Cluster details page

The following examples demonstrate how to retrieve cluster details using the AWS CLI and the Amazon EMR CLI.

To view cluster details using the AWS CLI

Use the describe-cluster command to view cluster-level details including status, hardware and software configuration, VPC settings, bootstrap actions, instance groups and so on.

  • To use the describe-cluster command, you need the cluster ID. The cluster ID can be retrieved using the list-clusters command. To view cluster details, type the following command and replace j-1K48XXXXXXHCB with your cluster ID.

    aws emr describe-cluster --cluster-id j-1K48XXXXXXHCB

    The output is similar to the following:

    {
        "Cluster": {
            "Status": {
                "Timeline": {
                    "ReadyDateTime": 1413102659.072,
                    "EndDateTime": 1413103872.89,
                    "CreationDateTime": 1413102441.707
                },
                "State": "TERMINATED",
                "StateChangeReason": {
                    "Message": "Terminated by user request",
                    "Code": "USER_REQUEST"
                }
            },
            "Ec2InstanceAttributes": {
                "Ec2AvailabilityZone": "us-west-2a"
            },
            "Name": "Development Cluster",
            "Tags": [],
            "TerminationProtected": false,
            "RunningAmiVersion": "3.1.0",
            "NormalizedInstanceHours": 24,
            "InstanceGroups": [
                {
                    "RequestedInstanceCount": 2,
                    "Status": {
                        "Timeline": {
                            "ReadyDateTime": 1413102659.09,
                            "EndDateTime": 1413103872.779,
                            "CreationDateTime": 1413102441.708
                        },
                        "State": "TERMINATED",
                        "StateChangeReason": {
                            "Message": "Job flow terminated",
                            "Code": "CLUSTER_TERMINATED"
                        }
                    },
                    "Name": "CORE",
                    "InstanceGroupType": "CORE",
                    "InstanceType": "m3.xlarge",
                    "Id": "ig-115XXXXXX52SX",
                    "Market": "ON_DEMAND",
                    "RunningInstanceCount": 0
                },
                {
                    "RequestedInstanceCount": 1,
                    "Status": {
                        "Timeline": {
                            "ReadyDateTime": 1413102655.968,
                            "EndDateTime": 1413103872.779,
                            "CreationDateTime": 1413102441.708
                        },
                        "State": "TERMINATED",
                        "StateChangeReason": {
                            "Message": "Job flow terminated",
                            "Code": "CLUSTER_TERMINATED"
                        }
                    },
                    "Name": "MASTER",
                    "InstanceGroupType": "MASTER",
                    "InstanceType": "m3.xlarge",
                    "Id": "ig-26LXXXXXXFCXQ",
                    "Market": "ON_DEMAND",
                    "RunningInstanceCount": 0
                }
            ],
            "Applications": [
                {
                    "Version": "2.4.0",
                    "Name": "hadoop"
                }
            ],
            "MasterPublicDnsName": "ec2-XX-XX-XXX-XX.us-west-2.compute.amazonaws.com",
            "VisibleToAllUsers": true,
            "BootstrapActions": [
                {
                    "Args": [],
                    "Name": "Install Ganglia",
                    "ScriptPath": "s3://us-west-2.elasticmapreduce/bootstrap-actions
    /install-ganglia"
                }
            ],
            "RequestedAmiVersion": "3.1.0",
            "AutoTerminate": false,
            "Id": "j-Z2OXXXXXXI45"
        }
    }

    For more information on using Amazon EMR commands in the AWS CLI, see http://docs.aws.amazon.com/cli/latest/reference/emr.

To list clusters by creation date using the AWS CLI

To list clusters by creation date, type the list-clusters command with the --created-after and --created-before parameters.

  • To list clusters created between 10-09-2014 and 10-12-2014, type the following command.

    aws emr list-clusters --created-after 2014-10-09T00:12:00 --created-before 2014-10-12T00:12:00

    The output lists all clusters created between the specified timestamps.

    For more information on using Amazon EMR commands in the AWS CLI, see http://docs.aws.amazon.com/cli/latest/reference/emr.

Note

Amazon EMR preserves metadata information about completed clusters for your reference, at no charge, for two months. The console does not provide a way to delete completed clusters from the console; these are automatically removed for you after two months.

To list clusters by state using the AWS CLI

To list clusters by state, type the list-clusters command with the --cluster-states parameter. Valid cluster states include: STARTING, BOOTSTRAPPING, RUNNING, WAITING, TERMINATING, TERMINATED, and TERMINATED_WITH_ERRORS.

You can also use several shortcut parameters to view clusters. The --active parameter filters clusters in the STARTING,BOOTSTRAPPING, RUNNING, WAITING, or TERMINATING states. The --terminated parameter filters clusters in the TERMINATED state. The --failed parameter filters clusters in the TERMINATED_WITH_ERRORS state.

  • Type the following command to list all TERMINATED clusters.

    aws emr list-clusters --cluster-states TERMINATED

    Or:

    aws emr list-clusters --terminated

    The output lists all clusters in the state specified.

    For more information on using Amazon EMR commands in the AWS CLI, see http://docs.aws.amazon.com/cli/latest/reference/emr.

For more information about the input parameters unique to DescribeJobFlows, see DescribeJobFlows.