Amazon Elastic MapReduce
Developer Guide (API Version 2009-03-31)
Did this page help you?  Yes | No |  Tell us about it...
« PreviousNext »
View the PDF for this guide.Go to the AWS Discussion Forum for this product.Go to the Kindle Store to download this guide in Kindle format.

View Cluster Details

After you start a cluster, you can monitor its status and retrieve extended information about its execution. This section describes the methods used to view the details of Amazon EMR clusters. You can view clusters in any state.

This procedure explains how to view the details of a cluster using the Amazon EMR console.

To view cluster details using the console

  1. Sign in to the AWS Management Console and open the Amazon EMR console at https://console.aws.amazon.com/elasticmapreduce/.

  2. You have the option to view details in the Cluster List page. By selecting the arrow icon next to each cluster, the row view expands and gives some details and actions for the cluster you chose.

  3. For more details, click the cluster link to optn the Cluster Details page. The Summary section displays detailed information about the selected cluster.

The following examples demonstrate how to retrieve cluster details using the AWS CLI.

To view cluster details using the AWS CLI

Use the describe-cluster command to view cluster-level details including status, hardware and software configuration, VPC settings, bootstrap actions, instance groups and so on.

  • To use the describe-cluster command, you need the cluster ID. The cluster ID can be retrieved using the list-clusters command. To view cluster details, type the following command and replace j-1K48XXXXXXHCB with your cluster ID.

    aws emr describe-cluster --cluster-id j-1K48XXXXXXHCB

    The output is similar to the following:

    {
        "Cluster": {
            "Status": {
                "Timeline": {
                    "ReadyDateTime": 1413102659.072,
                    "EndDateTime": 1413103872.89,
                    "CreationDateTime": 1413102441.707
                },
                "State": "TERMINATED",
                "StateChangeReason": {
                    "Message": "Terminated by user request",
                    "Code": "USER_REQUEST"
                }
            },
            "Ec2InstanceAttributes": {
                "Ec2AvailabilityZone": "us-west-2a"
            },
            "Name": "Development Cluster",
            "Tags": [],
            "TerminationProtected": false,
            "RunningAmiVersion": "3.1.0",
            "NormalizedInstanceHours": 24,
            "InstanceGroups": [
                {
                    "RequestedInstanceCount": 2,
                    "Status": {
                        "Timeline": {
                            "ReadyDateTime": 1413102659.09,
                            "EndDateTime": 1413103872.779,
                            "CreationDateTime": 1413102441.708
                        },
                        "State": "TERMINATED",
                        "StateChangeReason": {
                            "Message": "Job flow terminated",
                            "Code": "CLUSTER_TERMINATED"
                        }
                    },
                    "Name": "CORE",
                    "InstanceGroupType": "CORE",
                    "InstanceType": "m3.xlarge",
                    "Id": "ig-115XXXXXX52SX",
                    "Market": "ON_DEMAND",
                    "RunningInstanceCount": 0
                },
                {
                    "RequestedInstanceCount": 1,
                    "Status": {
                        "Timeline": {
                            "ReadyDateTime": 1413102655.968,
                            "EndDateTime": 1413103872.779,
                            "CreationDateTime": 1413102441.708
                        },
                        "State": "TERMINATED",
                        "StateChangeReason": {
                            "Message": "Job flow terminated",
                            "Code": "CLUSTER_TERMINATED"
                        }
                    },
                    "Name": "MASTER",
                    "InstanceGroupType": "MASTER",
                    "InstanceType": "m3.xlarge",
                    "Id": "ig-26LXXXXXXFCXQ",
                    "Market": "ON_DEMAND",
                    "RunningInstanceCount": 0
                }
            ],
            "Applications": [
                {
                    "Version": "2.4.0",
                    "Name": "hadoop"
                }
            ],
            "MasterPublicDnsName": "ec2-XX-XX-XXX-XX.us-west-2.compute.amazonaws.com
    ",
            "VisibleToAllUsers": true,
            "BootstrapActions": [
                {
                    "Args": [],
                    "Name": "Install Ganglia",
                    "ScriptPath": "s3://us-west-2.elasticmapreduce/bootstrap-actions
    /install-ganglia"
                }
            ],
            "RequestedAmiVersion": "3.1.0",
            "AutoTerminate": false,
            "Id": "j-Z2OXXXXXXI45"
        }
    }

    For more information on using Amazon EMR commands in the AWS CLI, see http://docs.aws.amazon.com/cli/latest/reference/emr.

To list clusters by creation date using the AWS CLI

To list clusters by creation date, type the list-clusters command with the --created-after and --created-before parameters.

  • To list clusters created between 10-09-2014 and 10-12-2014, type the following command.

    aws emr list-clusters --created-after 2014-10-09T00:12:00 --created-before 2014-10-12T00:12:00

    The output lists all clusters created between the specified timestamps.

    For more information on using Amazon EMR commands in the AWS CLI, see http://docs.aws.amazon.com/cli/latest/reference/emr.

To list clusters by state using the AWS CLI

To list clusters by state, type the list-clusters command with the --cluster-states parameter. Valid cluster states include: STARTING, BOOTSTRAPPING, RUNNING, WAITING, TERMINATING, TERMINATED, and TERMINATED_WITH_ERRORS.

You can also use several shortcut parameters to view clusters. The --active parameter filters clusters in the STARTING,BOOTSTRAPPING, RUNNING, WAITING, or TERMINATING states. The --terminated parameter filters clusters in the TERMINATED state. The --failed parameter filters clusters in the TERMINATED_WITH_ERRORS state.

  • Type the following command to list all TERMINATED clusters.

    aws emr list-clusters --cluster-states TERMINATED

    Or:

    aws emr list-clusters --terminated

    The output lists all clusters in the state specified.

    For more information on using Amazon EMR commands in the AWS CLI, see http://docs.aws.amazon.com/cli/latest/reference/emr.