Amazon Elastic MapReduce
Developer Guide (API Version 2009-03-31)
« PreviousNext »
View the PDF for this guide.Go to the AWS Discussion Forum for this product.Go to the Kindle Store to download this guide in Kindle format.Did this page help you?  Yes | No |  Tell us about it...

View Web Interfaces on the Cluster

Hadoop publishes web interfaces that display status about the cluster. These web interfaces are hosted on the master node of the cluster. You can view these web interfaces by using SSH to create a tunnel to the master node and configuring a SOCKS proxy so your browser can view websites hosted on the master node using the SSH tunnel. For more information, see Connect to the Cluster.

The web user interfaces for Hadoop are located at the URLs in the following table, where master-public-dns-name is the public DNS name of the master node of the cluster. For information about how to locate the public DNS name of the master node for a cluster, see Connect to the Master Node Using SSH.

Name of InterfaceURL
JobTracker http://master-public-dns-name:9100/
HDFS NameNode http://master-public-dns-name:9101/
TaskTracker http://master-public-dns-name:9103/

To relocate these web interfaces, edit conf/hadoop-default.xml.

To view the JobTracker web interface

  1. To access the JobTracker web interface running on the master node, open http://master-public-dns-name:9100/. This web interface is hosted on the master node of the cluster. You can access the web interface by using SSH to create a tunnel to the master node and configuring a SOCKS proxy so your browser can view websites hosted on the master node. For more information, see Connect to the Cluster.

    The Cluster Summary shows that there were two slave nodes in the cluster and that each performed four tasks. The Completed Jobs section shows that the map and reduce clusters are 100% complete.

  2. Click a cluster ID.

    Hadoop displays information about the selected cluster.

    This display shows a variety of file system and cluster counters.

  3. Choose one of the following actions:

    To...Do this...
    Find out more about the killed tasks

    Click on an entry in the Failed/Killed Task Attempts column.

    Get more information about the mapper tasks

    Click map.

    Hadoop displays all of the tasks completed and their status.

    All of the mapper tasks completed successfully.

    Display task counters

    Click on an entry in the Counters column.

    Hadoop displays the task counter information.

    Get information about tasks

    Click a task.

    Hadoop displays task information.

  4. On the All Task Attempts pane, choose one of the following actions:

    To...Do This...
    Get information about the node that ran the task

    Click an entry in the Machine column.

    Hadoop displays host information.

    See the task logs

    Click an entry in the Task Logs column.

    Hadoop displays the logs.

To view the HDFS NameNode web interface

  • Open http://master-public-dns-name:9101/. The Hadoop Distributed File System (HDFS) web interface is hosted on the master node of the cluster. You can access the web interface by using SSH to create a tunnel to the master node and configuring a SOCKS proxy so your browser can view websites hosted on the master node. For more information, see View Web Interfaces on the Cluster.

To view the TaskTracker web interface

  • Open http://master-public-dns-name:9103/. The TaskTracker web interface is hosted on the master node of the cluster. You can access the web interface by using SSH to create a tunnel to the master node and configuring a SOCKS proxy so your browser can view websites hosted on the master node. For more information, see View Web Interfaces on the Cluster.