Command Line Interface Options

Sets the AWS access identifier.

Sets the AWS access identifier.

Modifies a command to apply only to clusters in the RUNNING, STARTING or WAITING states. Used with --list.

Usage: View Cluster Details

Adds an instance group to an existing cluster. The role may be task only.

Usage: Resize a Running Cluster, Change the Number of Spot Instances in a Cluster

Used with --create to launch a cluster that continues running even after completing all its steps. Interactive clusters require this option.

Usage: Add Steps to a Cluster

Modifies a command to apply only to all clusters, regardless of status. Used with --list, it lists all the clusters created in the last two weeks.

Used with --create to specify the version of the AMI to use when launching the cluster.

Usage: Choose a Machine Image

Specifies the Amazon S3 path to the base of the Amazon EMR bucket to use, for example: s3://us-east-1.elasticmapreduce.

Passes in a single argument value to a script or application running on the cluster.

Usage: Launch a Hive Cluster, Launch a Pig Cluster, Launch a Cascading Cluster, Add Steps to a Cluster, Create Bootstrap Actions to Install Additional Software (Optional)

Passes in multiple arguments, separated by commas, to a script or application running on the cluster. This is a shorthand for specifying multiple --arg options. The arguments passed in with --args, however, cannot contain unescaped commas. The argument string may be surrounded with double-quotes.

Usage: Launch a Hive Cluster, Launch a Pig Cluster, Launch a Cascading Cluster, Add Steps to a Cluster, Create Bootstrap Actions to Install Additional Software (Optional)

The Availability Zone to launch the cluster in. For more information about Availability Zones supported by Amazon EMR, see Regions and Endpoints in the Amazon Web Services General Reference.

The directory where an Hbase backup exists or should be created.

Usage: Back Up and Restore HBase

Specifies the version number of an existing Hbase backup to restore.

Usage: Back Up and Restore HBase

Specifies the Amazon S3 path to the base of the Amazon EMR bucket to use, for example: s3://beta.elasticmapreduce.

The bid price, in U.S. dollars, for a group of Spot Instances.

Usage: Launch Spot Instances in a Cluster

Used with --create to specify a bootstrap action to run when the cluster launches. The location of the bootstrap action script is typically a location in Amazon S3. You can add more than one bootstrap action to a cluster.

Usage: Create Bootstrap Actions to Install Additional Software (Optional)

Sets the name of the bootstrap action.

Usage: Create Bootstrap Actions to Install Additional Software (Optional)

Specifies the credentials file that contains the AWS access identifier and the AWS private key to use when contacting the Amazon EMR web service.

Adds an individual file to the Distributed Cache.

Usage: Import files using Distributed Cache

Adds an archive file to the Distributed Cache

Usage: Import files using Distributed Cache

Pauses all write operations to the HBase cluster during the backup process, to ensure a consistent backup.

Usage: Back Up and Restore HBase

Launches a new cluster.

Usage: Launch a Streaming Cluster, Launch a Hive Cluster, Launch a Pig Cluster, Launch a Cascading Cluster, Launch an HBase Cluster on Amazon EMR

Lists all clusters created after the specified time and date in XML date-time format.

Lists all clusters created before the specified time and date in XML date-time format.

Specifies the credentials file that contains the AWS access identifier and the AWS private key to use when contacting the Amazon EMR web service.

Associates an elastic IP to the master node. If no elastic IP is specified, allocate a new elastic IP and associate it to the master node.

Used with --create to launch a cluster with debugging enabled.

Usage: Configure Logging and Debugging (Optional)

Specifies the endpoint of the Amazon EMR web service to connect to.

Prints stack traces when exceptions occur.

Returns information about the specified cluster or clusters.

Usage: View Cluster Details

Turns off scheduled full Hbase backups by passing this flag into a call with --hbase-schedule-backup.

Usage: Back Up and Restore HBase

Turns off scheduled incremental Hbase backups by passing this flag into a call with --hbase-schedule-backup.

Usage: Back Up and Restore HBase

An integer that specifies the period of time units to elapse between automated full backups of the HBase cluster.

Usage: Back Up and Restore HBase

The unit of time to use with --full-backup-time-interval to specify how often automatically scheduled Hbase backups should run. This can take any one of the following values: minutes, hours, days.

Usage: Back Up and Restore HBase

Copies the specified file from the master node using scp.

Displays help information from the CLI.

Used with --create to specify the version of Hadoop to use when launching the cluster.

Usage: Supported Hadoop Versions

Used to launch an Hbase cluster.

Usage: Launch an HBase Cluster on Amazon EMR

Creates a one-time backup of HBase data to the location specified by --backup-dir.

Usage: Back Up and Restore HBase

Restores a backup from the location specified by --backup-dir and (optionally) the version specified by --backup-version.

Usage: Back Up and Restore HBase

Schedules an automated backup of HBase data.

Usage: Back Up and Restore HBase

Displays help information from the CLI.

Used with --create to launch a cluster with Hive installed.

Usage: Interactive and Batch Hive Clusters

The Hive script to run in the cluster.

Usage: Interactive and Batch Hive Clusters

Installs the configuration values in hive-site.xml in the specified location. The --hive-site parameter overrides only the values defined in hive-site.xml.

Usage: Create a Metastore Outside the Hadoop Cluster, Additional Features of Hive in Amazon EMR

The Hive version or versions to load. This can be a Hive version number or "latest" to load the latest version. When you specify more than one Hive version, separate the versions with a comma.

Usage: Supported Hive Versions

An integer that specifies the period of time units to elapse between automated incremental backups of the HBase cluster. Used with --hbase-schedule-backup this parameter creates regularly scheduled incremental backups. If this period schedules a full backup at the same time as an incremental backup is scheduled, only the full backup is created. Used with --incremental-backup-time-unit.

Usage: Back Up and Restore HBase

The unit of time to use with --incremental-backup-time-interval to specify how often automatically scheduled incremental Hbase backups should run. This can take any one of the following values: minutes, hours, days.

Usage: Back Up and Restore HBase

Specifies additional information during cluster creation.

Specifies the input location for the cluster.

Usage: Launch a Streaming Cluster

Sets the count of nodes for an instance group.

Usage: Resize a Running Cluster, Change the Number of Spot Instances in a Cluster

Sets the instance group type. A type is MASTER, CORE, or TASK.

Usage: Resize a Running Cluster

Sets the type of EC2 instance to create nodes for an instance group.

Usage: Resize a Running Cluster, Launch Spot Instances in a Cluster

Specifies the cluster with the given cluster identifier.

Usage: View Cluster Details, Add Steps to a Cluster, Resize a Running Cluster, Change the Number of Spot Instances in a Cluster

Specifies the location of a Java archive (JAR) file. Typically, the JAR file is stored in an Amazon S3 bucket.

Usage: Resize a Running Cluster, Distributed Copy Using S3DistCp

Specifies jobconf arguments to pass to a streaming cluster, for example mapred.task.timeout=800000.

Specifies the cluster with the given cluster identifier.

Usage: View Cluster Details, Add Steps to a Cluster, Resize a Running Cluster, Change the Number of Spot Instances in a Cluster

Launches the EC2 instances of a cluster with the specified IAM role.

Configure IAM Roles for Amazon EMR

Adds a sequence of steps stored in the specified JSON file to the cluster.

The name of the Amazon EC2 key pair to set as the connection credential when you launch the cluster.

The path to the local PEM file of the Amazon EC2 key pair to set as the connection credential when you launch the cluster.

Lists clusters created in the last two days.

Usage: View Cluster Details

Displays the step logs for the step most recently executed.

Specifies the Amazon S3 bucket to receive log files. Used with --create.

Usage: View HBase Log Files

Specifies the JAR file's main class. This parameter is not needed if your JAR file has a manifest.

Usage: Add Steps to a Cluster

The name of a Hadoop built-in class or the location of a mapper script.

Usage: Launch a Streaming Cluster

The type of EC2 instances to launch as the master nodes in the cluster.

Usage: Build Binaries Using Amazon EMR

Modifies an existing instance group.

Usage: Resize a Running Cluster, Change the Number of Spot Instances in a Cluster

Specifies a name for the cluster. This can only be set when the jobflow is created.

Usage: Launch a Streaming Cluster, Launch a Hive Cluster, Launch a Pig Cluster, Launch a Cascading Cluster, Launch an HBase Cluster on Amazon EMR

Don't wait for the master node to start before executing scp or ssh or assigning an eip.

Prevents the CLI from listing steps when listing clusters.

Used with --create and --modify-instance-group to specify the number of EC2 instances in the cluster.

Usage: Launch a Streaming Cluster, Launch a Hive Cluster, Launch a Pig Cluster, Launch a Cascading Cluster, Launch an HBase Cluster on Amazon EMR, Change the Number of Spot Instances in a Cluster

Specifies the output location for the cluster.

Usage: Launch a Streaming Cluster

Specifies the AWS private key to use when contacting the Amazon EMR web service.

Substitutes the string VARIABLE with the string VALUE in the JSON file.

Used with --create to launch a cluster with Pig installed.

Usage: Launch a Pig Cluster

Specifies the version or versions of Pig to install on the cluster. If specifying more than one version of Pig, separated the versions with commas.

Usage: Supported Pig Versions

The Pig script to run in the cluster.

Usage: Launch a Pig Cluster

Returns the cluster identifier from the create step as simple text.

Copies a file to the master node using scp.

Prints the version of Hive that is currently active on the cluster.

Usage: Supported Hive Versions

Prints the version of Pig that is currently active on the cluster.

Usage: Supported Pig Versions

Specifies the AWS private key to use when contacting the Amazon EMR web service.

The name of a Hadoop built-in class or the location of a reducer script.

Usage: Launch a Streaming Cluster

Specifies the region in which to launch the cluster.

Usage: Choose an AWS Region

Adds a step to resize the cluster.

Copies a file from your local directory to the master node of the cluster.

Usage: Add Steps to a Cluster

Specifies the location of a script. Typically, the script is stored in an Amazon S3 bucket.

Enables or disables termination protection on the specified cluster or clusters. To enable termination protection, set this value to true. To disable termination protection, set this value to false.

Usage: Protect a Cluster from Termination

Makes the instances in an existing cluster visible to all IAM users of the AWS account that launched the cluster.

Usage: Configure IAM User Permissions

The type of EC2 instances to launch as the slave nodes in the cluster.

Uses SSH to create a tunnel to the master node of the specified cluster. You can then use this as a SOCKS proxy to view web interfaces hosted on the master node.

Usage: Open an SSH Tunnel to the Master Node, Configure FoxyProxy to View Websites Hosted on the Master Node

Uses SSH to connect to the master node of the specified cluster and, optionally, run a command. This option requires that you have an SSH client, such as OpenSSH, installed on your desktop.

Usage: Connect to the Master Node Using SSH

Specifies the time that a Hbase backup schedule should start. If this is not set, the first backup begins immediately. This should be in ISO date-time format.You can use this to ensure your first data load process has completed before performing the initial backup or to have the backup occur at a specific time each day.

Usage: Back Up and Restore HBase

Specifies the state of the cluster. You can specify more than one state by adding multiple state options to the command. The cluster state will be one of the following values: STARTING, RUNNING, WAITING, TERMINATED.

Usage: View Cluster Details

Specifies a name for a cluster step.

Specifies the action the cluster should take when the step finishes. This can be one of CANCEL_AND_WAIT, TERMINATE_JOB_FLOW or CONTINUE.

Used with --create to launch a streaming cluster.

Usage: Launch a Streaming Cluster

Launches a cluster in an Amazon VPC subnet.

Usage: Select a Amazon VPC Subnet for the Cluster (Optional)

Installs third-party software on an Amazon EMR cluster; for example, installing a third-party distribution of Hadoop. It accepts optional arguments for the third-party software to read and act on. It is used with --create to launch the cluster that can use the specified third-party applications. The 2013-03-19 and newer versions of the Amazon EMR CLI accepts optional arguments using the --args parameter.

Usage: Use Karmasphere Analytics, Using the MapR Distribution for Hadoop

Terminates the specified cluster or clusters.

Usage: Terminate a Cluster

Specifies the destination location when copying files to and from the master node using scp.

Traces commands made to the web service.

Unarrests an instance group of the cluster.

Turns on verbose logging of program interaction.

Turns on verbose logging of program interaction.

Displays the version of the CLI.

Usage: Command Line Interface Releases

Makes a cluster visible to all IAM users. Used with --create.

Usage: Configure IAM User Permissions

Causes the cluster to wait until a step has completed.

Usage: Add Steps to a Cluster

Used with --create to launch the cluster with termination protection enabled.

Usage: Protect a Cluster from Termination