Install the Amazon EMR Command Line Interface

To install Ruby

1. Download and install Ruby 1.8.7:

   • Linux and UNIX users can download Ruby from http://www.ruby-lang.org/en/news/2010/06/23/ruby-1-8-7-p299-released/ and install Ruby by entering the command:

     sudo apt-get install ruby-full

   • Windows users can install Ruby 1.8.7 from http://rubyforge.org/frs/?group_id=167&release_id=28426. During the installation process, select the checkboxes to add Ruby executables to your PATH environmental variable and to associate .rb files with this Ruby installation.

   • Mac OS X comes with Ruby installed. You can check the version as shown in the following step.

2. Verify that Ruby is running by typing the following at the command prompt:

   ruby -v

To download the Amazon EMR CLI

1. Create a new directory to install the Amazon EMR CLI into. From the command-line prompt, enter the following:

   mkdir elastic-mapreduce-cli

2. Download the Amazon EMR files:

   1. Go to http://aws.amazon.com/developertools/2264. If you are not logged in to AWS, enter your AWS account credentials when prompted.

   2. Click Download.

   3. Save the file in your newly created directory.

To install the Amazon EMR CLI

1. Navigate to your elastic-mapreduce-cli directory.

2. Unzip the compressed file:

   • Linux, UNIX, and Mac OS X users, from the command-line prompt, enter the following:

     unzip elastic-mapreduce-ruby.zip 

   • Windows users, from Windows Explorer, open the elastic-mapreduce-ruby.zip file and select Extract all files.

To create your credentials file

1. Create a file named credentials.json in the directory where you unzipped the Amazon EMR CLI.

2. Add the following lines to your credentials file:

   {
   "access_id": "Your AWS Access Key ID",
   "private_key": "Your AWS Secret Access Key",
   "keypair": "Your key pair name",
   "key-pair-file": "The path and name of your PEM file",
   "log_uri": "A path to a bucket you own on Amazon S3, such as, s3n://mylog-uri/",
   "region": "The region of your cluster, either us-east-1, us-west-2, us-west-1, eu-west-1, ap-northeast-1, ap-southeast-1, ap-southeast-2, or sa-east-1"
   }

   Note the name of the region. You use this region to create your Amazon EC2 key pair and your Amazon S3 bucket.

To configure your SSH credentials

• Configure your computer to use SSH:

  • Linux, UNIX, and Mac OS X users, set the permissions on the PEM file for your Amazon EC2 key pair. For example, if you saved the file as mykeypair.pem, the command looks like:

    chmod og-rwx mykeypair.pem  

  • Windows users

    1. Windows users use PuTTY to connect to the master node. Download PuTTYgen.exe to your computer from http://www.chiark.greenend.org.uk/~sgtatham/putty/download.html.

    2. Launch PuTTYgen.

    3. Click Load. Select the PEM file you created earlier.

    4. Click Open.

    5. Click OK on the PuTTYgen Notice telling you the key was successfully imported.

    6. Click Save private key to save the key in the PPK format.

    7. When PuTTYgen prompts you to save the key without a pass phrase, click Yes.

    8. Enter a name for your PuTTY private key, such as, mykeypair.ppk.

    9. Click Save.

    10. Exit the PuTTYgen application.

Verify installation of the Amazon EMR CLI

• In the directory where you installed the Amazon EMR CLI, run the following commands from the command line:

  • Linux, UNIX, and Mac OS X users:

    ./elastic-mapreduce --version

  • Windows users:

    ruby elastic-mapreduce --version

  If the CLI is correctly installed and the credentials properly configured, the CLI should display its version number represented as a date. The output should look similar to the following:

  Version 2012-12-17