Hadoop Memory-Intensive Configuration Settings (AMI 1.0)

The Amazon Elastic MapReduce (Amazon EMR) default configuration settings are appropriate for most workloads. However, based on your cluster’s specific memory and processing requirements, you might want to modify the configuration settings.

For example, if your cluster tasks are memory-intensive, you can use fewer tasks per core node and reduce your job tracker heap size. A predefined bootstrap action is available to configure your cluster on startup. For more information, see the Configure Memory-Intensive Workloads bootstrap action.

The following tables list the recommended configuration settings for each EC2 instance type. The default configurations for the cc1.4xlarge, cc2.8xlarge, hi1.4xlarge, hs1.8xlarge, and cg1.4xlarge instances are sufficient for memory-intensive workloads; therefore, the recommended configuration settings for these instances are not listed.