Menu
Amazon EMR
Amazon EMR Release Guide

Hadoop Daemon Settings

The following tables list the default configuration settings for each EC2 instance type in clusters launched with Amazon EMR.

m1.medium

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 384
YARN_PROXYSERVER_HEAPSIZE 192
YARN_NODEMANAGER_HEAPSIZE 256
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 256
HADOOP_NAMENODE_HEAPSIZE 384
HADOOP_DATANODE_HEAPSIZE 192

m1.large

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 768
YARN_PROXYSERVER_HEAPSIZE 384
YARN_NODEMANAGER_HEAPSIZE 512
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 512
HADOOP_NAMENODE_HEAPSIZE 768
HADOOP_DATANODE_HEAPSIZE 384

m1.xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 1024
YARN_PROXYSERVER_HEAPSIZE 512
YARN_NODEMANAGER_HEAPSIZE 768
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1024
HADOOP_NAMENODE_HEAPSIZE 2304
HADOOP_DATANODE_HEAPSIZE 384

m2.xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 1536
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1024
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1024
HADOOP_NAMENODE_HEAPSIZE 3072
HADOOP_DATANODE_HEAPSIZE 384

m2.2xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 1536
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1024
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1536
HADOOP_NAMENODE_HEAPSIZE 6144
HADOOP_DATANODE_HEAPSIZE 384

m2.4xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2048
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1536
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1536
HADOOP_NAMENODE_HEAPSIZE 12288
HADOOP_DATANODE_HEAPSIZE 384

m3.xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2396
YARN_PROXYSERVER_HEAPSIZE 2396
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2396
HADOOP_NAMENODE_HEAPSIZE 1740
HADOOP_DATANODE_HEAPSIZE 757

m3.2xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2703
YARN_PROXYSERVER_HEAPSIZE 2703
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2703
HADOOP_NAMENODE_HEAPSIZE 3276
HADOOP_DATANODE_HEAPSIZE 1064

m4.large

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2252
YARN_PROXYSERVER_HEAPSIZE 2252
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2252
HADOOP_NAMENODE_HEAPSIZE 1024
HADOOP_DATANODE_HEAPSIZE 614

m4.xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2416
YARN_PROXYSERVER_HEAPSIZE 2416
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2416
HADOOP_NAMENODE_HEAPSIZE 2048
HADOOP_DATANODE_HEAPSIZE 778

m4.2xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105

m4.4xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3399
YARN_PROXYSERVER_HEAPSIZE 3399
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3399
HADOOP_NAMENODE_HEAPSIZE 6758
HADOOP_DATANODE_HEAPSIZE 1761

m4.10xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 5365
YARN_PROXYSERVER_HEAPSIZE 5365
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 5365
HADOOP_NAMENODE_HEAPSIZE 16588
HADOOP_DATANODE_HEAPSIZE 3727

m4.16xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7331
YARN_PROXYSERVER_HEAPSIZE 7331
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7331
HADOOP_NAMENODE_HEAPSIZE 26419
HADOOP_DATANODE_HEAPSIZE 4096

c1.medium

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 192
YARN_PROXYSERVER_HEAPSIZE 96
YARN_NODEMANAGER_HEAPSIZE 128
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 128
HADOOP_NAMENODE_HEAPSIZE 192
HADOOP_DATANODE_HEAPSIZE 96

c1.xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 768
YARN_PROXYSERVER_HEAPSIZE 384
YARN_NODEMANAGER_HEAPSIZE 512
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 512
HADOOP_NAMENODE_HEAPSIZE 768
HADOOP_DATANODE_HEAPSIZE 384

c3.xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2124
YARN_PROXYSERVER_HEAPSIZE 2124
YARN_NODEMANAGER_HEAPSIZE 2124
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2124
HADOOP_NAMENODE_HEAPSIZE 972
HADOOP_DATANODE_HEAPSIZE 588

c3.2xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2396
YARN_PROXYSERVER_HEAPSIZE 2396
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2396
HADOOP_NAMENODE_HEAPSIZE 1740
HADOOP_DATANODE_HEAPSIZE 757

c3.4xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2703
YARN_PROXYSERVER_HEAPSIZE 2703
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2703
HADOOP_NAMENODE_HEAPSIZE 3276
HADOOP_DATANODE_HEAPSIZE 1064

c3.8xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3317
YARN_PROXYSERVER_HEAPSIZE 3317
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3317
HADOOP_NAMENODE_HEAPSIZE 6348
HADOOP_DATANODE_HEAPSIZE 1679

c4.large

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 1152
YARN_PROXYSERVER_HEAPSIZE 1152
YARN_NODEMANAGER_HEAPSIZE 1152
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1152
HADOOP_NAMENODE_HEAPSIZE 576
HADOOP_DATANODE_HEAPSIZE 384

c4.xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2124
YARN_PROXYSERVER_HEAPSIZE 2124
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2124
HADOOP_NAMENODE_HEAPSIZE 972
HADOOP_DATANODE_HEAPSIZE 588

c4.2xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2396
YARN_PROXYSERVER_HEAPSIZE 2396
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2396
HADOOP_NAMENODE_HEAPSIZE 1740
HADOOP_DATANODE_HEAPSIZE 757

c4.4xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2703
YARN_PROXYSERVER_HEAPSIZE 2703
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2703
HADOOP_NAMENODE_HEAPSIZE 3276
HADOOP_DATANODE_HEAPSIZE 1064

c4.8xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3317
YARN_PROXYSERVER_HEAPSIZE 3317
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3317
HADOOP_NAMENODE_HEAPSIZE 6348
HADOOP_DATANODE_HEAPSIZE 1679

cc2.8xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2048
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1536
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1536
HADOOP_NAMENODE_HEAPSIZE 12288
HADOOP_DATANODE_HEAPSIZE 384

cg1.4xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2048
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1536
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1536
HADOOP_NAMENODE_HEAPSIZE 3840
HADOOP_DATANODE_HEAPSIZE 384

cr1.8xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096

d2.xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075

d2.2xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699

d2.4xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949

d2.8xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7089
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096

hi1.4xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3328
YARN_PROXYSERVER_HEAPSIZE 3328
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3328
HADOOP_NAMENODE_HEAPSIZE 6400
HADOOP_DATANODE_HEAPSIZE 1689

hs1.8xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2048
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1536
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1536
HADOOP_NAMENODE_HEAPSIZE 12288
HADOOP_DATANODE_HEAPSIZE 384

i2.xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075

i2.2xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699

i2.4xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949

i2.8xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096

g2.2xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 1536
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1024
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1024
HADOOP_NAMENODE_HEAPSIZE 2304
HADOOP_DATANODE_HEAPSIZE 384

r3.xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075

r3.2xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699

r3.4xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949

r3.8xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096

Note

R4 instances are available only in version 5.4.0 and later.

r4.xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075

r4.2xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699

r4.4xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949

r4.8xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096

r4.16xlarge

Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 12083
YARN_PROXYSERVER_HEAPSIZE 12083
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 12083
HADOOP_NAMENODE_HEAPSIZE 50176
HADOOP_DATANODE_HEAPSIZE 4096