Hadoop daemon configuration settings - Amazon EMR

Hadoop daemon configuration settings

Hadoop daemon settings are different depending on the EC2 instance type that a cluster node uses. The following tables list the default configuration settings for each EC2 instance type.

To customize these settings, use the hadoop-env configuration classification. For more information, see Configure applications.

c1 instances

c1.medium
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 192
YARN_PROXYSERVER_HEAPSIZE 96
YARN_NODEMANAGER_HEAPSIZE 128
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 128
HADOOP_NAMENODE_HEAPSIZE 192
HADOOP_DATANODE_HEAPSIZE 96
c1.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 768
YARN_PROXYSERVER_HEAPSIZE 384
YARN_NODEMANAGER_HEAPSIZE 512
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 512
HADOOP_NAMENODE_HEAPSIZE 768
HADOOP_DATANODE_HEAPSIZE 384

c3 instances

c3.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2124
YARN_PROXYSERVER_HEAPSIZE 2124
YARN_NODEMANAGER_HEAPSIZE 2124
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2124
HADOOP_NAMENODE_HEAPSIZE 972
HADOOP_DATANODE_HEAPSIZE 588
c3.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2396
YARN_PROXYSERVER_HEAPSIZE 2396
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2396
HADOOP_NAMENODE_HEAPSIZE 1740
HADOOP_DATANODE_HEAPSIZE 757
c3.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2703
YARN_PROXYSERVER_HEAPSIZE 2703
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2703
HADOOP_NAMENODE_HEAPSIZE 3276
HADOOP_DATANODE_HEAPSIZE 1064
c3.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3317
YARN_PROXYSERVER_HEAPSIZE 3317
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3317
HADOOP_NAMENODE_HEAPSIZE 6348
HADOOP_DATANODE_HEAPSIZE 1679

c4 instances

c4.large
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 1152
YARN_PROXYSERVER_HEAPSIZE 1152
YARN_NODEMANAGER_HEAPSIZE 1152
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1152
HADOOP_NAMENODE_HEAPSIZE 576
HADOOP_DATANODE_HEAPSIZE 384
c4.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2124
YARN_PROXYSERVER_HEAPSIZE 2124
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2124
HADOOP_NAMENODE_HEAPSIZE 972
HADOOP_DATANODE_HEAPSIZE 588
c4.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2396
YARN_PROXYSERVER_HEAPSIZE 2396
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2396
HADOOP_NAMENODE_HEAPSIZE 1740
HADOOP_DATANODE_HEAPSIZE 757
c4.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2703
YARN_PROXYSERVER_HEAPSIZE 2703
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2703
HADOOP_NAMENODE_HEAPSIZE 3276
HADOOP_DATANODE_HEAPSIZE 1064
c4.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3317
YARN_PROXYSERVER_HEAPSIZE 3317
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3317
HADOOP_NAMENODE_HEAPSIZE 6348
HADOOP_DATANODE_HEAPSIZE 1679

c5 instances

c5.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2252
YARN_PROXYSERVER_HEAPSIZE 2252
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2252
HADOOP_NAMENODE_HEAPSIZE 1024
HADOOP_DATANODE_HEAPSIZE 614
c5.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2416
YARN_PROXYSERVER_HEAPSIZE 2416
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2416
HADOOP_NAMENODE_HEAPSIZE 1843
HADOOP_DATANODE_HEAPSIZE 778
c5.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105
c5.9xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3563
YARN_PROXYSERVER_HEAPSIZE 3563
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3563
HADOOP_NAMENODE_HEAPSIZE 7577
HADOOP_DATANODE_HEAPSIZE 1925
c5.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4055
YARN_PROXYSERVER_HEAPSIZE 4055
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4055
HADOOP_NAMENODE_HEAPSIZE 10035
HADOOP_DATANODE_HEAPSIZE 2416
c5.18xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 5038
YARN_PROXYSERVER_HEAPSIZE 5038
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 5038
HADOOP_NAMENODE_HEAPSIZE 14950
HADOOP_DATANODE_HEAPSIZE 3399
c5.24xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 6021
YARN_PROXYSERVER_HEAPSIZE 6021
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 6021
HADOOP_NAMENODE_HEAPSIZE 19865
HADOOP_DATANODE_HEAPSIZE 4096

c5a instances

c5a.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2124
YARN_PROXYSERVER_HEAPSIZE 2124
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2124
HADOOP_NAMENODE_HEAPSIZE 972
HADOOP_DATANODE_HEAPSIZE 588
c5a.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2401
YARN_PROXYSERVER_HEAPSIZE 2124
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2401
HADOOP_NAMENODE_HEAPSIZE 1766
HADOOP_DATANODE_HEAPSIZE 762
c5a.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
c5a.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
c5a.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4055
YARN_PROXYSERVER_HEAPSIZE 4055
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4055
HADOOP_NAMENODE_HEAPSIZE 10035
HADOOP_DATANODE_HEAPSIZE 2416
c5a.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949

c5ad instances

c5ad.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2124
YARN_PROXYSERVER_HEAPSIZE 2124
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2124
HADOOP_NAMENODE_HEAPSIZE 972
HADOOP_DATANODE_HEAPSIZE 588
c5ad.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2401
YARN_PROXYSERVER_HEAPSIZE 2401
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2401
HADOOP_NAMENODE_HEAPSIZE 1766
HADOOP_DATANODE_HEAPSIZE 762
c5ad.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
c5ad.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
c5ad.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3962
YARN_PROXYSERVER_HEAPSIZE 3962
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3962
HADOOP_NAMENODE_HEAPSIZE 9574
HADOOP_DATANODE_HEAPSIZE 2324
c5ad.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
c5ad.24xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 5836
YARN_PROXYSERVER_HEAPSIZE 5836
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 5836
HADOOP_NAMENODE_HEAPSIZE 18944
HADOOP_DATANODE_HEAPSIZE 4096

c5d instances

c5d.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2252
YARN_PROXYSERVER_HEAPSIZE 2252
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2252
HADOOP_NAMENODE_HEAPSIZE 1024
HADOOP_DATANODE_HEAPSIZE 614
c5d.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2416
YARN_PROXYSERVER_HEAPSIZE 2416
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2416
HADOOP_NAMENODE_HEAPSIZE 1843
HADOOP_DATANODE_HEAPSIZE 778
c5d.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105
c5d.9xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3563
YARN_PROXYSERVER_HEAPSIZE 3563
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3563
HADOOP_NAMENODE_HEAPSIZE 7577
HADOOP_DATANODE_HEAPSIZE 1925
c5d.18xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 5038
YARN_PROXYSERVER_HEAPSIZE 5038
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 5038
HADOOP_NAMENODE_HEAPSIZE 14950
HADOOP_DATANODE_HEAPSIZE 3399

c5n instances

c5n.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2304
YARN_PROXYSERVER_HEAPSIZE 2304
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2304
HADOOP_NAMENODE_HEAPSIZE 1280
HADOOP_DATANODE_HEAPSIZE 665
c5n.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2519
YARN_PROXYSERVER_HEAPSIZE 2519
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2519
HADOOP_NAMENODE_HEAPSIZE 2355
HADOOP_DATANODE_HEAPSIZE 880
c5n.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2949
YARN_PROXYSERVER_HEAPSIZE 2949
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2949
HADOOP_NAMENODE_HEAPSIZE 4505
HADOOP_DATANODE_HEAPSIZE 1310
c5n.9xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4055
YARN_PROXYSERVER_HEAPSIZE 4055
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4055
HADOOP_NAMENODE_HEAPSIZE 10035
HADOOP_DATANODE_HEAPSIZE 2416
c5n.18xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 6021
YARN_PROXYSERVER_HEAPSIZE 6021
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 6021
HADOOP_NAMENODE_HEAPSIZE 19865
HADOOP_DATANODE_HEAPSIZE 4096

c6g instances

c6g.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2124
YARN_PROXYSERVER_HEAPSIZE 2124
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2124
HADOOP_NAMENODE_HEAPSIZE 972
HADOOP_DATANODE_HEAPSIZE 588
c6g.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2104
YARN_PROXYSERVER_HEAPSIZE 2104
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2401
HADOOP_NAMENODE_HEAPSIZE 1766
HADOOP_DATANODE_HEAPSIZE 762
c6g.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
c6n.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
c6g.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3962
YARN_PROXYSERVER_HEAPSIZE 3962
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3962
HADOOP_NAMENODE_HEAPSIZE 9574
HADOOP_DATANODE_HEAPSIZE 2324
c6g.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949

c6gd instances

c6gd.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2124
YARN_PROXYSERVER_HEAPSIZE 2124
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2124
HADOOP_NAMENODE_HEAPSIZE 972
HADOOP_DATANODE_HEAPSIZE 588
c6gd.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2401
YARN_PROXYSERVER_HEAPSIZE 2401
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2401
HADOOP_NAMENODE_HEAPSIZE 1766
HADOOP_DATANODE_HEAPSIZE 762
c6gd.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
c6gd.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
c6gd.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3962
YARN_PROXYSERVER_HEAPSIZE 3962
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3962
HADOOP_NAMENODE_HEAPSIZE 9574
HADOOP_DATANODE_HEAPSIZE 2324
c6gd.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949

c6gn instances

c6gn.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2124
YARN_PROXYSERVER_HEAPSIZE 2124
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2124
HADOOP_NAMENODE_HEAPSIZE 972
HADOOP_DATANODE_HEAPSIZE 588
c6gn.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2401
YARN_PROXYSERVER_HEAPSIZE 2401
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2401
HADOOP_NAMENODE_HEAPSIZE 1766
HADOOP_DATANODE_HEAPSIZE 762
c6gn.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
c6gn.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
c6gn.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3962
YARN_PROXYSERVER_HEAPSIZE 3962
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3962
HADOOP_NAMENODE_HEAPSIZE 9574
HADOOP_DATANODE_HEAPSIZE 2324
c6gn.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949

cc2 instances

cc2.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2048
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1536
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1536
HADOOP_NAMENODE_HEAPSIZE 12288
HADOOP_DATANODE_HEAPSIZE 384

cg1 instances

cg1.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2048
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1536
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1536
HADOOP_NAMENODE_HEAPSIZE 3840
HADOOP_DATANODE_HEAPSIZE 384

cr1 instances

cr1.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096

d2 instances

d2.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
d2.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
d2.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
d2.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7089
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096

d3 instances

d3.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
d3.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
d3.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
d3.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096

d3en instances

d3en.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2401
YARN_PROXYSERVER_HEAPSIZE 2401
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2401
HADOOP_NAMENODE_HEAPSIZE 1766
HADOOP_DATANODE_HEAPSIZE 762
d3en.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
d3en.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
d3en.6xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3962
YARN_PROXYSERVER_HEAPSIZE 3962
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3962
HADOOP_NAMENODE_HEAPSIZE 9574
HADOOP_DATANODE_HEAPSIZE 2324
d3en.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
d3en.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 5836
YARN_PROXYSERVER_HEAPSIZE 5836
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 5836
HADOOP_NAMENODE_HEAPSIZE 18944
HADOOP_DATANODE_HEAPSIZE 4096

g2 instances

g2.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 1536
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1024
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1024
HADOOP_NAMENODE_HEAPSIZE 2304
HADOOP_DATANODE_HEAPSIZE 384

g3 instances

g3.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
g3.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096
g3.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 12083
YARN_PROXYSERVER_HEAPSIZE 12083
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 12083
HADOOP_NAMENODE_HEAPSIZE 50176
HADOOP_DATANODE_HEAPSIZE 4096

g3s instances

g3s.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075

g4dn instances

g4dn.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2416
YARN_PROXYSERVER_HEAPSIZE 2416
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2416
HADOOP_NAMENODE_HEAPSIZE 1843
HADOOP_DATANODE_HEAPSIZE 778
g4dn.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105
g4dn.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3399
YARN_PROXYSERVER_HEAPSIZE 3399
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3399
HADOOP_NAMENODE_HEAPSIZE 6758
HADOOP_DATANODE_HEAPSIZE 1761
g4dn.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4710
YARN_PROXYSERVER_HEAPSIZE 4710
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4710
HADOOP_NAMENODE_HEAPSIZE 13312
HADOOP_DATANODE_HEAPSIZE 3072
g4dn.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 6021
YARN_PROXYSERVER_HEAPSIZE 6021
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 6021
HADOOP_NAMENODE_HEAPSIZE 19865
HADOOP_DATANODE_HEAPSIZE 4096
g4dn.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7331
YARN_PROXYSERVER_HEAPSIZE 7331
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7331
HADOOP_NAMENODE_HEAPSIZE 26419
HADOOP_DATANODE_HEAPSIZE 4096

h1 instances

h1.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105
h1.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3399
YARN_PROXYSERVER_HEAPSIZE 3399
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3399
HADOOP_NAMENODE_HEAPSIZE 6758
HADOOP_DATANODE_HEAPSIZE 1761
h1.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4710
YARN_PROXYSERVER_HEAPSIZE 4710
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4710
HADOOP_NAMENODE_HEAPSIZE 13312
HADOOP_DATANODE_HEAPSIZE 3072
h1.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7331
YARN_PROXYSERVER_HEAPSIZE 7331
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7331
HADOOP_NAMENODE_HEAPSIZE 26419
HADOOP_DATANODE_HEAPSIZE 4096

hi1 instances

hi1.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3328
YARN_PROXYSERVER_HEAPSIZE 3328
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3328
HADOOP_NAMENODE_HEAPSIZE 6400
HADOOP_DATANODE_HEAPSIZE 1689

hs1 instances

hs1.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2048
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1536
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1536
HADOOP_NAMENODE_HEAPSIZE 12288
HADOOP_DATANODE_HEAPSIZE 384

i2 instances

i2.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
i2.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
i2.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
i2.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096

i3 instances

i3.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
i3.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
i3.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
i3.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096
i3.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 12083
YARN_PROXYSERVER_HEAPSIZE 12083
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE
HADOOP_NAMENODE_HEAPSIZE 12083
HADOOP_DATANODE_HEAPSIZE 1699

i3en instances

i3en.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105
i3en.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3399
YARN_PROXYSERVER_HEAPSIZE 3399
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3399
HADOOP_NAMENODE_HEAPSIZE 6758
HADOOP_DATANODE_HEAPSIZE 1761
i3en.3xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4055
YARN_PROXYSERVER_HEAPSIZE 4055
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4055
HADOOP_NAMENODE_HEAPSIZE 10035
HADOOP_DATANODE_HEAPSIZE 2416
i3en.6xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 6021
YARN_PROXYSERVER_HEAPSIZE 6021
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 6021
HADOOP_NAMENODE_HEAPSIZE 19865
HADOOP_DATANODE_HEAPSIZE 4096
i3en.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 9953
YARN_PROXYSERVER_HEAPSIZE 9953
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 9953
HADOOP_NAMENODE_HEAPSIZE 39526
HADOOP_DATANODE_HEAPSIZE 4096
i3en.24xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 17817
YARN_PROXYSERVER_HEAPSIZE 17817
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 17817
HADOOP_NAMENODE_HEAPSIZE 78848
HADOOP_DATANODE_HEAPSIZE 4096

m1 instances

m1.medium
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 384
YARN_PROXYSERVER_HEAPSIZE 192
YARN_NODEMANAGER_HEAPSIZE 256
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 256
HADOOP_NAMENODE_HEAPSIZE 384
HADOOP_DATANODE_HEAPSIZE 192
m1.large
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 768
YARN_PROXYSERVER_HEAPSIZE 384
YARN_NODEMANAGER_HEAPSIZE 512
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 512
HADOOP_NAMENODE_HEAPSIZE 768
HADOOP_DATANODE_HEAPSIZE 384
m1.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 1024
YARN_PROXYSERVER_HEAPSIZE 512
YARN_NODEMANAGER_HEAPSIZE 768
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1024
HADOOP_NAMENODE_HEAPSIZE 2304
HADOOP_DATANODE_HEAPSIZE 384

m2 instances

m2.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 1536
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1024
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1024
HADOOP_NAMENODE_HEAPSIZE 3072
HADOOP_DATANODE_HEAPSIZE 384
m2.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 1536
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1024
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1536
HADOOP_NAMENODE_HEAPSIZE 6144
HADOOP_DATANODE_HEAPSIZE 384
m2.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2048
YARN_PROXYSERVER_HEAPSIZE 1024
YARN_NODEMANAGER_HEAPSIZE 1536
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 1536
HADOOP_NAMENODE_HEAPSIZE 12288
HADOOP_DATANODE_HEAPSIZE 384

m3 instances

m3.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2703
YARN_PROXYSERVER_HEAPSIZE 2703
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2703
HADOOP_NAMENODE_HEAPSIZE 3276
HADOOP_DATANODE_HEAPSIZE 1064

m4 instances

m4.large
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2252
YARN_PROXYSERVER_HEAPSIZE 2252
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2252
HADOOP_NAMENODE_HEAPSIZE 1024
HADOOP_DATANODE_HEAPSIZE 614
m4.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2416
YARN_PROXYSERVER_HEAPSIZE 2416
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2416
HADOOP_NAMENODE_HEAPSIZE 2048
HADOOP_DATANODE_HEAPSIZE 778
m4.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105
m4.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3399
YARN_PROXYSERVER_HEAPSIZE 3399
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3399
HADOOP_NAMENODE_HEAPSIZE 6758
HADOOP_DATANODE_HEAPSIZE 1761
m4.10xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 5365
YARN_PROXYSERVER_HEAPSIZE 5365
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 5365
HADOOP_NAMENODE_HEAPSIZE 16588
HADOOP_DATANODE_HEAPSIZE 3727
m4.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7331
YARN_PROXYSERVER_HEAPSIZE 7331
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7331
HADOOP_NAMENODE_HEAPSIZE 26419
HADOOP_DATANODE_HEAPSIZE 4096

m5 instances

m5.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2416
YARN_PROXYSERVER_HEAPSIZE 2416
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2416
HADOOP_NAMENODE_HEAPSIZE 1843
HADOOP_DATANODE_HEAPSIZE 778
m5.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105
m5.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3399
YARN_PROXYSERVER_HEAPSIZE 3399
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3399
HADOOP_NAMENODE_HEAPSIZE 6758
HADOOP_DATANODE_HEAPSIZE 1761
m5.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4710
YARN_PROXYSERVER_HEAPSIZE 4710
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4710
HADOOP_NAMENODE_HEAPSIZE 13312
HADOOP_DATANODE_HEAPSIZE 3072
m5.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 6021
YARN_PROXYSERVER_HEAPSIZE 6021
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 6021
HADOOP_NAMENODE_HEAPSIZE 19865
HADOOP_DATANODE_HEAPSIZE 4096
m5.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7331
YARN_PROXYSERVER_HEAPSIZE 7331
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7331
HADOOP_NAMENODE_HEAPSIZE 26419
HADOOP_DATANODE_HEAPSIZE 4096
m5.24xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 9953
YARN_PROXYSERVER_HEAPSIZE 9953
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 9953
HADOOP_NAMENODE_HEAPSIZE 39526
HADOOP_DATANODE_HEAPSIZE 4096

m5a instances

m5a.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2416
YARN_PROXYSERVER_HEAPSIZE 2416
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2416
HADOOP_NAMENODE_HEAPSIZE 1843
HADOOP_DATANODE_HEAPSIZE 778
m5a.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105
m5a.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3399
YARN_PROXYSERVER_HEAPSIZE 3399
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3399
HADOOP_NAMENODE_HEAPSIZE 6758
HADOOP_DATANODE_HEAPSIZE 1761
m5a.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4710
YARN_PROXYSERVER_HEAPSIZE 4710
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4710
HADOOP_NAMENODE_HEAPSIZE 13312
HADOOP_DATANODE_HEAPSIZE 3072
m5a.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 6021
YARN_PROXYSERVER_HEAPSIZE 6021
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 6021
HADOOP_NAMENODE_HEAPSIZE 19865
HADOOP_DATANODE_HEAPSIZE 4096
m5a.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7331
YARN_PROXYSERVER_HEAPSIZE 7331
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7331
HADOOP_NAMENODE_HEAPSIZE 26419
HADOOP_DATANODE_HEAPSIZE 4096
m5a.24xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 9953
YARN_PROXYSERVER_HEAPSIZE 9953
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 9953
HADOOP_NAMENODE_HEAPSIZE 39526
HADOOP_DATANODE_HEAPSIZE 4096

m5d instances

m5d.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2416
YARN_PROXYSERVER_HEAPSIZE 2416
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2416
HADOOP_NAMENODE_HEAPSIZE 1843
HADOOP_DATANODE_HEAPSIZE 778
m5d.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105
m5d.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3399
YARN_PROXYSERVER_HEAPSIZE 3399
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3399
HADOOP_NAMENODE_HEAPSIZE 6758
HADOOP_DATANODE_HEAPSIZE 1761
m5d.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4710
YARN_PROXYSERVER_HEAPSIZE 4710
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4710
HADOOP_NAMENODE_HEAPSIZE 13312
HADOOP_DATANODE_HEAPSIZE 3072
m5d.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 6021
YARN_PROXYSERVER_HEAPSIZE 6021
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 6021
HADOOP_NAMENODE_HEAPSIZE 19865
HADOOP_DATANODE_HEAPSIZE 4096
m5d.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7331
YARN_PROXYSERVER_HEAPSIZE 7331
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7331
HADOOP_NAMENODE_HEAPSIZE 26419
HADOOP_DATANODE_HEAPSIZE 4096
m5d.24xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 9953
YARN_PROXYSERVER_HEAPSIZE 9953
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 9953
HADOOP_NAMENODE_HEAPSIZE 39526
HADOOP_DATANODE_HEAPSIZE 4096

m5zn instances

m5zn.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2396
YARN_PROXYSERVER_HEAPSIZE 2396
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2396
HADOOP_NAMENODE_HEAPSIZE 1740
HADOOP_DATANODE_HEAPSIZE 7575
m5zn.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2396
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2713
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
m5zn.3xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3025
YARN_PROXYSERVER_HEAPSIZE 3025
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3025
HADOOP_NAMENODE_HEAPSIZE 4889
HADOOP_DATANODE_HEAPSIZE 1387
m5zn.6xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3962
YARN_PROXYSERVER_HEAPSIZE 3962
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3962
HADOOP_NAMENODE_HEAPSIZE 9574
HADOOP_DATANODE_HEAPSIZE 2324
m5zn.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 5836
YARN_PROXYSERVER_HEAPSIZE 5836
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 5836
HADOOP_NAMENODE_HEAPSIZE 18944
HADOOP_DATANODE_HEAPSIZE 4096

m6g instances

m6g.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2401
YARN_PROXYSERVER_HEAPSIZE 2401
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2401
HADOOP_NAMENODE_HEAPSIZE 1766
HADOOP_DATANODE_HEAPSIZE 762
m6g.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
m6g.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
m6g.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
m6g.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 5877
YARN_PROXYSERVER_HEAPSIZE 5877
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 5877
HADOOP_NAMENODE_HEAPSIZE 19148
HADOOP_DATANODE_HEAPSIZE 4096
m6g.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096

m6gd instances

m6gd.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2401
YARN_PROXYSERVER_HEAPSIZE 2401
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2401
HADOOP_NAMENODE_HEAPSIZE 1766
HADOOP_DATANODE_HEAPSIZE 762
m6gd.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
m6gd.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
m6gd.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
m6gd.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 5877
YARN_PROXYSERVER_HEAPSIZE 5877
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 5877
HADOOP_NAMENODE_HEAPSIZE 19148
HADOOP_DATANODE_HEAPSIZE 4096
m6gd.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096

p2 instances

p2.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
p2.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 12083
YARN_PROXYSERVER_HEAPSIZE 12083
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 12083
HADOOP_NAMENODE_HEAPSIZE 50176
HADOOP_DATANODE_HEAPSIZE 4096
p2.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 17080
YARN_PROXYSERVER_HEAPSIZE 17080
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 17080
HADOOP_NAMENODE_HEAPSIZE 75161
HADOOP_DATANODE_HEAPSIZE 4096

p3 instances

p3.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
p3.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096
p3.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096

r3 instances

r3.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
r3.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
r3.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
r3.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096

r4 instances

Note

R4 instances are available only in version 5.4.0 and later.

r4.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
r4.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
r4.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
r4.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096
r4.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 12083
YARN_PROXYSERVER_HEAPSIZE 12083
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 12083
HADOOP_NAMENODE_HEAPSIZE 50176
HADOOP_DATANODE_HEAPSIZE 4096

r5 instances

r5.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105
r5.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3399
YARN_PROXYSERVER_HEAPSIZE 3399
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3399
HADOOP_NAMENODE_HEAPSIZE 6758
HADOOP_DATANODE_HEAPSIZE 1761
r5.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4710
YARN_PROXYSERVER_HEAPSIZE 4710
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4710
HADOOP_NAMENODE_HEAPSIZE 13312
HADOOP_DATANODE_HEAPSIZE 3072
r5.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7331
YARN_PROXYSERVER_HEAPSIZE 7331
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7331
HADOOP_NAMENODE_HEAPSIZE 26419
HADOOP_DATANODE_HEAPSIZE 4096
r5.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 9953
YARN_PROXYSERVER_HEAPSIZE 9953
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 9953
HADOOP_NAMENODE_HEAPSIZE 39526
HADOOP_DATANODE_HEAPSIZE 4096
r5.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 12574
YARN_PROXYSERVER_HEAPSIZE 12574
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 12574
HADOOP_NAMENODE_HEAPSIZE 52633
HADOOP_DATANODE_HEAPSIZE 4096
r5.24xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 17817
YARN_PROXYSERVER_HEAPSIZE 17817
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 17817
HADOOP_NAMENODE_HEAPSIZE 78848
HADOOP_DATANODE_HEAPSIZE 4096

r5a instances

r5a.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105
r5a.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3399
YARN_PROXYSERVER_HEAPSIZE 3399
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3399
HADOOP_NAMENODE_HEAPSIZE 6758
HADOOP_DATANODE_HEAPSIZE 1761
r5a.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4710
YARN_PROXYSERVER_HEAPSIZE 4710
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4710
HADOOP_NAMENODE_HEAPSIZE 13312
HADOOP_DATANODE_HEAPSIZE 3072
r5a.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7331
YARN_PROXYSERVER_HEAPSIZE 7331
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7331
HADOOP_NAMENODE_HEAPSIZE 26419
HADOOP_DATANODE_HEAPSIZE 4096
r5a.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 9953
YARN_PROXYSERVER_HEAPSIZE 9953
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 9953
HADOOP_NAMENODE_HEAPSIZE 39526
HADOOP_DATANODE_HEAPSIZE 4096
r5a.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 12574
YARN_PROXYSERVER_HEAPSIZE 12574
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 12574
HADOOP_NAMENODE_HEAPSIZE 52633
HADOOP_DATANODE_HEAPSIZE 4096
r5a.24xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 17817
YARN_PROXYSERVER_HEAPSIZE 17817
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 17817
HADOOP_NAMENODE_HEAPSIZE 78848
HADOOP_DATANODE_HEAPSIZE 4096

r5b instances

r5b.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
r5b.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
r5b.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
r5b.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096
r5b.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 9584
YARN_PROXYSERVER_HEAPSIZE 9584
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 9584
HADOOP_NAMENODE_HEAPSIZE 37683
HADOOP_DATANODE_HEAPSIZE 4096
r5b.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 12083
YARN_PROXYSERVER_HEAPSIZE 12083
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 12083
HADOOP_NAMENODE_HEAPSIZE 50176
HADOOP_DATANODE_HEAPSIZE 4096
r5b.24xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 17080
YARN_PROXYSERVER_HEAPSIZE 17080
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 17080
HADOOP_NAMENODE_HEAPSIZE 75161
HADOOP_DATANODE_HEAPSIZE 4096

r5d instances

r5d.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105
r5d.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3399
YARN_PROXYSERVER_HEAPSIZE 3399
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3399
HADOOP_NAMENODE_HEAPSIZE 6758
HADOOP_DATANODE_HEAPSIZE 1761
r5d.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4710
YARN_PROXYSERVER_HEAPSIZE 4710
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4710
HADOOP_NAMENODE_HEAPSIZE 13312
HADOOP_DATANODE_HEAPSIZE 3072
r5d.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7331
YARN_PROXYSERVER_HEAPSIZE 7331
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7331
HADOOP_NAMENODE_HEAPSIZE 26419
HADOOP_DATANODE_HEAPSIZE 4096
r5d.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 9953
YARN_PROXYSERVER_HEAPSIZE 9953
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 9953
HADOOP_NAMENODE_HEAPSIZE 39526
HADOOP_DATANODE_HEAPSIZE 4096
r5d.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 12574
YARN_PROXYSERVER_HEAPSIZE 12574
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 12574
HADOOP_NAMENODE_HEAPSIZE 52633
HADOOP_DATANODE_HEAPSIZE 4096
r5d.24xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 17817
YARN_PROXYSERVER_HEAPSIZE 17817
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 17817
HADOOP_NAMENODE_HEAPSIZE 78848
HADOOP_DATANODE_HEAPSIZE 4096

r5dn instances

r5dn.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
r5dn.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
r5dn.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
r5dn.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096
r5dn.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 9584
YARN_PROXYSERVER_HEAPSIZE 9584
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 9584
HADOOP_NAMENODE_HEAPSIZE 37683
HADOOP_DATANODE_HEAPSIZE 4096
r5dn.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 9584
YARN_PROXYSERVER_HEAPSIZE 12083
YARN_NODEMANAGER_HEAPSIZE 12083
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 12083
HADOOP_NAMENODE_HEAPSIZE 50176
HADOOP_DATANODE_HEAPSIZE 4096
r5dn.24xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 17080
YARN_PROXYSERVER_HEAPSIZE 17080
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 17080
HADOOP_NAMENODE_HEAPSIZE 75161
HADOOP_DATANODE_HEAPSIZE 4096

r6g instances

r6g.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2713
YARN_PROXYSERVER_HEAPSIZE 2713
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2713
HADOOP_NAMENODE_HEAPSIZE 3328
HADOOP_DATANODE_HEAPSIZE 1075
r6g.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
r6g.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
r6g.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096
r6g.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 9584
YARN_PROXYSERVER_HEAPSIZE 9584
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 9584
HADOOP_NAMENODE_HEAPSIZE 37683
HADOOP_DATANODE_HEAPSIZE 4096
r6g.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 12083
YARN_PROXYSERVER_HEAPSIZE 12083
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 12083
HADOOP_NAMENODE_HEAPSIZE 50176
HADOOP_DATANODE_HEAPSIZE 4096

r6gd instances

r6gd.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 12083
YARN_PROXYSERVER_HEAPSIZE 12083
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 12083
HADOOP_NAMENODE_HEAPSIZE 50176
HADOOP_DATANODE_HEAPSIZE 4096
r6gd.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3338
YARN_PROXYSERVER_HEAPSIZE 3338
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3338
HADOOP_NAMENODE_HEAPSIZE 6451
HADOOP_DATANODE_HEAPSIZE 1699
r6gd.4xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4587
YARN_PROXYSERVER_HEAPSIZE 4587
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4587
HADOOP_NAMENODE_HEAPSIZE 12697
HADOOP_DATANODE_HEAPSIZE 2949
r6gd.8xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 7086
YARN_PROXYSERVER_HEAPSIZE 7086
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 7086
HADOOP_NAMENODE_HEAPSIZE 25190
HADOOP_DATANODE_HEAPSIZE 4096
r6gd.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 9584
YARN_PROXYSERVER_HEAPSIZE 9584
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 9584
HADOOP_NAMENODE_HEAPSIZE 37683
HADOOP_DATANODE_HEAPSIZE 4096
r6gd.16xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 12083
YARN_PROXYSERVER_HEAPSIZE 12083
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 12083
HADOOP_NAMENODE_HEAPSIZE 50176
HADOOP_DATANODE_HEAPSIZE 4096

z1d instances

z1d.xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 2744
YARN_PROXYSERVER_HEAPSIZE 2744
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 2744
HADOOP_NAMENODE_HEAPSIZE 3481
HADOOP_DATANODE_HEAPSIZE 1105
z1d.2xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 3399
YARN_PROXYSERVER_HEAPSIZE 3399
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 3399
HADOOP_NAMENODE_HEAPSIZE 6758
HADOOP_DATANODE_HEAPSIZE 1761
z1d.3xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 4055
YARN_PROXYSERVER_HEAPSIZE 4055
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 4055
HADOOP_NAMENODE_HEAPSIZE 10035
HADOOP_DATANODE_HEAPSIZE 2416
z1d.6xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 6021
YARN_PROXYSERVER_HEAPSIZE 6021
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 6021
HADOOP_NAMENODE_HEAPSIZE 19865
HADOOP_DATANODE_HEAPSIZE 4096
z1d.12xlarge
Parameter Value
YARN_RESOURCEMANAGER_HEAPSIZE 9953
YARN_PROXYSERVER_HEAPSIZE 9953
YARN_NODEMANAGER_HEAPSIZE 2048
HADOOP_JOB_HISTORYSERVER_HEAPSIZE 9953
HADOOP_NAMENODE_HEAPSIZE 39526
HADOOP_DATANODE_HEAPSIZE 4096