Aufgabenkonfiguration - Amazon EMR

Die vorliegende Übersetzung wurde maschinell erstellt. Im Falle eines Konflikts oder eines Widerspruchs zwischen dieser übersetzten Fassung und der englischen Fassung (einschließlich infolge von Verzögerungen bei der Übersetzung) ist die englische Fassung maßgeblich.

Aufgabenkonfiguration

Sie können Konfigurationsvariablen zur Optimierung der Leistung Ihrer MapReduce -Aufträge. Dieser Abschnitt enthält die Standardwerte für wichtige Einstellungen. Standardwerte variieren je nach dem EC2-Instance-Typ des im Cluster verwendeten Knoten. HBase steht bei Verwendung von Amazon EMR-Version 4.6.0 und höher zur Verfügung. Unterschiedliche Standardeinstellungen werden verwendet, wenn HBase installiert ist. Diese Werte werden zusammen mit den anfänglichen Standardwerten bereitgestellt.

Hadoop 2 verwendet die zwei Parameter mapreduce.map.java.opts und mapreduce.reduce.java.opts zum Konfigurieren des Arbeitsspeichers für die Karte und zum entsprechenden Verringern der JVMs. Diese ersetzen die einzelne mapreduce.map.java.opts-Konfigurationsoption von früheren Hadoop-Versionen.

In ähnlicher Weisemapred.job.jvm.num.tasksersetztmapred.job.reuse.jvm.num.tasksin Hadoop 2.7.2 und höher. Amazon EMR setzt diesen Wert unabhängig vom EC2-Instance-Typ auf 20. Sie können diese Einstellung mithilfe der mapred-site-Konfigurationsklassifizierung überschreiben. Durch Festlegen eines Werts auf -1 wird angegeben, dass eine JVM für eine unendliche Anzahl an Aufgaben innerhalb eines einzelnen Auftrags wiederverwendet werden kann. Der Wert 1 gibt an, dass eine neue JVM für jede Aufgabe erzeugt wird.

Beispiel: Um den Wert von mapred.job.jvm.num.tasks auf -1 festzulegen, können Sie eine Datei mit dem folgenden Inhalt erstellen:

[ { "Classification": "mapred-site", "Properties": { "mapred.job.jvm.num.tasks": "-1" } } ]

Wenn Sie den Befehl create-cluster oder modify-instance-groups aus der AWS CLI verwenden, können Sie auf die JSON-Konfigurationsdatei verweisen. Im folgenden Beispiel wird die Konfigurationsdatei untermyConfig.jsonund in Amazon S3 aufbewahrt.

Anmerkung

Linux-Zeilenfortsetzungszeichen (\) sind zur Lesbarkeit enthalten. Sie können entfernt oder in Linux-Befehlen verwendet werden. Entfernen Sie unter Windows sie oder ersetzen Sie sie durch ein Caret-Zeichen (^).

aws emr create-cluster --release-label emr-5.36.0 --instance-type m5.xlarge \ --instance-count 3 --applications Name=Hadoop --configurations https://s3.amazonaws.com/mybucket/myfolder/myConfig.json \ --use-default-roles

Sie können die unten aufgeführten Standardwerte ändern, indem Siemapred-siteKonfigurationsklassifizierung auf dieselbe Weise und legen Sie mehrere Werte und mehrere Konfigurationsklassifizierungen mit einer einzelnen JSON-Datei fest. Weitere Informationen finden Sie unter Konfigurieren von Anwendungen.

Mit Amazon EMR Version 5.21.0 und höher können Sie Cluster-Konfigurationen überschreiben und zusätzliche Konfigurationsklassifizierungen für jede Instance-Gruppe in einem ausgeführten Cluster festlegen. Das tun Sie unter Verwendung der Amazon EMR-Konsole,AWS Command Line Interface(AWS CLI), oder dasAWS-SDKS. Weitere Informationen finden Sie unterAngeben einer Konfiguration für eine Instance-Gruppe in einem aktiven Clusteraus.

Standardwerte für Task-Konfigurationseinstellungen

c1-Instances

c1.medium
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx288m
mapreduce.reduce.java.opts -Xmx288m
mapreduce.map.memory.mb 512
mapreduce.reduce.memory.mb 512
yarn.app.mapreduce.am.resource.mb 512
yarn.scheduler.minimum-allocation-mb 256
yarn.scheduler.maximum-allocation-mb 512
yarn.nodemanager.resource.memory-mb 1024
c1.xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx864m -Xmx864m
mapreduce.reduce.java.opts -Xmx1536m -Xmx1536m
mapreduce.map.memory.mb 1024 1024
mapreduce.reduce.memory.mb 2048 2048
yarn.app.mapreduce.am.resource.mb 2048 2048
yarn.scheduler.minimum-allocation-mb 256 32
yarn.scheduler.maximum-allocation-mb 2048 2560
yarn.nodemanager.resource.memory-mb 5120 2560

c3-Instances

c3.xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1126m -Xmx1126m
mapreduce.reduce.java.opts -Xmx2252m -Xmx2252m
mapreduce.map.memory.mb 1 408 1 408
mapreduce.reduce.memory.mb 2816 2816
yarn.app.mapreduce.am.resource.mb 2816 2816
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 5632 2816
yarn.nodemanager.resource.memory-mb 5632 2816
c3.2xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1152m -Xmx1152m
mapreduce.reduce.java.opts -Xmx2304m -Xmx2304m
mapreduce.map.memory.mb 1440 1440
mapreduce.reduce.memory.mb 2880 2880
yarn.app.mapreduce.am.resource.mb 2880 2880
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 11520 5760
yarn.nodemanager.resource.memory-mb 11520 5760
c3.4xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1152m -Xmx1152m
mapreduce.reduce.java.opts -Xmx2304m -Xmx2304m
mapreduce.map.memory.mb 1440 1440
mapreduce.reduce.memory.mb 2880 2880
yarn.app.mapreduce.am.resource.mb 2880 2880
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 23040 11520
yarn.nodemanager.resource.memory-mb 23040 11520
c3.8xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1331m -Xmx1331m
mapreduce.reduce.java.opts -Xmx2662m -Xmx2662m
mapreduce.map.memory.mb 1664 1664
mapreduce.reduce.memory.mb 3328 3328
yarn.app.mapreduce.am.resource.mb 3328 3328
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 53248 26624
yarn.nodemanager.resource.memory-mb 53248 26624

c4-Instances

c4.large
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx717m -Xmx717m
mapreduce.reduce.java.opts -Xmx1434m -Xmx1434m
mapreduce.map.memory.mb 896 896
mapreduce.reduce.memory.mb 1792 1792
yarn.app.mapreduce.am.resource.mb 1792 1792
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 1792 896
yarn.nodemanager.resource.memory-mb 1792 896
c4.xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1126m -Xmx1126m
mapreduce.reduce.java.opts -Xmx2253m -Xmx2253m
mapreduce.map.memory.mb 1 408 1 408
mapreduce.reduce.memory.mb 2816 2816
yarn.app.mapreduce.am.resource.mb 2816 2816
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 5632 2816
yarn.nodemanager.resource.memory-mb 5632 2816
c4.2xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1152m -Xmx1152m
mapreduce.reduce.java.opts -Xmx2304m -Xmx2304m
mapreduce.map.memory.mb 1440 1440
mapreduce.reduce.memory.mb 2880 2880
yarn.app.mapreduce.am.resource.mb 2880 2880
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 11520 5760
yarn.nodemanager.resource.memory-mb 11520 5760
c4.4xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1152m -Xmx1152m
mapreduce.reduce.java.opts -Xmx2304m -Xmx2304m
mapreduce.map.memory.mb 1440 1440
mapreduce.reduce.memory.mb 2880 2880
yarn.app.mapreduce.am.resource.mb 2880 2880
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 23040 11520
yarn.nodemanager.resource.memory-mb 23040 11520
c4.8xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1183m -Xmx1183m
mapreduce.reduce.java.opts -Xmx2366m -Xmx2366m
mapreduce.map.memory.mb 1479 1479
mapreduce.reduce.memory.mb 2958 2958
yarn.app.mapreduce.am.resource.mb 2958 2958
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 53248 26624
yarn.nodemanager.resource.memory-mb 53248 26624

c5-Instances

c5.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1229m
mapreduce.reduce.java.opts -Xmx2458m
mapreduce.map.memory.mb 1536
mapreduce.reduce.memory.mb 3072
yarn.app.mapreduce.am.resource.mb 3072
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 6144
yarn.nodemanager.resource.memory-mb 6144
c5.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1229m
mapreduce.reduce.java.opts -Xmx2458m
mapreduce.map.memory.mb 1536
mapreduce.reduce.memory.mb 3072
yarn.app.mapreduce.am.resource.mb 3072
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 12288
yarn.nodemanager.resource.memory-mb 12288
c5.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1229m
mapreduce.reduce.java.opts -Xmx2458m
mapreduce.map.memory.mb 1536
mapreduce.reduce.memory.mb 3072
yarn.app.mapreduce.am.resource.mb 3072
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 24576
yarn.nodemanager.resource.memory-mb 24576
c5.9xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1456m
mapreduce.reduce.java.opts -Xmx2912m
mapreduce.map.memory.mb 1820
mapreduce.reduce.memory.mb 3640
yarn.app.mapreduce.am.resource.mb 3640
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 65536
yarn.nodemanager.resource.memory-mb 65536
c5.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1502m
mapreduce.reduce.java.opts -Xmx3004m
mapreduce.map.memory.mb 1877
mapreduce.reduce.memory.mb 3754
yarn.app.mapreduce.am.resource.mb 3754
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 90112
yarn.nodemanager.resource.memory-mb 90112
c5.18xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1547m
mapreduce.reduce.java.opts -Xmx3094m
mapreduce.map.memory.mb 1934
mapreduce.reduce.memory.mb 3868
yarn.app.mapreduce.am.resource.mb 3868
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 139264
yarn.nodemanager.resource.memory-mb 139264
c5.24xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1570m
mapreduce.reduce.java.opts -Xmx3140m
mapreduce.map.memory.mb 1963
mapreduce.reduce.memory.mb 3926
yarn.app.mapreduce.am.resource.mb 3926
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 188416
yarn.nodemanager.resource.memory-mb 188416

c5a-Instances

c5a.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1126m
mapreduce.reduce.java.opts -Xmx2252m
mapreduce.map.memory.mb 1 408
mapreduce.reduce.memory.mb 2816
yarn.app.mapreduce.am.resource.mb 2816
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 5632
yarn.nodemanager.resource.memory-mb 5632
c5a.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1171m
mapreduce.reduce.java.opts -Xmx2342m
mapreduce.map.memory.mb 1464
mapreduce.reduce.memory.mb 2928
yarn.app.mapreduce.am.resource.mb 2928
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 11712
yarn.nodemanager.resource.memory-mb 11712
c5a.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1171m
mapreduce.reduce.java.opts -Xmx2342m
mapreduce.map.memory.mb 1464
mapreduce.reduce.memory.mb 2928
yarn.app.mapreduce.am.resource.mb 2928
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
c5a.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1357m
mapreduce.reduce.java.opts -Xmx2714m
mapreduce.map.memory.mb 1696
mapreduce.reduce.memory.mb 3392
yarn.app.mapreduce.am.resource.mb 3392
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
c5a.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1502m
mapreduce.reduce.java.opts -Xmx3004m
mapreduce.map.memory.mb 1877
mapreduce.reduce.memory.mb 3754
yarn.app.mapreduce.am.resource.mb 3754
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 90112
yarn.nodemanager.resource.memory-mb 90112
c5a.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1459m
mapreduce.reduce.java.opts -Xmx3004m
mapreduce.map.memory.mb 1824
mapreduce.reduce.memory.mb 3648
yarn.app.mapreduce.am.resource.mb 3648
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736
c5a.24xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1494m
mapreduce.reduce.java.opts -xmx2988m
mapreduce.map.memory.mb 1867
mapreduce.reduce.memory.mb 3734
yarn.app.mapreduce.am.resource.mb 3734
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 179200
yarn.nodemanager.resource.memory-mb 179200

c5ad-Instances

c5ad.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1126m
mapreduce.reduce.java.opts -Xmx2252m
mapreduce.map.memory.mb 1 408
mapreduce.reduce.memory.mb 2816
yarn.app.mapreduce.am.resource.mb 2816
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 5632
yarn.nodemanager.resource.memory-mb 5632
c5ad.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1171m
mapreduce.reduce.java.opts -Xmx2342m
mapreduce.map.memory.mb 1464
mapreduce.reduce.memory.mb 2928
yarn.app.mapreduce.am.resource.mb 2928
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 11712
yarn.nodemanager.resource.memory-mb 11712
c5ad.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1171m
mapreduce.reduce.java.opts -Xmx2342m
mapreduce.map.memory.mb 1464
mapreduce.reduce.memory.mb 2928
yarn.app.mapreduce.am.resource.mb 2928
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
c5ad.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1357m
mapreduce.reduce.java.opts -Xmx2714m
mapreduce.map.memory.mb 1696
mapreduce.reduce.memory.mb 3392
yarn.app.mapreduce.am.resource.mb 3392
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
c5ad.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1425m
mapreduce.reduce.java.opts -xmx1425m
mapreduce.map.memory.mb 1781
mapreduce.reduce.memory.mb 3562
yarn.app.mapreduce.am.resource.mb 3562
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 85504
yarn.nodemanager.resource.memory-mb 85504
c5ad.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1459m
mapreduce.reduce.java.opts -Xmx2918m
mapreduce.map.memory.mb 1824
mapreduce.reduce.memory.mb 3648
yarn.app.mapreduce.am.resource.mb 3648
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736
c5ad.24xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1494m
mapreduce.reduce.java.opts -xmx2988m
mapreduce.map.memory.mb 1867
mapreduce.reduce.memory.mb 3734
yarn.app.mapreduce.am.resource.mb 3734
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 179200
yarn.nodemanager.resource.memory-mb 179200

c5d-Instances

c5d.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1229m
mapreduce.reduce.java.opts -Xmx2458m
mapreduce.map.memory.mb 1536
mapreduce.reduce.memory.mb 3072
yarn.app.mapreduce.am.resource.mb 3072
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 6144
yarn.nodemanager.resource.memory-mb 6144
c5d.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1229m
mapreduce.reduce.java.opts -Xmx2458m
mapreduce.map.memory.mb 1536
mapreduce.reduce.memory.mb 3072
yarn.app.mapreduce.am.resource.mb 3072
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 12288
yarn.nodemanager.resource.memory-mb 12288
c5d.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1229m
mapreduce.reduce.java.opts -Xmx2458m
mapreduce.map.memory.mb 1536
mapreduce.reduce.memory.mb 3072
yarn.app.mapreduce.am.resource.mb 3072
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 24576
yarn.nodemanager.resource.memory-mb 24576
c5d.9xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1456m
mapreduce.reduce.java.opts -Xmx2912m
mapreduce.map.memory.mb 1820
mapreduce.reduce.memory.mb 3640
yarn.app.mapreduce.am.resource.mb 3640
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 65536
yarn.nodemanager.resource.memory-mb 65536
c5d.18xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1547m
mapreduce.reduce.java.opts -Xmx3094m
mapreduce.map.memory.mb 1934
mapreduce.reduce.memory.mb 3868
yarn.app.mapreduce.am.resource.mb 3868
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 139264
yarn.nodemanager.resource.memory-mb 139264

c5n-Instances

c5n.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1613m
mapreduce.reduce.java.opts -Xmx3226m
mapreduce.map.memory.mb 2016
mapreduce.reduce.memory.mb 4032
yarn.app.mapreduce.am.resource.mb 4032
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 8064
yarn.nodemanager.resource.memory-mb 8064
c5n.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1613m
mapreduce.reduce.java.opts -Xmx3226m
mapreduce.map.memory.mb 2016
mapreduce.reduce.memory.mb 4032
yarn.app.mapreduce.am.resource.mb 4032
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 16128
yarn.nodemanager.resource.memory-mb 16128
c5n.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1741m
mapreduce.reduce.java.opts -Xmx3482m
mapreduce.map.memory.mb 2176
mapreduce.reduce.memory.mb 4352
yarn.app.mapreduce.am.resource.mb 4352
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 34816
yarn.nodemanager.resource.memory-mb 34816
c5n.9xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2002m
mapreduce.reduce.java.opts -Xmx4004m
mapreduce.map.memory.mb 2503
mapreduce.reduce.memory.mb 5006
yarn.app.mapreduce.am.resource.mb 5006
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 90112
yarn.nodemanager.resource.memory-mb 90112
c5n.18xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2094m
mapreduce.reduce.java.opts -Xmx4188m
mapreduce.map.memory.mb 2617
mapreduce.reduce.memory.mb 5234
yarn.app.mapreduce.am.resource.mb 5234
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 188416
yarn.nodemanager.resource.memory-mb 188416

c6g-Instances

c6g.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1126
mapreduce.reduce.java.opts -Xmx2252m
mapreduce.map.memory.mb 1 408
mapreduce.reduce.memory.mb 2816
yarn.app.mapreduce.am.resource.mb 2816
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 5632
yarn.nodemanager.resource.memory-mb 5632
c6g.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1171m
mapreduce.reduce.java.opts -Xmx2342m
mapreduce.map.memory.mb 1464
mapreduce.reduce.memory.mb 2928
yarn.app.mapreduce.am.resource.mb 2928
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 11712
yarn.nodemanager.resource.memory-mb 11712
c6g.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1171m
mapreduce.reduce.java.opts -Xmx2342m
mapreduce.map.memory.mb 1464
mapreduce.reduce.memory.mb 2928
yarn.app.mapreduce.am.resource.mb 2928
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
c6g.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1375m
mapreduce.reduce.java.opts -Xmx2714m
mapreduce.map.memory.mb 1696
mapreduce.reduce.memory.mb 3392
yarn.app.mapreduce.am.resource.mb 3392
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
c6g.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1425m
mapreduce.reduce.java.opts -xmx2850m
mapreduce.map.memory.mb 1781
mapreduce.reduce.memory.mb 3562
yarn.app.mapreduce.am.resource.mb 3562
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 85504
yarn.nodemanager.resource.memory-mb 85504
c6g.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1459m
mapreduce.reduce.java.opts -Xmx2918m
mapreduce.map.memory.mb 1824
mapreduce.reduce.memory.mb 3648
yarn.app.mapreduce.am.resource.mb 3648
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736

c6gd-Instances

c6gd.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1126m
mapreduce.reduce.java.opts -Xmx2252m
mapreduce.map.memory.mb 1 408
mapreduce.reduce.memory.mb 2816
yarn.app.mapreduce.am.resource.mb 2816
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 5632
yarn.nodemanager.resource.memory-mb 5632
c6gd.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1171m
mapreduce.reduce.java.opts -Xmx2342m
mapreduce.map.memory.mb 1464
mapreduce.reduce.memory.mb 2928
yarn.app.mapreduce.am.resource.mb 2928
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 11712
yarn.nodemanager.resource.memory-mb 11712
c6gd.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1171m
mapreduce.reduce.java.opts -Xmx2342m
mapreduce.map.memory.mb 1464
mapreduce.reduce.memory.mb 2928
yarn.app.mapreduce.am.resource.mb 2928
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
c6gd.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1357m
mapreduce.reduce.java.opts -Xmx2714m
mapreduce.map.memory.mb 1696
mapreduce.reduce.memory.mb 3392
yarn.app.mapreduce.am.resource.mb 3392
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
c6gd.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1425m
mapreduce.reduce.java.opts -xmx2850m
mapreduce.map.memory.mb 1781
mapreduce.reduce.memory.mb 3562
yarn.app.mapreduce.am.resource.mb 3562
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 85504
yarn.nodemanager.resource.memory-mb 85504
c6gd.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1459m
mapreduce.reduce.java.opts -Xmx2918m
mapreduce.map.memory.mb 1824
mapreduce.reduce.memory.mb 3648
yarn.app.mapreduce.am.resource.mb 3648
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736

c6gn-Instances

c6gn.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1126m
mapreduce.reduce.java.opts -Xmx2252m
mapreduce.map.memory.mb 1 408
mapreduce.reduce.memory.mb 2816
yarn.app.mapreduce.am.resource.mb 2816
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 5632
yarn.nodemanager.resource.memory-mb 5632
c6gn.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1171m
mapreduce.reduce.java.opts -Xmx2342m
mapreduce.map.memory.mb 1464
mapreduce.reduce.memory.mb 2928
yarn.app.mapreduce.am.resource.mb 2928
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 11712
yarn.nodemanager.resource.memory-mb 11712
c6gn.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1171m
mapreduce.reduce.java.opts -Xmx2342m
mapreduce.map.memory.mb 1464
mapreduce.reduce.memory.mb 2928
yarn.app.mapreduce.am.resource.mb 2928
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
c6gn.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1357m
mapreduce.reduce.java.opts -Xmx2714m
mapreduce.map.memory.mb 1696
mapreduce.reduce.memory.mb 3392
yarn.app.mapreduce.am.resource.mb 3392
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
c6gn.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1425m
mapreduce.reduce.java.opts -xmx2850m
mapreduce.map.memory.mb 1781
mapreduce.reduce.memory.mb 3562
yarn.app.mapreduce.am.resource.mb 3562
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 85504
yarn.nodemanager.resource.memory-mb 85504
c6gn.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx1459m
mapreduce.reduce.java.opts -Xmx2918m
mapreduce.map.memory.mb 1824
mapreduce.reduce.memory.mb 3648
yarn.app.mapreduce.am.resource.mb 3648
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736

cc2-Instances

cc2.8xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1280m -Xmx1280m
mapreduce.reduce.java.opts -Xmx2304m -Xmx2304m
mapreduce.map.memory.mb 1536 1536
mapreduce.reduce.memory.mb 2560 2560
yarn.app.mapreduce.am.resource.mb 2560 2560
yarn.scheduler.minimum-allocation-mb 256 32
yarn.scheduler.maximum-allocation-mb 56320 28160
yarn.nodemanager.resource.memory-mb 56320 28160

cg1-Instances

cg1.4xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1280m -Xmx1280m
mapreduce.reduce.java.opts -Xmx2304m -Xmx2304m
mapreduce.map.memory.mb 1536 1536
mapreduce.reduce.memory.mb 2560 2560
yarn.app.mapreduce.am.resource.mb 2560 2560
yarn.scheduler.minimum-allocation-mb 256 32
yarn.scheduler.maximum-allocation-mb 5120 10240
yarn.nodemanager.resource.memory-mb 20480 10240

cr1-Instances

cr1.8xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx6042m -Xmx6042m
mapreduce.reduce.java.opts -Xmx12084m -Xmx12084m
mapreduce.map.memory.mb 7552 7552
mapreduce.reduce.memory.mb 15104 15104
yarn.app.mapreduce.am.resource.mb 15104 15104
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 241664 211456
yarn.nodemanager.resource.memory-mb 241664 211456

d2-Instances

d2.xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx2342m -Xmx2342m
mapreduce.reduce.java.opts -Xmx4685m -Xmx4685m
mapreduce.map.memory.mb 2928 2928
mapreduce.reduce.memory.mb 5856 5856
yarn.app.mapreduce.am.resource.mb 5856 5856
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 23424 11712
yarn.nodemanager.resource.memory-mb 23424 11712
d2.2xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx2714m -Xmx2714m
mapreduce.reduce.java.opts -Xmx5428m -Xmx5428m
mapreduce.map.memory.mb 3392 3392
mapreduce.reduce.memory.mb 6784 6784
yarn.app.mapreduce.am.resource.mb 6784 6784
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 54272 27136
yarn.nodemanager.resource.memory-mb 54272 27136
d2.4xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx2918m -Xmx2918m
mapreduce.reduce.java.opts -Xmx5836m -Xmx5836m
mapreduce.map.memory.mb 3648 3648
mapreduce.reduce.memory.mb 7296 7296
yarn.app.mapreduce.am.resource.mb 7296 7296
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 116736 87552
yarn.nodemanager.resource.memory-mb 116736 87552
d2.8xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx2417m -Xmx2417m
mapreduce.reduce.java.opts -Xmx4384m -Xmx4834m
mapreduce.map.memory.mb 3021 3021
mapreduce.reduce.memory.mb 6042 6042
yarn.app.mapreduce.am.resource.mb 6042 6042
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 241664 211470
yarn.nodemanager.resource.memory-mb 241664 211470

d3-Instances

d3.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx4685m
mapreduce.reduce.java.opts -Xmx9370m
mapreduce.map.memory.mb 5856
mapreduce.reduce.memory.mb 11712
yarn.app.mapreduce.am.resource.mb 11712
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
d3.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5427m
mapreduce.reduce.java.opts -Xmx10854m
mapreduce.map.memory.mb 6784
mapreduce.reduce.memory.mb 13568
yarn.app.mapreduce.am.resource.mb 13568
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
d3.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5837m
mapreduce.reduce.java.opts -Xmx11674m
mapreduce.map.memory.mb 7296
mapreduce.reduce.memory.mb 14592
yarn.app.mapreduce.am.resource.mb 14592
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736
d3.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6042m
mapreduce.reduce.java.opts -Xmx12084m
mapreduce.map.memory.mb 7552
mapreduce.reduce.memory.mb 15104
yarn.app.mapreduce.am.resource.mb 15104
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 241664
yarn.nodemanager.resource.memory-mb 241664

D3en-Instances

d3en.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2342m
mapreduce.reduce.java.opts -Xmx4684m
mapreduce.map.memory.mb 2928
mapreduce.reduce.memory.mb 5856
yarn.app.mapreduce.am.resource.mb 5856
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 11712
yarn.nodemanager.resource.memory-mb 11712
d3en.2en.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2342m
mapreduce.reduce.java.opts -Xmx4684m
mapreduce.map.memory.mb 2928
mapreduce.reduce.memory.mb 5856
yarn.app.mapreduce.am.resource.mb 5856
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
d3en.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2714m
mapreduce.reduce.java.opts -Xmx5428m
mapreduce.map.memory.mb 3392
mapreduce.reduce.memory.mb 6784
yarn.app.mapreduce.am.resource.mb 6784
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
d3en.6xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx2850m
mapreduce.reduce.java.opts -xmx5700m
mapreduce.map.memory.mb 3563
mapreduce.reduce.memory.mb 7126
yarn.app.mapreduce.am.resource.mb 7126
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 85504
yarn.nodemanager.resource.memory-mb 85504
d3en.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2918m
mapreduce.reduce.java.opts -xmx5700m
mapreduce.map.memory.mb 3648
mapreduce.reduce.memory.mb 7296
yarn.app.mapreduce.am.resource.mb 7296
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736
d3en.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2918m
mapreduce.reduce.java.opts -xmx5700m
mapreduce.map.memory.mb 3733
mapreduce.reduce.memory.mb 7466
yarn.app.mapreduce.am.resource.mb 7466
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 179200
yarn.nodemanager.resource.memory-mb 179200

g2-Instances

g2.2xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx512m -Xmx512m
mapreduce.reduce.java.opts -Xmx1536m -Xmx1536m
mapreduce.map.memory.mb 768 768
mapreduce.reduce.memory.mb 2048 2048
yarn.app.mapreduce.am.resource.mb 2048 2048
yarn.scheduler.minimum-allocation-mb 256 32
yarn.scheduler.maximum-allocation-mb 8192 6144
yarn.nodemanager.resource.memory-mb 12288 6144

g3-Instances

g3.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5837m
mapreduce.reduce.java.opts -Xmx11674m
mapreduce.map.memory.mb 7296
mapreduce.reduce.memory.mb 14592
yarn.app.mapreduce.am.resource.mb 14592
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736
g3.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6042m
mapreduce.reduce.java.opts -Xmx12084m
mapreduce.map.memory.mb 7552
mapreduce.reduce.memory.mb 15104
yarn.app.mapreduce.am.resource.mb 15104
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 241664
yarn.nodemanager.resource.memory-mb 241664
g3.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6144m
mapreduce.reduce.java.opts -Xmx12288m
mapreduce.map.memory.mb 7680
mapreduce.reduce.memory.mb 15360
yarn.app.mapreduce.am.resource.mb 15360
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 491520
yarn.nodemanager.resource.memory-mb 491520

g3s-Instances

g3s.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx4685m
mapreduce.reduce.java.opts -Xmx9370m
mapreduce.map.memory.mb 5856
mapreduce.reduce.memory.mb 11712
yarn.app.mapreduce.am.resource.mb 11712
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424

g4dn-Instances

g4dn.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2458m
mapreduce.reduce.java.opts -Xmx4916m
mapreduce.map.memory.mb 3072
mapreduce.reduce.memory.mb 6144
yarn.app.mapreduce.am.resource.mb 6144
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 12288
yarn.nodemanager.resource.memory-mb 12288
g4dn.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2458m
mapreduce.reduce.java.opts -Xmx4916m
mapreduce.map.memory.mb 3072
mapreduce.reduce.memory.mb 6144
yarn.app.mapreduce.am.resource.mb 6144
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 24576
yarn.nodemanager.resource.memory-mb 24576
g4dn.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2867m
mapreduce.reduce.java.opts -Xmx5734m
mapreduce.map.memory.mb 3584
mapreduce.reduce.memory.mb 7168
yarn.app.mapreduce.am.resource.mb 7168
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 57344
yarn.nodemanager.resource.memory-mb 57344
g4dn.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3072m
mapreduce.reduce.java.opts -Xmx6144m
mapreduce.map.memory.mb 3840
mapreduce.reduce.memory.mb 7680
yarn.app.mapreduce.am.resource.mb 7680
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 122880
yarn.nodemanager.resource.memory-mb 122880
g4dn.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3140m
mapreduce.reduce.java.opts -Xmx6280m
mapreduce.map.memory.mb 3925
mapreduce.reduce.memory.mb 7850
yarn.app.mapreduce.am.resource.mb 7850
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 188416
yarn.nodemanager.resource.memory-mb 188416
g4dn.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3174m
mapreduce.reduce.java.opts -Xmx6348m
mapreduce.map.memory.mb 3968
mapreduce.reduce.memory.mb 7936
yarn.app.mapreduce.am.resource.mb 7936
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 253952
yarn.nodemanager.resource.memory-mb 253952

hi1-Instances

hi1.4xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx2688m -Xmx2688m
mapreduce.reduce.java.opts -Xmx5376m -Xmx5376m
mapreduce.map.memory.mb 3360 3360
mapreduce.reduce.memory.mb 6720 6720
yarn.app.mapreduce.am.resource.mb 6720 6720
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 53760 26880
yarn.nodemanager.resource.memory-mb 53760 26880

hs1-Instances

hs1.8xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1280m -Xmx1280m
mapreduce.reduce.java.opts -Xmx2304m -Xmx2304m
mapreduce.map.memory.mb 1536 1536
mapreduce.reduce.memory.mb 2560 2560
yarn.app.mapreduce.am.resource.mb 2560 2560
yarn.scheduler.minimum-allocation-mb 256 32
yarn.scheduler.maximum-allocation-mb 8192 28160
yarn.nodemanager.resource.memory-mb 56320 28160

i2-Instances

i2.xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx2342m -Xmx2342m
mapreduce.reduce.java.opts -Xmx4684m -Xmx4684m
mapreduce.map.memory.mb 2928 2928
mapreduce.reduce.memory.mb 5856 5856
yarn.app.mapreduce.am.resource.mb 5856 5856
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 23424 11712
yarn.nodemanager.resource.memory-mb 23424 11712
i2.2xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx2714m -Xmx2714m
mapreduce.reduce.java.opts -Xmx5428m -Xmx5428m
mapreduce.map.memory.mb 3392 3392
mapreduce.reduce.memory.mb 6784 6784
yarn.app.mapreduce.am.resource.mb 6784 6784
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 54272 27136
yarn.nodemanager.resource.memory-mb 54272 27136
i2.4xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx2918m -Xmx2918m
mapreduce.reduce.java.opts -Xmx5836m -Xmx5836m
mapreduce.map.memory.mb 3648 3648
mapreduce.reduce.memory.mb 7296 7296
yarn.app.mapreduce.am.resource.mb 7296 7296
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 116736 87552
yarn.nodemanager.resource.memory-mb 116736 87552
i2.8xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx3021m -Xmx3021m
mapreduce.reduce.java.opts -Xmx6042m -Xmx6042m
mapreduce.map.memory.mb 3776 3776
mapreduce.reduce.memory.mb 7552 7552
yarn.app.mapreduce.am.resource.mb 7552 7552
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 241664 211456
yarn.nodemanager.resource.memory-mb 241664 211456

i3-Instances

i3.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx4685m
mapreduce.reduce.java.opts -Xmx9370m
mapreduce.map.memory.mb 5856
mapreduce.reduce.memory.mb 11712
yarn.app.mapreduce.am.resource.mb 11712
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
i3.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5427m
mapreduce.reduce.java.opts -Xmx10854m
mapreduce.map.memory.mb 6784
mapreduce.reduce.memory.mb 13568
yarn.app.mapreduce.am.resource.mb 13568
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
i3.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5837m
mapreduce.reduce.java.opts -Xmx11674m
mapreduce.map.memory.mb 7296
mapreduce.reduce.memory.mb 14592
yarn.app.mapreduce.am.resource.mb 14592
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736
i3.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6042m
mapreduce.reduce.java.opts -Xmx12083m
mapreduce.map.memory.mb 7552
mapreduce.reduce.memory.mb 15104
yarn.app.mapreduce.am.resource.mb 15104
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 241664
yarn.nodemanager.resource.memory-mb 241664
i3.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6144m
mapreduce.reduce.java.opts -Xmx12288m
mapreduce.map.memory.mb 7680
mapreduce.reduce.memory.mb 15360
yarn.app.mapreduce.am.resource.mb 15360
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 491520
yarn.nodemanager.resource.memory-mb 491520

i3en-Instances

i3en.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx4915m
mapreduce.reduce.java.opts -Xmx9830m
mapreduce.map.memory.mb 6144
mapreduce.reduce.memory.mb 12288
yarn.app.mapreduce.am.resource.mb 12288
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 24576
yarn.nodemanager.resource.memory-mb 24576
i3en.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5734m
mapreduce.reduce.java.opts -Xmx11468m
mapreduce.map.memory.mb 7168
mapreduce.reduce.memory.mb 14336
yarn.app.mapreduce.am.resource.mb 14336
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 57344
yarn.nodemanager.resource.memory-mb 57344
i3en.3xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6007m
mapreduce.reduce.java.opts -Xmx12014m
mapreduce.map.memory.mb 7509
mapreduce.reduce.memory.mb 15018
yarn.app.mapreduce.am.resource.mb 15018
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 90112
yarn.nodemanager.resource.memory-mb 90112
i3en.6xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6281m
mapreduce.reduce.java.opts -Xmx12562m
mapreduce.map.memory.mb 7851
mapreduce.reduce.memory.mb 15702
yarn.app.mapreduce.am.resource.mb 15702
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 188416
yarn.nodemanager.resource.memory-mb 188416
i3en.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6417m
mapreduce.reduce.java.opts -Xmx12834m
mapreduce.map.memory.mb 8021
mapreduce.reduce.memory.mb 16042
yarn.app.mapreduce.am.resource.mb 16042
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 385024
yarn.nodemanager.resource.memory-mb 385024
i3en.24xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6486m
mapreduce.reduce.java.opts -Xmx12972m
mapreduce.map.memory.mb 8107
mapreduce.reduce.memory.mb 16214
yarn.app.mapreduce.am.resource.mb 16214
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 778240
yarn.nodemanager.resource.memory-mb 778240

m1-Instances

m1.medium
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx512m
mapreduce.reduce.java.opts -Xmx768m
mapreduce.map.memory.mb 768
mapreduce.reduce.memory.mb 1024
yarn.app.mapreduce.am.resource.mb 1024
yarn.scheduler.minimum-allocation-mb 256
yarn.scheduler.maximum-allocation-mb 2048
yarn.nodemanager.resource.memory-mb 2048
m1.large
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx512m -Xmx512m
mapreduce.reduce.java.opts -Xmx1024m -Xmx1024m
mapreduce.map.memory.mb 768 768
mapreduce.reduce.memory.mb 1536 1536
yarn.app.mapreduce.am.resource.mb 1536 1536
yarn.scheduler.minimum-allocation-mb 256 32
yarn.scheduler.maximum-allocation-mb 5120 2560
yarn.nodemanager.resource.memory-mb 5120 2560
m1.xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx512m -Xmx512m
mapreduce.reduce.java.opts -Xmx1536m -Xmx1536m
mapreduce.map.memory.mb 768 768
mapreduce.reduce.memory.mb 2048 2048
yarn.app.mapreduce.am.resource.mb 2048 2048
yarn.scheduler.minimum-allocation-mb 256 32
yarn.scheduler.maximum-allocation-mb 8192 6144
yarn.nodemanager.resource.memory-mb 12288 6144

m2-Instances

m2.xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx864m -Xmx864m
mapreduce.reduce.java.opts -Xmx1536m -Xmx1536m
mapreduce.map.memory.mb 1024 1024
mapreduce.reduce.memory.mb 2048 2048
yarn.app.mapreduce.am.resource.mb 2048 2048
yarn.scheduler.minimum-allocation-mb 256 32
yarn.scheduler.maximum-allocation-mb 7168 7168
yarn.nodemanager.resource.memory-mb 14336 7168
m2.2xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1280m -Xmx1280m
mapreduce.reduce.java.opts -Xmx2304m -Xmx2304m
mapreduce.map.memory.mb 1536 1536
mapreduce.reduce.memory.mb 2560 2560
yarn.app.mapreduce.am.resource.mb 2560 2560
yarn.scheduler.minimum-allocation-mb 256 32
yarn.scheduler.maximum-allocation-mb 8192 15360
yarn.nodemanager.resource.memory-mb 61440 15360
m2.4xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1280m -Xmx1280m
mapreduce.reduce.java.opts -Xmx2304m -Xmx2304m
mapreduce.map.memory.mb 1536 1536
mapreduce.reduce.memory.mb 2560 2560
yarn.app.mapreduce.am.resource.mb 2560 2560
yarn.scheduler.minimum-allocation-mb 256 32
yarn.scheduler.maximum-allocation-mb 8192 30720
yarn.nodemanager.resource.memory-mb 61440 30720

m3-Instances

m3.2xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1152m -Xmx1152m
mapreduce.reduce.java.opts -Xmx2304m -Xmx2304m
mapreduce.map.memory.mb 1440 1440
mapreduce.reduce.memory.mb 2880 2880
yarn.app.mapreduce.am.resource.mb 2880 2880
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 23040 11520
yarn.nodemanager.resource.memory-mb 23040 11520

m4-Instances

m4.large
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1229m -Xmx2458m
mapreduce.reduce.java.opts -Xmx2458m -Xmx4916m
mapreduce.map.memory.mb 1536 3072
mapreduce.reduce.memory.mb 3072 6144
yarn.app.mapreduce.am.resource.mb 3072 6144
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 6144 3072
yarn.nodemanager.resource.memory-mb 6144 3072
m4.xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1229m -Xmx1229m
mapreduce.reduce.java.opts -Xmx2458m -Xmx2458m
mapreduce.map.memory.mb 1536 1536
mapreduce.reduce.memory.mb 3072 3072
yarn.app.mapreduce.am.resource.mb 3072 3072
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 12288 6144
yarn.nodemanager.resource.memory-mb 12288 6144
m4.2xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1229m -Xmx1229m
mapreduce.reduce.java.opts -Xmx2458m -Xmx2458m
mapreduce.map.memory.mb 1536 1536
mapreduce.reduce.memory.mb 3072 3072
yarn.app.mapreduce.am.resource.mb 3072 3072
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 24576 12288
yarn.nodemanager.resource.memory-mb 24576 12288
m4.4xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1434m -Xmx1434m
mapreduce.reduce.java.opts -Xmx2868m -Xmx2868m
mapreduce.map.memory.mb 1792 1792
mapreduce.reduce.memory.mb 3584 3584
yarn.app.mapreduce.am.resource.mb 3584 3584
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 57344 28672
yarn.nodemanager.resource.memory-mb 57344 28672
m4.10xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx1557m -Xmx1557m
mapreduce.reduce.java.opts -Xmx3114m -Xmx3114m
mapreduce.map.memory.mb 1946 1946
mapreduce.reduce.memory.mb 3892 3892
yarn.app.mapreduce.am.resource.mb 3892 3892
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 155648 124544
yarn.nodemanager.resource.memory-mb 155648 124544
m4.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx1587m
mapreduce.reduce.java.opts -Xmx3174m
mapreduce.map.memory.mb 1984
mapreduce.reduce.memory.mb 3968
yarn.app.mapreduce.am.resource.mb 3968
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 253952
yarn.nodemanager.resource.memory-mb 253952

m5-Instances

m5.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2458m
mapreduce.reduce.java.opts -Xmx4916m
mapreduce.map.memory.mb 3072
mapreduce.reduce.memory.mb 6144
yarn.app.mapreduce.am.resource.mb 6144
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 12288
yarn.nodemanager.resource.memory-mb 12288
m5.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2458m
mapreduce.reduce.java.opts -Xmx4916m
mapreduce.map.memory.mb 3072
mapreduce.reduce.memory.mb 6144
yarn.app.mapreduce.am.resource.mb 6144
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 24576
yarn.nodemanager.resource.memory-mb 24576
m5.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2867m
mapreduce.reduce.java.opts -Xmx5734m
mapreduce.map.memory.mb 3584
mapreduce.reduce.memory.mb 7168
yarn.app.mapreduce.am.resource.mb 7168
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 57344
yarn.nodemanager.resource.memory-mb 57344
m5.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3072m
mapreduce.reduce.java.opts -Xmx6144m
mapreduce.map.memory.mb 3840
mapreduce.reduce.memory.mb 7680
yarn.app.mapreduce.am.resource.mb 7680
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 122880
yarn.nodemanager.resource.memory-mb 122880
m5.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3140m
mapreduce.reduce.java.opts -Xmx6280m
mapreduce.map.memory.mb 3925
mapreduce.reduce.memory.mb 7850
yarn.app.mapreduce.am.resource.mb 7850
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 188416
yarn.nodemanager.resource.memory-mb 188416
m5.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3174m
mapreduce.reduce.java.opts -Xmx6348m
mapreduce.map.memory.mb 3968
mapreduce.reduce.memory.mb 7936
yarn.app.mapreduce.am.resource.mb 7936
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 253952
yarn.nodemanager.resource.memory-mb 253952
m5.24xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3209m
mapreduce.reduce.java.opts -Xmx6418m
mapreduce.map.memory.mb 4011
mapreduce.reduce.memory.mb 8022
yarn.app.mapreduce.am.resource.mb 8022
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 385024
yarn.nodemanager.resource.memory-mb 385024

m5a-Instances

m5a.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2458m
mapreduce.reduce.java.opts -Xmx4916m
mapreduce.map.memory.mb 3072
mapreduce.reduce.memory.mb 6144
yarn.app.mapreduce.am.resource.mb 6144
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 12288
yarn.nodemanager.resource.memory-mb 12288
m5a.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2458m
mapreduce.reduce.java.opts -Xmx4916m
mapreduce.map.memory.mb 3072
mapreduce.reduce.memory.mb 6144
yarn.app.mapreduce.am.resource.mb 6144
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 24576
yarn.nodemanager.resource.memory-mb 24576
m5a.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2867m
mapreduce.reduce.java.opts -Xmx5734m
mapreduce.map.memory.mb 3584
mapreduce.reduce.memory.mb 7168
yarn.app.mapreduce.am.resource.mb 7168
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 57344
yarn.nodemanager.resource.memory-mb 57344
m5a.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6144m
mapreduce.reduce.java.opts -Xmx12288m
mapreduce.map.memory.mb 7680
mapreduce.reduce.memory.mb 15360
yarn.app.mapreduce.am.resource.mb 15360
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 122880
yarn.nodemanager.resource.memory-mb 122880
m5a.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3140m
mapreduce.reduce.java.opts -Xmx6280m
mapreduce.map.memory.mb 3925
mapreduce.reduce.memory.mb 7850
yarn.app.mapreduce.am.resource.mb 7850
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 188416
yarn.nodemanager.resource.memory-mb 188416
m5a.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6349m
mapreduce.reduce.java.opts -Xmx12698m
mapreduce.map.memory.mb 7936
mapreduce.reduce.memory.mb 15872
yarn.app.mapreduce.am.resource.mb 15872
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 253952
yarn.nodemanager.resource.memory-mb 253952
m5a.24xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3209m
mapreduce.reduce.java.opts -Xmx6418m
mapreduce.map.memory.mb 4011
mapreduce.reduce.memory.mb 8022
yarn.app.mapreduce.am.resource.mb 8022
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 385024
yarn.nodemanager.resource.memory-mb 385024

m5d-Instances

m5d.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2458m
mapreduce.reduce.java.opts -Xmx4916m
mapreduce.map.memory.mb 3072
mapreduce.reduce.memory.mb 6144
yarn.app.mapreduce.am.resource.mb 6144
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 12288
yarn.nodemanager.resource.memory-mb 12288
m5d.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2458m
mapreduce.reduce.java.opts -Xmx4916m
mapreduce.map.memory.mb 3072
mapreduce.reduce.memory.mb 6144
yarn.app.mapreduce.am.resource.mb 6144
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 24576
yarn.nodemanager.resource.memory-mb 24576
m5d.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2867m
mapreduce.reduce.java.opts -Xmx5734m
mapreduce.map.memory.mb 3584
mapreduce.reduce.memory.mb 7168
yarn.app.mapreduce.am.resource.mb 7168
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 57344
yarn.nodemanager.resource.memory-mb 57344
m5d.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6144m
mapreduce.reduce.java.opts -Xmx12288m
mapreduce.map.memory.mb 7680
mapreduce.reduce.memory.mb 15360
yarn.app.mapreduce.am.resource.mb 15360
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 122880
yarn.nodemanager.resource.memory-mb 122880
m5d.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3140m
mapreduce.reduce.java.opts -Xmx6280m
mapreduce.map.memory.mb 3925
mapreduce.reduce.memory.mb 7850
yarn.app.mapreduce.am.resource.mb 7850
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 188416
yarn.nodemanager.resource.memory-mb 188416
m5d.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6349m
mapreduce.reduce.java.opts -Xmx12698m
mapreduce.map.memory.mb 7936
mapreduce.reduce.memory.mb 15872
yarn.app.mapreduce.am.resource.mb 15872
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 253952
yarn.nodemanager.resource.memory-mb 253952
m5d.24xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3209m
mapreduce.reduce.java.opts -Xmx6418m
mapreduce.map.memory.mb 4011
mapreduce.reduce.memory.mb 8022
yarn.app.mapreduce.am.resource.mb 8022
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 385024
yarn.nodemanager.resource.memory-mb 385024

m5zn-Instances

m5zn.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2304m
mapreduce.reduce.java.opts -xmx4608m
mapreduce.map.memory.mb 2880
mapreduce.reduce.memory.mb 5760
yarn.app.mapreduce.am.resource.mb 5760
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 11520
yarn.nodemanager.resource.memory-mb 11520
m5zn.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2304m
mapreduce.reduce.java.opts -xmx4608m
mapreduce.map.memory.mb 2880
mapreduce.reduce.memory.mb 5760
yarn.app.mapreduce.am.resource.mb 5760
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 11520
yarn.nodemanager.resource.memory-mb 11520
m5zn.3xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2304m
mapreduce.reduce.java.opts -xmx5154m
mapreduce.map.memory.mb 3221
mapreduce.reduce.memory.mb 6442
yarn.app.mapreduce.am.resource.mb 6442
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 38656
yarn.nodemanager.resource.memory-mb 38656
m5zn.6xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx2850m
mapreduce.reduce.java.opts -xmx5700m
mapreduce.map.memory.mb 3563
mapreduce.reduce.memory.mb 7126
yarn.app.mapreduce.am.resource.mb 7126
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 85504
yarn.nodemanager.resource.memory-mb 85504
m5zn.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xmx2986m
mapreduce.reduce.java.opts -xMX5972m
mapreduce.map.memory.mb 3733
mapreduce.reduce.memory.mb 7466
yarn.app.mapreduce.am.resource.mb 7466
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 179200
yarn.nodemanager.resource.memory-mb 179200

m6g-Instances

m6g.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2342m
mapreduce.reduce.java.opts -Xmx4684m
mapreduce.map.memory.mb 2928
mapreduce.reduce.memory.mb 5856
yarn.app.mapreduce.am.resource.mb 5856
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 11712
yarn.nodemanager.resource.memory-mb 11712
m6g.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2342m
mapreduce.reduce.java.opts -Xmx4684m
mapreduce.map.memory.mb 2928
mapreduce.reduce.memory.mb 5856
yarn.app.mapreduce.am.resource.mb 5856
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
m6g.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2714m
mapreduce.reduce.java.opts -Xmx5428m
mapreduce.map.memory.mb 3392
mapreduce.reduce.memory.mb 6784
yarn.app.mapreduce.am.resource.mb 6784
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
m6g.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2918m
mapreduce.reduce.java.opts -Xmx5836m
mapreduce.map.memory.mb 3648
mapreduce.reduce.memory.mb 7296
yarn.app.mapreduce.am.resource.mb 7296
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736
m6g.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3021m
mapreduce.reduce.java.opts -Xmx6042m
mapreduce.map.memory.mb 3776
mapreduce.reduce.memory.mb 7552
yarn.app.mapreduce.am.resource.mb 7552
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 181248
yarn.nodemanager.resource.memory-mb 181248
m6g.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3021m
mapreduce.reduce.java.opts -Xmx6042m
mapreduce.map.memory.mb 3776
mapreduce.reduce.memory.mb 7552
yarn.app.mapreduce.am.resource.mb 7552
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 241664
yarn.nodemanager.resource.memory-mb 241664

m6gd-Instances

m6gd.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2342m
mapreduce.reduce.java.opts -Xmx4684m
mapreduce.map.memory.mb 2928
mapreduce.reduce.memory.mb 5856
yarn.app.mapreduce.am.resource.mb 5856
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 11712
yarn.nodemanager.resource.memory-mb 11712
m6gd.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2342m
mapreduce.reduce.java.opts -Xmx4684m
mapreduce.map.memory.mb 2928
mapreduce.reduce.memory.mb 5856
yarn.app.mapreduce.am.resource.mb 5856
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
m6gd.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2714m
mapreduce.reduce.java.opts -Xmx5428m
mapreduce.map.memory.mb 3392
mapreduce.reduce.memory.mb 6784
yarn.app.mapreduce.am.resource.mb 6784
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
m6gd.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx2918m
mapreduce.reduce.java.opts -Xmx5836m
mapreduce.map.memory.mb 3648
mapreduce.reduce.memory.mb 7296
yarn.app.mapreduce.am.resource.mb 7296
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736
m6gd.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3021m
mapreduce.reduce.java.opts -Xmx6042m
mapreduce.map.memory.mb 3776
mapreduce.reduce.memory.mb 7552
yarn.app.mapreduce.am.resource.mb 7552
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 181248
yarn.nodemanager.resource.memory-mb 181248
m6gd.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx3021m
mapreduce.reduce.java.opts -Xmx6042m
mapreduce.map.memory.mb 3776
mapreduce.reduce.memory.mb 7552
yarn.app.mapreduce.am.resource.mb 7552
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 241664
yarn.nodemanager.resource.memory-mb 241664

p2-Instances

p2.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx10854m
mapreduce.reduce.java.opts -Xmx21708m
mapreduce.map.memory.mb 13568
mapreduce.reduce.memory.mb 27136
yarn.app.mapreduce.am.resource.mb 27136
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
p2.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx12288m
mapreduce.reduce.java.opts -Xmx24576
mapreduce.map.memory.mb 15360
mapreduce.reduce.memory.mb 30720
yarn.app.mapreduce.am.resource.mb 30720
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 491520
yarn.nodemanager.resource.memory-mb 491520
p2.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx9267m
mapreduce.reduce.java.opts -Xmx18534m
mapreduce.map.memory.mb 11584
mapreduce.reduce.memory.mb 23168
yarn.app.mapreduce.am.resource.mb 23168
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 741376
yarn.nodemanager.resource.memory-mb 741376

p3-Instances

p3.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5427m
mapreduce.reduce.java.opts -Xmx10854m
mapreduce.map.memory.mb 6784
mapreduce.reduce.memory.mb 13568
yarn.app.mapreduce.am.resource.mb 13568
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
p3.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6042m
mapreduce.reduce.java.opts -Xmx12084m
mapreduce.map.memory.mb 7552
mapreduce.reduce.memory.mb 15104
yarn.app.mapreduce.am.resource.mb 15104
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 241664
yarn.nodemanager.resource.memory-mb 241664
p3.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6144m
mapreduce.reduce.java.opts -Xmx12288m
mapreduce.map.memory.mb 7680
mapreduce.reduce.memory.mb 15360
yarn.app.mapreduce.am.resource.mb 15360
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 491520
yarn.nodemanager.resource.memory-mb 491520

r3-Instances

r3.xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx2342m -Xmx2342m
mapreduce.reduce.java.opts -Xmx4684m -Xmx4684m
mapreduce.map.memory.mb 2928 2928
mapreduce.reduce.memory.mb 5856 5856
yarn.app.mapreduce.am.resource.mb 5856 5856
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 23424 11712
yarn.nodemanager.resource.memory-mb 23424 11712
r3.2xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx2714m -Xmx2714m
mapreduce.reduce.java.opts -Xmx5428m -Xmx5428m
mapreduce.map.memory.mb 3392 3392
mapreduce.reduce.memory.mb 6784 6784
yarn.app.mapreduce.am.resource.mb 6784 6784
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 54272 27136
yarn.nodemanager.resource.memory-mb 54272 27136
r3.4xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx2918m -Xmx2918m
mapreduce.reduce.java.opts -Xmx5836m -Xmx5836m
mapreduce.map.memory.mb 3648 3648
mapreduce.reduce.memory.mb 7296 7296
yarn.app.mapreduce.am.resource.mb 7296 7296
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 116736 87552
yarn.nodemanager.resource.memory-mb 116736 87552
r3.8xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx3021m -Xmx3021m
mapreduce.reduce.java.opts -Xmx6042m -Xmx6042m
mapreduce.map.memory.mb 3776 3776
mapreduce.reduce.memory.mb 7552 7552
yarn.app.mapreduce.am.resource.mb 7552 7552
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 241664 211456
yarn.nodemanager.resource.memory-mb 241664 211456

r4-Instances

Anmerkung

R4-Instances sind nur in Amazon EMR-Version 5.4.0 und höher verfügbar.

r4.xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx4685m -Xmx2342m
mapreduce.reduce.java.opts -Xmx9370m -Xmx4684m
mapreduce.map.memory.mb 5856 5856
mapreduce.reduce.memory.mb 11712 11712
yarn.app.mapreduce.am.resource.mb 11712 11712
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 23424 11712
yarn.nodemanager.resource.memory-mb 23424 11712
r4.2xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx5427m -Xmx5427m
mapreduce.reduce.java.opts -Xmx10854m -Xmx10854m
mapreduce.map.memory.mb 6784 6784
mapreduce.reduce.memory.mb 13568 13568
yarn.app.mapreduce.am.resource.mb 13568 13568
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 54272 27136
yarn.nodemanager.resource.memory-mb 54272 27136
r4.4xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx5837m -Xmx5837m
mapreduce.reduce.java.opts -Xmx11674m -Xmx11674m
mapreduce.map.memory.mb 7296 7296
mapreduce.reduce.memory.mb 14592 14592
yarn.app.mapreduce.am.resource.mb 14592 14592
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 116736 87552
yarn.nodemanager.resource.memory-mb 116736 87552
r4.8xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx6042m -Xmx6042m
mapreduce.reduce.java.opts -Xmx12084m -Xmx12084m
mapreduce.map.memory.mb 7552 7552
mapreduce.reduce.memory.mb 15104 15104
yarn.app.mapreduce.am.resource.mb 15104 15104
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 241664 211456
yarn.nodemanager.resource.memory-mb 241664 211456
r4.16xlarge
Konfigurationsoption Standardwert Mit installierter HBase-Anwendung
mapreduce.map.java.opts -Xmx6144m -Xmx6144m
mapreduce.reduce.java.opts -Xmx12288m -Xmx1228m
mapreduce.map.memory.mb 7680 7680
mapreduce.reduce.memory.mb 15360 15360
yarn.app.mapreduce.am.resource.mb 15360 15360
yarn.scheduler.minimum-allocation-mb 32 32
yarn.scheduler.maximum-allocation-mb 491520 460800
yarn.nodemanager.resource.memory-mb 491520 460800

r5-Instances

r5.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx4915m
mapreduce.reduce.java.opts -Xmx9830m
mapreduce.map.memory.mb 6144
mapreduce.reduce.memory.mb 12288
yarn.app.mapreduce.am.resource.mb 12288
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 24576
yarn.nodemanager.resource.memory-mb 24576
r5.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5734m
mapreduce.reduce.java.opts -Xmx11468m
mapreduce.map.memory.mb 7168
mapreduce.reduce.memory.mb 14336
yarn.app.mapreduce.am.resource.mb 14336
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 57344
yarn.nodemanager.resource.memory-mb 57344
r5.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6144m
mapreduce.reduce.java.opts -Xmx12288m
mapreduce.map.memory.mb 7680
mapreduce.reduce.memory.mb 15360
yarn.app.mapreduce.am.resource.mb 15360
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 122880
yarn.nodemanager.resource.memory-mb 122880
r5.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6349m
mapreduce.reduce.java.opts -Xmx12698m
mapreduce.map.memory.mb 7936
mapreduce.reduce.memory.mb 15872
yarn.app.mapreduce.am.resource.mb 15872
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 253952
yarn.nodemanager.resource.memory-mb 253952
r5.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6417m
mapreduce.reduce.java.opts -Xmx12834m
mapreduce.map.memory.mb 8021
mapreduce.reduce.memory.mb 16042
yarn.app.mapreduce.am.resource.mb 16042
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 385024
yarn.nodemanager.resource.memory-mb 385024
r5.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6451m
mapreduce.reduce.java.opts -Xmx12902m
mapreduce.map.memory.mb 8064
mapreduce.reduce.memory.mb 16128
yarn.app.mapreduce.am.resource.mb 16128
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 516096
yarn.nodemanager.resource.memory-mb 516096
r5.24xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6486m
mapreduce.reduce.java.opts -Xmx12972m
mapreduce.map.memory.mb 8107
mapreduce.reduce.memory.mb 16214
yarn.app.mapreduce.am.resource.mb 16214
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 778240
yarn.nodemanager.resource.memory-mb 778240

r5a-Instances

r5a.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx4915m
mapreduce.reduce.java.opts -Xmx9830m
mapreduce.map.memory.mb 6144
mapreduce.reduce.memory.mb 12288
yarn.app.mapreduce.am.resource.mb 12288
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 24576
yarn.nodemanager.resource.memory-mb 24576
r5a.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5734m
mapreduce.reduce.java.opts -Xmx11468m
mapreduce.map.memory.mb 7168
mapreduce.reduce.memory.mb 14336
yarn.app.mapreduce.am.resource.mb 14336
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 57344
yarn.nodemanager.resource.memory-mb 57344
r5a.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6144m
mapreduce.reduce.java.opts -Xmx12288m
mapreduce.map.memory.mb 7680
mapreduce.reduce.memory.mb 15360
yarn.app.mapreduce.am.resource.mb 15360
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 122880
yarn.nodemanager.resource.memory-mb 122880
r5a.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6349m
mapreduce.reduce.java.opts -Xmx12698m
mapreduce.map.memory.mb 7936
mapreduce.reduce.memory.mb 15872
yarn.app.mapreduce.am.resource.mb 15872
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 253952
yarn.nodemanager.resource.memory-mb 253952
r5a.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6417m
mapreduce.reduce.java.opts -Xmx12834m
mapreduce.map.memory.mb 8021
mapreduce.reduce.memory.mb 16042
yarn.app.mapreduce.am.resource.mb 16042
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 385024
yarn.nodemanager.resource.memory-mb 385024
r5a.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6451m
mapreduce.reduce.java.opts -Xmx12902m
mapreduce.map.memory.mb 8064
mapreduce.reduce.memory.mb 16128
yarn.app.mapreduce.am.resource.mb 16128
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 516096
yarn.nodemanager.resource.memory-mb 516096
r5a.24xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6486m
mapreduce.reduce.java.opts -Xmx12972m
mapreduce.map.memory.mb 8107
mapreduce.reduce.memory.mb 16214
yarn.app.mapreduce.am.resource.mb 16214
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 778240
yarn.nodemanager.resource.memory-mb 778240

r5b-Instances

r5b.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx4685m
mapreduce.reduce.java.opts -Xmx9370m
mapreduce.map.memory.mb 5856
mapreduce.reduce.memory.mb 11712
yarn.app.mapreduce.am.resource.mb 11712
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
r5b.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5427m
mapreduce.reduce.java.opts -Xmx10854m
mapreduce.map.memory.mb 6784
mapreduce.reduce.memory.mb 13568
yarn.app.mapreduce.am.resource.mb 13568
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
r5b.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5837m
mapreduce.reduce.java.opts -Xmx11674m
mapreduce.map.memory.mb 7296
mapreduce.reduce.memory.mb 14592
yarn.app.mapreduce.am.resource.mb 14592
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736
r5b.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6042m
mapreduce.reduce.java.opts -Xmx12084m
mapreduce.map.memory.mb 7552
mapreduce.reduce.memory.mb 15104
yarn.app.mapreduce.am.resource.mb 15104
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 241664
yarn.nodemanager.resource.memory-mb 241664
r5b.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xMX6110m
mapreduce.reduce.java.opts -xmx12220m
mapreduce.map.memory.mb 7637
mapreduce.reduce.memory.mb 15274
yarn.app.mapreduce.am.resource.mb 15274
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 366592
yarn.nodemanager.resource.memory-mb 366592
r5b.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6144m
mapreduce.reduce.java.opts -Xmx12288m
mapreduce.map.memory.mb 7680
mapreduce.reduce.memory.mb 15360
yarn.app.mapreduce.am.resource.mb 15360
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 491520
yarn.nodemanager.resource.memory-mb 491520
r5b.24xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xMX6178m
mapreduce.reduce.java.opts -xmx12356m
mapreduce.map.memory.mb 7723
mapreduce.reduce.memory.mb 15446
yarn.app.mapreduce.am.resource.mb 15446
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 741376
yarn.nodemanager.resource.memory-mb 741376

r5d-Instances

r5d.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx4915m
mapreduce.reduce.java.opts -Xmx9830m
mapreduce.map.memory.mb 6144
mapreduce.reduce.memory.mb 12288
yarn.app.mapreduce.am.resource.mb 12288
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 24576
yarn.nodemanager.resource.memory-mb 24576
r5d.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5734m
mapreduce.reduce.java.opts -Xmx11468m
mapreduce.map.memory.mb 7168
mapreduce.reduce.memory.mb 14336
yarn.app.mapreduce.am.resource.mb 14336
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 57344
yarn.nodemanager.resource.memory-mb 57344
r5d.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6144m
mapreduce.reduce.java.opts -Xmx12288m
mapreduce.map.memory.mb 7680
mapreduce.reduce.memory.mb 15360
yarn.app.mapreduce.am.resource.mb 15360
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 122880
yarn.nodemanager.resource.memory-mb 122880
r5d.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6349m
mapreduce.reduce.java.opts -Xmx12698m
mapreduce.map.memory.mb 7936
mapreduce.reduce.memory.mb 15872
yarn.app.mapreduce.am.resource.mb 15872
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 253952
yarn.nodemanager.resource.memory-mb 253952
r5d.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6417m
mapreduce.reduce.java.opts -Xmx12834m
mapreduce.map.memory.mb 8021
mapreduce.reduce.memory.mb 16042
yarn.app.mapreduce.am.resource.mb 16042
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 385024
yarn.nodemanager.resource.memory-mb 385024
r5d.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6451m
mapreduce.reduce.java.opts -Xmx12902m
mapreduce.map.memory.mb 8064
mapreduce.reduce.memory.mb 16128
yarn.app.mapreduce.am.resource.mb 16128
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 516096
yarn.nodemanager.resource.memory-mb 516096
r5d.24xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6486m
mapreduce.reduce.java.opts -Xmx12972m
mapreduce.map.memory.mb 8107
mapreduce.reduce.memory.mb 16214
yarn.app.mapreduce.am.resource.mb 16214
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 778240
yarn.nodemanager.resource.memory-mb 778240

r5dn-Instances

r5dn.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx4685m
mapreduce.reduce.java.opts -Xmx9370m
mapreduce.map.memory.mb 5856
mapreduce.reduce.memory.mb 11712
yarn.app.mapreduce.am.resource.mb 11712
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
r5dn.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5427m
mapreduce.reduce.java.opts -Xmx10854m
mapreduce.map.memory.mb 6784
mapreduce.reduce.memory.mb 13568
yarn.app.mapreduce.am.resource.mb 13568
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
r5dn.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5837m
mapreduce.reduce.java.opts -Xmx11674m
mapreduce.map.memory.mb 14592
mapreduce.reduce.memory.mb 13568
yarn.app.mapreduce.am.resource.mb 14592
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736
r5dn.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6042m
mapreduce.reduce.java.opts -Xmx12084m
mapreduce.map.memory.mb 7552
mapreduce.reduce.memory.mb 15104
yarn.app.mapreduce.am.resource.mb 15104
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 241664
yarn.nodemanager.resource.memory-mb 241664
r5dn.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6042m
mapreduce.reduce.java.opts -xmx12220m
mapreduce.map.memory.mb 7637
mapreduce.reduce.memory.mb 15274
yarn.app.mapreduce.am.resource.mb 15274
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 366592
yarn.nodemanager.resource.memory-mb 366592
r5dn.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6144m
mapreduce.reduce.java.opts -Xmx12288m
mapreduce.map.memory.mb 7680
mapreduce.reduce.memory.mb 15360
yarn.app.mapreduce.am.resource.mb 15360
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 491520
yarn.nodemanager.resource.memory-mb 491520
r5dn.24xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xMX6178m
mapreduce.reduce.java.opts -xmx12356m
mapreduce.map.memory.mb 7723
mapreduce.reduce.memory.mb 15446
yarn.app.mapreduce.am.resource.mb 15446
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 741376
yarn.nodemanager.resource.memory-mb 741376

r6g-Instances

r6g.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx4685m
mapreduce.reduce.java.opts -Xmx9370m
mapreduce.map.memory.mb 5856
mapreduce.reduce.memory.mb 11712
yarn.app.mapreduce.am.resource.mb 11712
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
r6g.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5427m
mapreduce.reduce.java.opts -xmx10584m
mapreduce.map.memory.mb 6784
mapreduce.reduce.memory.mb 13568
yarn.app.mapreduce.am.resource.mb 13568
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
r6g.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5837m
mapreduce.reduce.java.opts -Xmx11674m
mapreduce.map.memory.mb 7296
mapreduce.reduce.memory.mb 14592
yarn.app.mapreduce.am.resource.mb 14592
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736
r6g.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6042m
mapreduce.reduce.java.opts -Xmx12084m
mapreduce.map.memory.mb 7552
mapreduce.reduce.memory.mb 15104
yarn.app.mapreduce.am.resource.mb 15104
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 241664
yarn.nodemanager.resource.memory-mb 241664
r6g.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xMX6110m
mapreduce.reduce.java.opts -xmx12220m
mapreduce.map.memory.mb 7637
mapreduce.reduce.memory.mb 15274
yarn.app.mapreduce.am.resource.mb 15274
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 366592
yarn.nodemanager.resource.memory-mb 366592
r6g.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6144m
mapreduce.reduce.java.opts -Xmx12288m
mapreduce.map.memory.mb 7680
mapreduce.reduce.memory.mb 15360
yarn.app.mapreduce.am.resource.mb 15360
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 491520
yarn.nodemanager.resource.memory-mb 491520

r6gd-Instances

r6gd.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx4685m
mapreduce.reduce.java.opts -Xmx9370m
mapreduce.map.memory.mb 5856
mapreduce.reduce.memory.mb 11712
yarn.app.mapreduce.am.resource.mb 11712
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 23424
yarn.nodemanager.resource.memory-mb 23424
r6gd.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5427m
mapreduce.reduce.java.opts -Xmx10854m
mapreduce.map.memory.mb 6784
mapreduce.reduce.memory.mb 13568
yarn.app.mapreduce.am.resource.mb 13568
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 54272
yarn.nodemanager.resource.memory-mb 54272
r6gd.4xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5837m
mapreduce.reduce.java.opts -Xmx11674m
mapreduce.map.memory.mb 7296
mapreduce.reduce.memory.mb 14592
yarn.app.mapreduce.am.resource.mb 14592
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 116736
yarn.nodemanager.resource.memory-mb 116736
r6gd.8xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6042m
mapreduce.reduce.java.opts -Xmx12084m
mapreduce.map.memory.mb 7552
mapreduce.reduce.memory.mb 15104
yarn.app.mapreduce.am.resource.mb 15104
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 241664
yarn.nodemanager.resource.memory-mb 241664
r6gd.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -xMX6110m
mapreduce.reduce.java.opts -xmx12220m
mapreduce.map.memory.mb 7637
mapreduce.reduce.memory.mb 15274
yarn.app.mapreduce.am.resource.mb 15274
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 366592
yarn.nodemanager.resource.memory-mb 366592
r6gd.16xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6144m
mapreduce.reduce.java.opts -Xmx12288m
mapreduce.map.memory.mb 7680
mapreduce.reduce.memory.mb 15360
yarn.app.mapreduce.am.resource.mb 15360
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 491520
yarn.nodemanager.resource.memory-mb 491520

z1d-Instances

z1d.xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx4915m
mapreduce.reduce.java.opts -Xmx9830m
mapreduce.map.memory.mb 6144
mapreduce.reduce.memory.mb 12288
yarn.app.mapreduce.am.resource.mb 12288
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 24576
yarn.nodemanager.resource.memory-mb 24576
z1d.2xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx5734m
mapreduce.reduce.java.opts -Xmx11468m
mapreduce.map.memory.mb 7168
mapreduce.reduce.memory.mb 14336
yarn.app.mapreduce.am.resource.mb 14336
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 57344
yarn.nodemanager.resource.memory-mb 57344
z1d.3xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6007m
mapreduce.reduce.java.opts -Xmx12014m
mapreduce.map.memory.mb 7509
mapreduce.reduce.memory.mb 15018
yarn.app.mapreduce.am.resource.mb 15018
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 90112
yarn.nodemanager.resource.memory-mb 90112
z1d.6xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6281m
mapreduce.reduce.java.opts -Xmx12562m
mapreduce.map.memory.mb 7851
mapreduce.reduce.memory.mb 15702
yarn.app.mapreduce.am.resource.mb 15702
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 188416
yarn.nodemanager.resource.memory-mb 188416
z1d.12xlarge
Konfigurationsoption Standardwert
mapreduce.map.java.opts -Xmx6417m
mapreduce.reduce.java.opts -Xmx12834m
mapreduce.map.memory.mb 8021
mapreduce.reduce.memory.mb 16042
yarn.app.mapreduce.am.resource.mb 16042
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 385024
yarn.nodemanager.resource.memory-mb 385024