AWS services or capabilities described in AWS Documentation may vary by region/location. Click Getting Started with Amazon AWS to see specific differences applicable to the China (Beijing) Region.
KeepJobFlowAliveWhenNoSteps
parameter is set to TRUE
, the job flow will transition to the WAITING
state rather than shutting down once the steps have completed.
For additional protection, you can set the JobFlowInstancesConfigTerminationProtected
parameter to TRUE
to lock the job flow and prevent it from being terminated
by API call, user intervention, or in the event of a job flow error.
A maximum of 256 steps are allowed in each job flow.
If your job flow is long-running (such as a Hive data warehouse) or complex, you may require more than 256 steps to process your data. You can bypass the 256-step limitation in various ways, including using the SSH shell to connect to the master node and submitting queries directly to the software running on the master node, such as Hive and Hadoop. For more information on how to do this, go to Add More than 256 Steps to a Job Flow in the Amazon Elastic MapReduce Developer's Guide.
For long running job flows, we recommend that you periodically store your results.
Namespace: Amazon.ElasticMapReduce.Model
Assembly: AWSSDK.dll
Version: (assembly version)
public class RunJobFlowRequest : AmazonElasticMapReduceRequest IRequestEvents
The RunJobFlowRequest type exposes the following members
Name | Description | |
---|---|---|
RunJobFlowRequest() | Empty constructor used to set properties independently even when a simple constructor is available | |
RunJobFlowRequest(string, JobFlowInstancesConfig) | Instantiates RunJobFlowRequest with the parameterized properties |
Name | Type | Description | |
---|---|---|---|
AdditionalInfo | System.String |
Gets and sets the property AdditionalInfo.
A JSON string for selecting additional features. |
|
AmiVersion | System.String |
Gets and sets the property AmiVersion. For Amazon EMR releases 3.x and 2.x. For Amazon EMR releases 4.x and greater, use ReleaseLabel. The version of the Amazon Machine Image (AMI) to use when launching Amazon EC2 instances in the job flow. The following values are valid:
If the AMI supports multiple versions of Hadoop (for example, AMI 1.0 supports both
Hadoop 0.18 and 0.20) you can use the JobFlowInstancesConfig For details about the AMI versions currently supported by Amazon Elastic MapReduce, go to AMI Versions Supported in Elastic MapReduce in the Amazon Elastic MapReduce Developer's Guide. |
|
Applications | System.Collections.Generic.List<Amazon.ElasticMapReduce.Model.Application> |
Gets and sets the property Applications. Amazon EMR releases 4.x or later. A list of applications for the cluster. Valid values are: "Hadoop", "Hive", "Mahout", "Pig", and "Spark." They are case insensitive. |
|
BootstrapActions | System.Collections.Generic.List<Amazon.ElasticMapReduce.Model.BootstrapActionConfig> |
Gets and sets the property BootstrapActions.
A list of bootstrap actions that will be run before Hadoop is started on the cluster nodes. |
|
Configurations | System.Collections.Generic.List<Amazon.ElasticMapReduce.Model.Configuration> |
Gets and sets the property Configurations. Amazon EMR releases 4.x or later. The list of configurations supplied for the EMR cluster you are creating. |
|
Instances | Amazon.ElasticMapReduce.Model.JobFlowInstancesConfig |
Gets and sets the property Instances.
A specification of the number and type of Amazon EC2 instances on which to run the job flow. |
|
JobFlowRole | System.String |
Gets and sets the property JobFlowRole.
Also called instance profile and EC2 role. An IAM role for an EMR cluster. The EC2
instances of the cluster assume this role. The default role is |
|
LogUri | System.String |
Gets and sets the property LogUri.
The location in Amazon S3 to write the log files of the job flow. If a value is not provided, logs are not created. |
|
Name | System.String |
Gets and sets the property Name.
The name of the job flow. |
|
NewSupportedProducts | System.Collections.Generic.List<Amazon.ElasticMapReduce.Model.SupportedProductConfig> |
Gets and sets the property NewSupportedProducts. For Amazon EMR releases 3.x and 2.x. For Amazon EMR releases 4.x and greater, use Applications. A list of strings that indicates third-party software to use with the job flow that accepts a user argument list. EMR accepts and forwards the argument list to the corresponding installation script as bootstrap action arguments. For more information, see Launch a Job Flow on the MapR Distribution for Hadoop. Currently supported values are:
|
|
ReleaseLabel | System.String |
Gets and sets the property ReleaseLabel. Amazon EMR releases 4.x or later. The release label for the Amazon EMR release. For Amazon EMR 3.x and 2.x AMIs, use amiVersion instead instead of ReleaseLabel. |
|
ServiceRole | System.String |
Gets and sets the property ServiceRole.
The IAM role that will be assumed by the Amazon EMR service to access AWS resources on your behalf. |
|
Steps | System.Collections.Generic.List<Amazon.ElasticMapReduce.Model.StepConfig> |
Gets and sets the property Steps.
A list of steps to be executed by the job flow. |
|
SupportedProducts | System.Collections.Generic.List<System.String> |
Gets and sets the property SupportedProducts. For Amazon EMR releases 3.x and 2.x. For Amazon EMR releases 4.x and greater, use Applications. A list of strings that indicates third-party software to use with the job flow. For more information, go to Use Third Party Applications with Amazon EMR. Currently supported values are:
|
|
Tags | System.Collections.Generic.List<Amazon.ElasticMapReduce.Model.Tag> |
Gets and sets the property Tags.
A list of tags to associate with a cluster and propagate to Amazon EC2 instances. |
|
VisibleToAllUsers | System.Boolean |
Gets and sets the property VisibleToAllUsers.
Whether the job flow is visible to all IAM users of the AWS account associated with
the job flow. If this value is set to |
.NET Framework:
Supported in: 4.5, 4.0, 3.5
.NET for Windows Store apps:
Supported in: Windows 8