RunJobFlowRequest Class

Container for the parameters to the RunJobFlow operation. RunJobFlow creates and starts running a new job flow. The job flow will run the steps specified. Once the job flow completes, the cluster is stopped and the HDFS partition is lost. To prevent loss of data, configure the last step of the job flow to store results in Amazon S3. If the JobFlowInstancesConfig

CopyC#

KeepJobFlowAliveWhenNoSteps

parameter is set to

CopyC#

TRUE

, the job flow will transition to the WAITING state rather than shutting down once the steps have completed.

For additional protection, you can set the JobFlowInstancesConfig

CopyC#

TerminationProtected

parameter to

CopyC#

TRUE

to lock the job flow and prevent it from being terminated by API call, user intervention, or in the event of a job flow error.

A maximum of 256 steps are allowed in each job flow.

If your job flow is long-running (such as a Hive data warehouse) or complex, you may require more than 256 steps to process your data. You can bypass the 256-step limitation in various ways, including using the SSH shell to connect to the master node and submitting queries directly to the software running on the master node, such as Hive and Hadoop. For more information on how to do this, go to Add More than 256 Steps to a Job Flow in the Amazon Elastic MapReduce Developer's Guide.

For long running job flows, we recommend that you periodically store your results.

Declaration Syntax

public class RunJobFlowRequest : AmazonWebServiceRequest

Members

Icon	Member	Description
	RunJobFlowRequest()()()()	Initializes a new instance of the RunJobFlowRequest class
	AdditionalInfo	Gets and sets the property AdditionalInfo. A JSON string for selecting additional features.
	AmiVersion	Gets and sets the property AmiVersion. The version of the Amazon Machine Image (AMI) to use when launching Amazon EC2 instances in the job flow. The following values are valid: "latest" (uses the latest AMI) The version number of the AMI to use, for example, "2.0" If the AMI supports multiple versions of Hadoop (for example, AMI 1.0 supports both Hadoop 0.18 and 0.20) you can use the JobFlowInstancesConfig CopyC# HadoopVersion parameter to modify the version of Hadoop from the defaults shown above. For details about the AMI versions currently supported by Amazon Elastic MapReduce, go to AMI Versions Supported in Elastic MapReduce in the Amazon Elastic MapReduce Developer's Guide.
	BootstrapActions	Gets and sets the property BootstrapActions. A list of bootstrap actions that will be run before Hadoop is started on the cluster nodes.
	Equals(Object)	Determines whether the specified Object is equal to the current Object. (Inherited from Object.)
	GetHashCode()()()()	Serves as a hash function for a particular type. (Inherited from Object.)
	GetType()()()()	Gets the type of the current instance. (Inherited from Object.)
	Instances	Gets and sets the property Instances. A specification of the number and type of Amazon EC2 instances on which to run the job flow.
	JobFlowRole	Gets and sets the property JobFlowRole. An IAM role for the job flow. The EC2 instances of the job flow assume this role. The default role is CopyC# EMRJobflowDefault . In order to use the default role, you must have already created it using the CLI.
	LogUri	Gets and sets the property LogUri. The location in Amazon S3 to write the log files of the job flow. If a value is not provided, logs are not created.
	Name	Gets and sets the property Name. The name of the job flow.
	NewSupportedProducts	Gets and sets the property NewSupportedProducts. A list of strings that indicates third-party software to use with the job flow that accepts a user argument list. EMR accepts and forwards the argument list to the corresponding installation script as bootstrap action arguments. For more information, see Launch a Job Flow on the MapR Distribution for Hadoop. Currently supported values are: "mapr-m3" - launch the job flow using MapR M3 Edition. "mapr-m5" - launch the job flow using MapR M5 Edition. "mapr" with the user arguments specifying "--edition,m3" or "--edition,m5" - launch the job flow using MapR M3 or M5 Edition respectively.
	ServiceRole	Gets and sets the property ServiceRole. IAM role that Amazon ElasticMapReduce will assume to work with AWS resources on your behalf. You may set this parameter to the name of an existing IAM role.
	Steps	Gets and sets the property Steps. A list of steps to be executed by the job flow.
	SupportedProducts	Gets and sets the property SupportedProducts. A list of strings that indicates third-party software to use with the job flow. For more information, go to Use Third Party Applications with Amazon EMR. Currently supported values are: "mapr-m3" - launch the job flow using MapR M3 Edition. "mapr-m5" - launch the job flow using MapR M5 Edition.
	Tags	Gets and sets the property Tags. A list of tags to associate with a cluster and propagate to Amazon EC2 instances.
	ToString()()()()	Returns a string that represents the current object. (Inherited from Object.)
	VisibleToAllUsers	Gets and sets the property VisibleToAllUsers. Whether the job flow is visible to all IAM users of the AWS account associated with the job flow. If this value is set to CopyC# true , all IAM users of that AWS account can view and (if they have the proper policy permissions set) manage the job flow. If it is set to CopyC# false , only the IAM user that created the job flow can view and manage it.
	WithAdditionalInfo(String)	Obsolete. Sets the AdditionalInfo property
	WithAmiVersion(String)	Obsolete. Sets the AmiVersion property
	WithBootstrapActions(array<BootstrapActionConfig>[]()[][])	Obsolete. Sets the BootstrapActions property
	WithBootstrapActions(IEnumerable<(Of <<'(BootstrapActionConfig>)>>))	Obsolete. Sets the BootstrapActions property
	WithInstances(JobFlowInstancesConfig)	Obsolete. Sets the Instances property
	WithJobFlowRole(String)	Obsolete. Sets the JobFlowRole property
	WithLogUri(String)	Obsolete. Sets the LogUri property
	WithName(String)	Obsolete. Sets the Name property
	WithNewSupportedProducts(array<SupportedProductConfig>[]()[][])	Obsolete. Sets the NewSupportedProducts property
	WithNewSupportedProducts(IEnumerable<(Of <<'(SupportedProductConfig>)>>))	Obsolete. Sets the NewSupportedProducts property
	WithServiceRole(String)	Obsolete. Sets the ServiceRole property
	WithSteps(array<StepConfig>[]()[][])	Obsolete. Sets the Steps property
	WithSteps(IEnumerable<(Of <<'(StepConfig>)>>))	Obsolete. Sets the Steps property
	WithSupportedProducts(array<String>[]()[][])	Obsolete. Sets the SupportedProducts property
	WithSupportedProducts(IEnumerable<(Of <<'(String>)>>))	Obsolete. Sets the SupportedProducts property
	WithTags(array<Tag>[]()[][])	Obsolete. Sets the Tags property
	WithTags(IEnumerable<(Of <<'(Tag>)>>))	Obsolete. Sets the Tags property
	WithVisibleToAllUsers(Boolean)	Obsolete. Sets the VisibleToAllUsers property

Inheritance Hierarchy

Object
	AmazonWebServiceRequest
		RunJobFlowRequest

Assembly: AWSSDK (Module: AWSSDK) Version: 1.5.60.0 (1.5.60.0)

All Members	Constructors	Methods	Properties
Public Protected		Instance Static		Declared Inherited