This class provides helper methods for creating common Elastic MapReduce step
types. To use StepFactory, you should construct it with the appropriate bucket
for your region. The official bucket format is "<region>.elasticmapreduce", so
us-east-1 would use the bucket "us-east-1.elasticmapreduce".
Declaration Syntax| C# |
public class StepFactory
Members| All Members | Constructors | Methods | |||
| Icon | Member | Description |
|---|---|---|
 | StepFactory(String) | Initializes a new instance of the StepFactory class |
| StepFactory()()()() | Initializes a new instance of the StepFactory class |
| Equals(Object) | (Inherited from Object.) |
| GetHashCode()()()() | Serves as a hash function for a particular type. (Inherited from Object.) |
| GetType()()()() | Gets the type of the current instance. (Inherited from Object.) |
| NewEnableDebuggingStep()()()() |
When run as the first step in your job flow, enables the Hadoop debugging UI
in the AWS Management Console.
|
| NewInstallHiveStep(array<StepFactory..::..HiveVersion>[]()[][]) |
Step that installs Hive on your job flow.
|
| NewInstallHiveStep()()()() |
Step that installs Hive on your job flow.
|
| NewInstallPigStep()()()() |
Step that installs Pig on your job flow.
|
| NewRunHiveScriptStep(String, array<String>[]()[][]) |
Step that runs a Hive script on your job flow.
|
| NewRunHiveScriptStepVersioned(String, String, array<String>[]()[][]) |
Step that runs a Hive script on your job flow with a specific verson of Hive.
|
| NewRunPigScriptStep(String, array<String>[]()[][]) |
Step that runs a Pig script on your job flow.
|
| NewScriptRunnerStep(String, array<String>[]()[][]) |
Runs a specified script on the master node of your cluster.
|
| ToString()()()() | Returns a string that represents the current object. (Inherited from Object.) |
ExamplesCreate an interactive Hive job flow with debugging enabled:
CopyC#
CopyC#AmazonElasticMapReduce emr = AWSClientFactory.CreateAmazonElasticMapReduceClient(accessKey, secretKey); StepFactory stepFactory = new StepFactory(); StepConfig enableDebugging = new StepConfig { Name = "Enable Debugging", ActionOnFailure = "TERMINATE_JOB_FLOW", HadoopJarStep = stepFactory.NewEnableDebuggingStep() }; StepConfig installHive = new StepConfig { Name = "Install Hive", ActionOnFailure = "TERMINATE_JOB_FLOW", HadoopJarStep = stepFactory.NewInstallHiveStep() }; RunJobFlowRequest request = new RunJobFlowRequest { Name = "Hive Interactive", Steps = new List<StepConfig> { enableDebugging, installHive }, LogUri = "s3://log-bucket/", Instances = new JobFlowInstancesConfig { Ec2KeyName = "keypair", HadoopVersion = "0.20", InstanceCount = 5, KeepJobFlowAliveWhenNoSteps = true, MasterInstanceType = "m1.small", SlaveInstanceType = "m1.small" } }; RunJobFlowResponse response = emr.RunJobFlow(request);
Inheritance Hierarchy| Object | |
 | StepFactory |