ShellScriptConfig - AWS Data Pipeline

AWS Data Pipeline is no longer available to new customers. Existing customers of AWS Data Pipeline can continue to use the service as normal. Learn more

ShellScriptConfig

Use with an Activity to run a shell script for preActivityTaskConfig and postActivityTaskConfig. This object is available for HadoopActivity, HiveActivity, HiveCopyActivity, and PigActivity. You specify an S3 URI and a list of arguments for the script.

Example

A ShellScriptConfig with arguments:

{ "id" : "ShellScriptConfig_1”, "name" : “prescript”, "type" : "ShellScriptConfig", "scriptUri": “s3://my-bucket/shell-cleanup.sh”, "scriptArgument" : ["arg1","arg2"] }

Syntax

This object includes the following fields.

Optional Fields Description Slot Type
parent Parent of the current object from which slots are inherited. Reference Object, for example, "parent":{"ref":"myBaseObjectId"}
scriptArgument A list of arguments to use with the shell script. String
scriptUri The script URI in Amazon S3 that should be downloaded and run. String

Runtime Fields Description Slot Type
@version Pipeline version that the object was created with. String

System Fields Description Slot Type
@error Error describing the ill-formed object. String
@pipelineId ID of the pipeline to which this object belongs. String
@sphere The sphere of an object denotes its place in the lifecycle: Component Objects give rise to Instance Objects, which execute Attempt Objects. String