AWS SDK for Go (PILOT)
API Reference

PREVIEW DOCUMENTATION - This is a preview of a new format for the AWS SDK for Go API Reference documentation. For the current AWS SDK for Go API Reference, see https://docs.aws.amazon.com/sdk-for-go/api/.

We welcome your feedback on this new version of the documentation. Send your comments to aws-sdkdocs-feedback@amazon.com.

JobUpdate

import "github.com/aws/aws-sdk-go/service/glue"

type JobUpdate struct { AllocatedCapacity *int64 `deprecated:"true" type:"integer"` Command *JobCommand `type:"structure"` Connections *ConnectionsList `type:"structure"` DefaultArguments map[string]*string `type:"map"` Description *string `type:"string"` ExecutionProperty *ExecutionProperty `type:"structure"` LogUri *string `type:"string"` MaxCapacity *float64 `type:"double"` MaxRetries *int64 `type:"integer"` NotificationProperty *NotificationProperty `type:"structure"` Role *string `type:"string"` SecurityConfiguration *string `min:"1" type:"string"` Timeout *int64 `min:"1" type:"integer"` }

Specifies information used to update an existing job definition. Note that the previous job definition will be completely overwritten by this information.

AllocatedCapacity

Type: *int64

This field is deprecated. Use MaxCapacity instead.

The number of AWS Glue data processing units (DPUs) to allocate to this Job. From 2 to 100 DPUs can be allocated; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the AWS Glue pricing page (https://aws.amazon.com/glue/pricing/).

Deprecated: This property is deprecated, use MaxCapacity instead.

Command

Specifies code executed when a job is run.

Connections

Specifies the connections used by a job.

DefaultArguments

Type: map[string]*string

The default arguments for this job.

You can specify arguments here that your own job-execution script consumes, as well as arguments that AWS Glue itself consumes.

For information about how to specify and consume your own Job arguments, see the Calling AWS Glue APIs in Python (https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-python-calling.html) topic in the developer guide.

For information about the key-value pairs that AWS Glue consumes to set up your job, see the Special Parameters Used by AWS Glue (https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html) topic in the developer guide.

Description

Type: *string

Description of the job being defined.

ExecutionProperty

An execution property of a job.

LogUri

Type: *string

This field is reserved for future use.

MaxCapacity

Type: *float64

The number of AWS Glue data processing units (DPUs) that can be allocated when this job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the AWS Glue pricing page (https://aws.amazon.com/glue/pricing/).

The value that can be allocated for MaxCapacity depends on whether you are running a python shell job, or an Apache Spark ETL job:

  • When you specify a python shell job (JobCommand.Name="pythonshell"), you can allocate either 0.0625 or 1 DPU. The default is 0.0625 DPU.

  • When you specify an Apache Spark ETL job (JobCommand.Name="glueetl"), you can allocate from 2 to 100 DPUs. The default is 10 DPUs. This job type cannot have a fractional DPU allocation.

MaxRetries

Type: *int64

The maximum number of times to retry this job if it fails.

NotificationProperty

Specifies configuration properties of a notification.

Role

Type: *string

The name or ARN of the IAM role associated with this job (required).

SecurityConfiguration

Type: *string

The name of the SecurityConfiguration structure to be used with this job.

Timeout

Type: *int64

The job timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours).

Method

GoString

func (s JobUpdate) GoString() string

GoString returns the string representation

SetAllocatedCapacity

func (s *JobUpdate) SetAllocatedCapacity(v int64) *JobUpdate

SetAllocatedCapacity sets the AllocatedCapacity field's value.

SetCommand

func (s *JobUpdate) SetCommand(v *JobCommand) *JobUpdate

SetCommand sets the Command field's value.

SetConnections

func (s *JobUpdate) SetConnections(v *ConnectionsList) *JobUpdate

SetConnections sets the Connections field's value.

SetDefaultArguments

func (s *JobUpdate) SetDefaultArguments(v map[string]*string) *JobUpdate

SetDefaultArguments sets the DefaultArguments field's value.

SetDescription

func (s *JobUpdate) SetDescription(v string) *JobUpdate

SetDescription sets the Description field's value.

SetExecutionProperty

func (s *JobUpdate) SetExecutionProperty(v *ExecutionProperty) *JobUpdate

SetExecutionProperty sets the ExecutionProperty field's value.

SetLogUri

func (s *JobUpdate) SetLogUri(v string) *JobUpdate

SetLogUri sets the LogUri field's value.

SetMaxCapacity

func (s *JobUpdate) SetMaxCapacity(v float64) *JobUpdate

SetMaxCapacity sets the MaxCapacity field's value.

SetMaxRetries

func (s *JobUpdate) SetMaxRetries(v int64) *JobUpdate

SetMaxRetries sets the MaxRetries field's value.

SetNotificationProperty

func (s *JobUpdate) SetNotificationProperty(v *NotificationProperty) *JobUpdate

SetNotificationProperty sets the NotificationProperty field's value.

SetRole

func (s *JobUpdate) SetRole(v string) *JobUpdate

SetRole sets the Role field's value.

SetSecurityConfiguration

func (s *JobUpdate) SetSecurityConfiguration(v string) *JobUpdate

SetSecurityConfiguration sets the SecurityConfiguration field's value.

SetTimeout

func (s *JobUpdate) SetTimeout(v int64) *JobUpdate

SetTimeout sets the Timeout field's value.

String

func (s JobUpdate) String() string

String returns the string representation

Validate

func (s *JobUpdate) Validate() error

Validate inspects the fields of the type to determine if they are valid.

On this page: