JobUpdate
import "github.com/aws/aws-sdk-go/service/glue"
type JobUpdate struct { AllocatedCapacity *int64 `deprecated:"true" type:"integer"` Command *JobCommand `type:"structure"` Connections *ConnectionsList `type:"structure"` DefaultArguments map[string]*string `type:"map"` Description *string `type:"string"` ExecutionProperty *ExecutionProperty `type:"structure"` LogUri *string `type:"string"` MaxCapacity *float64 `type:"double"` MaxRetries *int64 `type:"integer"` NotificationProperty *NotificationProperty `type:"structure"` Role *string `type:"string"` SecurityConfiguration *string `min:"1" type:"string"` Timeout *int64 `min:"1" type:"integer"` }
Specifies information used to update an existing job definition. Note that the previous job definition will be completely overwritten by this information.
- AllocatedCapacity
-
Type:
*int64
This field is deprecated. Use MaxCapacity instead.
The number of AWS Glue data processing units (DPUs) to allocate to this Job. From 2 to 100 DPUs can be allocated; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the AWS Glue pricing page (https://aws.amazon.com/glue/pricing/).
Deprecated: This property is deprecated, use MaxCapacity instead.
- Command
-
Specifies code executed when a job is run.
- Connections
-
Specifies the connections used by a job.
- DefaultArguments
-
Type:
map[string]*string
The default arguments for this job.
You can specify arguments here that your own job-execution script consumes, as well as arguments that AWS Glue itself consumes.
For information about how to specify and consume your own Job arguments, see the Calling AWS Glue APIs in Python (https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-python-calling.html) topic in the developer guide.
For information about the key-value pairs that AWS Glue consumes to set up your job, see the Special Parameters Used by AWS Glue (https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html) topic in the developer guide.
- Description
-
Type:
*string
Description of the job being defined.
- ExecutionProperty
-
An execution property of a job.
- LogUri
-
Type:
*string
This field is reserved for future use.
- MaxCapacity
-
Type:
*float64
The number of AWS Glue data processing units (DPUs) that can be allocated when this job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the AWS Glue pricing page (https://aws.amazon.com/glue/pricing/).
The value that can be allocated for MaxCapacity depends on whether you are running a python shell job, or an Apache Spark ETL job:
-
When you specify a python shell job (JobCommand.Name="pythonshell"), you can allocate either 0.0625 or 1 DPU. The default is 0.0625 DPU.
-
When you specify an Apache Spark ETL job (JobCommand.Name="glueetl"), you can allocate from 2 to 100 DPUs. The default is 10 DPUs. This job type cannot have a fractional DPU allocation.
-
- MaxRetries
-
Type:
*int64
The maximum number of times to retry this job if it fails.
- NotificationProperty
-
Specifies configuration properties of a notification.
- Role
-
Type:
*string
The name or ARN of the IAM role associated with this job (required).
- SecurityConfiguration
-
Type:
*string
The name of the SecurityConfiguration structure to be used with this job.
- Timeout
-
Type:
*int64
The job timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours).
Method
GoString
func (s JobUpdate) GoString() string
GoString returns the string representation
SetAllocatedCapacity
func (s *JobUpdate) SetAllocatedCapacity(v int64) *JobUpdate
SetAllocatedCapacity sets the AllocatedCapacity field's value.
SetCommand
func (s *JobUpdate) SetCommand(v *JobCommand) *JobUpdate
SetCommand sets the Command field's value.
SetConnections
func (s *JobUpdate) SetConnections(v *ConnectionsList) *JobUpdate
SetConnections sets the Connections field's value.
SetDefaultArguments
func (s *JobUpdate) SetDefaultArguments(v map[string]*string) *JobUpdate
SetDefaultArguments sets the DefaultArguments field's value.
SetDescription
func (s *JobUpdate) SetDescription(v string) *JobUpdate
SetDescription sets the Description field's value.
SetExecutionProperty
func (s *JobUpdate) SetExecutionProperty(v *ExecutionProperty) *JobUpdate
SetExecutionProperty sets the ExecutionProperty field's value.
SetLogUri
func (s *JobUpdate) SetLogUri(v string) *JobUpdate
SetLogUri sets the LogUri field's value.
SetMaxCapacity
func (s *JobUpdate) SetMaxCapacity(v float64) *JobUpdate
SetMaxCapacity sets the MaxCapacity field's value.
SetMaxRetries
func (s *JobUpdate) SetMaxRetries(v int64) *JobUpdate
SetMaxRetries sets the MaxRetries field's value.
SetNotificationProperty
func (s *JobUpdate) SetNotificationProperty(v *NotificationProperty) *JobUpdate
SetNotificationProperty sets the NotificationProperty field's value.
SetRole
func (s *JobUpdate) SetRole(v string) *JobUpdate
SetRole sets the Role field's value.
SetSecurityConfiguration
func (s *JobUpdate) SetSecurityConfiguration(v string) *JobUpdate
SetSecurityConfiguration sets the SecurityConfiguration field's value.
SetTimeout
func (s *JobUpdate) SetTimeout(v int64) *JobUpdate
SetTimeout sets the Timeout field's value.
String
func (s JobUpdate) String() string
String returns the string representation
Validate
func (s *JobUpdate) Validate() error
Validate inspects the fields of the type to determine if they are valid.