ContinuousLoggingProps¶

class aws_cdk.aws_glue.ContinuousLoggingProps(*, enabled, conversion_pattern=None, log_group=None, log_stream_prefix=None, quiet=None)¶

Bases: object

(experimental) Properties for enabling Continuous Logging for Glue Jobs.

Parameters

enabled (bool) – (experimental) Enable continouous logging.
conversion_pattern (Optional[str]) – (experimental) Apply the provided conversion pattern. This is a Log4j Conversion Pattern to customize driver and executor logs. Default: %d{yy/MM/dd HH:mm:ss} %p %c{1}: %m%n
log_group (Optional[ILogGroup]) – (experimental) Specify a custom CloudWatch log group name. Default: - a log group is created with name /aws-glue/jobs/logs-v2/.
log_stream_prefix (Optional[str]) – (experimental) Specify a custom CloudWatch log stream prefix. Default: - the job run ID.
quiet (Optional[bool]) – (experimental) Filter out non-useful Apache Spark driver/executor and Apache Hadoop YARN heartbeat log messages. Default: true

See

https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

Stability

experimental

ExampleMetadata

fixture=_generated

Example:

# The code below shows an example of how to instantiate this type.
# The values are placeholders you should change.
import aws_cdk.aws_glue as glue
import aws_cdk.aws_logs as logs

# log_group: logs.LogGroup

continuous_logging_props = glue.ContinuousLoggingProps(
    enabled=False,

    # the properties below are optional
    conversion_pattern="conversionPattern",
    log_group=log_group,
    log_stream_prefix="logStreamPrefix",
    quiet=False
)

Attributes

conversion_pattern¶

(experimental) Apply the provided conversion pattern.

This is a Log4j Conversion Pattern to customize driver and executor logs.

Default: %d{yy/MM/dd HH:mm:ss} %p %c{1}: %m%n
Stability: experimental
Return type: Optional[str]

enabled¶

(experimental) Enable continouous logging.

Stability: experimental
Return type: bool

log_group¶

(experimental) Specify a custom CloudWatch log group name.

Default

a log group is created with name /aws-glue/jobs/logs-v2/.

Stability

experimental

Return type

Optional[ILogGroup]

log_stream_prefix¶

(experimental) Specify a custom CloudWatch log stream prefix.

Default

the job run ID.

Stability

experimental

Return type

Optional[str]

quiet¶

(experimental) Filter out non-useful Apache Spark driver/executor and Apache Hadoop YARN heartbeat log messages.

Default: true
Stability: experimental
Return type: Optional[bool]