Class: Aws::Glue::Types::S3IcebergDirectTarget
- Inherits:
-
Struct
- Object
- Struct
- Aws::Glue::Types::S3IcebergDirectTarget
- Defined in:
- gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb
Overview
Specifies a target that writes to an Iceberg data source in Amazon S3.
Constant Summary collapse
- SENSITIVE =
[]
Instance Attribute Summary collapse
-
#additional_options ⇒ Hash<String,String>
Provides additional configuration options for customizing the Iceberg table behavior.
-
#auto_data_quality ⇒ Types::AutoDataQuality
Specifies configuration options for automatic data quality evaluation in Glue jobs.
-
#compression ⇒ String
Specifies the compression codec used for Iceberg table files in S3.
-
#format ⇒ String
Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).
-
#inputs ⇒ Array<String>
Defines the single input source that provides data to this Iceberg target.
-
#name ⇒ String
Specifies the unique identifier for the Iceberg target node in your data pipeline.
-
#number_target_partitions ⇒ String
Sets the number of target partitions for distributing Iceberg table files across S3.
-
#output_schemas ⇒ Array<Types::GlueSchema>
Specifies the data schema for the S3 Iceberg direct target.
-
#partition_keys ⇒ Array<Array<String>>
Specifies the columns used to partition the Iceberg table data in S3.
-
#path ⇒ String
Defines the S3 location where the Iceberg table data will be stored.
-
#schema_change_policy ⇒ Types::DirectSchemaChangePolicy
Defines how schema changes are handled when writing data to the Iceberg table.
Instance Attribute Details
#additional_options ⇒ Hash<String,String>
Provides additional configuration options for customizing the Iceberg table behavior.
23842 23843 23844 23845 23846 23847 23848 23849 23850 23851 23852 23853 23854 23855 23856 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 23842 class S3IcebergDirectTarget < Struct.new( :name, :inputs, :partition_keys, :path, :format, :additional_options, :schema_change_policy, :auto_data_quality, :compression, :number_target_partitions, :output_schemas) SENSITIVE = [] include Aws::Structure end |
#auto_data_quality ⇒ Types::AutoDataQuality
Specifies configuration options for automatic data quality evaluation in Glue jobs. This structure enables automated data quality checks and monitoring during ETL operations, helping to ensure data integrity and reliability without manual intervention.
23842 23843 23844 23845 23846 23847 23848 23849 23850 23851 23852 23853 23854 23855 23856 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 23842 class S3IcebergDirectTarget < Struct.new( :name, :inputs, :partition_keys, :path, :format, :additional_options, :schema_change_policy, :auto_data_quality, :compression, :number_target_partitions, :output_schemas) SENSITIVE = [] include Aws::Structure end |
#compression ⇒ String
Specifies the compression codec used for Iceberg table files in S3.
23842 23843 23844 23845 23846 23847 23848 23849 23850 23851 23852 23853 23854 23855 23856 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 23842 class S3IcebergDirectTarget < Struct.new( :name, :inputs, :partition_keys, :path, :format, :additional_options, :schema_change_policy, :auto_data_quality, :compression, :number_target_partitions, :output_schemas) SENSITIVE = [] include Aws::Structure end |
#format ⇒ String
Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).
23842 23843 23844 23845 23846 23847 23848 23849 23850 23851 23852 23853 23854 23855 23856 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 23842 class S3IcebergDirectTarget < Struct.new( :name, :inputs, :partition_keys, :path, :format, :additional_options, :schema_change_policy, :auto_data_quality, :compression, :number_target_partitions, :output_schemas) SENSITIVE = [] include Aws::Structure end |
#inputs ⇒ Array<String>
Defines the single input source that provides data to this Iceberg target.
23842 23843 23844 23845 23846 23847 23848 23849 23850 23851 23852 23853 23854 23855 23856 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 23842 class S3IcebergDirectTarget < Struct.new( :name, :inputs, :partition_keys, :path, :format, :additional_options, :schema_change_policy, :auto_data_quality, :compression, :number_target_partitions, :output_schemas) SENSITIVE = [] include Aws::Structure end |
#name ⇒ String
Specifies the unique identifier for the Iceberg target node in your data pipeline.
23842 23843 23844 23845 23846 23847 23848 23849 23850 23851 23852 23853 23854 23855 23856 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 23842 class S3IcebergDirectTarget < Struct.new( :name, :inputs, :partition_keys, :path, :format, :additional_options, :schema_change_policy, :auto_data_quality, :compression, :number_target_partitions, :output_schemas) SENSITIVE = [] include Aws::Structure end |
#number_target_partitions ⇒ String
Sets the number of target partitions for distributing Iceberg table files across S3.
23842 23843 23844 23845 23846 23847 23848 23849 23850 23851 23852 23853 23854 23855 23856 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 23842 class S3IcebergDirectTarget < Struct.new( :name, :inputs, :partition_keys, :path, :format, :additional_options, :schema_change_policy, :auto_data_quality, :compression, :number_target_partitions, :output_schemas) SENSITIVE = [] include Aws::Structure end |
#output_schemas ⇒ Array<Types::GlueSchema>
Specifies the data schema for the S3 Iceberg direct target.
23842 23843 23844 23845 23846 23847 23848 23849 23850 23851 23852 23853 23854 23855 23856 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 23842 class S3IcebergDirectTarget < Struct.new( :name, :inputs, :partition_keys, :path, :format, :additional_options, :schema_change_policy, :auto_data_quality, :compression, :number_target_partitions, :output_schemas) SENSITIVE = [] include Aws::Structure end |
#partition_keys ⇒ Array<Array<String>>
Specifies the columns used to partition the Iceberg table data in S3.
23842 23843 23844 23845 23846 23847 23848 23849 23850 23851 23852 23853 23854 23855 23856 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 23842 class S3IcebergDirectTarget < Struct.new( :name, :inputs, :partition_keys, :path, :format, :additional_options, :schema_change_policy, :auto_data_quality, :compression, :number_target_partitions, :output_schemas) SENSITIVE = [] include Aws::Structure end |
#path ⇒ String
Defines the S3 location where the Iceberg table data will be stored.
23842 23843 23844 23845 23846 23847 23848 23849 23850 23851 23852 23853 23854 23855 23856 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 23842 class S3IcebergDirectTarget < Struct.new( :name, :inputs, :partition_keys, :path, :format, :additional_options, :schema_change_policy, :auto_data_quality, :compression, :number_target_partitions, :output_schemas) SENSITIVE = [] include Aws::Structure end |
#schema_change_policy ⇒ Types::DirectSchemaChangePolicy
Defines how schema changes are handled when writing data to the Iceberg table.
23842 23843 23844 23845 23846 23847 23848 23849 23850 23851 23852 23853 23854 23855 23856 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 23842 class S3IcebergDirectTarget < Struct.new( :name, :inputs, :partition_keys, :path, :format, :additional_options, :schema_change_policy, :auto_data_quality, :compression, :number_target_partitions, :output_schemas) SENSITIVE = [] include Aws::Structure end |