Class: Aws::Glue::Types::CodeGenConfigurationNode
- Inherits:
-
Struct
- Object
- Struct
- Aws::Glue::Types::CodeGenConfigurationNode
- Defined in:
- gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb
Overview
CodeGenConfigurationNode
enumerates all valid Node types. One and
only one of its member variables can be populated.
Constant Summary collapse
- SENSITIVE =
[]
Instance Attribute Summary collapse
-
#aggregate ⇒ Types::Aggregate
Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.
-
#apply_mapping ⇒ Types::ApplyMapping
Specifies a transform that maps data property keys in the data source to data property keys in the data target.
-
#athena_connector_source ⇒ Types::AthenaConnectorSource
Specifies a connector to an Amazon Athena data source.
-
#catalog_delta_source ⇒ Types::CatalogDeltaSource
Specifies a Delta Lake data source that is registered in the Glue Data Catalog.
-
#catalog_hudi_source ⇒ Types::CatalogHudiSource
Specifies a Hudi data source that is registered in the Glue Data Catalog.
-
#catalog_kafka_source ⇒ Types::CatalogKafkaSource
Specifies an Apache Kafka data store in the Data Catalog.
-
#catalog_kinesis_source ⇒ Types::CatalogKinesisSource
Specifies a Kinesis data source in the Glue Data Catalog.
-
#catalog_source ⇒ Types::CatalogSource
Specifies a data store in the Glue Data Catalog.
-
#catalog_target ⇒ Types::BasicCatalogTarget
Specifies a target that uses a Glue Data Catalog table.
-
#custom_code ⇒ Types::CustomCode
Specifies a transform that uses custom code you provide to perform the data transformation.
-
#direct_jdbc_source ⇒ Types::DirectJDBCSource
Specifies the direct JDBC source connection.
-
#direct_kafka_source ⇒ Types::DirectKafkaSource
Specifies an Apache Kafka data store.
-
#direct_kinesis_source ⇒ Types::DirectKinesisSource
Specifies a direct Amazon Kinesis data source.
-
#drop_duplicates ⇒ Types::DropDuplicates
Specifies a transform that removes rows of repeating data from a data set.
-
#drop_fields ⇒ Types::DropFields
Specifies a transform that chooses the data property keys that you want to drop.
-
#drop_null_fields ⇒ Types::DropNullFields
Specifies a transform that removes columns from the dataset if all values in the column are 'null'.
-
#dynamic_transform ⇒ Types::DynamicTransform
Specifies a custom visual transform created by a user.
-
#dynamo_db_catalog_source ⇒ Types::DynamoDBCatalogSource
Specifies a DynamoDBC Catalog data store in the Glue Data Catalog.
-
#evaluate_data_quality ⇒ Types::EvaluateDataQuality
Specifies your data quality evaluation criteria.
-
#fill_missing_values ⇒ Types::FillMissingValues
Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation.
-
#filter ⇒ Types::Filter
Specifies a transform that splits a dataset into two, based on a filter condition.
-
#governed_catalog_source ⇒ Types::GovernedCatalogSource
Specifies a data source in a goverened Data Catalog.
-
#governed_catalog_target ⇒ Types::GovernedCatalogTarget
Specifies a data target that writes to a goverened catalog.
-
#jdbc_connector_source ⇒ Types::JDBCConnectorSource
Specifies a connector to a JDBC data source.
-
#jdbc_connector_target ⇒ Types::JDBCConnectorTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
-
#join ⇒ Types::Join
Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys.
-
#merge ⇒ Types::Merge
Specifies a transform that merges a
DynamicFrame
with a stagingDynamicFrame
based on the specified primary keys to identify records. -
#microsoft_sql_server_catalog_source ⇒ Types::MicrosoftSQLServerCatalogSource
Specifies a Microsoft SQL server data source in the Glue Data Catalog.
-
#microsoft_sql_server_catalog_target ⇒ Types::MicrosoftSQLServerCatalogTarget
Specifies a target that uses Microsoft SQL.
-
#my_sql_catalog_source ⇒ Types::MySQLCatalogSource
Specifies a MySQL data source in the Glue Data Catalog.
-
#my_sql_catalog_target ⇒ Types::MySQLCatalogTarget
Specifies a target that uses MySQL.
-
#oracle_sql_catalog_source ⇒ Types::OracleSQLCatalogSource
Specifies an Oracle data source in the Glue Data Catalog.
-
#oracle_sql_catalog_target ⇒ Types::OracleSQLCatalogTarget
Specifies a target that uses Oracle SQL.
-
#pii_detection ⇒ Types::PIIDetection
Specifies a transform that identifies, removes or masks PII data.
-
#postgre_sql_catalog_source ⇒ Types::PostgreSQLCatalogSource
Specifies a PostgresSQL data source in the Glue Data Catalog.
-
#postgre_sql_catalog_target ⇒ Types::PostgreSQLCatalogTarget
Specifies a target that uses Postgres SQL.
-
#redshift_source ⇒ Types::RedshiftSource
Specifies an Amazon Redshift data store.
-
#redshift_target ⇒ Types::RedshiftTarget
Specifies a target that uses Amazon Redshift.
-
#relational_catalog_source ⇒ Types::RelationalCatalogSource
Specifies a relational catalog data store in the Glue Data Catalog.
-
#rename_field ⇒ Types::RenameField
Specifies a transform that renames a single data property key.
-
#s3_catalog_delta_source ⇒ Types::S3CatalogDeltaSource
Specifies a Delta Lake data source that is registered in the Glue Data Catalog.
-
#s3_catalog_hudi_source ⇒ Types::S3CatalogHudiSource
Specifies a Hudi data source that is registered in the Glue Data Catalog.
-
#s3_catalog_source ⇒ Types::S3CatalogSource
Specifies an Amazon S3 data store in the Glue Data Catalog.
-
#s3_catalog_target ⇒ Types::S3CatalogTarget
Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.
-
#s3_csv_source ⇒ Types::S3CsvSource
Specifies a command-separated value (CSV) data store stored in Amazon S3.
-
#s3_delta_catalog_target ⇒ Types::S3DeltaCatalogTarget
Specifies a target that writes to a Delta Lake data source in the Glue Data Catalog.
-
#s3_delta_direct_target ⇒ Types::S3DeltaDirectTarget
Specifies a target that writes to a Delta Lake data source in Amazon S3.
-
#s3_delta_source ⇒ Types::S3DeltaSource
Specifies a Delta Lake data source stored in Amazon S3.
-
#s3_direct_target ⇒ Types::S3DirectTarget
Specifies a data target that writes to Amazon S3.
-
#s3_glue_parquet_target ⇒ Types::S3GlueParquetTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
-
#s3_hudi_catalog_target ⇒ Types::S3HudiCatalogTarget
Specifies a target that writes to a Hudi data source in the Glue Data Catalog.
-
#s3_hudi_direct_target ⇒ Types::S3HudiDirectTarget
Specifies a target that writes to a Hudi data source in Amazon S3.
-
#s3_hudi_source ⇒ Types::S3HudiSource
Specifies a Hudi data source stored in Amazon S3.
-
#s3_json_source ⇒ Types::S3JsonSource
Specifies a JSON data store stored in Amazon S3.
-
#s3_parquet_source ⇒ Types::S3ParquetSource
Specifies an Apache Parquet data store stored in Amazon S3.
-
#select_fields ⇒ Types::SelectFields
Specifies a transform that chooses the data property keys that you want to keep.
-
#select_from_collection ⇒ Types::SelectFromCollection
Specifies a transform that chooses one
DynamicFrame
from a collection ofDynamicFrames
. -
#spark_connector_source ⇒ Types::SparkConnectorSource
Specifies a connector to an Apache Spark data source.
-
#spark_connector_target ⇒ Types::SparkConnectorTarget
Specifies a target that uses an Apache Spark connector.
-
#spark_sql ⇒ Types::SparkSQL
Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data.
-
#spigot ⇒ Types::Spigot
Specifies a transform that writes samples of the data to an Amazon S3 bucket.
-
#split_fields ⇒ Types::SplitFields
Specifies a transform that splits data property keys into two
DynamicFrames
. -
#union ⇒ Types::Union
Specifies a transform that combines the rows from two or more datasets into a single result.
Instance Attribute Details
#aggregate ⇒ Types::Aggregate
Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#apply_mapping ⇒ Types::ApplyMapping
Specifies a transform that maps data property keys in the data source to data property keys in the data target. You can rename keys, modify the data types for keys, and choose which keys to drop from the dataset.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#athena_connector_source ⇒ Types::AthenaConnectorSource
Specifies a connector to an Amazon Athena data source.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#catalog_delta_source ⇒ Types::CatalogDeltaSource
Specifies a Delta Lake data source that is registered in the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#catalog_hudi_source ⇒ Types::CatalogHudiSource
Specifies a Hudi data source that is registered in the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#catalog_kafka_source ⇒ Types::CatalogKafkaSource
Specifies an Apache Kafka data store in the Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#catalog_kinesis_source ⇒ Types::CatalogKinesisSource
Specifies a Kinesis data source in the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#catalog_source ⇒ Types::CatalogSource
Specifies a data store in the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#catalog_target ⇒ Types::BasicCatalogTarget
Specifies a target that uses a Glue Data Catalog table.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#custom_code ⇒ Types::CustomCode
Specifies a transform that uses custom code you provide to perform the data transformation. The output is a collection of DynamicFrames.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#direct_jdbc_source ⇒ Types::DirectJDBCSource
Specifies the direct JDBC source connection.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#direct_kafka_source ⇒ Types::DirectKafkaSource
Specifies an Apache Kafka data store.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#direct_kinesis_source ⇒ Types::DirectKinesisSource
Specifies a direct Amazon Kinesis data source.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#drop_duplicates ⇒ Types::DropDuplicates
Specifies a transform that removes rows of repeating data from a data set.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#drop_fields ⇒ Types::DropFields
Specifies a transform that chooses the data property keys that you want to drop.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#drop_null_fields ⇒ Types::DropNullFields
Specifies a transform that removes columns from the dataset if all values in the column are 'null'. By default, Glue Studio will recognize null objects, but some values such as empty strings, strings that are "null", -1 integers or other placeholders such as zeros, are not automatically recognized as nulls.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#dynamic_transform ⇒ Types::DynamicTransform
Specifies a custom visual transform created by a user.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#dynamo_db_catalog_source ⇒ Types::DynamoDBCatalogSource
Specifies a DynamoDBC Catalog data store in the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#evaluate_data_quality ⇒ Types::EvaluateDataQuality
Specifies your data quality evaluation criteria.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#fill_missing_values ⇒ Types::FillMissingValues
Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation. The input data set is used to train the machine learning model that determines what the missing value should be.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#filter ⇒ Types::Filter
Specifies a transform that splits a dataset into two, based on a filter condition.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#governed_catalog_source ⇒ Types::GovernedCatalogSource
Specifies a data source in a goverened Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#governed_catalog_target ⇒ Types::GovernedCatalogTarget
Specifies a data target that writes to a goverened catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#jdbc_connector_source ⇒ Types::JDBCConnectorSource
Specifies a connector to a JDBC data source.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#jdbc_connector_target ⇒ Types::JDBCConnectorTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#join ⇒ Types::Join
Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys. You can use inner, outer, left, right, left semi, and left anti joins.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#merge ⇒ Types::Merge
Specifies a transform that merges a DynamicFrame
with a staging
DynamicFrame
based on the specified primary keys to identify
records. Duplicate records (records with the same primary keys) are
not de-duplicated.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#microsoft_sql_server_catalog_source ⇒ Types::MicrosoftSQLServerCatalogSource
Specifies a Microsoft SQL server data source in the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#microsoft_sql_server_catalog_target ⇒ Types::MicrosoftSQLServerCatalogTarget
Specifies a target that uses Microsoft SQL.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#my_sql_catalog_source ⇒ Types::MySQLCatalogSource
Specifies a MySQL data source in the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#my_sql_catalog_target ⇒ Types::MySQLCatalogTarget
Specifies a target that uses MySQL.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#oracle_sql_catalog_source ⇒ Types::OracleSQLCatalogSource
Specifies an Oracle data source in the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#oracle_sql_catalog_target ⇒ Types::OracleSQLCatalogTarget
Specifies a target that uses Oracle SQL.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#pii_detection ⇒ Types::PIIDetection
Specifies a transform that identifies, removes or masks PII data.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#postgre_sql_catalog_source ⇒ Types::PostgreSQLCatalogSource
Specifies a PostgresSQL data source in the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#postgre_sql_catalog_target ⇒ Types::PostgreSQLCatalogTarget
Specifies a target that uses Postgres SQL.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#redshift_source ⇒ Types::RedshiftSource
Specifies an Amazon Redshift data store.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#redshift_target ⇒ Types::RedshiftTarget
Specifies a target that uses Amazon Redshift.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#relational_catalog_source ⇒ Types::RelationalCatalogSource
Specifies a relational catalog data store in the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#rename_field ⇒ Types::RenameField
Specifies a transform that renames a single data property key.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_catalog_delta_source ⇒ Types::S3CatalogDeltaSource
Specifies a Delta Lake data source that is registered in the Glue Data Catalog. The data source must be stored in Amazon S3.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_catalog_hudi_source ⇒ Types::S3CatalogHudiSource
Specifies a Hudi data source that is registered in the Glue Data Catalog. The data source must be stored in Amazon S3.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_catalog_source ⇒ Types::S3CatalogSource
Specifies an Amazon S3 data store in the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_catalog_target ⇒ Types::S3CatalogTarget
Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_csv_source ⇒ Types::S3CsvSource
Specifies a command-separated value (CSV) data store stored in Amazon S3.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_delta_catalog_target ⇒ Types::S3DeltaCatalogTarget
Specifies a target that writes to a Delta Lake data source in the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_delta_direct_target ⇒ Types::S3DeltaDirectTarget
Specifies a target that writes to a Delta Lake data source in Amazon S3.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_delta_source ⇒ Types::S3DeltaSource
Specifies a Delta Lake data source stored in Amazon S3.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_direct_target ⇒ Types::S3DirectTarget
Specifies a data target that writes to Amazon S3.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_glue_parquet_target ⇒ Types::S3GlueParquetTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_hudi_catalog_target ⇒ Types::S3HudiCatalogTarget
Specifies a target that writes to a Hudi data source in the Glue Data Catalog.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_hudi_direct_target ⇒ Types::S3HudiDirectTarget
Specifies a target that writes to a Hudi data source in Amazon S3.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_hudi_source ⇒ Types::S3HudiSource
Specifies a Hudi data source stored in Amazon S3.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_json_source ⇒ Types::S3JsonSource
Specifies a JSON data store stored in Amazon S3.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#s3_parquet_source ⇒ Types::S3ParquetSource
Specifies an Apache Parquet data store stored in Amazon S3.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#select_fields ⇒ Types::SelectFields
Specifies a transform that chooses the data property keys that you want to keep.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#select_from_collection ⇒ Types::SelectFromCollection
Specifies a transform that chooses one DynamicFrame
from a
collection of DynamicFrames
. The output is the selected
DynamicFrame
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#spark_connector_source ⇒ Types::SparkConnectorSource
Specifies a connector to an Apache Spark data source.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#spark_connector_target ⇒ Types::SparkConnectorTarget
Specifies a target that uses an Apache Spark connector.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#spark_sql ⇒ Types::SparkSQL
Specifies a transform where you enter a SQL query using Spark SQL
syntax to transform the data. The output is a single DynamicFrame
.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#spigot ⇒ Types::Spigot
Specifies a transform that writes samples of the data to an Amazon S3 bucket.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#split_fields ⇒ Types::SplitFields
Specifies a transform that splits data property keys into two
DynamicFrames
. The output is a collection of DynamicFrames
: one
with selected data property keys, and one with the remaining data
property keys.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |
#union ⇒ Types::Union
Specifies a transform that combines the rows from two or more datasets into a single result.
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 1998 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target) SENSITIVE = [] include Aws::Structure end |