Class: Aws::Glue::Types::CodeGenConfigurationNode
- Inherits:
-
Struct
- Object
- Struct
- Aws::Glue::Types::CodeGenConfigurationNode
- Defined in:
- gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb
Overview
CodeGenConfigurationNode
enumerates all valid Node types. One and
only one of its member variables can be populated.
Constant Summary collapse
- SENSITIVE =
[]
Instance Attribute Summary collapse
-
#aggregate ⇒ Types::Aggregate
Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.
-
#amazon_redshift_source ⇒ Types::AmazonRedshiftSource
Specifies a target that writes to a data source in Amazon Redshift.
-
#amazon_redshift_target ⇒ Types::AmazonRedshiftTarget
Specifies a target that writes to a data target in Amazon Redshift.
-
#apply_mapping ⇒ Types::ApplyMapping
Specifies a transform that maps data property keys in the data source to data property keys in the data target.
-
#athena_connector_source ⇒ Types::AthenaConnectorSource
Specifies a connector to an Amazon Athena data source.
-
#catalog_delta_source ⇒ Types::CatalogDeltaSource
Specifies a Delta Lake data source that is registered in the Glue Data Catalog.
-
#catalog_hudi_source ⇒ Types::CatalogHudiSource
Specifies a Hudi data source that is registered in the Glue Data Catalog.
-
#catalog_kafka_source ⇒ Types::CatalogKafkaSource
Specifies an Apache Kafka data store in the Data Catalog.
-
#catalog_kinesis_source ⇒ Types::CatalogKinesisSource
Specifies a Kinesis data source in the Glue Data Catalog.
-
#catalog_source ⇒ Types::CatalogSource
Specifies a data store in the Glue Data Catalog.
-
#catalog_target ⇒ Types::BasicCatalogTarget
Specifies a target that uses a Glue Data Catalog table.
-
#connector_data_source ⇒ Types::ConnectorDataSource
Specifies a source generated with standard connection options.
-
#connector_data_target ⇒ Types::ConnectorDataTarget
Specifies a target generated with standard connection options.
-
#custom_code ⇒ Types::CustomCode
Specifies a transform that uses custom code you provide to perform the data transformation.
-
#direct_jdbc_source ⇒ Types::DirectJDBCSource
Specifies the direct JDBC source connection.
-
#direct_kafka_source ⇒ Types::DirectKafkaSource
Specifies an Apache Kafka data store.
-
#direct_kinesis_source ⇒ Types::DirectKinesisSource
Specifies a direct Amazon Kinesis data source.
-
#drop_duplicates ⇒ Types::DropDuplicates
Specifies a transform that removes rows of repeating data from a data set.
-
#drop_fields ⇒ Types::DropFields
Specifies a transform that chooses the data property keys that you want to drop.
-
#drop_null_fields ⇒ Types::DropNullFields
Specifies a transform that removes columns from the dataset if all values in the column are 'null'.
-
#dynamic_transform ⇒ Types::DynamicTransform
Specifies a custom visual transform created by a user.
-
#dynamo_db_catalog_source ⇒ Types::DynamoDBCatalogSource
Specifies a DynamoDBC Catalog data store in the Glue Data Catalog.
-
#evaluate_data_quality ⇒ Types::EvaluateDataQuality
Specifies your data quality evaluation criteria.
-
#evaluate_data_quality_multi_frame ⇒ Types::EvaluateDataQualityMultiFrame
Specifies your data quality evaluation criteria.
-
#fill_missing_values ⇒ Types::FillMissingValues
Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation.
-
#filter ⇒ Types::Filter
Specifies a transform that splits a dataset into two, based on a filter condition.
-
#governed_catalog_source ⇒ Types::GovernedCatalogSource
Specifies a data source in a goverened Data Catalog.
-
#governed_catalog_target ⇒ Types::GovernedCatalogTarget
Specifies a data target that writes to a goverened catalog.
-
#jdbc_connector_source ⇒ Types::JDBCConnectorSource
Specifies a connector to a JDBC data source.
-
#jdbc_connector_target ⇒ Types::JDBCConnectorTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
-
#join ⇒ Types::Join
Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys.
-
#merge ⇒ Types::Merge
Specifies a transform that merges a
DynamicFrame
with a stagingDynamicFrame
based on the specified primary keys to identify records. -
#microsoft_sql_server_catalog_source ⇒ Types::MicrosoftSQLServerCatalogSource
Specifies a Microsoft SQL server data source in the Glue Data Catalog.
-
#microsoft_sql_server_catalog_target ⇒ Types::MicrosoftSQLServerCatalogTarget
Specifies a target that uses Microsoft SQL.
-
#my_sql_catalog_source ⇒ Types::MySQLCatalogSource
Specifies a MySQL data source in the Glue Data Catalog.
-
#my_sql_catalog_target ⇒ Types::MySQLCatalogTarget
Specifies a target that uses MySQL.
-
#oracle_sql_catalog_source ⇒ Types::OracleSQLCatalogSource
Specifies an Oracle data source in the Glue Data Catalog.
-
#oracle_sql_catalog_target ⇒ Types::OracleSQLCatalogTarget
Specifies a target that uses Oracle SQL.
-
#pii_detection ⇒ Types::PIIDetection
Specifies a transform that identifies, removes or masks PII data.
-
#postgre_sql_catalog_source ⇒ Types::PostgreSQLCatalogSource
Specifies a PostgresSQL data source in the Glue Data Catalog.
-
#postgre_sql_catalog_target ⇒ Types::PostgreSQLCatalogTarget
Specifies a target that uses Postgres SQL.
-
#recipe ⇒ Types::Recipe
Specifies a Glue DataBrew recipe node.
-
#redshift_source ⇒ Types::RedshiftSource
Specifies an Amazon Redshift data store.
-
#redshift_target ⇒ Types::RedshiftTarget
Specifies a target that uses Amazon Redshift.
-
#relational_catalog_source ⇒ Types::RelationalCatalogSource
Specifies a relational catalog data store in the Glue Data Catalog.
-
#rename_field ⇒ Types::RenameField
Specifies a transform that renames a single data property key.
-
#s3_catalog_delta_source ⇒ Types::S3CatalogDeltaSource
Specifies a Delta Lake data source that is registered in the Glue Data Catalog.
-
#s3_catalog_hudi_source ⇒ Types::S3CatalogHudiSource
Specifies a Hudi data source that is registered in the Glue Data Catalog.
-
#s3_catalog_source ⇒ Types::S3CatalogSource
Specifies an Amazon S3 data store in the Glue Data Catalog.
-
#s3_catalog_target ⇒ Types::S3CatalogTarget
Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.
-
#s3_csv_source ⇒ Types::S3CsvSource
Specifies a command-separated value (CSV) data store stored in Amazon S3.
-
#s3_delta_catalog_target ⇒ Types::S3DeltaCatalogTarget
Specifies a target that writes to a Delta Lake data source in the Glue Data Catalog.
-
#s3_delta_direct_target ⇒ Types::S3DeltaDirectTarget
Specifies a target that writes to a Delta Lake data source in Amazon S3.
-
#s3_delta_source ⇒ Types::S3DeltaSource
Specifies a Delta Lake data source stored in Amazon S3.
-
#s3_direct_target ⇒ Types::S3DirectTarget
Specifies a data target that writes to Amazon S3.
-
#s3_glue_parquet_target ⇒ Types::S3GlueParquetTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
-
#s3_hudi_catalog_target ⇒ Types::S3HudiCatalogTarget
Specifies a target that writes to a Hudi data source in the Glue Data Catalog.
-
#s3_hudi_direct_target ⇒ Types::S3HudiDirectTarget
Specifies a target that writes to a Hudi data source in Amazon S3.
-
#s3_hudi_source ⇒ Types::S3HudiSource
Specifies a Hudi data source stored in Amazon S3.
-
#s3_json_source ⇒ Types::S3JsonSource
Specifies a JSON data store stored in Amazon S3.
-
#s3_parquet_source ⇒ Types::S3ParquetSource
Specifies an Apache Parquet data store stored in Amazon S3.
-
#select_fields ⇒ Types::SelectFields
Specifies a transform that chooses the data property keys that you want to keep.
-
#select_from_collection ⇒ Types::SelectFromCollection
Specifies a transform that chooses one
DynamicFrame
from a collection ofDynamicFrames
. -
#snowflake_source ⇒ Types::SnowflakeSource
Specifies a Snowflake data source.
-
#snowflake_target ⇒ Types::SnowflakeTarget
Specifies a target that writes to a Snowflake data source.
-
#spark_connector_source ⇒ Types::SparkConnectorSource
Specifies a connector to an Apache Spark data source.
-
#spark_connector_target ⇒ Types::SparkConnectorTarget
Specifies a target that uses an Apache Spark connector.
-
#spark_sql ⇒ Types::SparkSQL
Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data.
-
#spigot ⇒ Types::Spigot
Specifies a transform that writes samples of the data to an Amazon S3 bucket.
-
#split_fields ⇒ Types::SplitFields
Specifies a transform that splits data property keys into two
DynamicFrames
. -
#union ⇒ Types::Union
Specifies a transform that combines the rows from two or more datasets into a single result.
Instance Attribute Details
#aggregate ⇒ Types::Aggregate
Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#amazon_redshift_source ⇒ Types::AmazonRedshiftSource
Specifies a target that writes to a data source in Amazon Redshift.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#amazon_redshift_target ⇒ Types::AmazonRedshiftTarget
Specifies a target that writes to a data target in Amazon Redshift.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#apply_mapping ⇒ Types::ApplyMapping
Specifies a transform that maps data property keys in the data source to data property keys in the data target. You can rename keys, modify the data types for keys, and choose which keys to drop from the dataset.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#athena_connector_source ⇒ Types::AthenaConnectorSource
Specifies a connector to an Amazon Athena data source.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#catalog_delta_source ⇒ Types::CatalogDeltaSource
Specifies a Delta Lake data source that is registered in the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#catalog_hudi_source ⇒ Types::CatalogHudiSource
Specifies a Hudi data source that is registered in the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#catalog_kafka_source ⇒ Types::CatalogKafkaSource
Specifies an Apache Kafka data store in the Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#catalog_kinesis_source ⇒ Types::CatalogKinesisSource
Specifies a Kinesis data source in the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#catalog_source ⇒ Types::CatalogSource
Specifies a data store in the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#catalog_target ⇒ Types::BasicCatalogTarget
Specifies a target that uses a Glue Data Catalog table.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#connector_data_source ⇒ Types::ConnectorDataSource
Specifies a source generated with standard connection options.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#connector_data_target ⇒ Types::ConnectorDataTarget
Specifies a target generated with standard connection options.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#custom_code ⇒ Types::CustomCode
Specifies a transform that uses custom code you provide to perform the data transformation. The output is a collection of DynamicFrames.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#direct_jdbc_source ⇒ Types::DirectJDBCSource
Specifies the direct JDBC source connection.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#direct_kafka_source ⇒ Types::DirectKafkaSource
Specifies an Apache Kafka data store.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#direct_kinesis_source ⇒ Types::DirectKinesisSource
Specifies a direct Amazon Kinesis data source.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#drop_duplicates ⇒ Types::DropDuplicates
Specifies a transform that removes rows of repeating data from a data set.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#drop_fields ⇒ Types::DropFields
Specifies a transform that chooses the data property keys that you want to drop.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#drop_null_fields ⇒ Types::DropNullFields
Specifies a transform that removes columns from the dataset if all values in the column are 'null'. By default, Glue Studio will recognize null objects, but some values such as empty strings, strings that are "null", -1 integers or other placeholders such as zeros, are not automatically recognized as nulls.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#dynamic_transform ⇒ Types::DynamicTransform
Specifies a custom visual transform created by a user.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#dynamo_db_catalog_source ⇒ Types::DynamoDBCatalogSource
Specifies a DynamoDBC Catalog data store in the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#evaluate_data_quality ⇒ Types::EvaluateDataQuality
Specifies your data quality evaluation criteria.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#evaluate_data_quality_multi_frame ⇒ Types::EvaluateDataQualityMultiFrame
Specifies your data quality evaluation criteria. Allows multiple input data and returns a collection of Dynamic Frames.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#fill_missing_values ⇒ Types::FillMissingValues
Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation. The input data set is used to train the machine learning model that determines what the missing value should be.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#filter ⇒ Types::Filter
Specifies a transform that splits a dataset into two, based on a filter condition.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#governed_catalog_source ⇒ Types::GovernedCatalogSource
Specifies a data source in a goverened Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#governed_catalog_target ⇒ Types::GovernedCatalogTarget
Specifies a data target that writes to a goverened catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#jdbc_connector_source ⇒ Types::JDBCConnectorSource
Specifies a connector to a JDBC data source.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#jdbc_connector_target ⇒ Types::JDBCConnectorTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#join ⇒ Types::Join
Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys. You can use inner, outer, left, right, left semi, and left anti joins.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#merge ⇒ Types::Merge
Specifies a transform that merges a DynamicFrame
with a staging
DynamicFrame
based on the specified primary keys to identify
records. Duplicate records (records with the same primary keys) are
not de-duplicated.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#microsoft_sql_server_catalog_source ⇒ Types::MicrosoftSQLServerCatalogSource
Specifies a Microsoft SQL server data source in the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#microsoft_sql_server_catalog_target ⇒ Types::MicrosoftSQLServerCatalogTarget
Specifies a target that uses Microsoft SQL.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#my_sql_catalog_source ⇒ Types::MySQLCatalogSource
Specifies a MySQL data source in the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#my_sql_catalog_target ⇒ Types::MySQLCatalogTarget
Specifies a target that uses MySQL.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#oracle_sql_catalog_source ⇒ Types::OracleSQLCatalogSource
Specifies an Oracle data source in the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#oracle_sql_catalog_target ⇒ Types::OracleSQLCatalogTarget
Specifies a target that uses Oracle SQL.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#pii_detection ⇒ Types::PIIDetection
Specifies a transform that identifies, removes or masks PII data.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#postgre_sql_catalog_source ⇒ Types::PostgreSQLCatalogSource
Specifies a PostgresSQL data source in the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#postgre_sql_catalog_target ⇒ Types::PostgreSQLCatalogTarget
Specifies a target that uses Postgres SQL.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#recipe ⇒ Types::Recipe
Specifies a Glue DataBrew recipe node.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#redshift_source ⇒ Types::RedshiftSource
Specifies an Amazon Redshift data store.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#redshift_target ⇒ Types::RedshiftTarget
Specifies a target that uses Amazon Redshift.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#relational_catalog_source ⇒ Types::RelationalCatalogSource
Specifies a relational catalog data store in the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#rename_field ⇒ Types::RenameField
Specifies a transform that renames a single data property key.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_catalog_delta_source ⇒ Types::S3CatalogDeltaSource
Specifies a Delta Lake data source that is registered in the Glue Data Catalog. The data source must be stored in Amazon S3.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_catalog_hudi_source ⇒ Types::S3CatalogHudiSource
Specifies a Hudi data source that is registered in the Glue Data Catalog. The data source must be stored in Amazon S3.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_catalog_source ⇒ Types::S3CatalogSource
Specifies an Amazon S3 data store in the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_catalog_target ⇒ Types::S3CatalogTarget
Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_csv_source ⇒ Types::S3CsvSource
Specifies a command-separated value (CSV) data store stored in Amazon S3.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_delta_catalog_target ⇒ Types::S3DeltaCatalogTarget
Specifies a target that writes to a Delta Lake data source in the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_delta_direct_target ⇒ Types::S3DeltaDirectTarget
Specifies a target that writes to a Delta Lake data source in Amazon S3.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_delta_source ⇒ Types::S3DeltaSource
Specifies a Delta Lake data source stored in Amazon S3.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_direct_target ⇒ Types::S3DirectTarget
Specifies a data target that writes to Amazon S3.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_glue_parquet_target ⇒ Types::S3GlueParquetTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_hudi_catalog_target ⇒ Types::S3HudiCatalogTarget
Specifies a target that writes to a Hudi data source in the Glue Data Catalog.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_hudi_direct_target ⇒ Types::S3HudiDirectTarget
Specifies a target that writes to a Hudi data source in Amazon S3.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_hudi_source ⇒ Types::S3HudiSource
Specifies a Hudi data source stored in Amazon S3.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_json_source ⇒ Types::S3JsonSource
Specifies a JSON data store stored in Amazon S3.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_parquet_source ⇒ Types::S3ParquetSource
Specifies an Apache Parquet data store stored in Amazon S3.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#select_fields ⇒ Types::SelectFields
Specifies a transform that chooses the data property keys that you want to keep.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#select_from_collection ⇒ Types::SelectFromCollection
Specifies a transform that chooses one DynamicFrame
from a
collection of DynamicFrames
. The output is the selected
DynamicFrame
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#snowflake_source ⇒ Types::SnowflakeSource
Specifies a Snowflake data source.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#snowflake_target ⇒ Types::SnowflakeTarget
Specifies a target that writes to a Snowflake data source.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#spark_connector_source ⇒ Types::SparkConnectorSource
Specifies a connector to an Apache Spark data source.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#spark_connector_target ⇒ Types::SparkConnectorTarget
Specifies a target that uses an Apache Spark connector.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#spark_sql ⇒ Types::SparkSQL
Specifies a transform where you enter a SQL query using Spark SQL
syntax to transform the data. The output is a single DynamicFrame
.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#spigot ⇒ Types::Spigot
Specifies a transform that writes samples of the data to an Amazon S3 bucket.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#split_fields ⇒ Types::SplitFields
Specifies a transform that splits data property keys into two
DynamicFrames
. The output is a collection of DynamicFrames
: one
with selected data property keys, and one with the remaining data
property keys.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#union ⇒ Types::Union
Specifies a transform that combines the rows from two or more datasets into a single result.
2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2507 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |