Class: Aws::Glue::Types::DataQualityGlueTable

Inherits:
Struct
  • Object
show all
Defined in:
gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb

Overview

The database and table in the Glue Data Catalog that is used for input or output data for Data Quality Operations.

Constant Summary collapse

SENSITIVE =
[]

Instance Attribute Summary collapse

Instance Attribute Details

#additional_optionsHash<String,String>

Additional options for the table. Currently there are two keys supported:

  • pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset.

  • catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.

Returns:

  • (Hash<String,String>)


8105
8106
8107
8108
8109
8110
8111
8112
8113
8114
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 8105

class DataQualityGlueTable < Struct.new(
  :database_name,
  :table_name,
  :catalog_id,
  :connection_name,
  :additional_options,
  :pre_processing_query)
  SENSITIVE = []
  include Aws::Structure
end

#catalog_idString

A unique identifier for the Glue Data Catalog.

Returns:

  • (String)


8105
8106
8107
8108
8109
8110
8111
8112
8113
8114
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 8105

class DataQualityGlueTable < Struct.new(
  :database_name,
  :table_name,
  :catalog_id,
  :connection_name,
  :additional_options,
  :pre_processing_query)
  SENSITIVE = []
  include Aws::Structure
end

#connection_nameString

The name of the connection to the Glue Data Catalog.

Returns:

  • (String)


8105
8106
8107
8108
8109
8110
8111
8112
8113
8114
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 8105

class DataQualityGlueTable < Struct.new(
  :database_name,
  :table_name,
  :catalog_id,
  :connection_name,
  :additional_options,
  :pre_processing_query)
  SENSITIVE = []
  include Aws::Structure
end

#database_nameString

A database name in the Glue Data Catalog.

Returns:

  • (String)


8105
8106
8107
8108
8109
8110
8111
8112
8113
8114
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 8105

class DataQualityGlueTable < Struct.new(
  :database_name,
  :table_name,
  :catalog_id,
  :connection_name,
  :additional_options,
  :pre_processing_query)
  SENSITIVE = []
  include Aws::Structure
end

#pre_processing_queryString

SQL Query of SparkSQL format that can be used to pre-process the data for the table in Glue Data Catalog, before running the Data Quality Operation.

Returns:

  • (String)


8105
8106
8107
8108
8109
8110
8111
8112
8113
8114
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 8105

class DataQualityGlueTable < Struct.new(
  :database_name,
  :table_name,
  :catalog_id,
  :connection_name,
  :additional_options,
  :pre_processing_query)
  SENSITIVE = []
  include Aws::Structure
end

#table_nameString

A table name in the Glue Data Catalog.

Returns:

  • (String)


8105
8106
8107
8108
8109
8110
8111
8112
8113
8114
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 8105

class DataQualityGlueTable < Struct.new(
  :database_name,
  :table_name,
  :catalog_id,
  :connection_name,
  :additional_options,
  :pre_processing_query)
  SENSITIVE = []
  include Aws::Structure
end