Class: Aws::GlueDataBrew::Types::ProfileConfiguration

Inherits:
Struct
  • Object
show all
Defined in:
gems/aws-sdk-gluedatabrew/lib/aws-sdk-gluedatabrew/types.rb

Overview

Note:

When making an API call, you may pass ProfileConfiguration data as a hash:

{
  dataset_statistics_configuration: {
    included_statistics: ["Statistic"],
    overrides: [
      {
        statistic: "Statistic", # required
        parameters: { # required
          "ParameterName" => "ParameterValue",
        },
      },
    ],
  },
  profile_columns: [
    {
      regex: "ColumnName",
      name: "ColumnName",
    },
  ],
  column_statistics_configurations: [
    {
      selectors: [
        {
          regex: "ColumnName",
          name: "ColumnName",
        },
      ],
      statistics: { # required
        included_statistics: ["Statistic"],
        overrides: [
          {
            statistic: "Statistic", # required
            parameters: { # required
              "ParameterName" => "ParameterValue",
            },
          },
        ],
      },
    },
  ],
  entity_detector_configuration: {
    entity_types: ["EntityType"], # required
    allowed_statistics: [
      {
        statistics: ["Statistic"], # required
      },
    ],
  },
}

Configuration for profile jobs. Configuration can be used to select columns, do evaluations, and override default parameters of evaluations. When configuration is undefined, the profile job will apply default settings to all supported columns.

Constant Summary collapse

SENSITIVE =
[]

Instance Attribute Summary collapse

Instance Attribute Details

#column_statistics_configurationsArray<Types::ColumnStatisticsConfiguration>

List of configurations for column evaluations. ColumnStatisticsConfigurations are used to select evaluations and override parameters of evaluations for particular columns. When ColumnStatisticsConfigurations is undefined, the profile job will profile all supported columns and run all supported evaluations.



3821
3822
3823
3824
3825
3826
3827
3828
# File 'gems/aws-sdk-gluedatabrew/lib/aws-sdk-gluedatabrew/types.rb', line 3821

class ProfileConfiguration < Struct.new(
  :dataset_statistics_configuration,
  :profile_columns,
  :column_statistics_configurations,
  :entity_detector_configuration)
  SENSITIVE = []
  include Aws::Structure
end

#dataset_statistics_configurationTypes::StatisticsConfiguration

Configuration for inter-column evaluations. Configuration can be used to select evaluations and override parameters of evaluations. When configuration is undefined, the profile job will run all supported inter-column evaluations.



3821
3822
3823
3824
3825
3826
3827
3828
# File 'gems/aws-sdk-gluedatabrew/lib/aws-sdk-gluedatabrew/types.rb', line 3821

class ProfileConfiguration < Struct.new(
  :dataset_statistics_configuration,
  :profile_columns,
  :column_statistics_configurations,
  :entity_detector_configuration)
  SENSITIVE = []
  include Aws::Structure
end

#entity_detector_configurationTypes::EntityDetectorConfiguration

Configuration of entity detection for a profile job. When undefined, entity detection is disabled.



3821
3822
3823
3824
3825
3826
3827
3828
# File 'gems/aws-sdk-gluedatabrew/lib/aws-sdk-gluedatabrew/types.rb', line 3821

class ProfileConfiguration < Struct.new(
  :dataset_statistics_configuration,
  :profile_columns,
  :column_statistics_configurations,
  :entity_detector_configuration)
  SENSITIVE = []
  include Aws::Structure
end

#profile_columnsArray<Types::ColumnSelector>

List of column selectors. ProfileColumns can be used to select columns from the dataset. When ProfileColumns is undefined, the profile job will profile all supported columns.

Returns:



3821
3822
3823
3824
3825
3826
3827
3828
# File 'gems/aws-sdk-gluedatabrew/lib/aws-sdk-gluedatabrew/types.rb', line 3821

class ProfileConfiguration < Struct.new(
  :dataset_statistics_configuration,
  :profile_columns,
  :column_statistics_configurations,
  :entity_detector_configuration)
  SENSITIVE = []
  include Aws::Structure
end