AWS::DataBrew::Job ProfileConfiguration

Configuration for profile jobs. Configuration can be used to select columns, do evaluations, and override default parameters of evaluations. When configuration is undefined, the profile job will apply default settings to all supported columns.

Syntax

To declare this entity in your AWS CloudFormation template, use the following syntax:

JSON

{
  "ColumnStatisticsConfigurations" : [ ColumnStatisticsConfiguration, ... ],
  "DatasetStatisticsConfiguration" : StatisticsConfiguration,
  "EntityDetectorConfiguration" : EntityDetectorConfiguration,
  "ProfileColumns" : [ ColumnSelector, ... ]
}

YAML

  ColumnStatisticsConfigurations: 
    - ColumnStatisticsConfiguration
  DatasetStatisticsConfiguration: 
    StatisticsConfiguration
  EntityDetectorConfiguration: 
    EntityDetectorConfiguration
  ProfileColumns: 
    - ColumnSelector

Properties

ColumnStatisticsConfigurations

List of configurations for column evaluations. ColumnStatisticsConfigurations are used to select evaluations and override parameters of evaluations for particular columns. When ColumnStatisticsConfigurations is undefined, the profile job will profile all supported columns and run all supported evaluations.

Required: No

Type: Array of ColumnStatisticsConfiguration

Minimum: 1

Update requires: No interruption

DatasetStatisticsConfiguration

Configuration for inter-column evaluations. Configuration can be used to select evaluations and override parameters of evaluations. When configuration is undefined, the profile job will run all supported inter-column evaluations.

Required: No

Type: StatisticsConfiguration

Update requires: No interruption

EntityDetectorConfiguration

Configuration of entity detection for a profile job. When undefined, entity detection is disabled.

Required: No

Type: EntityDetectorConfiguration

Update requires: No interruption

ProfileColumns

List of column selectors. ProfileColumns can be used to select columns from the dataset. When ProfileColumns is undefined, the profile job will profile all supported columns.

Required: No

Type: Array of ColumnSelector

Minimum: 1

Update requires: No interruption