AWS Glue API

Contents

• Security APIs in AWS Glue
  • Data Types
  • DataCatalogEncryptionSettings Structure
  • EncryptionAtRest Structure
  • ConnectionPasswordEncryption Structure
  • EncryptionConfiguration Structure
  • S3Encryption Structure
  • CloudWatchEncryption Structure
  • JobBookmarksEncryption Structure
  • SecurityConfiguration Structure
  • GluePolicy Structure
  • Operations
  • GetDataCatalogEncryptionSettings Action (Python: get_data_catalog_encryption_settings)
  • PutDataCatalogEncryptionSettings Action (Python: put_data_catalog_encryption_settings)
  • PutResourcePolicy Action (Python: put_resource_policy)
  • GetResourcePolicy Action (Python: get_resource_policy)
  • DeleteResourcePolicy Action (Python: delete_resource_policy)
  • CreateSecurityConfiguration Action (Python: create_security_configuration)
  • DeleteSecurityConfiguration Action (Python: delete_security_configuration)
  • GetSecurityConfiguration Action (Python: get_security_configuration)
  • GetSecurityConfigurations Action (Python: get_security_configurations)
  • GetResourcePolicies Action (Python: get_resource_policies)
• Catalog API
  • Database API
    • Data Types
    • Database Structure
    • DatabaseInput Structure
    • PrincipalPermissions Structure
    • DataLakePrincipal Structure
    • DatabaseIdentifier Structure
    • Operations
    • CreateDatabase Action (Python: create_database)
    • UpdateDatabase Action (Python: update_database)
    • DeleteDatabase Action (Python: delete_database)
    • GetDatabase Action (Python: get_database)
    • GetDatabases Action (Python: get_databases)
  • Table API
    • Data Types
    • Table Structure
    • TableInput Structure
    • Column Structure
    • StorageDescriptor Structure
    • SchemaReference Structure
    • SerDeInfo Structure
    • Order Structure
    • SkewedInfo Structure
    • TableVersion Structure
    • TableError Structure
    • TableVersionError Structure
    • SortCriterion Structure
    • TableIdentifier Structure
    • KeySchemaElement Structure
    • PartitionIndex Structure
    • PartitionIndexDescriptor Structure
    • BackfillError Structure
    • Operations
    • CreateTable Action (Python: create_table)
    • UpdateTable Action (Python: update_table)
    • DeleteTable Action (Python: delete_table)
    • BatchDeleteTable Action (Python: batch_delete_table)
    • GetTable Action (Python: get_table)
    • GetTables Action (Python: get_tables)
    • GetTableVersion Action (Python: get_table_version)
    • GetTableVersions Action (Python: get_table_versions)
    • DeleteTableVersion Action (Python: delete_table_version)
    • BatchDeleteTableVersion Action (Python: batch_delete_table_version)
    • SearchTables Action (Python: search_tables)
    • GetPartitionIndexes Action (Python: get_partition_indexes)
    • CreatePartitionIndex Action (Python: create_partition_index)
    • DeletePartitionIndex Action (Python: delete_partition_index)
    • GetColumnStatisticsForTable Action (Python: get_column_statistics_for_table)
    • UpdateColumnStatisticsForTable Action (Python: update_column_statistics_for_table)
    • DeleteColumnStatisticsForTable Action (Python: delete_column_statistics_for_table)
  • Partition API
    • Data Types
    • Partition Structure
    • PartitionInput Structure
    • PartitionSpecWithSharedStorageDescriptor Structure
    • PartitionListComposingSpec Structure
    • PartitionSpecProxy Structure
    • PartitionValueList Structure
    • Segment Structure
    • PartitionError Structure
    • BatchUpdatePartitionFailureEntry Structure
    • BatchUpdatePartitionRequestEntry Structure
    • Operations
    • CreatePartition Action (Python: create_partition)
    • BatchCreatePartition Action (Python: batch_create_partition)
    • UpdatePartition Action (Python: update_partition)
    • DeletePartition Action (Python: delete_partition)
    • BatchDeletePartition Action (Python: batch_delete_partition)
    • GetPartition Action (Python: get_partition)
    • GetPartitions Action (Python: get_partitions)
    • BatchGetPartition Action (Python: batch_get_partition)
    • BatchUpdatePartition Action (Python: batch_update_partition)
    • GetColumnStatisticsForPartition Action (Python: get_column_statistics_for_partition)
    • UpdateColumnStatisticsForPartition Action (Python: update_column_statistics_for_partition)
    • DeleteColumnStatisticsForPartition Action (Python: delete_column_statistics_for_partition)
  • Connection API
    • Data Types
    • Connection Structure
    • ConnectionInput Structure
    • PhysicalConnectionRequirements Structure
    • GetConnectionsFilter Structure
    • Operations
    • CreateConnection Action (Python: create_connection)
    • DeleteConnection Action (Python: delete_connection)
    • GetConnection Action (Python: get_connection)
    • GetConnections Action (Python: get_connections)
    • UpdateConnection Action (Python: update_connection)
    • BatchDeleteConnection Action (Python: batch_delete_connection)
  • User-Defined Function API
    • Data Types
    • UserDefinedFunction Structure
    • UserDefinedFunctionInput Structure
    • Operations
    • CreateUserDefinedFunction Action (Python: create_user_defined_function)
    • UpdateUserDefinedFunction Action (Python: update_user_defined_function)
    • DeleteUserDefinedFunction Action (Python: delete_user_defined_function)
    • GetUserDefinedFunction Action (Python: get_user_defined_function)
    • GetUserDefinedFunctions Action (Python: get_user_defined_functions)
  • Importing an Athena Catalog to AWS Glue
    • Data Types
    • CatalogImportStatus Structure
    • Operations
    • ImportCatalogToGlue Action (Python: import_catalog_to_glue)
    • GetCatalogImportStatus Action (Python: get_catalog_import_status)
• Crawlers and Classifiers API
  • Classifier API
    • Data Types
    • Classifier Structure
    • GrokClassifier Structure
    • XMLClassifier Structure
    • JsonClassifier Structure
    • CsvClassifier Structure
    • CreateGrokClassifierRequest Structure
    • UpdateGrokClassifierRequest Structure
    • CreateXMLClassifierRequest Structure
    • UpdateXMLClassifierRequest Structure
    • CreateJsonClassifierRequest Structure
    • UpdateJsonClassifierRequest Structure
    • CreateCsvClassifierRequest Structure
    • UpdateCsvClassifierRequest Structure
    • Operations
    • CreateClassifier Action (Python: create_classifier)
    • DeleteClassifier Action (Python: delete_classifier)
    • GetClassifier Action (Python: get_classifier)
    • GetClassifiers Action (Python: get_classifiers)
    • UpdateClassifier Action (Python: update_classifier)
  • Crawler API
    • Data Types
    • Crawler Structure
    • Schedule Structure
    • CrawlerTargets Structure
    • S3Target Structure
    • JdbcTarget Structure
    • MongoDBTarget Structure
    • DynamoDBTarget Structure
    • CatalogTarget Structure
    • CrawlerMetrics Structure
    • SchemaChangePolicy Structure
    • LastCrawlInfo Structure
    • RecrawlPolicy Structure
    • LineageConfiguration Structure
    • Operations
    • CreateCrawler Action (Python: create_crawler)
    • DeleteCrawler Action (Python: delete_crawler)
    • GetCrawler Action (Python: get_crawler)
    • GetCrawlers Action (Python: get_crawlers)
    • GetCrawlerMetrics Action (Python: get_crawler_metrics)
    • UpdateCrawler Action (Python: update_crawler)
    • StartCrawler Action (Python: start_crawler)
    • StopCrawler Action (Python: stop_crawler)
    • BatchGetCrawlers Action (Python: batch_get_crawlers)
    • ListCrawlers Action (Python: list_crawlers)
  • Crawler Scheduler API
    • Data Types
    • Schedule Structure
    • Operations
    • UpdateCrawlerSchedule Action (Python: update_crawler_schedule)
    • StartCrawlerSchedule Action (Python: start_crawler_schedule)
    • StopCrawlerSchedule Action (Python: stop_crawler_schedule)
• Autogenerating ETL Scripts API
  • Data Types
  • CodeGenNode Structure
  • CodeGenNodeArg Structure
  • CodeGenEdge Structure
  • Location Structure
  • CatalogEntry Structure
  • MappingEntry Structure
  • Operations
  • CreateScript Action (Python: create_script)
  • GetDataflowGraph Action (Python: get_dataflow_graph)
  • GetMapping Action (Python: get_mapping)
  • GetPlan Action (Python: get_plan)
• Visual Job API
  • Data Types
  • CodeGenConfigurationNode Structure
  • JDBCConnectorOptions Structure
  • StreamingDataPreviewOptions Structure
  • AthenaConnectorSource Structure
  • JDBCConnectorSource Structure
  • SparkConnectorSource Structure
  • CatalogSource Structure
  • CatalogKinesisSource Structure
  • DirectKinesisSource Structure
  • KinesisStreamingSourceOptions Structure
  • CatalogKafkaSource Structure
  • DirectKafkaSource Structure
  • KafkaStreamingSourceOptions Structure
  • RedshiftSource Structure
  • S3CatalogSource Structure
  • S3SourceAdditionalOptions Structure
  • S3CSVSource Structure
  • S3JsonSource Structure
  • S3ParquetSource Structure
  • DynamoDBELTConnectorSource Structure
  • DDBELTConnectionOptions Structure
  • JDBCConnectorTarget Structure
  • SparkConnectorTarget Structure
  • BasicCatalogTarget Structure
  • RedshiftTarget Structure
  • S3CatalogTarget Structure
  • S3GlueParquetTarget Structure
  • CatalogSchemaChangePolicy Structure
  • S3DirectTarget Structure
  • DirectSchemaChangePolicy Structure
  • ApplyMapping Structure
  • Mapping Structure
  • SelectFields Structure
  • DropFields Structure
  • RenameField Structure
  • Spigot Structure
  • Join Structure
  • JoinColumn Structure
  • SplitFields Structure
  • SelectFromCollection Structure
  • FillMissingValues Structure
  • Filter Structure
  • FilterExpression Structure
  • FilterValue Structure
  • CustomCode Structure
  • SparkSQL Structure
  • SqlAlias Structure
  • DropNullFields Structure
  • NullCheckBoxList Structure
  • NullValueField Structure
  • Datatype Structure
  • Merge Structure
  • Union Structure
• Jobs API
  • Jobs
    • Data Types
    • Job Structure
    • ExecutionProperty Structure
    • NotificationProperty Structure
    • JobCommand Structure
    • ConnectionsList Structure
    • JobUpdate Structure
    • Operations
    • CreateJob Action (Python: create_job)
    • UpdateJob Action (Python: update_job)
    • GetJob Action (Python: get_job)
    • GetJobs Action (Python: get_jobs)
    • DeleteJob Action (Python: delete_job)
    • ListJobs Action (Python: list_jobs)
    • BatchGetJobs Action (Python: batch_get_jobs)
  • Job Runs
    • Data Types
    • JobRun Structure
    • Predecessor Structure
    • JobBookmarkEntry Structure
    • BatchStopJobRunSuccessfulSubmission Structure
    • BatchStopJobRunError Structure
    • Operations
    • StartJobRun Action (Python: start_job_run)
    • BatchStopJobRun Action (Python: batch_stop_job_run)
    • GetJobRun Action (Python: get_job_run)
    • GetJobRuns Action (Python: get_job_runs)
    • GetJobBookmark Action (Python: get_job_bookmark)
    • GetJobBookmarks Action (Python: get_job_bookmarks)
    • ResetJobBookmark Action (Python: reset_job_bookmark)
  • Triggers
    • Data Types
    • Trigger Structure
    • TriggerUpdate Structure
    • Predicate Structure
    • Condition Structure
    • Action Structure
    • EventBatchingCondition Structure
    • Operations
    • CreateTrigger Action (Python: create_trigger)
    • StartTrigger Action (Python: start_trigger)
    • GetTrigger Action (Python: get_trigger)
    • GetTriggers Action (Python: get_triggers)
    • UpdateTrigger Action (Python: update_trigger)
    • StopTrigger Action (Python: stop_trigger)
    • DeleteTrigger Action (Python: delete_trigger)
    • ListTriggers Action (Python: list_triggers)
    • BatchGetTriggers Action (Python: batch_get_triggers)
• Schema Registry
  • Data Types
  • RegistryId Structure
  • RegistryListItem Structure
  • MetadataInfo Structure
  • OtherMetadataValueListItem Structure
  • SchemaListItem Structure
  • SchemaVersionListItem Structure
  • MetadataKeyValuePair Structure
  • SchemaVersionErrorItem Structure
  • ErrorDetails Structure
  • SchemaVersionNumber Structure
  • SchemaId Structure
  • Operations
  • CreateRegistry Action (Python: create_registry)
  • CreateSchema Action (Python: create_schema)
  • GetSchema Action (Python: get_schema)
  • ListSchemaVersions Action (Python: list_schema_versions)
  • GetSchemaVersion Action (Python: get_schema_version)
  • GetSchemaVersionsDiff Action (Python: get_schema_versions_diff)
  • ListRegistries Action (Python: list_registries)
  • ListSchemas Action (Python: list_schemas)
  • RegisterSchemaVersion Action (Python: register_schema_version)
  • UpdateSchema Action (Python: update_schema)
  • CheckSchemaVersionValidity Action (Python: check_schema_version_validity)
  • UpdateRegistry Action (Python: update_registry)
  • GetSchemaByDefinition Action (Python: get_schema_by_definition)
  • GetRegistry Action (Python: get_registry)
  • PutSchemaVersionMetadata Action (Python: put_schema_version_metadata)
  • QuerySchemaVersionMetadata Action (Python: query_schema_version_metadata)
  • RemoveSchemaVersionMetadata Action (Python: remove_schema_version_metadata)
  • DeleteRegistry Action (Python: delete_registry)
  • DeleteSchema Action (Python: delete_schema)
  • DeleteSchemaVersions Action (Python: delete_schema_versions)
• Workflows
  • Data Types
  • JobNodeDetails Structure
  • CrawlerNodeDetails Structure
  • TriggerNodeDetails Structure
  • Crawl Structure
  • Node Structure
  • Edge Structure
  • Workflow Structure
  • WorkflowGraph Structure
  • WorkflowRun Structure
  • WorkflowRunStatistics Structure
  • StartingEventBatchCondition Structure
  • Blueprint Structure
  • BlueprintDetails Structure
  • LastActiveDefinition Structure
  • BlueprintRun Structure
  • Operations
  • CreateWorkflow Action (Python: create_workflow)
  • UpdateWorkflow Action (Python: update_workflow)
  • DeleteWorkflow Action (Python: delete_workflow)
  • GetWorkflow Action (Python: get_workflow)
  • ListWorkflows Action (Python: list_workflows)
  • BatchGetWorkflows Action (Python: batch_get_workflows)
  • GetWorkflowRun Action (Python: get_workflow_run)
  • GetWorkflowRuns Action (Python: get_workflow_runs)
  • GetWorkflowRunProperties Action (Python: get_workflow_run_properties)
  • PutWorkflowRunProperties Action (Python: put_workflow_run_properties)
  • CreateBlueprint Action (Python: create_blueprint)
  • UpdateBlueprint Action (Python: update_blueprint)
  • DeleteBlueprint Action (Python: delete_blueprint)
  • ListBlueprints Action (Python: list_blueprints)
  • BatchGetBlueprints Action (Python: batch_get_blueprints)
  • StartBlueprintRun Action (Python: start_blueprint_run)
  • GetBlueprintRun Action (Python: get_blueprint_run)
  • GetBlueprintRuns Action (Python: get_blueprint_runs)
  • StartWorkflowRun Action (Python: start_workflow_run)
  • StopWorkflowRun Action (Python: stop_workflow_run)
  • ResumeWorkflowRun Action (Python: resume_workflow_run)
• Development Endpoints API
  • Data Types
  • DevEndpoint Structure
  • DevEndpointCustomLibraries Structure
  • Operations
  • CreateDevEndpoint Action (Python: create_dev_endpoint)
  • UpdateDevEndpoint Action (Python: update_dev_endpoint)
  • DeleteDevEndpoint Action (Python: delete_dev_endpoint)
  • GetDevEndpoint Action (Python: get_dev_endpoint)
  • GetDevEndpoints Action (Python: get_dev_endpoints)
  • BatchGetDevEndpoints Action (Python: batch_get_dev_endpoints)
  • ListDevEndpoints Action (Python: list_dev_endpoints)
• Machine Learning API
  • Data Types
  • TransformParameters Structure
  • EvaluationMetrics Structure
  • MLTransform Structure
  • FindMatchesParameters Structure
  • FindMatchesMetrics Structure
  • ConfusionMatrix Structure
  • GlueTable Structure
  • TaskRun Structure
  • TransformFilterCriteria Structure
  • TransformSortCriteria Structure
  • TaskRunFilterCriteria Structure
  • TaskRunSortCriteria Structure
  • TaskRunProperties Structure
  • FindMatchesTaskRunProperties Structure
  • ImportLabelsTaskRunProperties Structure
  • ExportLabelsTaskRunProperties Structure
  • LabelingSetGenerationTaskRunProperties Structure
  • SchemaColumn Structure
  • TransformEncryption Structure
  • MLUserDataEncryption Structure
  • ColumnImportance Structure
  • Operations
  • CreateMLTransform Action (Python: create_ml_transform)
  • UpdateMLTransform Action (Python: update_ml_transform)
  • DeleteMLTransform Action (Python: delete_ml_transform)
  • GetMLTransform Action (Python: get_ml_transform)
  • GetMLTransforms Action (Python: get_ml_transforms)
  • ListMLTransforms Action (Python: list_ml_transforms)
  • StartMLEvaluationTaskRun Action (Python: start_ml_evaluation_task_run)
  • StartMLLabelingSetGenerationTaskRun Action (Python: start_ml_labeling_set_generation_task_run)
  • GetMLTaskRun Action (Python: get_ml_task_run)
  • GetMLTaskRuns Action (Python: get_ml_task_runs)
  • CancelMLTaskRun Action (Python: cancel_ml_task_run)
  • StartExportLabelsTaskRun Action (Python: start_export_labels_task_run)
  • StartImportLabelsTaskRun Action (Python: start_import_labels_task_run)
• Tagging APIs in AWS Glue
  • Data Types
  • Tag Structure
  • Operations
  • TagResource Action (Python: tag_resource)
  • UntagResource Action (Python: untag_resource)
  • GetTags Action (Python: get_tags)
• Common Data Types
  • Tag Structure
  • DecimalNumber Structure
  • ErrorDetail Structure
  • PropertyPredicate Structure
  • ResourceUri Structure
  • ColumnStatistics Structure
  • ColumnStatisticsError Structure
  • ColumnError Structure
  • ColumnStatisticsData Structure
  • BooleanColumnStatisticsData Structure
  • DateColumnStatisticsData Structure
  • DecimalColumnStatisticsData Structure
  • DoubleColumnStatisticsData Structure
  • LongColumnStatisticsData Structure
  • StringColumnStatisticsData Structure
  • BinaryColumnStatisticsData Structure
  • String Patterns
• Exceptions
  • AccessDeniedException Structure
  • AlreadyExistsException Structure
  • ConcurrentModificationException Structure
  • ConcurrentRunsExceededException Structure
  • CrawlerNotRunningException Structure
  • CrawlerRunningException Structure
  • CrawlerStoppingException Structure
  • EntityNotFoundException Structure
  • GlueEncryptionException Structure
  • IdempotentParameterMismatchException Structure
  • InternalServiceException Structure
  • InvalidExecutionEngineException Structure
  • InvalidInputException Structure
  • InvalidStateException Structure
  • InvalidTaskStatusTransitionException Structure
  • JobDefinitionErrorException Structure
  • JobRunInTerminalStateException Structure
  • JobRunInvalidStateTransitionException Structure
  • JobRunNotInTerminalStateException Structure
  • LateRunnerException Structure
  • NoScheduleException Structure
  • OperationTimeoutException Structure
  • ResourceNotReadyException Structure
  • ResourceNumberLimitExceededException Structure
  • SchedulerNotRunningException Structure
  • SchedulerRunningException Structure
  • SchedulerTransitioningException Structure
  • UnrecognizedRunnerException Structure
  • ValidationException Structure
  • VersionMismatchException Structure