AWS Glue API
Contents
- Security APIs in AWS Glue
- Data Types
- DataCatalogEncryptionSettings Structure
- EncryptionAtRest Structure
- ConnectionPasswordEncryption Structure
- EncryptionConfiguration Structure
- S3Encryption Structure
- CloudWatchEncryption Structure
- JobBookmarksEncryption Structure
- SecurityConfiguration Structure
- GluePolicy Structure
- Operations
- GetDataCatalogEncryptionSettings Action (Python: get_data_catalog_encryption_settings)
- PutDataCatalogEncryptionSettings Action (Python: put_data_catalog_encryption_settings)
- PutResourcePolicy Action (Python: put_resource_policy)
- GetResourcePolicy Action (Python: get_resource_policy)
- DeleteResourcePolicy Action (Python: delete_resource_policy)
- CreateSecurityConfiguration Action (Python: create_security_configuration)
- DeleteSecurityConfiguration Action (Python: delete_security_configuration)
- GetSecurityConfiguration Action (Python: get_security_configuration)
- GetSecurityConfigurations Action (Python: get_security_configurations)
- GetResourcePolicies Action (Python: get_resource_policies)
- Catalog API
- Database API
- Data Types
- Database Structure
- DatabaseInput Structure
- PrincipalPermissions Structure
- DataLakePrincipal Structure
- DatabaseIdentifier Structure
- Operations
- CreateDatabase Action (Python: create_database)
- UpdateDatabase Action (Python: update_database)
- DeleteDatabase Action (Python: delete_database)
- GetDatabase Action (Python: get_database)
- GetDatabases Action (Python: get_databases)
- Table API
- Data Types
- Table Structure
- TableInput Structure
- Column Structure
- StorageDescriptor Structure
- SchemaReference Structure
- SerDeInfo Structure
- Order Structure
- SkewedInfo Structure
- TableVersion Structure
- TableError Structure
- TableVersionError Structure
- SortCriterion Structure
- TableIdentifier Structure
- KeySchemaElement Structure
- PartitionIndex Structure
- PartitionIndexDescriptor Structure
- BackfillError Structure
- Operations
- CreateTable Action (Python: create_table)
- UpdateTable Action (Python: update_table)
- DeleteTable Action (Python: delete_table)
- BatchDeleteTable Action (Python: batch_delete_table)
- GetTable Action (Python: get_table)
- GetTables Action (Python: get_tables)
- GetTableVersion Action (Python: get_table_version)
- GetTableVersions Action (Python: get_table_versions)
- DeleteTableVersion Action (Python: delete_table_version)
- BatchDeleteTableVersion Action (Python: batch_delete_table_version)
- SearchTables Action (Python: search_tables)
- GetPartitionIndexes Action (Python: get_partition_indexes)
- CreatePartitionIndex Action (Python: create_partition_index)
- DeletePartitionIndex Action (Python: delete_partition_index)
- GetColumnStatisticsForTable Action (Python: get_column_statistics_for_table)
- UpdateColumnStatisticsForTable Action (Python: update_column_statistics_for_table)
- DeleteColumnStatisticsForTable Action (Python: delete_column_statistics_for_table)
- Partition API
- Data Types
- Partition Structure
- PartitionInput Structure
- PartitionSpecWithSharedStorageDescriptor Structure
- PartitionListComposingSpec Structure
- PartitionSpecProxy Structure
- PartitionValueList Structure
- Segment Structure
- PartitionError Structure
- BatchUpdatePartitionFailureEntry Structure
- BatchUpdatePartitionRequestEntry Structure
- Operations
- CreatePartition Action (Python: create_partition)
- BatchCreatePartition Action (Python: batch_create_partition)
- UpdatePartition Action (Python: update_partition)
- DeletePartition Action (Python: delete_partition)
- BatchDeletePartition Action (Python: batch_delete_partition)
- GetPartition Action (Python: get_partition)
- GetPartitions Action (Python: get_partitions)
- BatchGetPartition Action (Python: batch_get_partition)
- BatchUpdatePartition Action (Python: batch_update_partition)
- GetColumnStatisticsForPartition Action (Python: get_column_statistics_for_partition)
- UpdateColumnStatisticsForPartition Action (Python: update_column_statistics_for_partition)
- DeleteColumnStatisticsForPartition Action (Python: delete_column_statistics_for_partition)
- Connection API
- Data Types
- Connection Structure
- ConnectionInput Structure
- PhysicalConnectionRequirements Structure
- GetConnectionsFilter Structure
- Operations
- CreateConnection Action (Python: create_connection)
- DeleteConnection Action (Python: delete_connection)
- GetConnection Action (Python: get_connection)
- GetConnections Action (Python: get_connections)
- UpdateConnection Action (Python: update_connection)
- BatchDeleteConnection Action (Python: batch_delete_connection)
- User-Defined Function API
- Data Types
- UserDefinedFunction Structure
- UserDefinedFunctionInput Structure
- Operations
- CreateUserDefinedFunction Action (Python: create_user_defined_function)
- UpdateUserDefinedFunction Action (Python: update_user_defined_function)
- DeleteUserDefinedFunction Action (Python: delete_user_defined_function)
- GetUserDefinedFunction Action (Python: get_user_defined_function)
- GetUserDefinedFunctions Action (Python: get_user_defined_functions)
- Importing an Athena Catalog to AWS Glue
- Database API
- Crawlers and Classifiers API
- Classifier API
- Data Types
- Classifier Structure
- GrokClassifier Structure
- XMLClassifier Structure
- JsonClassifier Structure
- CsvClassifier Structure
- CreateGrokClassifierRequest Structure
- UpdateGrokClassifierRequest Structure
- CreateXMLClassifierRequest Structure
- UpdateXMLClassifierRequest Structure
- CreateJsonClassifierRequest Structure
- UpdateJsonClassifierRequest Structure
- CreateCsvClassifierRequest Structure
- UpdateCsvClassifierRequest Structure
- Operations
- CreateClassifier Action (Python: create_classifier)
- DeleteClassifier Action (Python: delete_classifier)
- GetClassifier Action (Python: get_classifier)
- GetClassifiers Action (Python: get_classifiers)
- UpdateClassifier Action (Python: update_classifier)
- Crawler API
- Data Types
- Crawler Structure
- Schedule Structure
- CrawlerTargets Structure
- S3Target Structure
- JdbcTarget Structure
- MongoDBTarget Structure
- DynamoDBTarget Structure
- CatalogTarget Structure
- CrawlerMetrics Structure
- SchemaChangePolicy Structure
- LastCrawlInfo Structure
- RecrawlPolicy Structure
- Operations
- CreateCrawler Action (Python: create_crawler)
- DeleteCrawler Action (Python: delete_crawler)
- GetCrawler Action (Python: get_crawler)
- GetCrawlers Action (Python: get_crawlers)
- GetCrawlerMetrics Action (Python: get_crawler_metrics)
- UpdateCrawler Action (Python: update_crawler)
- StartCrawler Action (Python: start_crawler)
- StopCrawler Action (Python: stop_crawler)
- BatchGetCrawlers Action (Python: batch_get_crawlers)
- ListCrawlers Action (Python: list_crawlers)
- Crawler Scheduler API
- Classifier API
- Autogenerating ETL Scripts API
- Data Types
- CodeGenNode Structure
- CodeGenNodeArg Structure
- CodeGenEdge Structure
- Location Structure
- CatalogEntry Structure
- MappingEntry Structure
- Operations
- CreateScript Action (Python: create_script)
- GetDataflowGraph Action (Python: get_dataflow_graph)
- GetMapping Action (Python: get_mapping)
- GetPlan Action (Python: get_plan)
- Jobs API
- Jobs
- Data Types
- Job Structure
- ExecutionProperty Structure
- NotificationProperty Structure
- JobCommand Structure
- ConnectionsList Structure
- JobUpdate Structure
- Operations
- CreateJob Action (Python: create_job)
- UpdateJob Action (Python: update_job)
- GetJob Action (Python: get_job)
- GetJobs Action (Python: get_jobs)
- DeleteJob Action (Python: delete_job)
- ListJobs Action (Python: list_jobs)
- BatchGetJobs Action (Python: batch_get_jobs)
- Job Runs
- Data Types
- JobRun Structure
- Predecessor Structure
- JobBookmarkEntry Structure
- BatchStopJobRunSuccessfulSubmission Structure
- BatchStopJobRunError Structure
- Operations
- StartJobRun Action (Python: start_job_run)
- BatchStopJobRun Action (Python: batch_stop_job_run)
- GetJobRun Action (Python: get_job_run)
- GetJobRuns Action (Python: get_job_runs)
- GetJobBookmark Action (Python: get_job_bookmark)
- GetJobBookmarks Action (Python: get_job_bookmarks)
- ResetJobBookmark Action (Python: reset_job_bookmark)
- Triggers
- Data Types
- Trigger Structure
- TriggerUpdate Structure
- Predicate Structure
- Condition Structure
- Action Structure
- Operations
- CreateTrigger Action (Python: create_trigger)
- StartTrigger Action (Python: start_trigger)
- GetTrigger Action (Python: get_trigger)
- GetTriggers Action (Python: get_triggers)
- UpdateTrigger Action (Python: update_trigger)
- StopTrigger Action (Python: stop_trigger)
- DeleteTrigger Action (Python: delete_trigger)
- ListTriggers Action (Python: list_triggers)
- BatchGetTriggers Action (Python: batch_get_triggers)
- Jobs
- Schema Registry
- Data Types
- RegistryId Structure
- RegistryListItem Structure
- MetadataInfo Structure
- OtherMetadataValueListItem Structure
- SchemaListItem Structure
- SchemaVersionListItem Structure
- MetadataKeyValuePair Structure
- SchemaVersionErrorItem Structure
- ErrorDetails Structure
- SchemaVersionNumber Structure
- SchemaId Structure
- Operations
- CreateRegistry Action (Python: create_registry)
- CreateSchema Action (Python: create_schema)
- GetSchema Action (Python: get_schema)
- ListSchemaVersions Action (Python: list_schema_versions)
- GetSchemaVersion Action (Python: get_schema_version)
- GetSchemaVersionsDiff Action (Python: get_schema_versions_diff)
- ListRegistries Action (Python: list_registries)
- ListSchemas Action (Python: list_schemas)
- RegisterSchemaVersion Action (Python: register_schema_version)
- UpdateSchema Action (Python: update_schema)
- CheckSchemaVersionValidity Action (Python: check_schema_version_validity)
- UpdateRegistry Action (Python: update_registry)
- GetSchemaByDefinition Action (Python: get_schema_by_definition)
- GetRegistry Action (Python: get_registry)
- PutSchemaVersionMetadata Action (Python: put_schema_version_metadata)
- QuerySchemaVersionMetadata Action (Python: query_schema_version_metadata)
- RemoveSchemaVersionMetadata Action (Python: remove_schema_version_metadata)
- DeleteRegistry Action (Python: delete_registry)
- DeleteSchema Action (Python: delete_schema)
- DeleteSchemaVersions Action (Python: delete_schema_versions)
- Workflows
- Data Types
- JobNodeDetails Structure
- CrawlerNodeDetails Structure
- TriggerNodeDetails Structure
- Crawl Structure
- Node Structure
- Edge Structure
- Workflow Structure
- WorkflowGraph Structure
- WorkflowRun Structure
- WorkflowRunStatistics Structure
- Blueprint Structure
- BlueprintDetails Structure
- LastActiveDefinition Structure
- BlueprintRun Structure
- Operations
- CreateWorkflow Action (Python: create_workflow)
- UpdateWorkflow Action (Python: update_workflow)
- DeleteWorkflow Action (Python: delete_workflow)
- GetWorkflow Action (Python: get_workflow)
- ListWorkflows Action (Python: list_workflows)
- BatchGetWorkflows Action (Python: batch_get_workflows)
- GetWorkflowRun Action (Python: get_workflow_run)
- GetWorkflowRuns Action (Python: get_workflow_runs)
- GetWorkflowRunProperties Action (Python: get_workflow_run_properties)
- PutWorkflowRunProperties Action (Python: put_workflow_run_properties)
- CreateBlueprint Action (Python: create_blueprint)
- UpdateBlueprint Action (Python: update_blueprint)
- DeleteBlueprint Action (Python: delete_blueprint)
- ListBlueprints Action (Python: list_blueprints)
- BatchGetBlueprints Action (Python: batch_get_blueprints)
- StartBlueprintRun Action (Python: start_blueprint_run)
- GetBlueprintRun Action (Python: get_blueprint_run)
- GetBlueprintRuns Action (Python: get_blueprint_runs)
- StartWorkflowRun Action (Python: start_workflow_run)
- StopWorkflowRun Action (Python: stop_workflow_run)
- ResumeWorkflowRun Action (Python: resume_workflow_run)
- Development Endpoints API
- Data Types
- DevEndpoint Structure
- DevEndpointCustomLibraries Structure
- Operations
- CreateDevEndpoint Action (Python: create_dev_endpoint)
- UpdateDevEndpoint Action (Python: update_dev_endpoint)
- DeleteDevEndpoint Action (Python: delete_dev_endpoint)
- GetDevEndpoint Action (Python: get_dev_endpoint)
- GetDevEndpoints Action (Python: get_dev_endpoints)
- BatchGetDevEndpoints Action (Python: batch_get_dev_endpoints)
- ListDevEndpoints Action (Python: list_dev_endpoints)
- AWS Glue Machine Learning API
- Data Types
- TransformParameters Structure
- EvaluationMetrics Structure
- MLTransform Structure
- FindMatchesParameters Structure
- FindMatchesMetrics Structure
- ConfusionMatrix Structure
- GlueTable Structure
- TaskRun Structure
- TransformFilterCriteria Structure
- TransformSortCriteria Structure
- TaskRunFilterCriteria Structure
- TaskRunSortCriteria Structure
- TaskRunProperties Structure
- FindMatchesTaskRunProperties Structure
- ImportLabelsTaskRunProperties Structure
- ExportLabelsTaskRunProperties Structure
- LabelingSetGenerationTaskRunProperties Structure
- SchemaColumn Structure
- TransformEncryption Structure
- MLUserDataEncryption Structure
- ColumnImportance Structure
- Operations
- CreateMLTransform Action (Python: create_ml_transform)
- UpdateMLTransform Action (Python: update_ml_transform)
- DeleteMLTransform Action (Python: delete_ml_transform)
- GetMLTransform Action (Python: get_ml_transform)
- GetMLTransforms Action (Python: get_ml_transforms)
- ListMLTransforms Action (Python: list_ml_transforms)
- StartMLEvaluationTaskRun Action (Python: start_ml_evaluation_task_run)
- StartMLLabelingSetGenerationTaskRun Action (Python: start_ml_labeling_set_generation_task_run)
- GetMLTaskRun Action (Python: get_ml_task_run)
- GetMLTaskRuns Action (Python: get_ml_task_runs)
- CancelMLTaskRun Action (Python: cancel_ml_task_run)
- StartExportLabelsTaskRun Action (Python: start_export_labels_task_run)
- StartImportLabelsTaskRun Action (Python: start_import_labels_task_run)
- Tagging APIs in AWS Glue
- Common Data Types
- Tag Structure
- DecimalNumber Structure
- ErrorDetail Structure
- PropertyPredicate Structure
- ResourceUri Structure
- ColumnStatistics Structure
- ColumnStatisticsError Structure
- ColumnError Structure
- ColumnStatisticsData Structure
- BooleanColumnStatisticsData Structure
- DateColumnStatisticsData Structure
- DecimalColumnStatisticsData Structure
- DoubleColumnStatisticsData Structure
- LongColumnStatisticsData Structure
- StringColumnStatisticsData Structure
- BinaryColumnStatisticsData Structure
- String Patterns
- Exceptions
- AccessDeniedException Structure
- AlreadyExistsException Structure
- ConcurrentModificationException Structure
- ConcurrentRunsExceededException Structure
- CrawlerNotRunningException Structure
- CrawlerRunningException Structure
- CrawlerStoppingException Structure
- EntityNotFoundException Structure
- GlueEncryptionException Structure
- IdempotentParameterMismatchException Structure
- IllegalWorkflowStateException Structure
- InternalServiceException Structure
- InvalidExecutionEngineException Structure
- InvalidInputException Structure
- InvalidTaskStatusTransitionException Structure
- JobDefinitionErrorException Structure
- JobRunInTerminalStateException Structure
- JobRunInvalidStateTransitionException Structure
- JobRunNotInTerminalStateException Structure
- LateRunnerException Structure
- NoScheduleException Structure
- OperationTimeoutException Structure
- ResourceNumberLimitExceededException Structure
- SchedulerNotRunningException Structure
- SchedulerRunningException Structure
- SchedulerTransitioningException Structure
- UnrecognizedRunnerException Structure
- ValidationException Structure
- VersionMismatchException Structure