Specifies a crawler program that examines a data source and uses classifiers to try to determine its schema. If successful, the crawler records metadata concerning the data source in the Glue Data Catalog.
Inheritance Hierarchy
Namespace: Amazon.Glue.Model
Assembly: AWSSDK.Glue.dll
Version: 3.x.y.z
Syntax
public class Crawler
The Crawler type exposes the following members
Constructors
| Name | Description | |
|---|---|---|
|
Crawler() |
Properties
| Name | Type | Description | |
|---|---|---|---|
|
|
Classifiers | System.Collections.Generic.List<System.String> |
Gets and sets the property Classifiers. A list of UTF-8 strings that specify the custom classifiers that are associated with the crawler. |
|
|
Configuration | System.String |
Gets and sets the property Configuration. Crawler configuration information. This versioned JSON string allows users to specify aspects of a crawler's behavior. For more information, see Setting crawler configuration options. |
|
|
CrawlElapsedTime | System.Int64 |
Gets and sets the property CrawlElapsedTime. If the crawler is running, contains the total time elapsed since the last crawl began. |
|
|
CrawlerSecurityConfiguration | System.String |
Gets and sets the property CrawlerSecurityConfiguration.
The name of the |
|
|
CreationTime | System.DateTime |
Gets and sets the property CreationTime. The time that the crawler was created. |
|
|
DatabaseName | System.String |
Gets and sets the property DatabaseName. The name of the database in which the crawler's output is stored. |
|
|
Description | System.String |
Gets and sets the property Description. A description of the crawler. |
|
|
LakeFormationConfiguration | Amazon.Glue.Model.LakeFormationConfiguration |
Gets and sets the property LakeFormationConfiguration. Specifies whether the crawler should use Lake Formation credentials for the crawler instead of the IAM role credentials. |
|
|
LastCrawl | Amazon.Glue.Model.LastCrawlInfo |
Gets and sets the property LastCrawl. The status of the last crawl, and potentially error information if an error occurred. |
|
|
LastUpdated | System.DateTime |
Gets and sets the property LastUpdated. The time that the crawler was last updated. |
|
|
LineageConfiguration | Amazon.Glue.Model.LineageConfiguration |
Gets and sets the property LineageConfiguration. A configuration that specifies whether data lineage is enabled for the crawler. |
|
|
Name | System.String |
Gets and sets the property Name. The name of the crawler. |
|
|
RecrawlPolicy | Amazon.Glue.Model.RecrawlPolicy |
Gets and sets the property RecrawlPolicy. A policy that specifies whether to crawl the entire dataset again, or to crawl only folders that were added since the last crawler run. |
|
|
Role | System.String |
Gets and sets the property Role. The Amazon Resource Name (ARN) of an IAM role that's used to access customer resources, such as Amazon Simple Storage Service (Amazon S3) data. |
|
|
Schedule | Amazon.Glue.Model.Schedule |
Gets and sets the property Schedule. For scheduled crawlers, the schedule when the crawler runs. |
|
|
SchemaChangePolicy | Amazon.Glue.Model.SchemaChangePolicy |
Gets and sets the property SchemaChangePolicy. The policy that specifies update and delete behaviors for the crawler. |
|
|
State | Amazon.Glue.CrawlerState |
Gets and sets the property State. Indicates whether the crawler is running, or whether a run is pending. |
|
|
TablePrefix | System.String |
Gets and sets the property TablePrefix. The prefix added to the names of tables that are created. |
|
|
Targets | Amazon.Glue.Model.CrawlerTargets |
Gets and sets the property Targets. A collection of targets to crawl. |
|
|
Version | System.Int64 |
Gets and sets the property Version. The version of the crawler. |
Version Information
.NET Core App:
Supported in: 3.1
.NET Standard:
Supported in: 2.0
.NET Framework:
Supported in: 4.5, 4.0, 3.5