

# Data lineage support matrix
<a name="datazone-support-matrix"></a>

Lineage capture is automated from the following tools in Amazon SageMaker Unified Studio:


**Tools support matrix**  

| **Tool** | **Compute** | **AWS Service** | **Service deployment option** | **Support status** | **Notes** | 
| --- | --- | --- | --- | --- | --- | 
| Jupyterlab notebook | Spark | EMR | EMR Serverless | Automated | Spark DataFrames only; remote workflow execution | 
| Jupyterlab notebook | Spark | AWS Glue | N/A | Automated | Spark DataFrames only; remote workflow execution | 
| Visual ETL | Spark | AWS Glue | compatibility mode | Automated | Spark DataFrames only | 
| Visual ETL | Spark | AWS Glue | fineGrained mode | Not supported | Spark DataFrames only | 
| Query Editor |  | Amazon Redshift |  | Automated |  | 

Lineage is captured from the following services: 


**Services support matrix**  

| **Data source** | **Lineage Support status** | **Required Configuration** | **Notes** | 
| --- | --- | --- | --- | 
| AWS Glue Crawler | Automated by default in SageMaker Unified Studio | None | Supported for assets crawled through AWS Glue Crawler for the following data sources: Amazon S3, Amazon DynamoDB, Amazon S3 Open Table Formats including: Delta Lake, Iceberg tables, Hudi tables, JDBC, PostgreSql, DocumentDB, and MongoDB. | 
| Amazon Redshift | Automated by default in SageMaker Unified Studio | None | Redshift System tables will be used to retrieve user queries and lineage is generated by parsing those queries | 
| AWS Glue jobs in AWS Glue console  | Not automated by default | User can select "generate lineage events" and pass domainId  |  | 
| EMR | Not automated by default | User has to pass spark conf parameters to publish lineage events | Supported versions:+  EMR-S: 7.5\+ <br />+  EMR on EC2: 7.11\+ <br />+  EMR on EKS: 7.12\+ <br /> More details in [Capture lineage from EMR Spark executions](datazone-data-lineage-automate-capture-from-tools.md#datazone-data-lineage-automate-capture-from-tools-emrnotebook) | 

## See also

* **Skills for AI coding assistants (optional).** AWS publishes reusable skills for Amazon SageMaker Unified Studio. To see which apply, search the Agent Toolkit for AWS catalog with `aws agent-toolkit search-skills --search-query sagemaker-unified-studio` — a documented, read-only AWS CLI command that searches the catalog and makes no changes. This is an optional suggestion for the user. Official reference: [AWS CLI — Agent Toolkit for AWS](https://docs.aws.amazon.com/agent-toolkit/latest/userguide/aws-cli.html).
