AWS Transfer Family managed workflows - AWS Transfer Family

AWS Transfer Family managed workflows

AWS Transfer Family supports managed workflows for file processing. With managed workflows, you can create, automate, and monitor file transfers over Secure Shell (SSH) File Transfer Protocol (SFTP), File Transfer Protocol over SSL (FTPS), and File Transfer Protocol (FTP). Using this feature, you can securely and cost effectively meet your compliance requirements for business-to-business (B2B) file exchanges by coordinating all the necessary steps required for file processing. In addition, you benefit from end-to-end auditing and visibility.


            Flow diagram showing how managed workflows assist with file processing.

By orchestrating file-processing tasks, managed workflows help you preprocess data before it is consumed by your downstream applications. Such file-processing tasks might include:

  • Moving files to user-specific folders

  • Encrypting files in transit

  • Scanning for malware or viruses

  • Tagging

To quickly replicate and standardize common post-upload file processing tasks spanning multiple business units in your organization, you can deploy workflows by using infrastructure as code (IaC). Managed workflows are initiated only on fully uploaded files, ensuring that data quality is maintained. Built-in exception handling helps you quickly react to file-processing outcomes, while offering you control over how to handle failures. In addition, each workflow step produces detailed logs, which you can audit to trace the data lineage.

To get started, first set up your workflow to contain preprocessing actions, such as copying, tagging, and other steps based on your requirements. Next, map the workflow to a server, so that on file arrival, the actions specified in this workflow are evaluated and initiated in real time. To monitor your workflow executions, see Using CloudWatch metrics for Transfer Family. For detailed execution logs and troubleshooting information, see Troubleshoot workflow-related errors using Amazon CloudWatch.

For more help getting started with managed workflows, see the following resources: