What Is AWS DataSync? - AWS DataSync

What Is AWS DataSync?

AWS DataSync is an online data transfer service designed to simplify, automate, and accelerate copying large amounts of data to and from AWS storage services. DataSync copies data over the internet or AWS Direct Connect. As a fully managed service, DataSync removes much of the need to modify applications, develop scripts, or manage infrastructure.

DataSync supports data transfer between Network File System (NFS) and Amazon Elastic File System (Amazon EFS) or Amazon Simple Storage Service (Amazon S3). It also supports data transfer between Server Message Block (SMB) and Amazon EFS, Amazon S3, or Amazon FSx for Windows File Server.

In this guide, you can find a description of the components of DataSync, detailed instructions on how to get started, and the API reference.

Use Cases

These are some of the main use cases for AWS DataSync:

  • Data migration – Move active datasets rapidly over the network into Amazon S3, Amazon EFS, or Amazon FSx for Windows File Server. DataSync includes automatic encryption and data integrity validation to help make sure that your data arrives securely, intact, and ready to use.

  • Data movement for timely in-cloud processing – Move data into or out of AWS for processing when working with systems that generate data on-premises. This approach can speed up critical hybrid cloud workflows across many industries. These include video production in media and entertainment, seismic research in oil and gas, machine learning in life science, and big data analytics in finance.

  • Data archiving – Move cold data from expensive on-premises storage systems directly to durable and secure long-term storage such as Amazon S3 Glacier or S3 Glacier Deep Archive. By doing this, you can free up on-premises storage capacity and shut down legacy storage systems.

  • Data protection – Move data into all Amazon S3 storage classes, and choose the most cost-effective storage class for your needs. You can also send the data to Amazon EFS or Amazon FSx for Windows File Server for a standby file system.

Benefits

By using AWS DataSync, you can get the following benefits:

  • Simplify and automate data movement. Using DataSync, you can easily transfer data between on-premises sources and AWS storage over the network. AWS DataSync automates management of the infrastructure and the transfer processes for you. DataSync also includes encryption and data validation. This approach minimizes the time for in-house development and management that is otherwise needed for fast, reliable, and secure transfers.

  • Transfer data fast over the network into AWS, at a rate up to 10 Gbps. This approach speeds up migrations, hybrid workflows for analytics and machine learning, and data protection processes.

  • Reduce data transfer costs and move data cost-effectively with the flat, per-gigabyte pricing in DataSync. You also can save on script development and management costs, and avoid the need for costly commercial transfer tools.

Additional AWS DataSync Resources

We recommend that you read the following:

AWS DataSync also supports Terraform. To learn more about DataSync deployment automation with Terraform, see the Terraform documentation.