Configuring how AWS DataSync verifies data integrity
During a transfer, AWS DataSync uses checksum verification to verify the integrity of the data that you copy between locations. You also can configure DataSync to perform additional verification at the end of your transfer.
Data verification options
Use the following information to help you decide if and how you want DataSync to perform these additional checks.
Option in console | Option in API | Description |
---|---|---|
Verify only transferred data (recommended) |
VerifyMode set to
|
DataSync calculates the checksum of transferred data (including metadata) at the source location. At the end of your transfer, DataSync compares this checksum to the checksum calculated on that same data at the destination. We recommend this option when transferring to S3 Glacier Flexible Retrieval or S3 Glacier Deep Archive storage classes. For more information, see Storage class considerations with Amazon S3 transfers. |
Verify all data |
VerifyMode set to
|
At the end of your transfer, DataSync checks the entire source and destination to verify that both locations are fully synchronized. NoteNot supported when your task uses Enhanced mode. If you use a manifest, DataSync only scans and verifies what's listed in the manifest. You can't use this option when transferring to S3 Glacier Flexible Retrieval or S3 Glacier Deep Archive storage classes. For more information, see Storage class considerations with Amazon S3 transfers. |
Don't verify data after transfer |
VerifyMode set to
|
DataSync performs data integrity checks only during your transfer. Unlike other options, there's no additional verification at the end of your transfer. |
Configuring data verification
You can configure data verification options when creating a task, updating a task, or starting a task execution.
The following instructions describe how to configure data verification options when creating a task.
To configure data verification by using the console
Open the AWS DataSync console at https://console.aws.amazon.com/datasync/
. In the left navigation pane, expand Data transfer, then choose Tasks, and then choose Create task.
-
Configure your task's source and destination locations.
For more information, see Where can I transfer my data with AWS DataSync?
-
For Verification, choose one of the following:
-
Verify only transferred data (recommended)
-
Verify all data
-
Don't verify data after transfer
-
You can configure how DataSync verifies data by using the VerifyMode
parameter with any of the following operations: