AWS DataSync
User Guide

Configure Task Settings

Now that you have an agent and have configured source and destination locations, you configure settings for your task. A task is a set of two locations (source and destination) and a set of options that you use to control the behavior of a task. If you don't specify options when you create a task, AWS DataSync populates the options with service default settings.

To configure settings

  1. On the Configure settings page, enter a name for your task for Task name - optional.

  2. In the Options section, configure the options that you want to use to run your task.

    These options control the behavior of a task execution. Behavior includes preserving metadata such as the user ID (UID) or group ID (GID), preserving file permissions, and data integrity verification. If you don't specify values for these options, DataSync uses a set of default options that can be overridden for a task execution.

    Available options are as follows:

    • Verify data – Verify the data in your destination after transfer. DataSync always performs data integrity checks while transferring and writing data.

      Choose Check integrity during transfer to check data integrity during the transfer.

      Choose Verify only the data transferred to verify only the data that is transferred.

      Choose Verify all data in the destination to check integrity during the transfer.

    • Copy ownership – If you choose this option, DataSync copies file ownership such as the group ID of the file's owners and the user ID of the file's owner.

    • Copy permissions – If you choose this option, DataSync copies file POSIX permissions from the source to the destination.

    • Copy timestamps – If you choose this option, DataSync copies the timestamp metadata from the source to the destination.

    • Keep deleted files – If you choose this option, DataSync keeps files in the destination that don't exist in the source file system.

      If your task deletes objects, you might incur minimum storage duration charges for certain storage classes. For detailed information, see Considerations When Working with S3 Storage Classes in DataSync.

    • Overwrite files – If you choose this option, files at the destination are overwritten by files from the source. If you don't choose this option, the destination file isn't replaced by the source file, even if the destination file differs from the source file.

      If your task overwrites objects, you might incur minimum storage duration charges for certain storage classes. For detailed information, see Considerations When Working with S3 Storage Classes in DataSync.

    • Use available or Set bandwidth limit (MiB/s) – If you choose Use available, DataSync uses all the network bandwidth that is available for the transfer. If you choose Set bandwidth limit (MiB/s), you limit the maximum bandwidth that you want DataSync to use for this task.

    • Queueing – If you are using a single agent to run multiple tasks, choose this option to make the tasks run in series (first in, first out). For more information, see Queueing Task Executions.

  3. In the Filtering configuration - Optional section, enter a pattern to use as a filter. This pattern defines the criteria for specific files, folders, and objects to exclude from your transfer. To add additional patterns to your filter, choose Add pattern. For detailed information about filtering and syntax for creating patterns, see Filtering the Data Transferred by AWS DataSync.

    If you want to specify an include filter to transfer only specific files, you can do that later when you start a task. For more information, see Including Data in a Transfer.

  4. In the Schedule (optional) section, configure your task to run on a schedule that you specify.

  5. For Frequency, configure how frequently you want the task to run. For frequency configuration options, see Configuring a Task Schedule.

  6. In the Tags - optional section, enter Key and Value to tag your task. A tag is a key-value pair that helps you manage, filter, and search for your tasks. We recommend that you create a name tag for your task.

  7. Task logging - optional – If you choose this option, DataSync uses Amazon CloudWatch Log Groups to log activities and errors that occur during the execution of your task. For DataSync to upload logs to your CloudWatch log group, DataSync requires a resource policy that grants sufficient permissions. For an example of such a policy, see Allowing DataSync to Upload Logs to Amazon CloudWatch Log Groups.

    For more information, see Working with Log Groups and Log Streams in the Amazon CloudWatch User Guide. We recommend choosing this option.

  8. Choose Next to open the Review page.