Creating an AWS DataSync task with the AWS CLI

Once you create your source and destination locations, you can create your AWS DataSync task.

Important

If you're planning to transfer data to or from an Amazon S3 location, review how DataSync can affect your S3 request charges and the DataSync pricing page before you begin.

To create a task by using the AWS CLI

1. Create an Amazon CloudWatch Logs log group by using the following command.

   aws logs create-log-group \
       --log-group-name your-log-group

2. Attach an IAM resource policy to your log group. For instructions on how to attach the policy, see Allowing DataSync to upload logs to CloudWatch log groups.

3. Create a task by using the following command.

   aws datasync create-task \
       --source-location-arn 'arn:aws:datasync:region:account-id:location/location-id' \
       --destination-location-arn 'arn:aws:datasync:region:account-id:location/location-id' \
       --cloud-watch-log-group-arn 'arn:aws:logs:region:account-id:log-group:log-group' \
       --name task-name

   This command returns the Amazon Resource Name (ARN) for a task, similar to the one shown following.

   { 
       "TaskArn": "arn:aws:datasync:us-east-1:111222333444:task/task-08de6e6697796f026" 
   }

   When creating a task that transfers data between AWS services in different Regions, and the other location must be specified in a different Region (for example, to transfer data between us-east-1 and us-east-2), use DataSync in one of the Regions and create a task by using the following command.

   aws datasync create-task \
       --source-location-arn 'arn:aws:datasync:us-east-1:account-id:location/location-id \
       --destination-location-arn 'arn:aws:datasync:us-east-2:account-id:location/location-id \
       --cloud-watch-log-group-arn 'arn:aws:logs:region:account-id' \
       --name task-name \
       --options VerifyMode=NONE,OverwriteMode=NEVER,Atime=BEST_EFFORT,Mtime=PRESERVE,Uid=INT_VALUE,Gid=INT_VALUE,PreserveDevices=PRESERVE,PosixPermissions=PRESERVE,PreserveDeletedFiles=PRESERVE,TaskQueueing=ENABLED,LogLevel=TRANSFER

   Your task is created with the default configuration options. If you want to configure different options as part of your task creation, add the --options parameter to your create-task command. The following example shows how to specify different options. For a description of these options, see Options.

   aws datasync create-task \
       --source-location-arn 'arn:aws:datasync:region:account-id:location/location-id' \
       --destination-location-arn 'arn:aws:datasync:region:account-id:location/location-id' \
       --cloud-watch-log-group-arn 'arn:aws:logs:region:account-id:log-group:log-group' \
       --name task-name \
       --options VerifyMode=NONE,OverwriteMode=NEVER,Atime=BEST_EFFORT,Mtime=PRESERVE,Uid=INT_VALUE,Gid=INT_VALUE,PreserveDevices=PRESERVE,PosixPermissions=PRESERVE,PreserveDeletedFiles=PRESERVE,TaskQueueing=ENABLED,LogLevel=TRANSFER

   When you create a task, you can configure the task to include or exclude specific files, folders, and objects. For more information, see Specifying what AWS DataSync transfers by using filters. You can also schedule when you want your task to run. For more information, see Scheduling your AWS DataSync task.