Creating an AWS DataSync task with the AWS CLI
Once you create your source and destination locations, you can create your AWS DataSync task.
Important
If you're planning to transfer data to or from an Amazon S3 location, review how DataSync can affect your S3 request charges and the DataSync pricing page
To create a task by using the AWS CLI
-
Create an Amazon CloudWatch Logs log group by using the following command.
aws logs create-log-group \ --log-group-name
your-log-group
-
Attach an IAM resource policy to your log group. For instructions on how to attach the policy, see Allowing DataSync to upload logs to CloudWatch log groups.
-
Create a task by using the following command.
aws datasync create-task \ --source-location-arn 'arn:aws:datasync:
region
:account-id
:location/location-id
' \ --destination-location-arn 'arn:aws:datasync:region
:account-id
:location/location-id
' \ --cloud-watch-log-group-arn 'arn:aws:logs:region
:account-id
:log-group:log-group
' \ --nametask-name
This command returns the Amazon Resource Name (ARN) for a task, similar to the one shown following.
{ "TaskArn": "arn:aws:datasync:us-east-1:111222333444:task/task-08de6e6697796f026" }
When creating a task that transfers data between AWS services in different Regions, and the other location must be specified in a different Region (for example, to transfer data between
us-east-1
andus-east-2
), use DataSync in one of the Regions and create a task by using the following command.aws datasync create-task \ --source-location-arn 'arn:aws:datasync:us-east-1:
account-id
:location/location-id
\ --destination-location-arn 'arn:aws:datasync:us-east-2:account-id
:location/location-id
\ --cloud-watch-log-group-arn 'arn:aws:logs:region
:account-id
' \ --nametask-name
\ --options VerifyMode=NONE,OverwriteMode=NEVER,Atime=BEST_EFFORT,Mtime=PRESERVE,Uid=INT_VALUE,Gid=INT_VALUE,PreserveDevices=PRESERVE,PosixPermissions=PRESERVE,PreserveDeletedFiles=PRESERVE,TaskQueueing=ENABLED,LogLevel=TRANSFERYour task is created with the default configuration options. If you want to configure different options as part of your task creation, add the
--options
parameter to yourcreate-task
command. The following example shows how to specify different options. For a description of these options, see Options.aws datasync create-task \ --source-location-arn 'arn:aws:datasync:
region
:account-id
:location/location-id
' \ --destination-location-arn 'arn:aws:datasync:region
:account-id
:location/location-id
' \ --cloud-watch-log-group-arn 'arn:aws:logs:region
:account-id
:log-group:log-group
' \ --nametask-name
\ --options VerifyMode=NONE,OverwriteMode=NEVER,Atime=BEST_EFFORT,Mtime=PRESERVE,Uid=INT_VALUE,Gid=INT_VALUE,PreserveDevices=PRESERVE,PosixPermissions=PRESERVE,PreserveDeletedFiles=PRESERVE,TaskQueueing=ENABLED,LogLevel=TRANSFERWhen you create a task, you can configure the task to include or exclude specific files, folders, and objects. For more information, see Filtering data transferred by AWS DataSync. You can also schedule when you want your task to run. For more information, see Scheduling your AWS DataSync task.