Working with task executions in DataSync - AWS DataSync

Working with task executions in DataSync

In AWS DataSync, a task execution is an individual run of a task, which includes information such as start time, end time, bytes written, and status.

After a task execution starts, you can monitor its progress, add or adjust bandwidth throttling for it, or cancel it before it completes.

Adjusting bandwidth throttling for a task execution

You can modify bandwidth throttling for a task execution using the AWS Management Console or the DataSync API. For information about using the API, see UpdateTaskExecution.

To modify bandwidth throttling

  1. Open the AWS DataSync console at https://console.aws.amazon.com/datasync/.

  2. In the navigation pane, choose Tasks.

  3. Select the Task ID for the running task that you want to monitor. Using the console, you can modify any task execution that is currently running or that is queued.

  4. Choose History to view task execution instances.

  5. Select the active task execution to be modified.

  6. For Action, choose Edit.

  7. In the Edit Task Execution dialog box that appears, choose Use available to remove bandwidth throttling and use all available bandwidth for the task execution.

    Choose Set bandwidth limit (MIB/s) to change the bandwidth limit.

    To save changes to your task execution's bandwidth limit, choose Save changes. The new bandwidth limit setting goes into effect on the running or queued task execution within 60 seconds.

Task execution statuses

Here's information about the statuses you see might see once you start a DataSync task.

Status Description

Queueing

This is the first phase of a task execution if there is another task running and it's using the same agent. For more information, see Queueing task executions.

Launching

This is the first phase of a task execution if there is no other task running and using the same agent or if queueing isn't enabled. At this point, AWS DataSync is initializing the task execution. This status usually goes quickly, but can take up to a few minutes.

Preparing

This is the second phase of a task execution. AWS DataSync is computing which files need to be transferred. The time that this phase takes is proportional to the number of files in the source location. It usually takes between a few minutes to a few hours, depending on both the source and destination file systems and the performance of these file systems. For more information, see Starting your DataSync task.

Transferring

This is the third phase of a task execution. DataSync is performing the actual transfer of your data to AWS. While the DataSync is transferring files, the number of bytes and files that are transferred is updated in real time.

Verifying

This is the fourth and optional phase of a task execution. If the VerifyMode operation is set to POINT_IN_TIME_CONSISTENT, DataSync performs a full data and metadata integrity verification. This verification ensures that the data in your destination location is an exact copy of the data in your source. This process requires reading back all files in the destination and can take a significant amount of time on very large volumes. If you want to skip verification, specify the VerifyMode operation to NONE. For more information, see How DataSync verifies data integrity.

Success

This value is returned if the data transfer is successful. If the VerifyMode option isn't set, this status occurs after the Transferring phase. Otherwise, it occurs after the Verifying phase. For more information, see Task execution.

Error

This value is returned if the data transfer fails. If the VerifyMode option isn't set, this status occurs after the Transferring phase. Otherwise, it occurs after the Verifying phase.

Canceling a DataSync task

Using the console, you can cancel any task execution that is currently running or that is queued. You can also cancel a task execution using the API. For more information, see CancelTaskExecution.

To cancel a task execution

  1. Open the AWS DataSync console at https://console.aws.amazon.com/datasync/.

  2. In the navigation pane, choose Tasks.

  3. Select the Task ID for the running task that you want to monitor. The Status should be Running.

  4. Choose History to view task execution instances.

  5. Select the active task execution to be stopped.

  6. For Action, choose Stop.

  7. In the Stop Task Execution dialog box that appears, choose Confirm to stop the task execution.