Menu
Amazon Mechanical Turk
Requester UI Guide (API Version 2017-01-17)

Reviewing Assignments Offline

If a batch is large, it's often easier to download batch results, review them using another application, such as Microsoft Excel, and then upload the revised file. For information about reviewing assignments in the Requester UI, see Reviewing Assignments.

Results are available for 120 days after you approve or reject them. If you need to access the results longer than that, you can use the following procedure to download and archive them.

Downloading and Reviewing Assignments

To download and review assignments offline

  1. On the Mechanical Turk Requester website https://requester.mturk.com/, click the Manage tab and then click Results.

  2. Under Manage Batches click the arrow next to Batches ready for review.

  3. Click Results on the batch you want to review.

  4. On the Review Results page, click Download CSV.

    The following dialog box appears.

  5. Click the word here.

    The following dialog box appears.

  6. In this dialog box, do one of the following.

    To... Do This...
    To open and view the results Select Open with and choose the application from the drop down list that you want to use to view the results. The application you select must be able to display .csv files.
    To save the results Select Save to Disk.
  7. Click OK and open the results file with a .csv compatible application, such as Microsoft Excel.

  8. For each result, enter an X in the Approve column or a reason to reject the result in the Reject column.

  9. Save the spreadsheet as a .csv file.

Uploading Reviewed Results

Now that you've reviewed the results, you must upload your reviewed file so Mechanical Turk can approve or reject work based on the changes you made to the file.

To upload a reviewed .csv file

  1. On the Mechanical Turk Requester website https://requester.mturk.com/, click the Manage tab and then click Results.

  2. Under Manage Batches click the arrow next to Batches ready for review.

  3. Click Results on the batch you want to review.

  4. On the Review Results page, click Upload CSV.

    The Review Results Offline dialog box appears.

  5. Click Browse, select the .csv file you saved, and click Upload CSV.

    The number of approvals and rejections are reported.

  6. To republish the rejected assignments, select the Republish rejected assignment(s) for other workers to complete check box.

  7. Click Yes to confirm your choices.

    Some versions of Microsoft Excel do not display international characters by default. If your HIT title, description, or HIT results contain international characters, you must follow the instructions for your version of Microsoft Excel to import or activate international characters.