Review assignments offline - Amazon Mechanical Turk

Review assignments offline

If a batch is large, it's often easier to download batch results, review them using another application, such as Microsoft Excel, and then upload the revised file. For information about reviewing assignments in the Requester UI, see Review assignments.

Results are available for 120 days after you approve or reject them. If you need to access the results longer than that, you can use the following procedure to download and archive them.

Download and review assignments

To download and review assignments offline

  1. On the Mechanical Turk Requester website at https://requester.mturk.com/, choose the Manage tab and then choose Results.

  2. Under Manage Batches, choose the arrow next to Batches ready for review.

  3. Choose Review Results on the batch you want to review.

  4. On the Review Results page, choose Download CSV. The Download Batch Results page opens and a dialog box appears when your .csv is ready to download.

  5. Choose here in the first sentence in the dialog box to download your .csv.

  6. Choose OK and open the results file with a .csv compatible application, such as Microsoft Excel.

  7. For each result, enter an X in the Approve column or a reason to reject the result in the Reject column.

  8. Save the spreadsheet as a .csv file.

Upload reviewed results

Now that you've reviewed the results, you must upload your reviewed file so Mechanical Turk can approve or reject work based on the changes you made to the file.

To upload a reviewed .csv file

  1. On the Mechanical Turk Requester website at https://requester.mturk.com/, choose the Manage tab and then choose Results.

  2. Under Manage Batches, choose the arrow next to Batches ready for review.

  3. Choose Results on the batch you want to review.

  4. On the Review Results page, choose Upload CSV.

  5. Choose Review Results Offline, choose Browse, choose the .csv file you saved, and then choose Upload CSV.

  6. On the Processing File page, wait for your file to finish processing. It might take a few moments to process your file.

  7. If you rejected any assignments, you can republish the rejected assignments by selecting the Republish rejected assignment(s) for other workers to complete check box.

  8. Choose Yes to confirm your choices.

Some versions of Microsoft Excel do not display international characters by default. If your HIT title, description, or HIT results contain international characters, you must follow the instructions for your version of Microsoft Excel to import or activate international characters.