

# Manage batches
<a name="ManagingYourHITs"></a>

On the **Manage** tab, you can manage your batch results, the Workers who work on your batches, and your Qualification Types. On the **Results** page on the **Manage** tab you can view the following: 
+ Progress of your batch
+ Batch details
+ Batch results

**Topics**
+ [

# Display batch progress, details, and results
](DisplayingBatchResults.md)
+ [

# Approve and reject assignments
](ApprovingandRejectingWork.md)
+ [

# Cancel a batch
](CancelingaBatch.md)

# Display batch progress, details, and results
<a name="DisplayingBatchResults"></a>

The procedures in this topic describe how to display and filter your batch information.

## Display batch progress, details, and results
<a name="DisplayingBatchResultsProcedure"></a>

The following procedure describes how to display information related to your batches.

**To display the batch progress, details, and results**

1. On the Mechanical Turk Requester website at [https://requester.mturk.com/](https://requester.mturk.com/), choose the **Manage** tab and you'll see the **Results** section.

   

1. Under **Manage Batches**, choose the arrow next to the batch state you want to view. The batches in that state appear and the progress bar shows two quantities:
   + **% submitted – **Percentage of completed HITs.
   + **% published – **Percentage of published HITs in your batch.

     Most batches publish quickly, but extremely large batches can take several minutes to publish.

1. Choose the name of the batch you want to view.

   

   

1. On the **Batch Details** page, choose **Results** to see the submissions for the assignments in the batch.

1. On the **Review Results** page, review the detailed information about the HIT results, such as the Worker who completed the HIT, the Worker's approval rating, and the Worker's submission for your HITs.

## Configure the Review Results page
<a name="ConfiguringtheReviewResultsPage"></a>

You can customize the look and contents of the **Review Results** page.

**To configure the Review Results page**

1. On the Mechanical Turk Requester website at [https://requester.mturk.com/](https://requester.mturk.com/), choose the **Manage** tab and then choose **Results**. 

1. Under **Manage Batches**, choose the arrow next to the batch state you want to view.

1. Choose **Results** on a batch.

1. Choose **Customize View**. 

   

1. On the **Configure Data Results** page, do one or more of the actions listed in the following table.    
[\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/AWSMechTurk/latest/RequesterUI/DisplayingBatchResults.html)

1. Choose **Apply Settings**.

## Filter results
<a name="FilterResults"></a>

You can display a subset of the results by filtering out results based on the amount of time it took to do the assignment, and on the state of the result: submitted, approved, or rejected. By default, only submitted work appears.

**To filter the results**

1. On the Mechanical Turk Requester website [https://requester.mturk.com/](https://requester.mturk.com/), choose the **Manage** tab and then click **Results**. 

1. Under **Manage Batches**, choose the arrow next to the batch state you want to view.

1. Choose **Review Results** for the batch you want to filter.

1. On the **Review Results** page, choose **Filter Results**.

   

1. On the **Filter Results** page, choose one or both filters and specify filter criteria as follows: 
   + To show assignments of a specified status, select the **Status Filter** check box, and then choose the state that you want to view from the list.
   + To show assignments completed in a specified amount of time or less, select the **Velocity Filter** check box and specify a number of seconds.

1. Choose **Apply Filters**.

# Approve and reject assignments
<a name="ApprovingandRejectingWork"></a>

A Requester approves or rejects assignments that Workers submit. When you approve an assignment, the Worker gets paid. When you reject an assignment, the Worker doesn't get paid.

You can approve results individually or all at once. Also, you can sort the results based on the Worker ID so you can review the results from a specific Worker all at once. 

**Topics**
+ [

# Review assignments
](ReviewingResultsintheRUI.md)
+ [

# Review assignments offline
](ReviewingResultsOutsideoftheRUI.md)
+ [

# Approve previously rejected assignments
](ReversingRejectedAssignment.md)

# Review assignments
<a name="ReviewingResultsintheRUI"></a>

It's convenient to review small batches of results so that you can approve or reject work. 

**To approve or reject work**

1. On the Mechanical Turk Requester website at [https://requester.mturk.com/](https://requester.mturk.com/), choose the **Manage** tab and then choose **Results**. 

1. Under **Manage Batches**, choose the arrow next to **Batches ready for review**.

1. Choose **Results** on the batch you want to review.

1. On the **Review Results** page, do one of the following:    
[\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/AWSMechTurk/latest/RequesterUI/ReviewingResultsintheRUI.html)

1. If you want to sort the list by Worker, choose the **Worker ID** column heading.

You can easily approve or reject all of a Worker's work. Over time, you might find a Worker who consistently submits excellent work and therefore has a very high approval rating. In that case, you can approve all of the Worker's work without reviewing all of it.

Mechanical Turk processes payments several times a day so there is almost always a small delay between approval and payment. When there is a delay, Workers see HITs as **Approved-pending payment** in their dashboard. The dashboard displays **Paid** for processed payments.

# Review assignments offline
<a name="ReviewingResultsOutsideoftheRUI"></a>

If a batch is large, it's often easier to download batch results, review them using another application, such as Microsoft Excel, and then upload the revised file. For information about reviewing assignments in the Requester UI, see [Review assignments](ReviewingResultsintheRUI.md).

Results are available for 120 days after you approve or reject them. If you need to access the results longer than that, you can use the following procedure to download and archive them.

## Download and review assignments
<a name="DownloadtheResults"></a>

**To download and review assignments offline**

1. On the Mechanical Turk Requester website at [https://requester.mturk.com/](https://requester.mturk.com/), choose the **Manage** tab and then choose **Results**. 

1. Under **Manage Batches**, choose the arrow next to **Batches ready for review**.

1. Choose **Review Results** on the batch you want to review.

1. On the **Review Results** page, choose **Download CSV**. The **Download Batch Results** page opens and a dialog box appears when your `.csv` is ready to download. 

1. Choose **here** in the first sentence in the dialog box to download your `.csv`. 

1. Choose **OK** and open the results file with a .`csv` compatible application, such as Microsoft Excel.

1. For each result, enter an `X` in the **Approve** column or a reason to reject the result in the **Reject** column.

1. Save the spreadsheet as a .`csv` file.

## Upload reviewed results
<a name="ReviewingandUploadingtheResults"></a>

Now that you've reviewed the results, you must upload your reviewed file so Mechanical Turk can approve or reject work based on the changes you made to the file.

**To upload a reviewed .csv file**

1. On the Mechanical Turk Requester website at [https://requester.mturk.com/](https://requester.mturk.com/), choose the **Manage** tab and then choose **Results**.

1. Under **Manage Batches**, choose the arrow next to **Batches ready for review**.

1. Choose **Results** on the batch you want to review.

1. On the **Review Results** page, choose **Upload CSV**.

1. Choose **Review Results Offline**, choose **Browse**, choose the .`csv` file you saved, and then choose **Upload CSV**.

1. On the **Processing File** page, wait for your file to finish processing. It might take a few moments to process your file. 

1. If you rejected any assignments, you can republish the rejected assignments by selecting the **Republish rejected assignment(s) for other workers to complete** check box.

1. Choose **Yes** to confirm your choices.

Some versions of Microsoft Excel do not display international characters by default. If your HIT title, description, or HIT results contain international characters, you must follow the instructions for your version of Microsoft Excel to import or activate international characters.

# Approve previously rejected assignments
<a name="ReversingRejectedAssignment"></a>

You can approve previously rejected assignments to reverse any rejections you might make by mistake. It is important to make sure that all acceptable work is approved to ensure a good reputation with Workers. 

You can only approve previously rejected assignments that were submitted within the previous 30 days and only if the assignment's related Human Intelligence Task (HIT) has not been disposed.

**To approve previously rejected assignments**

1. On the Mechanical Turk Requester website at [https://requester.mturk.com/](https://requester.mturk.com/), choose the **Manage** tab and then choose **Results**. 

1. Under **Manage Batches**, choose the arrow next to **Batches already reviewed**.

1. Choose **Results** on the batch that contains the previously rejected assignments that you want to approve.

1. On the **Review Results** page for the batch that contains the rejected assignments you want to approve, choose **Download CSV**. If you have not downloaded a results .csv file before, you can follow the detailed steps described in [Download and review assignments](ReviewingResultsOutsideoftheRUI.md#DownloadtheResults). 

1. In the downloaded .csv file, mark an assignment as approved by putting an **x** in the **Approve** column and remove the text from the **Reject** column. 

1. After you mark the rejected assignments for approval, save the file, and then upload the modified .csv file by choosing **Upload CSV** on the **Review Results** page for the batch. If you have not uploaded a modified results .csv file before, you can follow the steps in [Upload reviewed results](ReviewingResultsOutsideoftheRUI.md#ReviewingandUploadingtheResults). 

1. When you're asked to confirm your approval choices, choose **Yes** to confirm the approval of the assignments, which approves the assignments, pays the Workers, and updates the Workers' HITs submitted statistics. 

Approving a rejected assignment initiates two payments from your Requester Amazon.com account: one payment to the Worker who submitted the results for the reward amount specified in the HIT and one payment for Mechanical Turk fees. For the operation to succeed, you must have sufficient funds in your account to pay the Worker and the fees. 

If your HITs were created using the Mechanical Turk API, you can approve a previously rejected assignment using the [ApproveRejectedAssignment](https://docs.aws.amazon.com/AWSMechTurk/latest/AWSMturkAPI/ApiReference_ApproveRejectedAssignmentOperation.html) operation. 

# Cancel a batch
<a name="CancelingaBatch"></a>

If the batch you published isn't working the way you'd like, you can cancel it.

**To cancel a batch**

1. On the Mechanical Turk Requester website at [https://requester.mturk.com/](https://requester.mturk.com/), choose the **Manage** tab and then choose **Results**.

1. Under **Manage Batches**, choose the arrow next to **Batches in progress**.

1. Choose **Cancel** on the batch you want to delete.

1. In the **Cancel Batch** dialog box, choose **Yes**.

It can take several minutes to cancel a batch. All Workers who accepted assignments before you deleted the batch can continue working on them. The batch won't be completely deleted until all assignments accepted by Workers have been returned, submitted, or abandoned.