You are browsing the documentation for a deprecated version ('2014-08-15') of the Amazon Mechanical Turk Requester API. This version of the API will be deprecated and will be rendered unusable as of June 1st, 2019. If you request against a legacy API version (https://docs.aws.amazon.com/AWSMechTurk/latest/AWSMturkAPI-legacy/Welcome.html) on or after June 1, 2019, you will receive the following response:
The latest version of our API ('2017-01-17') provides you with additional tool choices and enables you to select from nine AWS Software Development Kits This version also updates naming conventions used in the API and adopts the AWS standard of Signature Version 4 to authenticate requests securely. The API uses REST requests and no longer requires that developers be familiar with SOAP protocol. These changes make the MTurk API consistent with AWS APIs, simplifying the on-boarding process for both new and existing AWS developers. The legacy MTurk Command Line Tools and .NET, Java, Ruby, and Perl SDKs were marked as deprecated in January 2018. We will be deprecating the legacy APIs as of June 1, 2019. If you are on a legacy API, you must migrate to the latest
version of our API. You can find documentation for the latest API here and the AWS SDKs here For support, contact requestor-apilegacydeprecation-support@amazon.com |
QualificationRequirement
Topics
- Description
- Using Custom, System-Assigned, and Master Qualification Types
- Elements
- Qualification Type IDs
- Master Qualifications
- Adding Adult Content
- The Locale Qualification
- Example—Using the QualificationRequirement Data Structure
- Example—Using the QualificationRequirement Data Structure for Comparing Multiple Values
Description
The QualificationRequirement data structure describes a Qualification a Worker must have before the Worker is allowed to accept a HIT. A requirement may optionally state that a Worker must have the Qualification to preview the HIT.
The QualificationRequirement data structure is used as a parameter for the following operations:
-
CreateHIT
-
RegisterHITType
The QualificationRequirement data structure is used in the HIT data structure.
Using Custom, System-Assigned, and Master Qualification Types
A Qualification requirement can be based on a Qualification you assign to Workers. You can
create a custom Qualification type using the
CreateQualificationType
operation. Then you can grant requests
for the Qualification automatically using a Qualification test and answer key submitted
with the Qualification type, or you can grant the request manually with the
GrantQualification
operation. The
CreateQualificationType
returns a
QualificationTypeId
, which you can use with the
QualificationRequirement
data structure to identify the type of Qualification the Worker
is required to have to accept a HIT. Either the Qualification test or your call to
GrantQualification
determines a Qualification value, which is
compared to the requirement in the HIT to determine the Worker's eligibility.
Amazon Mechanical Turk supplies several Qualification types for use by all Requesters.
Mechanical Turk system-assigned Qualification types work the same way as Qualifications
that you create, except that data from the Mechanical Turk marketplace determines the
Worker’s values. Every Worker has a value for each system Qualification, and these
values are updated as the Worker uses the system. Additionally, Amazon Mechanical Turk
also provides Master Qualification types that give you access to an elite group of
Workers who have demonstrated superior performance while completing thousands of
HITs across the Mechanical Turk marketplace.
You can use the Master and system-assigned Qualification types by using the
corresponding Qualification type ID in the QualificationTypeId
element of the QualificationRequirement
data structure.
For a list of the Master and system-assigned IDs,
see Qualification Type IDs.
For more information about using a Master Qualification type,
see Master Qualifications.
Elements
The QualificationRequirement data structure can contain the following elements.
Name | Description | Value |
---|---|---|
QualificationTypeId
|
The ID of the Qualification type for the requirement. |
A valid QualificationType ID from a custom Qualification type you created or an ID from the list of Master and system-assigned Qualification Type IDs. |
Comparator
|
The kind of comparison to make against a Qualification's value. You can compare a Qualification's value:
A Qualification requirement can also test if a Qualification
|
|
IntegerValue
|
The integer value to compare against the Qualification's value.
When performing a set comparison by using the |
An integer. |
LocaleValue
|
The locale value to compare against the Qualification's value. The local value must be a valid
ISO 3166 country code
You must only use a single
When performing a set comparison by using the |
A Locale data structure. |
RequiredToPreview
|
If If a Worker meets all of the requirements where The default is |
A Boolean value, |
Qualification Type IDs
The following table lists the Master and system-assigned Qualification Type IDs that can be used in the QualificationTypeId
element.
Name | QualificationTypeId | Description |
---|---|---|
Masters |
Sandbox: 2ARFPLSP75KLA8M8DH1HTEQVJT3SY6 Production: 2F1QJWKUDD8XADTFD2Q0G6UTO95ALH |
Masters are an elite group of Workers, who have demonstrated superior
performance while completing thousands of HITs across the
Mechanical Turk marketplace. Masters must maintain this high level of performance or
they may lose this distinction. Set the Note that for this Qualification type ID, the
|
Worker_NumberHITsApproved | 00000000000000000040 | Specifies the total number of HITs submitted by a Worker that have been approved. The value is an integer greater than or equal to 0. |
Worker_Locale | 00000000000000000071 |
The location of the Worker, as specified in the Worker's mailing address. For more information about the locale Qualification, see the The Locale Qualification section. |
Worker_Adult | 00000000000000000060 | Requires workers to acknowledge that they are over 18 and that they agree to work on potentially offensive content. The value type is boolean, 1 (required), 0 (not required, the default). |
Worker_PercentAssignmentsApproved | 000000000000000000L0 |
The percentage of assignments the Worker has submitted that were subsequently approved by the Requester, over all assignments the Worker has submitted. The value is an integer between 0 and 100. Note that a Worker's approval rate is statistically meaningless for small numbers of assignments, since a single rejection can reduce the approval rate by many percentage points. So to ensure that a new Worker's approval rate is unaffected by these statistically meaningless changes, if a Worker has submitted less than 100 assignments, the Worker's approval rate in the system is 100%. To prevent Workers who have less than 100 approved assignments from working on your HIT, set the Worker_NumberHITsApproved qualification type ID to a value greater than 100. |
Master Qualifications
You can require that Workers must have a Master Qualification to complete your HITs.
To create a Qualification requirement for Masters, specify:
-
A
QualificationTypeId
of 2F1QJWKUDD8XADTFD2Q0G6UTO95ALH -
A
Comparator
ofExists
Note
The Master Qualification Type ID values used for the
QualificationTypeId
parameter in the preceding procedures
are for the production environment. The ID values to use in the Mechanical Turk
Sandbox environment are listed in the Qualification Type IDs table.
Adding Adult Content
Adult content can be offensive to some people. For that reason, if your HIT is adult-oriented, we ask you to use the following procedure.
Adding Adult HITs
-
In the HIT title, include the words "adult content."
-
Specify the worker's qualifications in one of the following ways:
Using the API:
-
Set the
CreateHit
parameter,QualificationRequirement
, to the qualification type, 00000000000000000060. -
Set
comparator
parameter to "EqualTo." -
Set the
IntegerValue
parameter to 1 (required).
Using the command line tools, in the HIT properties file:
-
Set
qualificationTypeId
to 00000000000000000060. -
Set
comparator
, to "EqualTo." -
Set the
IntegerValue
to 1 (required). For example,<QualificationRequirement> <QualificationTypeId>00000000000000000060</QualificationTypeId> <Comparator>EqualTo</Comparator> <IntegerValue>1</IntegerValue> </QualificationRequirement>
-
-
Define the HIT to be private or previewed.
This setting prevents anyone who does not qualify from seeing the HIT. To make the HIT private, use one of the following methods:
Using the API, set the RequiredToPreview
parameter to true.Using the command line tools, in the HIT properties file, set the private parameter,
qualification.private
, to TRUE.
The Locale Qualification
You can create a Qualification requirement based on the Worker's location. The Worker's location is specified by the Worker to Amazon Mechanical Turk when the Worker creates his account.
To create a Qualification requirement based on the Worker's location, specify:
-
A
QualificationTypeId
of 00000000000000000071 -
A
Comparator
ofEqualTo
orNotEqualTo
-
A
LocaleValue
that corresponds to the desired locale
To create a Qualification requirement based on the Worker being in or not in one of several locations, specify:
-
A
QualificationTypeId
of 00000000000000000071 -
A
Comparator
ofIn
orNotIn
-
Multiple
LocaleValue
values that correspond to the desired locales.
For more information on the format of a LocaleValue
element, see Locale data structure.
Example
The following example shows a QualificationRequirement specifying Workers located in the state of Pennsylvania. Workers located in the state of New York (US-NY) or in the country of India (IN) do not qualify for the HITs with this QualificationRequirement.
<QualificationRequirement> <QualificationTypeId>00000000000000000071</QualificationTypeId> <Comparator>EqualTo</Comparator> <LocaleValue> <Country>US</Country> <Subdivision>PA</Subdivision> </LocaleValue> </QualificationRequirement>
The following example shows a QualificationRequirement specifying Workers not located in the state of California. Workers located in the state of New York or in the country of India (IN) will be qualified to do HITs with this QualificationRequirement.
<QualificationRequirement> <QualificationTypeId>00000000000000000071</QualificationTypeId> <Comparator>NotEqualTo</Comparator> <LocaleValue> <Country>US</Country> <Subdivision>CA</Subdivision> </LocaleValue> </QualificationRequirement>
Example—Using the QualificationRequirement Data Structure
The following example of a QualificationRequirement data structure could be passed in
to a call to CreateHIT
. CreateHIT
accepts
parameters that describe the HIT being created, including one or more Qualification
requirements.
Example SOAP Request
In a SOAP request, the QualificationRequirement data structure is specified as the
QualificationRequirement
parameter in XML:
<QualificationRequirement> <QualificationTypeId>789RVWYBAZW00EXAMPLE</QualificationTypeId> <Comparator>GreaterThan</Comparator> <IntegerValue>18</IntegerValue> </QualificationRequirement>
Example REST Request
In a REST request, the components of the QualificationRequirement data structure are
specified as separate parameters. To specify more than one QualificationRequirement
in a REST request, increment the sequence
number in the parameter name for each value:
https://mechanicalturk.amazonaws.com/?Service=AWSMechanicalTurkRequester
[...]
&QualificationRequirement.1.QualificationTypeId=789RVWYBAZW00EXAMPLE &QualificationRequirement.1.Comparator=GreaterThan &QualificationRequirement.1.IntegerValue=18 &QualificationRequirement.2.QualificationTypeId=ZSPJXD4F1SFZP7YNJWR0 &QualificationRequirement.2.Comparator=EqualTo &QualificationRequirement.2.IntegerValue=1
Example—Using the QualificationRequirement Data Structure for Comparing Multiple Values
The following example of a QualificationRequirement data structure could be passed in
to a call to CreateHIT
. CreateHIT
accepts
parameters that describe the HIT being created, including one or more Qualification
requirements.
Example SOAP Request
The following example shows a QualificationRequirement data structure used in a SOAP request that uses multiple
IntegerValue
values when performing a set comparison by using the In
comparator.
<QualificationRequirement> <QualificationTypeId>789RVWYBAZW00EXAMPLE</QualificationTypeId> <Comparator>In</Comparator> <IntegerValue>10</IntegerValue> <IntegerValue>20</IntegerValue> <IntegerValue>30</IntegerValue> </QualificationRequirement>
Example SOAP Response
The following is an example of a SOAP QualificationRequirement data structure in a response to the preceding example request.
<QualificationRequirement> <QualificationTypeId>789RVWYBAZW00EXAMPLE</QualificationTypeId> <Comparator>In</Comparator> <IntegerValue>10</IntegerValue> <IntegerValue>20</IntegerValue> <IntegerValue>30</IntegerValue> <RequiredToPreview>0</RequiredToPreview> </QualificationRequirement>
Example REST Request
In a REST request, the components of the QualificationRequirement data structure are
specified as separate parameters. The following example shows how to perform set comparisons by using the In
comparator with
multiple IntegerValue
and LocaleValue
values.
https://mechanicalturk.amazonaws.com/?Service=AWSMechanicalTurkRequester
[...]
&QualificationRequirement.1.QualificationTypeId=789RVWYBAZW00EXAMPLE &QualificationRequirement.1.Comparator=In &QualificationRequirement.1.IntegerValue.1=10 &QualificationRequirement.1.IntegerValue.2=20 &QualificationRequirement.1.IntegerValue.3=30 &QualificationRequirement.2.QualificationTypeId=ZSPJXD4F1SFZP7YNJWR0 &QualificationRequirement.2.Comparator=In &QualificationRequirement.2.LocaleValue.1.Country=US &QualificationRequirement.2.LocaleValue.2.Country=CA &QualificationRequirement.2.LocaleValue.3.Country=MX