Amazon Mechanical Turk: The Microtask Marketplace Behind a Lot of AI and Research Data

Amazon Mechanical Turk is a microtask marketplace launched in 2005 where requesters post small tasks for people to complete. This explains HITs, who uses it and the research debate.

Made or run by
Amazon Web Services
Launched
2005
Available in
Requesters and workers in many countries
Pricing
Requesters pay per task plus a fee; workers are paid per task
Official site
mturk.com
Not verified
Worker eligibility and task supply vary
Holyprofweb editorial graphic for Amazon Mechanical Turk

Amazon Mechanical Turk (MTurk) is a crowdsourcing marketplace, launched in 2005, where businesses and researchers post small online tasks that need human judgment and workers complete them for payment. The tasks are called HITs, short for human intelligence tasks.

How it works

A requester designs a task, sets a reward and publishes it to the marketplace. Workers, often called Turkers, browse and accept tasks in their browser. Typical HITs include tagging images, transcribing audio, checking data, moderating content and answering survey questions. Requesters can also automate this through the API, which is how many businesses integrate human review into software.

Why researchers use it

Academic papers describe MTurk as a fast way to recruit survey and experiment participants, including in addiction research, where authors have also set out concerns and best practices about data quality and worker protections.

The labour question

Scholarly work in the journal Labor has examined MTurk as a case of human-science labour, noting that low per-task pay and limited protections for workers are recurring issues. Amazon’s documentation describes the marketplace as an on-demand, scalable human workforce, which is a requester’s point of view.

If you are thinking of working on it

  • Check that your country is supported before registering.
  • Track time against reward to see your effective hourly rate.
  • Be wary of any third party that sells MTurk accounts.

What we could not verify

We did not use MTurk as a worker or requester, so we cannot give typical earnings.

Sources

  1. Amazon Mechanical Turk: What is Amazon Mechanical Turk?
  2. Wikipedia: Amazon Mechanical Turk
  3. PMC: Mechanical Turk data collection in addiction research
  4. Duke University Press, Labor: Amazon Mechanical Turk, the human sciences' labor problem