Screening Participants on Mechanical Turk: Techniques and Justifications

Concerns about the quality of Mechanical Turk participants induce researchers to screen participants. We evaluate screening strategies according to their discriminant ability to identify observations contributing only noise. Our results suggest that omitting participants based on these indicators would likely bias the sample rather than improve data quality.



Citation:

Julie S. Downs, Mandy B. Holbrook, and Emily Peel (2012) ,"Screening Participants on Mechanical Turk: Techniques and Justifications", in NA - Advances in Consumer Research Volume 40, eds. Zeynep Gürhan-Canli, Cele Otnes, and Rui (Juliet) Zhu, Duluth, MN : Association for Consumer Research, Pages: 112-116.

Authors

Julie S. Downs, Carnegie Mellon University, USA
Mandy B. Holbrook, Carnegie Mellon University, USA
Emily Peel, Carnegie Mellon University, USA



Volume

NA - Advances in Consumer Research Volume 40 | 2012



Share Proceeding

Featured papers

See More

Featured

Trust in Doubt: Co-Chair's Invited Panel

Adam Berinsky, Massachusetts Institute of Technology, USA
John Gray, MentionMapp.com
Andre Spicer, City University of London, UK

Read More

Featured

How Regional Diasporic Consumer Experiences Produce Transnational Imaginary

Mark Buschgens, RMIT University
Bernardo Figueiredo, RMIT University
Kaleel Rahman, RMIT University

Read More

Featured

M5. The More Expensive a Gift Is, the More It Is Appreciated? The Effect of Gift Price on Recipients’ Appreciation

Jooyoung Park, Peking University
MENGSHU CHEN, Tencent Holdings Limited

Read More

Engage with Us

Becoming an Association for Consumer Research member is simple. Membership in ACR is relatively inexpensive, but brings significant benefits to its members.