Screening Participants on Mechanical Turk: Techniques and Justifications

Concerns about the quality of Mechanical Turk participants induce researchers to screen participants. We evaluate screening strategies according to their discriminant ability to identify observations contributing only noise. Our results suggest that omitting participants based on these indicators would likely bias the sample rather than improve data quality.


Julie S. Downs, Mandy B. Holbrook, and Emily Peel (2012) ,"Screening Participants on Mechanical Turk: Techniques and Justifications", in NA - Advances in Consumer Research Volume 40, eds. Zeynep Gürhan-Canli, Cele Otnes, and Rui (Juliet) Zhu, Duluth, MN : Association for Consumer Research, Pages: 112-116.


Julie S. Downs, Carnegie Mellon University, USA
Mandy B. Holbrook, Carnegie Mellon University, USA
Emily Peel, Carnegie Mellon University, USA


NA - Advances in Consumer Research Volume 40 | 2012

Share Proceeding

Featured papers

See More


Trust in Doubt: Co-Chair's Invited Panel

Adam Berinsky, Massachusetts Institute of Technology, USA
John Gray,
Andre Spicer, City University of London, UK

Read More


How Regional Diasporic Consumer Experiences Produce Transnational Imaginary

Mark Buschgens, RMIT University
Bernardo Figueiredo, RMIT University
Kaleel Rahman, RMIT University

Read More


M5. The More Expensive a Gift Is, the More It Is Appreciated? The Effect of Gift Price on Recipients’ Appreciation

Jooyoung Park, Peking University
MENGSHU CHEN, Tencent Holdings Limited

Read More

Engage with Us

Becoming an Association for Consumer Research member is simple. Membership in ACR is relatively inexpensive, but brings significant benefits to its members.