Scalable Content Curation: Learning From Human Effort

Creative agencies often crowdsource to generate ideas for new content or products. We find that some evaluators benefit disproportionately from the application of a statistical model, a phenomenon we term “predictable inaccuracy.” Our framework yields metrics for evaluator importance and assesses the extent to which a model substitutes human effort.


Pavel Kireyev, Artem Timoshenko, and Cathy Liu Yang (2020) ,"Scalable Content Curation: Learning From Human Effort", in NA - Advances in Consumer Research Volume 48, eds. Jennifer Argo, Tina M. Lowrey, and Hope Jensen Schau, Duluth, MN : Association for Consumer Research, Pages: 831-835.


Pavel Kireyev, INSEAD, France
Artem Timoshenko, Northwestern University, USA
Cathy Liu Yang, HEC Paris, France


NA - Advances in Consumer Research Volume 48 | 2020

Share Proceeding

Featured papers

See More


G9. The Voice From Afar: How Reverberation Affects Consumer Cognition

Johann Melzner, New York University, USA
Jochim Hansen, University of Salzburg

Read More


Bundle Variety and Preference: A Neuromarketing Study Using Event-Related Potentials

Ruyi Qiu, Tsinghua University
Xiaoang Wan, Tsinghua University

Read More


Attenuating Endowment Effect with Venmo: Online Payment Systems Make it a Pleasure to Pay

Liang Huang, University of Arizona, USA
Jennifer Savary, University of Arizona, USA

Read More

Engage with Us

Becoming an Association for Consumer Research member is simple. Membership in ACR is relatively inexpensive, but brings significant benefits to its members.