Testing the Waters: Behavior across Participant Pools
Author(s) -
Erik Snowberg,
Leeat Yariv
Publication year - 2021
Publication title -
american economic review
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 16.936
H-Index - 297
eISSN - 1944-7981
pISSN - 0002-8282
DOI - 10.1257/aer.20181065
Subject(s) - leverage (statistics) , sample (material) , population , set (abstract data type) , amazon rainforest , scale (ratio) , psychology , statistics , computer science , geography , ecology , mathematics , demography , biology , cartography , sociology , physics , programming language , thermodynamics
We leverage a large-scale incentivized survey eliciting behaviors from (almost) an entire undergraduate university student population, a representative sample of the US population, and Amazon Mechanical Turk (MTurk) to address concerns about the external validity of experiments with student participants. Behavior in the student population offers bounds on behaviors in other populations, and correlations between behaviors are similar across samples. Furthermore, non-student samples exhibit higher levels of noise. Adding historical lab participation data, we find a small set of attributes over which lab participants differ from non-lab participants. An additional set of lab experiments shows no evidence of observer effects. (JEL C83, D90, D91)
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom