Expertise versus Bias in Evaluation: Evidence from the NIH
Author(s) -
Danielle Li
Publication year - 2017
Publication title -
american economic journal applied economics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 12.996
H-Index - 82
eISSN - 1945-7782
pISSN - 1945-7790
DOI - 10.1257/app.20150421
Subject(s) - objectivity (philosophy) , context (archaeology) , quality (philosophy) , actuarial science , psychology , public economics , economics , business , paleontology , philosophy , epistemology , biology
Evaluators with expertise in a particular field may have an informational advantage in separating good projects from bad. At the same time, they may also have personal preferences that impact their objectivity. This paper examines these issues in the context of peer review at the US National Institutes of Health. I show that evaluators are both better informed and more biased about the quality of projects in their own area. On net, the benefits of expertise weakly dominate the costs of bias. As such, policies designed to limit bias by seeking impartial evaluators may reduce the quality of funding decisions. (JEL D82, H51, I10, I23, O38)
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom