Challenges to Replication and Iteration in Field Experiments: Evidence from Two Direct Mail Shots
Author(s) -
Jake Bowers,
Nathaniel Higgins,
Dean Karlan,
Sarah Tulman,
Jonathan Zinman
Publication year - 2017
Publication title -
american economic review
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 16.936
H-Index - 297
eISSN - 1944-7981
pISSN - 0002-8282
DOI - 10.1257/aer.p20171060
Subject(s) - replication (statistics) , context (archaeology) , direct mail , government (linguistics) , replicate , direct marketing , economics , field experiment , test (biology) , econometrics , marketing , advertising , public economics , business , statistics , mathematics , geography , biology , philosophy , paleontology , linguistics , archaeology
We conducted an experiment marketing microloans to farmers in the USA during Spring 2015 and found a simple direct mail letter increased borrowing from a government program. The subsequent spring, we built on this finding and enriched the design to test for information spillovers. The direct effect result did not replicate in the second year, thus lowering the likelihood that spillovers would be present and detectable. These results add to recent evidence on how (seemingly subtle) differences in context and treatment content affect consumer responses.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom