Author Archives: Benjamin DK Wood

Benjamin DK Wood

Benjamin helps manage 3ie’s Replication Programme at the Washington, D.C. office, providing oversight of contracted replications of impact evaluations. He also conducts replications for the programme.
Read more

What’s first for replication studies is what’s next for 3ie’s replication programme

Many consider pure replication, where the replication researcher starts with the original data set and writes code to recreate the published results according to the methods described in the publication, to be the second step in replication analysis. So, what is the first? The first step is checking whether the original authors’ code can be
Read more…

Reflections on replication research: a conversation with Paul Winters

| November 3, 2015

Replication research is often the space of junior researchers. As a well-cited research economist, with multiple international organisation affiliations, Paul Winters stands out in this space. I recently caught up with Paul to discuss his co-authored replication study of Galiani’s and Schargrodsky’s influential paper Property rights for the poor: Effects of land titling. Galiani’s and
Read more…

Replication research promotes open discourse

| July 23, 2015

The just-released International Journal of Epidemiology (IJE) suite of publications reexamining the effectiveness of deworming in Kenya demonstrates the potential impact of replication research. The headline publication is a 3ie-funded replication study. The paper has been published alongside three additional commentaries: a synopsis of a systematic review of deworming evidence, a response from the original
Read more…

How to peer review replication research

“The 3ie replication process differs in important ways from the standard research community-led peer-review process in academic journals. We have been explicitly instructed by 3ie staff not to discuss our experiences with the replication process at any length in this note, including our views on the weaknesses of their current system and the review standards
Read more…

Requiring fuel gauges: A pitch for justifying impact evaluation sample size assumptions

and | October 17, 2014

We expect researchers to defend their assumptions when they write papers or present at seminars. Well, we expect them to defend most of their assumptions. However, the assumptions behind their sample size, determined by their power calculations, are rarely discussed. Sample sizes and power calculations matter. Power calculations determine sample size requirements, which match budget
Read more…