Should the Randomistas (Continue To) Rule?
Should the Randomistas (Continue to) Rule? Martin Ravallion Abstract The rising popularity of randomized controlled trials (RCTs) in development applications has come with continuing debates on the pros and cons of this approach. The paper revisits the issues. While RCTs have a place in the toolkit for impact evaluation, an unconditional preference for RCTs as the “gold standard” is questionable. The statistical case is unclear on a priori grounds; a stronger ethical defense is often called for; and there is a risk of distorting the evidence-base for informing policymaking. Going forward, pressing knowledge gaps should drive the questions asked and how they are answered, not the methodological preferences of some researchers. The gold standard is the best method for the question at hand. Keywords: Randomized controlled trials, bias, ethics, external validity, ethics, development policy JEL: B23, H43, O22 Working Paper 492 August 2018 www.cgdev.org Should the Randomistas (Continue to) Rule? Martin Ravallion Department of Economics, Georgetown University François Roubaud encouraged the author to write this paper. For comments the author is grateful to Sarah Baird, Mary Ann Bronson, Caitlin Brown, Kevin Donovan, Markus Goldstein, Miguel Hernan, Emmanuel Jimenez, Madhulika Khanna, Nishtha Kochhar, Andrew Leigh, David McKenzie, Berk Özler, Dina Pomeranz, Lant Pritchett, Milan Thomas, Vinod Thomas, Eva Vivalt, Dominique van de Walle and Andrew Zeitlin. Staff of the International Initiative for Impact Evaluation kindly provided an update to their database on published impact evaluations and helped with the author’s questions. Martin Ravallion, 2018. “Should the Randomistas (Continue to) Rule?.” CGD Working Paper 492. Washington, DC: Center for Global Development.
[Show full text]