MIT Sloan School of Management MIT Sloan School Working Paper 4773-10 The Scientific Method in Practice: Reproducibility in the Computational Sciences Victoria Stodden © Victoria Stodden All rights reserved. Short sections of text, not to exceed two paragraphs, may be quoted without explicit permission, provided that full credit including © notice is given to the source. This paper also can be downloaded without charge from the Social Science Research Network Electronic Paper Collection: http://ssrn.com/abstract=1550193 Electronic copy available at: http://ssrn.com/abstract=1550193 THE SCIENTIFIC METHOD IN PRACTICE: REPRODUCIBILITY IN THE COMPUTATIONAL SCIENCES Victoria Stodden* February 2010 * MIT Sloan School of Management 50 Memorial Drive, Cambridge, MA 02141, USA; Postdoctoral Associate in Law and Kauffman Fellow in Law and Innovation Yale Law School 127 Wall St., New Haven, CT 06511, USA
[email protected] Electronic copy available at: http://ssrn.com/abstract=1550193 2 Knowledge in the “Republic of Science” [9-Feb-10 THE SCIENTIFIC METHOD IN PRACTICE: REPRODUCIBILITY IN THE COMPUTATIONAL SCIENCES ABSTRACT Since the 1660’s the scientific method has included reproducibility as a mainstay in its effort to root error from scientific discovery. With the explosive growth of digitization in scientific research and communication, it is easier than ever to satisfy this requirement. In computational research experimental details and methods can be recorded in code and scripts, data is digital, papers are frequently online, and the result is the potential for “really reproducible research.”1 Imagine the ability to routinely inspect code and data and recreate others’ results: Every step taken to achieve the findings can potentially be transparent.