Field Experiments on Discrimination∗

Total Page:16

File Type:pdf, Size:1020Kb

Field Experiments on Discrimination∗ Field Experiments on Discrimination∗ Prepared for the Handbook of Field Experiments Marianne Bertrandy Esther Dufloz This version: January 7, 2016 Abstract This article reviews the existing field experimentation literature on the prevalence of discrimination, the consequences of such discrimination, and possible approaches to under- mine it. We highlight key gaps in the literature and ripe opportunities for future field work. Section 1 reviews the various experimental methods that have been employed to measure the prevalence of discrimination, most notably audit and correspondence studies; it also describes several other measurement tools commonly used in lab-based work that deserve greater consideration in field research. Section 2 provides an overview of the literature on the costs of being stereotyped or discriminated against, with a focus on self-expectancy effects and self-fulfilling prophecies; section 2 also discusses the thin field-based literature on the consequences of limited diversity in organizations and groups. The final section of the paper, Section 3, reviews the evidence for policies and interventions aimed at weakening discrim- ination, covering role model and intergroup contact effects, as well as socio-cognitive and technological de-biasing strategies. ∗Laura Stilwell and Jan Zilinsky provided excellent research assistance. We thank Abhijit Banerjee for com- ments. We are particularly grateful to Betsy Levy Paluck, our discussant, for her detailed and thoughtful review of an earlier draft. yBertrand: University of Chicago Booth School of Business, NBER, and J-PAL (email: Mari- [email protected]). zDuflo: MIT Economics Department, NBER, and J-PAL (email: edufl[email protected]). 1 Introduction Black people are less likely to be employed, more likely to be arrested by the police, and more likely to be incarcerated. Women are very scarce at the top echelon of the corporate, academic and political ladders despite the fact that (in rich countries at least) they get better grades in school and are more likely to graduate from college. While many in the media and public opinion circles argue that discrimination is a key force in driving these patterns, showing that it is actually the case is not simple. Indeed, it has proven elusive to produce convincing evidence of discrimination using standard regression analysis methods and observational data, in the sense in which we define discrimination throughout this chapter: members of a minority group (women, Blacks, Muslims, immigrants, etc.) are treated differentially (less favorably) than members of a majority group with otherwise identical characteristics in similar circumstances. However, over the last couple of decades, a rich literature in economics, sociology, political science and psychology has leveraged experiments (in the lab and in the field) to provide convinc- ing evidence that discrimination, thus defined, indeed exists. We begin this chapter by describing the various experimental methods that have been used to measure discrimination in the field. Overall, this literature offers staggering evidence of pervasive discrimination against minority or under-represented groups all around the world. We summarize this research and discuss some of its key limitations. If discrimination is as pervasive as the evidence suggests, what do existing theories tell us about the costs to minority groups and to society overall? The two workhorse models of discrim- ination in the economics literature give drastically different answers, particularly with respect to the societal consequences. In the first model, developed in Becker (1957) for the context of the labor market, some employers have a distaste for hiring members of the minority group. They may indulge this distaste by refusing to hire, say, Blacks or, if they do hire them, paying them less than other employees for the same level of productivity. If the fraction of discriminating em- ployers in the economy is sufficiently large, a wage differential will emerge in equilibrium between otherwise identically productive minority and majority employees and this wage differential will be a reflection of the distaste parameter of the marginal employer for minority workers (Becker, 1957; Charles and Guryan, 2008). By electing to not hire minority workers, infra-margin racist employers will experience lower profits. In fact, if the conditions of perfect competition were 2 satisfied, discriminating employers would be wiped away and taste-based discrimination would disappear.1 This “taste-based” explanation for discrimination stands in contrast with what many economists would view as a more disciplined explanation, which does not involve an ad-hoc (even if intuitive) addition to the utility function (animus towards certain groups) to help rationalize a puzzling behavior. In a “statistical discrimination” model (Phelps, 1972; Arrow, 1973; Aigner and Cain, 1977), the differential treatment of members of the minority group is due to imperfect infor- mation, and discrimination is the result of a signal extraction problem. As a profit-maximizing prospective employer, renter, or car salesman, tries to infer the characteristics of a person that are relevant to the market transaction they are considering to complete with that person, they use all the information available to them. When the person-specific information is limited, group- specific membership may provide additional valuable information about expected productivity. For example, again using the labor market scenario, it may be known to employers that minority applicants are on average less productive than majority applicants. In this case, an employer who sees two applicants with similar noisy but unbiased signals of productivity should rationally favor the majority applicant to the minority one as her expected productivity is higher. While expected productivity will equal true productivity on average within each group, statistical dis- crimination will result in some minority workers being treated less favorably than non-minority workers of the same true productivity, i.e. will result in discrimination as defined above. In the extreme case where individual signals of productivity are totally uninformative, an employer may rationally decide to make offers only to Whites if the mean productivity among Blacks does not exceed the required threshold. While taste-based discrimination is clearly inefficient (simply consider how it constrains the allocation of talent), statistical discrimination is theoretically efficient and hence more easily defendable in ethical terms under the utilitarian argument. Moreover, statistical discrimination can also be argued to be “fair” in that it treats identical people with the same expected produc- tivity (even if not with the same actual productivity) and is not motivated by animus. In fact, many economists would most likely support allowing statistical discrimination as a good policy, even where it is now illegal (as it is, for example, in the US labor market and real estate market 1Refusing to hire black people could be efficient if the employer knows he cannot work well with them due to his animus, but this does not take away from the fact that businesses that do this should not survive. 3 contexts). Unfortunately, as we discuss below, while field experiments have been overall successful at documenting that discrimination exists, they have (with a few exceptions) struggled with linking the patterns of discrimination to a specific theory. Meanwhile, psychologists have made considerable progress in their own understanding of the roots of discrimination, on a largely parallel track. The theories they have advanced and the (mainly lab) experiments they have conducted have been helpful in better nailing the micro- foundations of discrimination. We believe this body of work blurs the sharp line economists tend to draw between taste-based and statistical explanations. Psychologists’ work on discrimination is embedded in an immense literature that attempts to understand the roots of prejudice, widely characterized as negative evaluation of others made on the basis of their group membership. This literature has looked for the micro-foundations of such negative evaluation in a wide variety of areas, including personality development, socialization, social cognition, evolutionary psychology and neuroscience. Early scholarship in psychology viewed prejudice as a form of abnormal thinking and equated it to a psychopathology (think Adolf Hitler) that could be treated by addressing the personality disorders of subset of the population that was “diseased.” It was only in the second half of the twentieth century that that the prevalent view of prejudice among psychologists became rooted in normal thinking processes (Dovidio, 2001), with socialization and social norms being viewed as dominant drivers. Influential work by Tajfel (Tajfel, 1970; Tajfel and Turner, 1979) demonstrated the key role social identity plays in the process underlying prejudice. Experimental evidence has shown that the assignment of people to groups, even if totally arbitrary ones and even if they do not last, is sufficient to produce favoritism for in-group members and negativity towards out- group members. At the same time, evolutionary psychology has stressed the importance of social differentiation and the delineation of clear group boundaries as a way to achieve the benefits of cooperation between human beings without the risk of excessive costs, with group membership and group identity emerging as a form of contingent
Recommended publications
  • A Field Experiment with Job Seekers in Germany Search:Learning Job About IZA DP No
    IZA DP No. 9040 Learning about Job Search: A Field Experiment with Job Seekers in Germany Steffen Altmann Armin Falk Simon Jäger Florian Zimmermann May 2015 DISCUSSION PAPER SERIES Forschungsinstitut zur Zukunft der Arbeit Institute for the Study of Labor Learning about Job Search: A Field Experiment with Job Seekers in Germany Steffen Altmann University of Copenhagen and IZA Armin Falk University of Bonn, CEPR, CESifo, DIW, IZA and MPI Simon Jäger Harvard University and IZA Florian Zimmermann University of Zurich, CESifo and IZA Discussion Paper No. 9040 May 2015 IZA P.O. Box 7240 53072 Bonn Germany Phone: +49-228-3894-0 Fax: +49-228-3894-180 E-mail: [email protected] Any opinions expressed here are those of the author(s) and not those of IZA. Research published in this series may include views on policy, but the institute itself takes no institutional policy positions. The IZA research network is committed to the IZA Guiding Principles of Research Integrity. The Institute for the Study of Labor (IZA) in Bonn is a local and virtual international research center and a place of communication between science, politics and business. IZA is an independent nonprofit organization supported by Deutsche Post Foundation. The center is associated with the University of Bonn and offers a stimulating research environment through its international network, workshops and conferences, data service, project support, research visits and doctoral program. IZA engages in (i) original and internationally competitive research in all fields of labor economics, (ii) development of policy concepts, and (iii) dissemination of research results and concepts to the interested public.
    [Show full text]
  • In 2012 the Society of Labor Economists Presented the Sherwin Rosen Award to Marianne Bertrand, for Outstanding Contributions in the Field of Labor Economics
    In 2012 the Society of Labor Economists presented the Sherwin Rosen Award to Marianne Bertrand, for outstanding contributions in the field of labor economics. Bertrand received her PhD from Harvard in 1998. She is the Chris P. Dialynas Professor of Economics and Richard N. Rosett Faculty Fellow at the Booth School of Business at the University of Chicago. She is a research associate of the National Bureau of Economic Research and a coeditor of the American Economic Review. Her work has covered a number of topics including racial discrimination, CEO pay and incentives, the effects of regulation on employment, and household finance. Her research in these areas has been published widely, including numerous research articles in the Quarterly Journal of Economics, the Journal of Political Economy, and the American Economic Review, as well as several public policy journals. Bertrand has made outstanding contributions to several areas of labor economics. A first area concerns the connection between product market competition and labor market outcomes. Her Quarterly Journal of Economics (2002) article with Francis Kramarz, “Does Entry Regulation Hinder Job Creation? Evidence from the French Retail Industry,” looks at whether entry regulation in the French retail industry can explain the low rates of job creation observed in that sector over the last 25 years. Since the early 1970s, the French government has required regional zoning board approval for the creation or extension of any large retail store. Using a unique database that provides time and regional variation in boards' approval decisions, they show that this requirement created barriers to entry in the retail sector, and weakened employment growth in the retail industry.
    [Show full text]
  • Social Norms, Labor Market Opportunities, and the Marriage Gap for Skilled Women
    DISCUSSION PAPER SERIES IZA DP No. 11382 Social Norms, Labor Market Opportunities, and the Marriage Gap for Skilled Women Marianne Bertrand Patricia Cortes Claudia Olivetti Jessica Pan MARCH 2018 DISCUSSION PAPER SERIES IZA DP No. 11382 Social Norms, Labor Market Opportunities, and the Marriage Gap for Skilled Women Marianne Bertrand University of Chicago and IZA Patricia Cortes Boston University Claudia Olivetti Boston College Jessica Pan National University of Singapore and IZA MARCH 2018 Any opinions expressed in this paper are those of the author(s) and not those of IZA. Research published in this series may include views on policy, but IZA takes no institutional policy positions. The IZA research network is committed to the IZA Guiding Principles of Research Integrity. The IZA Institute of Labor Economics is an independent economic research institute that conducts research in labor economics and offers evidence-based policy advice on labor market issues. Supported by the Deutsche Post Foundation, IZA runs the world’s largest network of economists, whose research aims to provide answers to the global labor market challenges of our time. Our key objective is to build bridges between academic research, policymakers and society. IZA Discussion Papers often represent preliminary work and are circulated to encourage discussion. Citation of such a paper should account for its provisional character. A revised version may be available directly from the author. IZA – Institute of Labor Economics Schaumburg-Lippe-Straße 5–9 Phone: +49-228-3894-0 53113 Bonn, Germany Email: [email protected] www.iza.org IZA DP No. 11382 MARCH 2018 ABSTRACT Social Norms, Labor Market Opportunities, and the Marriage Gap for Skilled Women* In most of the developed world, skilled women marry at a lower rate than unskilled women.
    [Show full text]
  • Behavioral Economics and Marketing in Aid of Decision Making Among the Poor
    Behavioral Economics and Marketing in Aid of Decision Making Among the Poor The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters Citation Bertrand, Marianne, Sendhil Mullainathan, and Eldar Shafir. 2006. Behavioral economics and marketing in aid of decision making among the poor. Journal of Public Policy and Marketing 25(1): 8-23. Published Version http://dx.doi.org/10.1509/jppm.25.1.8 Citable link http://nrs.harvard.edu/urn-3:HUL.InstRepos:2962609 Terms of Use This article was downloaded from Harvard University’s DASH repository, and is made available under the terms and conditions applicable to Other Posted Material, as set forth at http:// nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of- use#LAA Behavioral Economics and Marketing in Aid of Decision Making Among the Poor Marianne Bertrand, Sendhil Mullainathan, and Eldar Shafir This article considers several aspects of the economic decision making of the poor from the perspective of behavioral economics, and it focuses on potential contributions from marketing. Among other things, the authors consider some relevant facets of the social and institutional environments in which the poor interact, and they review some behavioral patterns that are likely to arise in these contexts. A behaviorally more informed perspective can help make sense of what might otherwise be considered “puzzles” in the economic comportment of the poor. A behavioral analysis suggests that substantial welfare changes could result from relatively minor policy interventions, and insightful marketing may provide much needed help in the design of such interventions.
    [Show full text]
  • Preschool Television Viewing and Adolescent Test Scores: Historical Evidence from the Coleman Study
    PRESCHOOL TELEVISION VIEWING AND ADOLESCENT TEST SCORES: HISTORICAL EVIDENCE FROM THE COLEMAN STUDY MATTHEW GENTZKOW AND JESSE M. SHAPIRO We use heterogeneity in the timing of television’s introduction to different local markets to identify the effect of preschool television exposure on standardized test scores during adolescence. Our preferred point estimate indicates that an additional year of preschool television exposure raises average adolescent test scores by about 0.02 standard deviations. We are able to reject negative effects larger than about 0.03 standard deviations per year of television exposure. For reading and general knowledge scores, the positive effects we find are marginally statistically significant, and these effects are largest for children from households where English is not the primary language, for children whose mothers have less than a high school education, and for nonwhite children. I. INTRODUCTION Television has attracted young viewers since broadcasting be- gan in the 1940s. Concerns about its effects on the cognitive devel- opment of young children emerged almost immediately and have been fueled by academic research showing a negative association between early-childhood television viewing and later academic achievement.1 These findings have contributed to a belief among the vast majority of pediatricians that television has “negative effects on brain development” of children below age five (Gentile et al. 2004). They have also provided partial motivation for re- cent recommendations that preschool children’s television view- ing time be severely restricted (American Academy of Pediatrics 2001). According to a widely cited report on media use by young * We are grateful to Dominic Brewer, John Collins, Ronald Ehrenberg, Eric Hanushek, and Mary Morris (at ICPSR) for assistance with Coleman study data, and to Christopher Berry for supplying data on school quality.
    [Show full text]
  • Field Experiments in Development Economics1 Esther Duflo Massachusetts Institute of Technology
    Field Experiments in Development Economics1 Esther Duflo Massachusetts Institute of Technology (Department of Economics and Abdul Latif Jameel Poverty Action Lab) BREAD, CEPR, NBER January 2006 Prepared for the World Congress of the Econometric Society Abstract There is a long tradition in development economics of collecting original data to test specific hypotheses. Over the last 10 years, this tradition has merged with an expertise in setting up randomized field experiments, resulting in an increasingly large number of studies where an original experiment has been set up to test economic theories and hypotheses. This paper extracts some substantive and methodological lessons from such studies in three domains: incentives, social learning, and time-inconsistent preferences. The paper argues that we need both to continue testing existing theories and to start thinking of how the theories may be adapted to make sense of the field experiment results, many of which are starting to challenge them. This new framework could then guide a new round of experiments. 1 I would like to thank Richard Blundell, Joshua Angrist, Orazio Attanasio, Abhijit Banerjee, Tim Besley, Michael Kremer, Sendhil Mullainathan and Rohini Pande for comments on this paper and/or having been instrumental in shaping my views on these issues. I thank Neel Mukherjee and Kudzai Takavarasha for carefully reading and editing a previous draft. 1 There is a long tradition in development economics of collecting original data in order to test a specific economic hypothesis or to study a particular setting or institution. This is perhaps due to a conjunction of the lack of readily available high-quality, large-scale data sets commonly available in industrialized countries and the low cost of data collection in developing countries, though development economists also like to think that it has something to do with the mindset of many of them.
    [Show full text]
  • Massachusetts Institute of Technology (MIT)
    FRANCISCO A. GALLEGO Department of Economics, Pontificia Universidad Catolica de Chile Vicuna Mackenna 4860, Macul, Santiago, Chile Phone: 56-2-354-4321, Fax: 56-2-553-2377, Email: [email protected] Web: http://economia.uc.cl/profesor/francisco-gallego/ DATE OF BIRTH: April 21, 1974 CITIZENSHIP: Chile ACADEMIC POSITIONS: 2011-present: Associate Professor of Economics, Department of Economics, Pontificia Universidad Catolica de Chile 2009-present, Scientific Director and Affiliated Professor, Latin American Office, Abdul Latif Jameel Poverty Action Lab (J-PAL). 2008-present, Research Affiliate, Economic History and Cliometrics Laboratory (EH-Clio Lab), Pontificia Universidad Catolica de Chile OTHER POSITIONS: 2017, Visiting Associate Professor, Woodrow School of Public Policy, and Visiting Associate Research Scholar, Department of Economics, Princeton University. 2007-present, Part-Time Lecturer, MBA program, Pontificia Universidad Catolica de Chile. 2006-2011, Assistant Professor of Economics, Department of Economics, Pontificia Universidad Catolica de Chile 2004-2006, Teaching Assistant, Department of Economics, Massachusetts Institute of Technology (MIT). 2002-2006, Research Assistant to Prof. Daron Acemoglu, Josh Angrist and Ricardo Caballero, Massachusetts Institute of Technology (MIT). 1999-2002, Part-Time Lecturer, Department of Economics, Universidad Alberto Hurtado. 1998-2002, Research Economist, Research Department, Central Bank of Chile. 1997-2001, Part-Time Lecturer, Department of Economics, Pontificia Universidad Catolica de Chile 1993-1998, Research and Teaching Assistant, Department of Economics, Pontificia Universidad Catolica de Chile EDUCATION: B.A. in Economics (highest honors), Pontificia Universidad Católica de Chile, 1997 B.A. in Business, Pontificia Universidad Católica de Chile, 1997 M.A. in Economics (highest honors), Pontificia Universidad Católica de Chile, 2001 Ph.D.
    [Show full text]
  • On Boundaries Between Field Experiment, Action Research and Design Research
    Pertti Järvinen On boundaries between field experiment, action research and design research UNIVERSITY OF TAMPERE SCHOOL OF INFORMATION SCIENCES REPORTS IN INFORMATION SCIENCES 14 TAMPERE 2012 UNIVERSITY OF TAMPERE SCHOOL OF INFORMATION SCIENCES REPORTS IN INFORMATION SCIENCES 14 JUNE 2012 Pertti Järvinen On boundaries between field experiment, action research and design research SCHOOL OF INFORMATION SCIENCES FIN‐33014 UNIVERSITY OF TAMPERE ISBN 978‐951‐44‐8883‐2 ISSN‐L 1799‐8158 ISSN 1799‐8158 On boundaries between field experiment, action research and design research Pertti Järvinen School of Information Sciences University of Tampere Abstract The practice-science gap is often emphasized during the last years. It has also had such a form as competition between relevance and rigor, although both must be taken care. The three research methods (field experiment, action research and design research) are sometimes recommended to be used interchangeable. But we shall show they are quite different. We try to analyze and describe their boundaries and division of labor between practitioners and researchers. We shall also correct some long-lasting misconceptions and propose some further research topic. Introduction Mathiassen and Nielsen (2008) studied the articles published in the Scandinavian Journal of Information Systems during 20 years and found that empirical articles have a great share of the all the published articles. Majority of the authors are from the Scandinavian countries. This seems to show that practice is much appreciated among the Scandinavian researchers and practical emphasis is characteristic in the Scandinavian research culture. We shall in this paper consider three empirical research methods (field experiment, action research and design research).
    [Show full text]
  • Field Experiments: a Bridge Between Lab and Naturally-Occurring Data
    NBER WORKING PAPER SERIES FIELD EXPERIMENTS: A BRIDGE BETWEEN LAB AND NATURALLY-OCCURRING DATA John A. List Working Paper 12992 http://www.nber.org/papers/w12992 NATIONAL BUREAU OF ECONOMIC RESEARCH 1050 Massachusetts Avenue Cambridge, MA 02138 March 2007 *This study is based on plenary talks at the 2005 International Meetings of the Economic Science Association, the 2006 Canadian Economic Association, and the 2006 Australian Econometric Association meetings. The paper is written as an introduction to the BE-JEAP special issue on Field Experiments that I have edited; thus my focus is on the areas to which these studies contribute. Some of the arguments parallel those contained in my previous work, most notably the working paper version of Levitt and List (2006) and Harrison and List (2004). Don Fullerton, Dean Karlan, Charles Manski, and an anonymous reporter provided remarks that improved the study. The views expressed herein are those of the author(s) and do not necessarily reflect the views of the National Bureau of Economic Research. © 2007 by John A. List. All rights reserved. Short sections of text, not to exceed two paragraphs, may be quoted without explicit permission provided that full credit, including © notice, is given to the source. Field Experiments: A Bridge Between Lab and Naturally-Occurring Data John A. List NBER Working Paper No. 12992 March 2007 JEL No. C9,C90,C91,C92,C93,D01,H41,Q5,Q51 ABSTRACT Laboratory experiments have been used extensively in economics in the past several decades to lend both positive and normative insights into a myriad of important economic issues.
    [Show full text]
  • Zbwleibniz-Informationszentrum
    A Service of Leibniz-Informationszentrum econstor Wirtschaft Leibniz Information Centre Make Your Publications Visible. zbw for Economics Bertrand, Marianne Article Economic consequences of gender identity NBER Reporter Provided in Cooperation with: National Bureau of Economic Research (NBER), Cambridge, Mass. Suggested Citation: Bertrand, Marianne (2014) : Economic consequences of gender identity, NBER Reporter, National Bureau of Economic Research (NBER), Cambridge, MA, Iss. 2, pp. 14-17 This Version is available at: http://hdl.handle.net/10419/103260 Standard-Nutzungsbedingungen: Terms of use: Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Documents in EconStor may be saved and copied for your Zwecken und zum Privatgebrauch gespeichert und kopiert werden. personal and scholarly purposes. Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle You are not to copy documents for public or commercial Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich purposes, to exhibit the documents publicly, to make them machen, vertreiben oder anderweitig nutzen. publicly available on the internet, or to distribute or otherwise use the documents in public. Sofern die Verfasser die Dokumente unter Open-Content-Lizenzen (insbesondere CC-Lizenzen) zur Verfügung gestellt haben sollten, If the documents have been made available under an Open gelten abweichend von diesen Nutzungsbedingungen die in der dort Content Licence (especially Creative Commons Licences), you genannten Lizenz gewährten Nutzungsrechte. may exercise further usage rights as specified in the indicated licence. www.econstor.eu overlooked in research on trade because include G. J. Borjas and V. A. Ramey, (3) (2013), pp. 220–5; and “Untangling of a focus on wages as the sole channel “Foreign Competition, Market Power, Trade and Technology: Evidence from of trade adjustment.
    [Show full text]
  • Microeconomics Conference Participant Biographies
    Second Annual Federal Trade Commission & Northwestern University Microeconomics Conference Sponsored by: FTC Bureau of Economics Northwestern University Searle Center on Law, Regulation and Economic Growth Northwestern University Center for the Study of Industrial Organization November 19-20, 2009 FTC Conference Center 601 New Jersey Ave., NW Washington, D.C. 20001 Participant Biographies Christopher Adams, Federal Trade Commission Christopher Adams is a staff economist with the Federal Trade Commission. He has a Ph.D. in Economics from the University of Wisconsin. At the FTC, Chris has worked on mergers and antitrust cases in a number of industries including pharmaceuticals, real estate, software and retail. He has organized a number of conferences including FTC conferences on the pharmaceutical industry, online auctions, and the grocery industry. Recently, he was one of the local organizers for the 2008 International Industrial Organization Conference and a co-organizer of the annual FTC-NU Microeconomics Conference held in November. Before joining in the FTC he taught at the University of Vermont. His publications include “Estimating the Cost of New Drug Development: Is it really $800m?” in Health Affairs, “Estimating Demand from eBay Prices” in International Journal of Industrial Organization and “Optimal Team Incentives with CES Production” in Economics Letters. His current research interests include estimating incentives for pharmaceutical R&D, empirical industrial organization, estimating demand from online-auction data, information
    [Show full text]
  • Power(Ful) Guidelines for Experimental Economists
    Power(ful) Guidelines for Experimental Economists Kathryn N. Vasilaky and J. Michelle Brock Abstract Statistical power is an important detail to consider in the design phase of any experi- ment. This note serves as a reference for experimental economists on power calculations. We synthesize many of the questions and issues frequently brought up regarding power calculations and the literature that surrounds that. We provide practical coded exam- ples and tools available for calculating power, and suggest when and how to report power calculations in published studies. Keywords: statistical power, experiments, design, significance. JEL Classification: C9. Contact details: J. Michelle Brock, Principal Economist, One Exchange Square, London, EC2A 2JN, UK Phone: +44 20 7338 7193; email: [email protected]. Kathryn N. Vasilaky is an Assistant Professor at California Polytechnic University and Research Affiliate at the Columbia University International Research Institute for Climate and Society. J. Michelle Brock is a Principal Economist at the EBRD and a Research Affiliate at the Centre for Economic Policy Research (CEPR). Thanks to contributions from the ESA discussion forum. The working paper series has been produced to stimulate debate on the economic transition and develop- ment. Views presented are those of the authors and not necessarily of the EBRD. Working Paper No. 239 Prepared in December 2019 Power(ful) Guidelines for Experimental Economists ∗ Kathryn N Vasilaky y J Michelle Brock z December 19, 2019 Abstract Statistical power is an important detail to consider in the design phase of any experiment. This note serves as a reference on power calculations for experimental economists. We syn- thesize many of the questions and issues frequently brought up regarding power calculations and the literature that surrounds that.
    [Show full text]