DOCSLIB.ORG

Brady and Collier, Rethinking Social Inquiry

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Brady and Collier, Rethinking Social Inquiry Rethinking Social Inquiry ................. 17811$ $$FM 06-28-10 14:26:41 PS PAGE i ................. 17811$ $$FM 06-28-10 14:26:41 PS PAGE ii Rethinking Social Inquiry Diverse Tools, Shared Standards Second Edition Edited by Henry E. Brady and David Collier ROWMAN & LITTLEFIELD PUBLISHERS, INC. Lanham • Boulder • New York • Toronto • Plymouth, UK ................. 17811$ $$FM 06-28-10 14:26:42 PS PAGE iii Published by Rowman & Littlefield Publishers, Inc. A wholly owned subsidiary of The Rowman & Littlefield Publishing Group, Inc. 4501 Forbes Boulevard, Suite 200, Lanham, Maryland 20706 http://www.rowmanlittlefield.com Estover Road, Plymouth PL6 7PY, United Kingdom Copyright ᭧ 2010 by Rowman & Littlefield Publishers, Inc. Chapters 6–9 from the previous edition are available as downloadable files from the Rowman & Littlefield website. For more information about these chapters and to obtain the required username and password visit http://www.rowmanlittlefield .com/RL/books/RSI2e/ or e-mail [email protected]. All rights reserved. No part of this book may be reproduced in any form or by any electronic or mechanical means, including information storage and retrieval systems, without written permission from the publisher, except by a reviewer who may quote passages in a review. British Library Cataloguing in Publication Information Available Library of Congress Cataloging-in-Publication Data Rethinking social inquiry : diverse tools, shared standards / edited by Henry E. Brady and David Collier.—2nd ed. p. cm. Includes bibliographical references and index. ISBN 978-1-4422-0343-3 (cloth : alk. paper) ISBN 978-1-4422-0344-0 (pbk. : alk. paper) 1. Social sciences—Research. 2. Social sciences—Methodology. I. Brady, Henry E. II. Collier, David. H62.R4646 2010 300.72—dc22 2010022477 ⅜ϱ ீThe paper used in this publication meets the minimum requirements of American National Standard for Information Sciences—Permanence of Paper for Printed Library Materials, ANSI/NISO Z39.48-1992. Printed in the United States of America ................. 17811$ $$FM 06-28-10 14:26:42 PS PAGE iv To the memory of David A. Freedman Brilliant statistician, Guardian against precarious statistical models, Champion of joining quantitative and qualitative analysis, Friend of remarkable wit and generosity And indeed, social science methodology is now catching up with him ................. 17811$ $$FM 06-28-10 14:26:42 PS PAGE v ................. 17811$ $$FM 06-28-10 14:26:43 PS PAGE vi Contents List of Figures and Tables xi Preface to the Second Edition xiii Preface to the First Edition xv Introduction to the Second Edition: A Sea Change in Political Methodology 1 David Collier, Henry E. Brady, and Jason Seawright Part I. A Debate on Methodology 11 A. Framing the Debate 13 1. Refocusing the Discussion of Methodology 15 Henry E. Brady, David Collier, and Jason Seawright 2. The Quest for Standards: King, Keohane, and Verba’s Designing Social Inquiry 33 David Collier, Jason Seawright, and Gerardo L. Munck B. Critiques of the Quantitative Template 65 3. Doing Good and Doing Better: How Far Does the Quantitative Template Get Us? 67 Henry E. Brady 4. Some Unfulfilled Promises of Quantitative Imperialism 83 Larry M. Bartels vii ................. 17811$ CNTS 06-28-10 14:26:45 PS PAGE vii viii Contents 5. How Inference in the Social (but Not the Physical) Sciences Neglects Theoretical Anomaly 89 Ronald Rogowski C. Linking the Quantitative and Qualitative Traditions 99 6. Bridging the Quantitative-Qualitative Divide 101 Sidney Tarrow 7. The Importance of Research Design 111 Gary King, Robert O. Keohane, and Sidney Verba D. Diverse Tools, Shared Standards 123 8. Critiques, Responses, and Trade-Offs: Drawing Together the Debate 135 David Collier, Henry E. Brady, and Jason Seawright 9. Sources of Leverage in Causal Inference: Toward an Alternative View of Methodology 161 David Collier, Henry E. Brady, and Jason Seawright Part II. Causal Inference: Old Dilemmas, New Tools 201 Introduction to Part II David Collier, Henry E. Brady, and Jason Seawright E. Qualitative Tools for Causal Inference 205 10. Process Tracing and Causal Inference 207 Andrew Bennett 11. On Types of Scientific Inquiry: The Role of Qualitative Reasoning 221 David A. Freedman 12. Data-Set Observations versus Causal-Process Observations: The 2000 U.S. Presidential Election 237 Henry E. Brady Addendum: Teaching Process Tracing 243 David Collier F. Quantitative Tools for Causal Inference 245 13. Regression-Based Inference: A Case Study in Failed Causal Assessment 247 Jason Seawright ................. 17811$ CNTS 06-28-10 14:26:45 PS PAGE viii Contents ix 14. Design-Based Inference: Beyond the Pitfalls of Regression Analysis? 273 Thad Dunning Glossary 313 Jason Seawright and David Collier Bibliography 361 Acknowledgment of Permission to Reprint Copyrighted Material 387 Subject Index 389 Name Index 397 About the Contributors 405 ................. 17811$ CNTS 06-28-10 14:26:45 PS PAGE ix ................. 17811$ CNTS 06-28-10 14:26:46 PS PAGE x Figures and Tables FIGURES 2.1 Steps in the Research Cycle: A Framework for Summarizing Designing Social Inquiry 50 8.1 Evaluating Necessary and/or Sufficient Causes 147 13.1 Mean Growth Rates by Level of Democracy 252 13.2 Stable Empirical Results Are Compatible with Three Alternative Causal Models 257 14.1 Plausibility of As-If Random Assignment 292 14.2 Credibility of Statistical Models 296 14.3 Substantive Relevance of Intervention 301 14.4 Typology of Natural Experiments 305 TABLES 2.1 Quantitative Tools Employed in Designing Social Inquiry 39 2.2 Anticipating the Debate on Designing Social Inquiry 58 6.1 Tools for Bridging the Qualitative-Quantitative Divide 104 9.1 Four Approaches to the Qualitative-Quantitative Distinction 179 9.2 Data-Set Observation versus Causal-Process Observation 185 9.3 Adding Different Forms of Data: Consequences for Causal Inference 192 10.1 Process Tracing: Four Tests for Causation 210 13.1 Economic Growth Regressed on Democracy and Lagged Income Level 253 xi ................. 17811$ FIGS 06-28-10 14:26:49 PS PAGE xi xii Figures and Tables 13.2 Economic Growth Regressed on Democracy, Lagged Income Level, and Primary Educational Attainment 255 13.3 Alternative Combinations of Control Variables 260 14.1 Examples of Natural Experiments, Including Regression Discontinuity (RD) and Instrumental Variable (IV) Designs 282 ................. 17811$ FIGS 06-28-10 14:26:49 PS PAGE xii Preface to the Second Edition Rethinking Social Inquiry seeks to redirect ongoing discussions of methodol- ogy in political and social science. This Preface presents our two goals in launching a second edition. The first goal (a central focus of Part I) is to sustain the debate with King, Keohane, and Verba’s (KKV)1 Designing Social Inquiry. Nine chapters from the first edition are included here to continue this exchange. Although published more than 15 years ago, KKV remains a fundamental point of reference in political science methodology and in controversies on methods—as we dis- cuss in the Introduction to the Second Edition. Through articulating the approach we call ‘‘mainstream quantitative methods,’’ KKV has wide impor- tance in the political science discipline—and, correspondingly, in graduate student training. While we admire aspects of the book’s contribution, our strong dissent from many of the arguments remains highly salient today. KKV has played a key role in narrowing attention to a particular set of quantitative tools, and the methodological horizon of political science has been shortened by the book’s continuing influence. Sustaining this debate in 2010 therefore remainsasnecessaryasitwaswhenourfirsteditionappearedin2004. The second goal is to open new avenues of discussion in methodology, both qualitative and quantitative. A number of chapters from the first edi- tion—in particular chapters 8 and 9—explore these wider themes. In addi- tion, a new set of chapters has been incorporated as Part II of the second edition. These chapters offer an innovative view of the crucial qualitative tools of process tracing and causal process observations, as well as an extended new discussion of the weaknesses and strengths of regression analysis and other quantitative tools. 1. To avoid personalizing the debate, we previously adopted the abbreviation DSI in referring to the book. However, the abbreviation KKV is now ubiquitous, and we have deferred to standard usage. In the present edition, DSI has been replaced by KKV. xiii ................. 17811$ PREF 06-28-10 14:26:51 PS PAGE xiii xiv Preface to the Second Edition A detailed overview of the new chapters is provided in the Introduction to Part II below. A central theme of these chapters is the importance of methodological pluralism and the value of multi-method research. Quali- tative analysis is strengthened when used in conjunction with quantitative research; and quantitative analysis, in turn, contributes more if it is built on a foundation of qualitative analysis and insight. Two distinctive features of the second edition must be underscored. The first is the online placement, on the Rowman & Littlefield website, of four chapters from the first edition that are not included here. The online chap- ters are part of the original debate with KKV, and they also extend the dis- cussion well beyond that debate.2 Thus, we are able to retain all the original chapters and accommodate the new chapters in Part II, with little change in the overall length of the printed book. These chapters are accessible by following the instructions on the copyright page of this volume. Second, with the goal of advancing the understanding of process tracing and improving the teaching of this method, the online resources include a set of exercises. These challenge readers to push further in examining the case study evidence provided in the chapters by Bennett, Freedman, and Brady. The exercises also focus on additional readings, including the Sher- lock Holmes story ‘‘The Adventure of Silver Blaze,’’ an excellent illustration of process tracing. We are grateful for the extensive help we have received in preparing the second edition.
Load more

Recommended publications
  • A Tale of Two Cultures: Contrasting Quantitative and Qualitative Research
    Advance Access publication June 13, 2006 Political Analysis (2006) 14:227–249 doi:10.1093/pan/mpj017 A Tale of Two Cultures: Contrasting Quantitative and Qualitative Research James Mahoney Departments of Political Science and Sociology, Northwestern University, Evanston, IL 60208-1006 e-mail: [email protected] (corresponding author) Gary Goertz Department of Political Science, University of Arizona, Tucson, AZ 85721 e-mail: [email protected] The quantitative and qualitative research traditions can be thought of as distinct cultures marked by different values, beliefs, and norms. In this essay, we adopt this metaphor toward the end of contrasting these research traditions across 10 areas: (1) approaches to expla- nation, (2) conceptions of causation, (3) multivariate explanations, (4) equifinality, (5) scope and causal generalization, (6) case selection, (7) weighting observations, (8) substantively important cases, (9) lack of fit, and (10) concepts and measurement. We suggest that an appreciation of the alternative assumptions and goals of the traditions can help scholars avoid misunderstandings and contribute to more productive ‘‘cross-cultural’’ communica- tion in political science. Introduction Comparisons of the quantitative and qualitative research traditions sometimes call to mind religious metaphors. In his commentary for this issue, for example, Beck (2006) likens the traditions to the worship of alternative gods. Schrodt (2006), inspired by Brady’s (2004b, 53) prior casting of the controversy in terms of theology versus homiletics, is more explicit: ‘‘while this debate is not in any sense about religion, its dynamics are best understood as though it were about religion. We have always known that, it just needed to be said.’’ We prefer to think of the two traditions as alternative cultures.
    [Show full text]
  • Research Design Skopje 6-7 November 2008
    Research Design Skopje 6-7 November 2008 Daniel Bochsler and Lucas Leemann Center for Comparative and International Studies, University of Zurich [email protected]; [email protected] Introduction The goal of this workshop session is to review the current literature on issues of research design in social sciences and to allow the participants to improve on their skills in designing research. The workshop starts off with a short review of some basic principles of scientific research, before turning to two of the main goals of scientific work, namely descriptive and causal inferences. In a second part different research designs are discussed, relying on the basic distinction between experimental and quasi-experimental work. Given that despite the important forays in experimental studies in the social sciences (see Druckman, Green, Kuklinski and Lupia, 2006) quasi- experimental designs will be discussed in more detail. Special emphasis will be put on the dangers to our inferences in such quasi-experimental designs. The third part will consist of a discussion of a few chosen research designs to highlight their strengths and weaknesses. Finally, based on the participants own experience, in a short training session they will have to sketch possible research designs for chosen research questions. Plan, readings and literature Most of the literature on which this workshop will rely comes from King, Keohane and Verba (1994), a book that, from a very specific perspective, highlights the similarities between quantitative and qualitative approaches. Needless to say, this book has attracted a series of critiques (e.g., Caporaso, 1995; Collier, 1995; Rogowski, 1995; Tarrow, 1995; Brady and Collier, 2004).
    [Show full text]
  • "A Sea Change in Political Methodology." in Rethinking Social
    Introduction to Rethinking Social Inquiry, 2 edn., Henry E. Brady, and David Collier, ed. (Rowman and Littlefield, 2010). A Sea Change in Political Methodology David Collier, Henry E. Brady, and Jason Seawright We begin with rival claims about the ''science'' in social science. In our view, juxtaposing these claims brings into focus a sea change in political science methodology. King, Keohane, and Verba's (KKV) 1994 book, Designing Social Inquiry, proposes a bold methodological agenda for researchers who work in the qualitative tradition. The book's subtitle directly summarizes the agenda: ''scientific inference in qualitative research'' (italics added). To its credit, the book is explicit in its definition of science. It draws on what we and many others have viewed as a ''quantitative template,'' which serves as the foun- dation for the desired scientific form of qualitative methods. In KKV's view, standard research procedures of qualitative analysis are routinely problem- atic, and ideas drawn from conventional quantitative methods are offered as guideposts to help qualitative researchers be scientific. 1. For our own work, we share Freedman's view of plurality in scientific methods, and we recognize social versus natural science as partially different enterprises. Yet the two can and should strive for careful formulation of hypotheses, intersubjec- tive agreement on the facts being analyzed, precise use of data, and good research design. With this big-tent understanding of science, we are happy to be included in the tent. 2. As explained above in the preface, in the second edition we use the abbreviation KKV to refer to the book, rather than DSI, as in the first edition.
    [Show full text]
  • Introduction to the Second Edition
    UC Berkeley UC Berkeley Previously Published Works Title A Sea of Change in Political Methodology? Permalink https://escholarship.org/uc/item/8gq6g191 Journal Qualitative and Multi-Method Research, 9(1) Authors Collier, David Brady, Henry E Seawright, Jason Publication Date 2011-04-01 Peer reviewed eScholarship.org Powered by the California Digital Library University of California Qualitative and Multi-Method Research. Newsletter of the American Political Science Association Organized Section. 9, No. 1 (Spring 2011, forthcoming). A Sea Change in Political Methodology1 David Collier University of California, Berkeley [email protected] Henry E. Brady University of California, Berkeley [email protected] Jason Seawright Northwestern University [email protected] Shifting debates on what constitutes “science” reveal competing claims about methodology.2 Of course, in its origin the term “science” means “knowledge,” and researchers obviously hold a wide spectrum of positions on how to produce viable knowledge. Within this spectrum, we compare two alternative meanings of science, advanced by scholars who seek to legitimate sharply contrasting views of qualitative methods. This comparison points to a sea change in political science methodology.3 1 This article draws on the Introductions to Parts I and II of Brady and Collier, Rethinking Social Inquiry: Diverse Tools, Shared Standards, 2nd edn. (Lanham, MD.: Rowman & Littlefield, 2010). 2 Morgan (1996) provides a broad overview of rival views of science, encompassing the natural,
    [Show full text]
  • Gary King, Robert O. Keohane, Sidney Verba Designing Social Inquiry
    Designing Social Inquiry Designing Social Inquiry SCIENTIFIC INFERENCE IN QUALITATIVE RESEARCH Gary King Robert O. Keohane Sidney Verba PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Copyright 1994 by Princeton University Press Published by Princeton University Press, 41 William Street, Princeton, New Jersey 08540 In The United Kingdom: Princeton University Press, Chichester, West Sussex All Rights Reserved Library of Congress Cataloging-in-Publication Data King, Gary. Designing social inquiry : scientific inference in qualitiative research / Gary King, Robert O. Keohane, Sidney Verba. p. cm. Includes bibliographical references and index ISBN 0-691-03470-2 (cloth : alk. paper) ISBN 0-691-03471-0 (pbk. : alk. paper) 1. Social sciences—Methodology. 2. Social sciences— Research. 3. Inference I. Keohane, Robert Owen. II. Verba, Sidney. III. Title. H61.K5437 1994 93-39283 300′.72—dc20 CIP This book has been composed in Adobe Palatino Princeton University Press books are printed on acid-free paper and meet the guidelines for permanence and durability of the Committee on Production Guidelines for Book Longevity of the Council on Library Resources Printed in the United States of America 109876543 Third printing, with corrections and expanded index, 1995 Contents Preface ix 1 The Science in Social Science 3 1.1 Introduction 3 1.1.1 Two Styles of Research, One Logic of Inference 3 1.1.2 Defining Scientific Research in Social Sciences 7 1.1.3 Science and Complexity 9 1.2 Major Components of Research Design 12 1.2.1 Improving Research Questions
    [Show full text]
  • POL 415: Political Science Junior Seminar Syllabus Updated 2015-01-25; Total Pages: 944 Prof. Alex Montgomery [email protected] (503) 517-7395
    POL 415: Political Science Junior Seminar Syllabus updated 2015-01-25; Total Pages: 944 Prof. Alex Montgomery [email protected] (503) 517-7395 Class Office M 6:10-7:30 Tu 2:00-5:00 or by appointment Vollum 110 Vollum 241 https://moodle.reed.edu/course/view.php?id=2662 http://alexmontgomery.com Course Description and Goals Half-credit course for one semester. This course is intended for second semester juniors in political science. The course prepares students to complete the initial steps required for a year-long project: asking a research question, reviewing prior literature on the subject, and proposing a research design. Conference. The schedule of the course mirrors closely the political science junior qualifying examination. The materials covered in this course are independent of the qual, and none of your qual work will be used to satisfy the requirements for this course. However, the tools and techniques that you will learn in this course should help you complete the qual and prepare you for your senior thesis. The course focuses on the tools and techniques of political science research. We will review many of the major research approaches in political science, particularly those reflecting the main areas of scholarship covered by faculty at Reed College. Much of the work in the class will involve reading, analyzing, and critiquing existing political science research with an eye to identifying the questions asked, methodology chosen, and how answers were reached. Finally, there is an important and enjoyable team-building exercise to this class: comparative cooking! Each week, the department will support a student or set of students who will cook for the class.
    [Show full text]
  • Workshop on Interdisciplinary Standards for Systematic Qualitative Research
    Workshop on Interdisciplinary Standards for Systematic Qualitative Research Cultural Anthropology, Law and Social Science, Political Science, and Sociology Programs National Science Foundation Supported Workshop Report prepared by: Michèle Lamont Harvard University Patricia White National Science Foundation Acknowledgements We wish to thank James Granato, former NSF Political Science Program Director, Joane Nagel, former NSF Sociology Program Director, Stuart Plattner, former NSF Cultural Anthropology Program Director, and Christopher Zorn, former NSF Law and Social Science Program Director, for their help in planning and participation in the workshop, Karen Duke and Michelle Jenkins, NSF Social and Political Sciences Cluster staff members, for their administrative and technical support, Lauren Rivera and Sabrina Pendergrass, graduate assistants for their work with Professor Lamont on workshop and report preparations at Harvard University, Joane Nagel and Kristin Luker, Professor of Sociology and Jurisprudence and Social Policy, University of California, Berkeley for their thoughtful comments on the draft report, and the 23 workshop participants who took on the enormous task of representing their respective disciplines at the workshop through the submission and presentations of short papers prior to the workshop and comment and recommendations during and after the meeting. We also thank the 2007 graduate student cohort of the Department of Sociology at Harvard University and Camonia Long, Howard University graduate student, for their reactions to the report. Workshop Participants & Attendees Michèle Lamont, Harvard University, Jody Miller, University of Missouri, St. Louis Workshop Organizer Joane Nagel, University of Kansas Andrew Bennett, Georgetown University Beth Rubin, University of North Ted Bestor, Harvard University Carolina-Charlotte Kathleen Blee, University of Pittsburgh Gery Ryan, Rand Corporation Don Brenneis, University of California, Susan Silbey, Massachusetts Institute of Santa Cruz Technology John Bowen, Washington University in St.
    [Show full text]
  • Claiming Too Much: Warnings About Selection Bias
    CHAPTER 1 Claiming Too Much: Warnings about Selection Bias David Collier, James Mahoney, and Jason Seawright How well do the tools and insights of mainstream quantitative methods1 serve as a template for qualitative analysis? The present chapter addresses this question by evaluating forceful warnings about selection bias that have been offered, from a quantitative perspective, to qualitative researchers. Specifically, we discuss warnings about bias in studies that deliberately focus on cases with extreme values on the dependent variable. Assessing these warnings provides an opportunity to examine the leverage gained, as well as the pitfalls encountered, in applying insights about quantitative methods to qualitative investigation. Within the quantitative tradition, selection bias is recognized as a challenging problem of inference. James Heckman’s (1976, 1979) widely known research on this topic, and his Nobel Prize in economics for this work, underscore the Mark I. Lichbach provided insightful suggestions about the version of this material earlier published in the American Political Science Review. 1Mainstream quantitative methods are understood here as strongly oriented toward regression analysis, econometric refinements on regression, and the search for alternatives to regression models in contexts where specific regression assumptions are not met. 3 4 David Collier, James Mahoney, and Jason Seawright importance of selection bias.2 In light of the effort that has gone into exploring this problem, it is perhaps not surprising that selection bias is a complex issue, the nature of which is not intuitively obvious for many scholars.3 This chapter first briefly reviews these warnings about selection bias, as well as counterarguments to these warnings that have been presented by various researchers.
    [Show full text]
  • Qualitative Methods and Cross-Method Dialogue in Political Science
    Comparative Political Studies http://cps.sagepub.com Qualitative Methods and Cross-Method Dialogue in Political Science Jack S. Levy Comparative Political Studies 2007; 40; 196 DOI: 10.1177/0010414006296348 The online version of this article can be found at: http://cps.sagepub.com/cgi/content/abstract/40/2/196 Published by: http://www.sagepublications.com Additional services and information for Comparative Political Studies can be found at: Email Alerts: http://cps.sagepub.com/cgi/alerts Subscriptions: http://cps.sagepub.com/subscriptions Reprints: http://www.sagepub.com/journalsReprints.nav Permissions: http://www.sagepub.com/journalsPermissions.nav Citations (this article cites 10 articles hosted on the SAGE Journals Online and HighWire Press platforms): http://cps.sagepub.com/cgi/content/abstract/40/2/196#BIBL Downloaded from http://cps.sagepub.com at RUTGERS UNIV on January 17, 2007 © 2007 Sage Publications. All rights reserved. Not for commercial use or unauthorized distribution. Comparative Political Studies Volume 40 Number 2 February 2007 196-214 © 2007 Sage Publications Qualitative Methods and 10.1177/0010414006296348 http://cps.sagepub.com hosted at Cross-Method Dialogue http://online.sagepub.com in Political Science Jack S. Levy Rutgers University, New Brunswick, New Jersey The author accepts the basic argument that recent advances in qualitative methods have had an uneven impact on the three major empirical fields in political science. He emphasizes that scholars in all three fields have made significant contributions to qualitative methodology, but these contributions have a more profound impact on the practice of qualitative work in compar- ative and international politics than in American politics. The author argues that the differences between qualitative and quantitative or formal research are less pronounced than some would believe.
    [Show full text]
  • Chapter 1 Introduction
    © Copyright, Princeton University Press. No part of this book may be distributed, posted, or reproduced in any form by digital or mechanical means without prior written permission of the publisher. Chapter 1 Introduction In this book, we explore the relationship between the quantitative and qualitative research traditions in the social sciences, with particular emphasis on political science and sociology. We do so by identifying various ways in which the traditions differ. They contrast across numerous areas of method­ ology, ranging from type of research question, to mode of data analysis, to method of inference. We suggest that these differences are systematically and coherently related to one another such that it is meaningful to speak of distinct quantitative and qualitative research paradigms. We treat the quantitative and qualitative traditions as alternative cul­ tures. Each has its own values, beliefs, and norms. Each is associated with distinctive research procedures and practices. Communication within a given culture tends to be fluid and productive. Communication across cultures, however, tends to be difficult and marked by misunderstanding. When scholars from one tradition offer their insights to members of the other tradition, the advice is often viewed as unhelpful and inappropriate. The dissonance between the alternative cultures is seen with the miscom­ munication, skepticism, and frustration that sometimes mark encounters between quantitative and qualitative researchers. At its core, we suggest, the quantitative–qualitative disputation in the social sciences is really a clash of cultures. Like all cultures, the quantitative and qualitative ones are not mono­ lithic blocks (see Sewell (2005) for a good discussion of the concept of “culture”).
    [Show full text]
  • The Promising Integration of Qualitative Methods and Field Experiments
    The Promising Integration of Qualitative Methods and Field Experiments Elizabeth Levy Paluck Princeton University In press, Annals of the American Academy for Political and Social Science The author gratefully acknowledges Lee Ann Fuji, John Gerring, Donald P. Green, Jessica Greenberg, Peter John, and Christopher Muller for helpful conversations and feedback. WORD COUNT: 5,002 KEYWORDS: Field experimentation, qualitative methods, experimental ethnography, interpretive methods, archival methods. 2 Abstract Randomized field experiments should take a more central place in qualitative research. Although field experimentation is often considered a quantitative enterprise, this paper illustrates the compatibility of field experimentation with various types of qualitative measurement tools and research questions. Integrating qualitative and quantitative data within field experiments allows investigators to move past simple average treatment effects and explore mechanisms of the identified causal effect. A more novel proposal is to use field experimentation as the organizing methodological framework for archival, ethnographic, or interpretive work, and to use ethnographic methods as the primary source of measurement in “experimental ethnography.” Sustained research and theoretical specificity can address some of the seemingly incompatible features of qualitative and field experimental methods. For example, small sample sizes are acceptable as part of a research program, and some theories of historical patterns or rare events could be disaggregated into smaller cause and effect linkages to test with field experiments in theoretically relevant contexts. 3 The Promising Integration of Qualitative Methods and Field Experiments Over the past few decades, a productive exchange in political science has explored the idea that qualitative research should be guided by the logic of mainstream quantitative and experimental methods (e.g., Brady and Collier 2004; Gerring and McDermott 2007; King et al.
    [Show full text]
  • Concepts and Methods in Social Inquiry
    Mi420 Concepts and Methods in Social Inquiry Methodology Institute, London School of Economics and Political Science Reading List, 2nd Term 2003 Teacher responsible: Dr Paul Mitchell, Kings Chambers 308; [email protected] Other Teachers: Dr Martin Bauer Prof George Gaskell Dr Mathew Mulford 10 Sessions: Lent term 2003 Wednesdays 14.00-16.00: Clement House, Room D1. Abstract This course focuses on qualitative research design in the social sciences. It seeks to encourage a critical attitude towards the basic assumptions that might inform research projects in the political and social sciences. The broad aims are: to investigate the possibility that social scientific research can contribute to social progress; to heighten methodological awareness in postgraduate study; and to enable students to improve their dissertations. By the end of the course participants should have obtained a clearer understanding of some central issues that are basic to the idea of a social science.By achieving a solid grasp of important methodological debates, they should be able to employ appropriate criteria in assessing the scientific merits of scholarly literature in their area of study. Students will also be facilitated in their efforts to pursue their own research in an analytically rigorous manner. The course is in two parts. Part 1 ‘Research Design and Evaluation’ addresses broad conceptual and methodological issues in the social science, including descriptive and casual inference in qualitative research, hypothesis testing, the logic and strategies of comparative research and rational theory evaluation. Theory will be balanced with some prominent case studies of influential political science research. Part two ‘Techniques of Analysis’ shifts from broad conceptual matters to outline a partial ‘menu’ of some of the actual research techniques that have been used to great effect in the social sciences.
    [Show full text]