Priority Challenges for Social and Behavioral Research and Its Modeling

Total Page:16

File Type:pdf, Size:1020Kb

Priority Challenges for Social and Behavioral Research and Its Modeling Priority Challenges for Social and Behavioral Research and Its Modeling Paul K. Davis, Angela O’Mahony, Timothy R. Gulden, Osonde A. Osoba, Katharine Sieck C O R P O R A T I O N For more information on this publication, visit www.rand.org/t/RR2208 Library of Congress Cataloging-in-Publication Data is available for this publication. ISBN: 978-0-8330-9995-2 Published by the RAND Corporation, Santa Monica, Calif. © Copyright 2018 RAND Corporation R® is a registered trademark. Cover: jolly/stock.adobe.com. Limited Print and Electronic Distribution Rights This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited. Permission is given to duplicate this document for personal use only, as long as it is unaltered and complete. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial use. For information on reprint and linking permissions, please visit www.rand.org/pubs/permissions. The RAND Corporation is a research organization that develops solutions to public policy challenges to help make communities throughout the world safer and more secure, healthier and more prosperous. RAND is nonprofit, nonpartisan, and committed to the public interest. RAND’s publications do not necessarily reflect the opinions of its research clients and sponsors. Support RAND Make a tax-deductible charitable contribution at www.rand.org/giving/contribute www.rand.org Preface The Defense Advanced Research Proj ects Agency (DARPA) is invest- ing in diverse aspects of social- behavioral research and modeling. This report is part of a study to assist DARPA in defining challenges and prioritizing such investments. Its initial version was a provocative read- ahead for a workshop of prominent researchers. This final version incorporates insights from that workshop and subsequent research. Comments are welcome and should be addressed to the proj ect leaders Paul K. Davis ([email protected]) and Angela O’Mahony (aomahon1 @rand.org). The research in this report was sponsored by Dr. Jonathan Pfautz, a program man ager in DARPA’s Information Innovation Office (I20). The research was conducted within the International Security and Defense Policy and Acquisition and Technology Policy Centers of the RAND National Defense Research Institute, a federally funded research and development center sponsored by the Office of the Secre- tary of Defense, the Joint Staff, the Unified Combatant Commands, the Navy, the Marine Corps, the defense agencies, and the defense intel- ligence community. For more information on the centers, see www.rand.org/nsrd/ndri /centers/ISDP.html and www.rand.org/nsrd/ndri/centers/atp.html or contact the directors (contact information is provided on the webpage). iii Table of Contents Preface ............................................................................. iii Figures ............................................................................. ix Tables .............................................................................. xi Summary ........................................................................ xiii Acknowl edgments ............................................................ xxix CHAPTER ONE Introduction ....................................................................... 1 Objectives ........................................................................... 1 Background ......................................................................... 3 Structure of Report ................................................................ 9 CHAPTER TWO Difficulties, Challenges, and a Broad Strategy for Next Steps ..........11 Inherent Difficulties of Social- Behavioral Science and Its Modeling ......................................................................11 Complex Adaptive Systems ....................................................12 Wicked Prob lems ...............................................................13 The Dynamic Character of People and Social Systems .....................14 Obstacles Due to Shortcomings of Current Practice .........................14 Fragmentation ...................................................................14 Methods and Norms ...........................................................15 Representing the Richness of the Science ....................................17 Modularity and Composability .............................................. 20 Rethinking Model Validity ................................................... 23 v vi Priority Challenges for Social-Behavioral Research and Its Modeling CHAPTER THREE Broad Strategy for Next Steps .................................................33 CHAPTER FOUR Tightening the Theory- Modeling- Experimentation Research Cycle ..............................................................39 Background on Differences of Philosophy .....................................39 An Idealized System View Relating the Real and Model Worlds ...........44 Real ity versus the Ideal ..........................................................48 Real ity and Its Implications ...................................................48 Moving Toward the Ideal .....................................................50 CHAPTER FIVE Theory and Its Modeling .......................................................55 Assimilating Modeling Better into Social- Behavioral Science ...............55 Assuring That Modeling Is Faithful to Subtleties of Theory .................57 Toward Multivariate Causal Models ............................................59 Causality .........................................................................59 Multivariate Aspects and Nonlinearity .......................................61 Dealing Routinely with Uncertainty ...........................................62 Going Beyond Simulation: Using a Portfolio of Modeling Methods .........63 Toward Greater Generality, Synthesis, and Coherence .......................67 Issues .............................................................................67 Scale and Perspective ...........................................................67 Reconciling Models Across Type, Formalism, Resolution, and Perspective .............................................................70 Improving Scientific Practices ...................................................76 CHAPTER SIX Experimentation .................................................................79 Theory- Informed Experimentation .............................................79 Urging a Theory- Informed Approach Is Not Radical ..................... 80 To Inform with Theory Is Not to Impose a Theory........................ 80 Connections Exist with Multiresolution Modeling .........................81 Contents vii Other Issues ........................................................................82 Estimating Difficult- to- Measure Variables ...................................82 Speed, Tailoring .................................................................83 Joint Planning for Empirical and Computational Experimentation ......83 New Sources and New Technology .............................................85 Exploratory Research and Analy sis ............................................ 86 CHAPTER SEVEN Modernizing Model- Based Decision Aiding ...............................89 The Decision- Aiding Aspect of the Challenge .................................89 Deep Uncertainty................................................................90 Princi ples and Lessons Learned .................................................91 Implications for Analy sis Outputs and Communication ....................92 CHAPTER EIGHT Methods and Technology ......................................................97 Capacity for Multidimensional Uncertainty Analy sis ........................97 Variable- Structure Simulation and Emergence................................98 Knowledge Management and Heterogeneous Information Fusion .........99 Composability .................................................................101 Theory- Informed Empirical and Computational Experimentation .......102 Interactivity, Gaming, and Related Visualization ..........................104 Other ..........................................................................104 CHAPTER NINE Infrastructure, Culture, and Governance ................................. 107 Infrastructure .................................................................... 107 Cultural Mindsets ............................................................... 108 Governance and Ethics, Privacy, and Civil Liberties ....................... 109 Results from a Workshop on Ethics and Privacy.......................... 109 More General Ethical Reasons for Caution................................ 110 Final Comments ................................................................ 111 APPENDIXES A. Social and Behavioral Modeling Laboratories ........................ 113 B. Definitions ................................................................... 125 viii Priority Challenges for Social-Behavioral Research and Its Modeling C. Validation .................................................................... 129 D. Participants in Workshops ............................................... 135 Abbreviations ................................................................... 137 References ......................................................................
Recommended publications
  • Pollack, 2009
    Cite as: Pollack, J. (2009). Multimethodology in series and parallel: strategic planning using hard and soft OR. Journal of the Operational Research Society, 60, 156 -167. Multimethodology in series and parallel: strategic planning using hard and soft OR J Pollack University of Technology, Sydney, Australia Abstract: This paper examines two distinct ways in which hard and soft operational research (OR) methodologies can be combined, in series and in parallel. Multimethodology in series is acknowledged as the simpler and more common approach. Multimethodology in parallel is identified as having the potential to provide significant benefits to projects in political, changing, or ‘wicked’ contexts that multimethodology in series cannot. Observations regarding these approaches to multimethodology are examined in light of an information systems strategic planning project in the Australian public sector. Two distinct methodologies were combined in the project: soft systems methodology and project management. These methodologies are based on the soft and hard paradigms, respectively. However, findings in this paper have the potential to be transferred to combinations of other hard and soft OR methodologies. Keywords: methodology; project management; soft systems methodology; planning; government; information systems Introduction This research focuses on different ways in which operational research (OR) methodologies based in the hard and soft paradigms can be combined in practice. Two distinct multimethodological arrangements are discussed, multimethodology in series and in parallel. The vast majority of multimethodology research involves using different approaches in series. This usually involves movement from soft to hard OR, as an initially undefined but stable environment is clarified, allowing practitioners to move from exploration to product delivery.
    [Show full text]
  • Abraham Kaplan Papers 0054
    http://oac.cdlib.org/findaid/ark:/13030/c86q1z11 No online items Abraham Kaplan Papers 0054 California State Polytechnic University, Pomona. Special Collections and Archives 3801 West Temple Avenue Pomona, CA 91768 [email protected] 909-869-3775 Abraham Kaplan Papers 0054 0054 1 Title: Abraham Kaplan Papers Creator: Kaplan, Abraham, 1918-1993 Identifier/Call Number: 0054 Contributing Institution: California State Polytechnic University, Pomona. Special Collections and Archives Language of Material: English Physical Description: 17 boxes Date (inclusive): 1942-1989 Abstract: Abraham Kaplan (1918-1993) was a philosopher, an author and an educator. His collection contains correspondence, articles, lectures, speeches, book manuscripts, subject files, notes, and printed matter pertaining to his writings and academic career. Conditions Governing Access Advance notice required for access. Conditions Governing Use Unpublished manuscripts are protected by copyright. Permission to publish, quote, or reproduce must be secured from the repository and the copyright holder. Preferred Citation [Box/folder# or item name], Abraham Kaplan Papers, Collection no. 0054, University Archives, Special Collections and Archives, University Library, California State Polytechnic University, Pomona. Immediate Source of Acquisition The collection was transferred to the University Archives by Professor of Philosophy James Manley in 2001. Biographical / Historical Abraham Kaplan (1918-1993) was an American philosopher with a long and distinguished career. He was born June 11, 1918 to parents Joseph J. (a Rabbi) and Chava (Lerner) Kaplan in Odessa, Ukraine. Kaplan and his family immigrated to the United States in 1923 and he became a naturalized citizen in 1930. A student of philosopher Bertrand Russell, he graduated from the College of St.
    [Show full text]
  • A Multimethodology Contractor Assessment Model for Facilitating Green Innovation: the View of Energy and Environmental Protection
    Hindawi Publishing Corporation The Scientific World Journal Volume 2013, Article ID 624340, 14 pages http://dx.doi.org/10.1155/2013/624340 Research Article A Multimethodology Contractor Assessment Model for Facilitating Green Innovation: The View of Energy and Environmental Protection Sung-Lin Hsueh1 and Min-Ren Yan2 1 Graduate Institute of Cultural and Creative Design, Tung Fang Design Institute, No. 110 Dongfang Road, Hunei District, Kaohsiung City 82941, Taiwan 2 Department of International Business Administration, Chinese Culture University, No. 231, Sec 2, Jian guo S. Road, Da-an District, Taipei City 106, Taiwan Correspondence should be addressed to Min-Ren Yan; [email protected] Received 11 August 2013; Accepted 10 September 2013 Academic Editors: E. Lui and R. Su Copyright © 2013 S.-L. Hsueh and M.-R. Yan. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The trends of the green supply chain are attributed to pressures from the environment and from customers. Green innovation is a practice for creating competitive advantage in sustainable development. To keep up with the changing business environment, the construction industry needs an appropriate assessment tool to examine the intrinsic and extrinsic effects regarding corporate competitive advantage. From the viewpoint of energy and environmental protection, this study combines four scientific methodologies to develop an assessment model for the green innovation of contractors. System dynamics can be used to estimate the future trends for the overall industrial structure and is useful in predicting competitive advantage in the industry.
    [Show full text]
  • Towards a Critical-Pragmatic Theory Of
    CONSTITUENTS AND THEIR EXPECTATIONS: TOWARDS A CRITICAL-PRAGMATIC THEORY OF INFORMATION SYSTEMS PROJECT MANAGEMENT Phillip William James Brook BSc DipCS University of Western Sydney Submitted as fulfilling the requirements for the Doctor of Philosophy Degree March 2004 Certificate of Originality I hereby declare that this dissertation is my own work and that, to the best of my knowledge and belief, it contains no material previously published or written by another person, nor material which to a substantial extent has been accepted for the award of any degree or diploma of the University or other institute of higher learning except where due acknowledgement in made in the text. I also declare that the intellectual content of this thesis is the product of my own work, even though I may have received assistance from others in style, presentation and language expression. Signature _____ ____ ii Acknowledgements First and foremost my appreciation for all her efforts go to Dubravka Cecez- Kecmanovic, whose continual encouragement to undertake doctoral studies has finally borne fruit. Thanks also to Alan Buttery for his support and encouragement, and to Owen Hanson who was a willing sounding board for what I wanted to say. The members of the Information Systems and Knowledge Management Research Group provided a supportive environment in which I could present and refine my ideas, so to them I also extend my appreciation. iii Abstract This dissertation presents a theoretical model of information systems (IS) project management that aims to improve the rate of project success, estimated currently to be less than 50% despite over thirty years of experience.
    [Show full text]
  • Contribution of Multimethodology to Human Factors in Air Navigation Systems
    Wright State University CORE Scholar International Symposium on Aviation International Symposium on Aviation Psychology - 2015 Psychology 2015 Contribution of Multimethodology to Human Factors in Air Navigation Systems Lisia Maria Espinola da Silva Pacheco Cabral Marcos Pereira Follow this and additional works at: https://corescholar.libraries.wright.edu/isap_2015 Part of the Other Psychiatry and Psychology Commons Repository Citation Espinola da Silva Pacheco Cabral, L. M., & Pereira, M. (2015). Contribution of Multimethodology to Human Factors in Air Navigation Systems. 18th International Symposium on Aviation Psychology, 236-241. https://corescholar.libraries.wright.edu/isap_2015/67 This Article is brought to you for free and open access by the International Symposium on Aviation Psychology at CORE Scholar. It has been accepted for inclusion in International Symposium on Aviation Psychology - 2015 by an authorized administrator of CORE Scholar. For more information, please contact [email protected]. CONTRIBUTION OF MULTIMETHODOLOGY TO HUMAN FACTORS IN AIR NAVIGATION SYSTEMS CABRAL, Lisia Maria Espinola da Silva Pacheco Brazilian Airport Administration Organization (INFRAERO) Rio de Janeiro, RJ, Brazil ESTELLITA LINS, Marcos Pereira Federal University of Rio de Janeiro (UFRJ) Rio de Janeiro, RJ, Brazil This article presents a general view of a post-graduation study developed from 2011 to 2014 into some civil Air Navigation contexts of a brazilian public organization, to promote System and Rational Thinking, and Metagovernance,
    [Show full text]
  • The Uses of Qualitative Data in Multimethodology: Developing Causal Loop Diagrams During the Coding Process
    Yearworth, M., & White, L. A. (2013). The uses of qualitative data in multimethodology: Developing causal loop diagrams during the coding process. European Journal of Operational Research, 231(1), 151-161. https://doi.org/10.1016/j.ejor.2013.05.002 Peer reviewed version Link to published version (if available): 10.1016/j.ejor.2013.05.002 Link to publication record in Explore Bristol Research PDF-document NOTICE: this is the author’s version of a work that was accepted for publication in European Journal of Operational Research. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in European Journal of Operational Research, [VOL 231, ISSUE 1, (16 November 2013)] DOI: 10.1016/j.ejor.2013.05.002 University of Bristol - Explore Bristol Research General rights This document is made available in accordance with publisher policies. Please cite only the published version using the reference above. Full terms of use are available: http://www.bristol.ac.uk/red/research-policy/pure/user-guides/ebr-terms/ The Uses of Qualitative Data in Multimethodology: Developing Causal Loop Diagrams During the Coding Process Mike Yearworth1*, Leroy White2 1 Systems Centre, Faculty of Engineering, University of Bristol, BS8 1TR, UK 2 Department of Management, Faculty of Social Science and Law, University of Bristol, BS8 1TN, UK *Corresponding author: Tel +44-778-969-2266, Fax +44-117-331-5719, email [email protected] Abstract – In this research note we describe a method for exploring the creation of causal loop diagrams (CLDs) from the coding trees developed through a grounded theory approach and using computer aided qualitative data analysis software (CAQDAS).
    [Show full text]
  • Social Media Research
    AUGUST 2010 Social media research > How do you analyze user-generated content? > The three trade-offs of social media research > Sampling and weighting social media data SCHLESINGER ONLINE SOLUTIONS Schlesinger Associates’ Online Solutions include online surveys, focus groups and bulletin boards. Our qualitative and quantitative methodologies provide the most comprehensive online research solutions available. dynamic online communities custom panels fast delivery multimethodology service comprehensive support quality guaranteed cost-effective results www.SchlesingerAssociates.com TOLL FREE (USA+1) 866.549.3500 Quirk’s Marketing Research Review 2010 Volume XXIV Number 8 August departments contents 6 In Case You Missed It... 8 Survey Monitor 52 Now and for the future 10 Names of Note case study The road ahead for marketing 30 Still in the hunt and advertising research Comcast’s Versus channel By John Wittenbraker 12 Product and Service Update turned to research to 58 Too much information? better understand a core Let’s be prudent in our use of 14 Research Industry News audience segment neuroscience for marketing By Jon Last and Christopher Whitely and advertising research 73 Index of Advertisers By John Owen 74 Calendar of Events techniques columns 24 Does UGC make 78 Before You Go… 16 By the Numbers you say ‘Ugh’? Are Internet access panels When your consumers are a lemon market? talking online, here are By David Haynes some tips on how to listen 24 By Andrew Wilson 20 Software Review Q data analysis software 36 Something ventured, By
    [Show full text]
  • 1 Construction of a Multimethodology for Use
    CONSTRUCTION OF A MULTIMETHODOLOGY FOR USE IN COLLABORATIVE MODEL ACTUALIZATION Philip J. Cook MBA, CET 207 George Street Ingersoll, Ontario, Canada N5C 1Z5 Ingersoll Rand / Athabasca University ABSTRACT Multiple stakeholder engagement and collaboration is an area of great complexity and difficulty. Crossing paradigms and disciplines involves the engagement and understanding of multiple worldviews by all parties involved. This is difficult at best with the full cooperation of the stakeholders involved and is further exacerbated by financial structures, divergent objectives, power relations, and institutional biases within and between organizations. It is, however, posited that collaborative efforts of this magnitude and range are necessary to fully employ the undergirding ethic of Sustainable Development (SD). The SD ethic also implies an intergenerational consideration that the author suggests is best introduced through a collaboratively derived statement of ethic used to mediate all decisions put forth for employment. This paper explores the assembly of a multimethodology constructed through the combination of widely held methodologies with peculiar strengths in a complementary manner. Soft Systems Methodology (SSM), Appreciative Inquiry (AI) and a Collective Statement of Ethics (CSE) are assembled in a partitioned manner that allows each to maintain its core strengths while feeding the next iteration with what is argued a higher quality input. The ontological, epistemological and axiological implication of the multimethodology are examined and illustrated along with a review of the literature regarding the implications of such a methodology. It is deemed that the ontological variance is not significant and that the minor epistemological and axiological differences are within reasonable tolerances considering the multimethodological protocol employed and successful precedent use of similar methodologies.
    [Show full text]
  • Semiotics Guidelines Final.Pdf
    Kent Academic Repository Full text document (pdf) Citation for published version Mingers, John and Willcocks, Leslie (2017) An integrative semiotic methodology for IS research. Information and Organization, 27 (1). pp. 17-36. ISSN 1471-7727. DOI https://doi.org/10.1016/j.infoandorg.2016.12.001 Link to record in KAR http://kar.kent.ac.uk/60191/ Document Version Author's Accepted Manuscript Copyright & reuse Content in the Kent Academic Repository is made available for research purposes. Unless otherwise stated all content is protected by copyright and in the absence of an open licence (eg Creative Commons), permissions for further reuse of content should be sought from the publisher, author or other copyright holder. Versions of research The version in the Kent Academic Repository may differ from the final published version. Users are advised to check http://kar.kent.ac.uk for the status of the paper. Users should always cite the published version of record. Enquiries For any further enquiries regarding the licence status of this document, please contact: [email protected] If you believe this document infringes copyright then please contact the KAR admin team with the take-down information provided at http://kar.kent.ac.uk/contact.html AN INTEGRATIVE SEMIOTIC METHODOLOGY FOR IS RESEARCH Abstract Semiotics studies the production, transmission and interpretation of meaning represented symbolically in signs and messages, primarily but not exclusively in language. For information systems (IS) the domain of semiosis consists of human and non-human interactions based on technologically-mediated communication in the social, material and personal worlds. The paper argues that semiosis has immense bearing on processes of communication central to the advanced information and communications technologies studied by IS scholars.
    [Show full text]
  • Download Download
    ONTOLOGICAL SUPPORT FOR MULTIPARADIGM MULTIMETHODOLOGIES: ISOMORPHIC PROCESS–STRUCTURES AND THE CRITICAL MOMENT Todd D. Bowers Hull University Business School, Centre for Systems Studies ABSTRACT Because it still lacks adequate theory needed to ground its multiparadigm multimethodologies, critical systems practice has been derisively called “theoretically- contradictory eclecticism”. This paper is an introduction to and overview of the author’s forthcoming Ph.D. dissertation which offers a new framework for research in critical systems thinking and proposes a new approach for the practice of critical systemic intervention. To underpin this framework an ontology of process–structure isomorphies is designed as a metaphysical interface through an abstraction called the critical moment to each of the conventional paradigms of critical systems thinking (functionalist, interpretivist, emancipatory and postmodern). The ontology is realised by a new epistemology (its raison d'être) that respects paradigm incommensurability and yet exploits all the advantages to be had from a multiparadigmatic perspectivity. The new methodology, (wherein each of the paradigmatic approaches is critically ‘deployed’) then operationalises and completes the new framework. This new approach calls for and directs the systemist’s critically reflexive, axiologically transparent, multiparadigmatic appreciation of, and multimethodological engagement with, the problem situation and flux. The philosophy necessarily lays out the framework’s foundational motives, rationale, intents and purposes and acts as a guide for its use. The principal advantage of this new approach is derived from its critically-grounded multiparadigmatic perspectivity and the consequent leveraging of the full gamut of existing systemic methodologies and best practices. Keywords: multiparadigm; multimethodology; systemic intervention; systems theory; critical systems; incommensurability. INTRODUCTION The impetus for this author’s Ph.D.
    [Show full text]
  • Towards a Theory of Multi-Method M&S Approach
    Proceedings of the 2014 Winter Simulation Conference A. Tolk, S. Y. Diallo, I. O. Ryzhov, L. Yilmaz, S. Buckley, and J. A. Miller, eds. TOWARDS A THEORY OF MULTI-METHOD M&S APPROACH: PART I Mariusz Balaban Patrick Hester MYMIC LLC. Old Dominion University 1040 University Blvd. 5115 Hampton Blvd. Portsmouth, VA 23704, USA Norfolk, VA 23539, USA Saikou Diallo Virginia Modeling, Analysis and Simulation Center 1030 University Blvd. Suffolk, VA 23435, USA ABSTRACT This paper is the first from a series of papers that aim to develop a theory of multi-method M&S approach. The aim of this paper is to develop ontological basis for multi-method M&S approach. The first part of this paper discusses terms related to the use of more than a single modeling & simulation (M&S) method. This is to show the ontological ambiguity currently present within the M&S field in the context of using more than a single method. Next section provides the philosophical stance of the authors about the main terms in order to provide clarification and context of the term multi-method M&S approach. The last section takes these previous concepts and proposes a set of definitions relevant to a multi-method M&S approach, including its parent and derivative terms. 1 INTRODUCTION More than four decades ago, Fahrland (1970) introduced the notion of combined discrete event and continuous simulation. Presently, the practice of combining methods has matured and more simulation platforms offer capability beyond the original idea of combining two main modeling methods. Mingers (2001) points at two main reasons for using a multi-method approach: “It is both desirable and feasible to combine together different research methods to gain richer and more reliable research results.” (243).
    [Show full text]
  • Department of Political Science [email protected]
    Getting Organized: A Pragmatic Tool for Writing Papers BY Patricia M. Shields Department of Political Science Southwest Texas State University Presented at the International Consortium for Educational Development in Higher Education, April 19-22,1998 Austin, Texas. For further information contact Pat Shields, Director, Masters of Public Administration Program, Southwest Texas State University, San Marcos, TX 512-245-2143 [email protected]. Getting Organized: A Pragmatic Tool for Writing Papers Patricia M, Shields Department of Political Science Southwest Texas State University This paper describes a method for writing formal research papers. The technique, known and the "Notebook Method" has been applied successfully by graduate students, faculty and students in continuing education programs. The Notebwk Method's success is measured in publications, award winning student papers1,graduation rates and dollars. For example, after The Bill Blackwood Law Enforcement Management Institute of Texas, Graduate Management Institute, Sam Houston State University began applying this technique their paper completion rate went from 32 in 1995 to 88 in 1996. Before implementation of the Notebook Method, the institute spent approximately $250,000 a year on the research component of their program. After instituting this method, the cost dropped to about $45,000 per year.* One key to the notebook's success is its focus on organization. The technique is also powerful because it is grounded in "Pragmatism"as a philosophy of inquiry. Much of this paper is devoted to developing the link to pragmatism. A Little History: Defining the Problem Every Southwest Texas Masters of Public Administration (MPA) student is required to complete an Applied Research Project (ARP).
    [Show full text]