WHY ARE WE DISCUSSING QUANTIFICATION TODAY? the WORLD IS a MESSY PLACE: POLICY WORLD REALLY MESSY Image Removed Due to Copyright Restrictions

Total Page:16

File Type:pdf, Size:1020Kb

WHY ARE WE DISCUSSING QUANTIFICATION TODAY? the WORLD IS a MESSY PLACE: POLICY WORLD REALLY MESSY Image Removed Due to Copyright Restrictions WHY ARE WE DISCUSSING QUANTIFICATION TODAY? THE WORLD IS A MESSY PLACE: POLICY WORLD REALLY MESSY Image removed due to copyright restrictions. View the image of the flowchart of the proposed health care law. Quantitative research is generally made using scientific methods, which can include: • The generation of models, theories and hypotheses • The development of instruments and methods for measurement • Experimental control and manipulation of variables • Collection of empirical data • Modeling and analysis of data • Evaluation of results • • In social science particularly, quantitative research is often contrasted with qualitative research, which is the examination, analysis and interpretation of observations for the purpose of discovering underlying meanings and patterns of relationships, including classifications of types of phenomena and entities, in a manner that does not involve mathematical models. • Quant or Qual? • Although a distinction is commonly drawn between qualitative and quantitative aspects of scientific investigation, it has been argued that the two go hand in hand. • • For example, based on analysis of the history of science, Kuhn concludes “large amounts of qualitative work have usually been prerequisite to fruitful quantification in the physical sciences. • • Qualitative research is often used to gain a general sense of phenomena and to form theories that can be tested using further quantitative research. For instance, in the social sciences qualitative research methods are often used to gain better understanding of such things as intentionality and • • Quantitative investigation of the world has existed since people first began to record events or objects that had been counted. Scientific method A body of techniques for investigating phenomena, acquiring new knowledge, or correcting and integrating previous knowledge. To be termed scientific, a method of inquiry must be based on gathering observable, empirical and measurable evidence subject to specific principles of reasoning. A scientific method consists of the collection of data through observation and experimentation, and the formulation and testing of hypotheses. • • Although procedures vary from one field of inquiry to another, identifiable features distinguish scientific inquiry from other methods of obtaining knowledge. Scientific researchers propose hypotheses as explanations of phenomena, and design experimental studies to test these hypotheses. • • These steps must be repeatable, to predict future results. • Theories that encompass wider domains of inquiry may bind many independently derived hypotheses together in a coherent, supportive structure. • • Theories, in turn, may help form new hypotheses or place groups of hypotheses into context. • Scientific inquiry is generally intended to be as objective possible, to reduce biased interpretations of results. • • Another basic expectation is to document, archive and share all data and methodology so they are available for careful scrutiny by other scientists, giving them the opportunity to verify results by attempting to reproduce them. • • This practice, called full disclosure, also allows statistical measures of the reliability of these data to be established. • Don’t Go Being Qualitative on Me! Primary Approach by Students • The case study • It is based on an in-depth investigation of a single individual, group, or event. Case studies may be descriptive or explanatory. The latter type is used to explore causation in order to find underlying principles. • Rather than using samples and following a rigid protocol (strict set of rules) to examine a limited number of variables, case study methods involve an in-depth, longitudinal (over a long period of time) examination of a single instance or event: a case. • They provide a systematic way of looking at events, collecting data, analyzing information, and reporting the results. • As a result the researcher may gain a sharpened understanding of why the instance happened as it did, and what might become important to look at more extensively in future research. Case studies lend themselves to both generating and testing hypotheses. The Case Study • Choosing good cases for extremely small samples is a challenging endeavor. • most case studies seek to elucidate the features of a broader population. • They are about something larger than the case itself, even if the resulting generalization is issued in a tentative fashion. • In case studies of this sort, the chosen case is asked to perform a heroic role: to stand for (represent) a population of cases that is often much larger than the case itself. How to Justify Selection of Case Study • When selecting a case for a case study, researchers often use information-oriented sampling , as opposed to random sampling. This is because an average case is often not the richest in information. Extreme or atypical cases reveal more information because they activate more basic mechanisms and more actors in the situation studied. The Critical Case • A critical case can be defined as having strategic importance in relation to the general problem. A critical case allows the following type of generalization, ‘If it is valid for this case, it is valid for all (or many) cases.’ In its negative form, the generalization would be, ‘If it is not valid for this case, then it is not valid for any (or only few) cases.’ • The case study is also effective for generalizing using the type of test that Karl Popper, called falsification, which forms part of critical reflexivity . Falsification is one of the most rigorous tests to which a scientific proposition can be subjected: if just one observation does not fit with the proposition it is considered not valid generally and must therefore be either revised or rejected. • Popper himself used the now famous example of, "All swans are white," and proposed that just one observation of a single black swan would falsify this proposition and in this way have general significance and stimulate further investigations and theory- building. The case study is well suited for identifying "black swans" because of its in-depth approach: what appears to be "white" often turns out on closer examination to be "black." The typical case study focuses on a case that exemplifies a stable, cross-case relationship. The puzzle of interest to the researcher lies within that case. Specifically, the researcher wants to find a typical case of some phenomenon so that he or she can better explore the causal mechanisms at work in a general, cross-case relationship. A second case selection strategy has as its primary objective the achievement of maximum variance along relevant dimensions. We refer to this as a the diverse case method. It requires the selection of a set cases. Each represents the full range of value of the subject in question. Large-N analysis. Where causal variables are continuous and the outcome is dichotomous, the researcher may employ discriminant analysis to identify diverse cases. The extreme case method selects a case because of its extreme value on the independent (X) or dependent (Y) variable of interest. • The deviant case method selects that case that, by reference to some general understanding of a topic (either a specific theory or common sense), demonstrates a surprising value. • Sometimes, the choice of a case is motivated solely by the need to check the assumptions behind some model of causal relations. In this circum stance, the extent to which a case fits the overall model is important only insofar as it might affect the overall set of findings for the whole population. • In its purest form, the chosen pair of cases is similar on all the measured • independent variables, except the independent variable of interest. My Project • Soldiers, health care access, policy to improve conditions • Literature, Data, Analysis, Findings, Testing, Reporting, Replicability My Problem… • Some of the results make sense; • Some don’t. • What should I do? • Which approach should I take? MIT OpenCourseWare http://ocw.mit.edu 11.201 Gateway to the Profession of Planning Fall 2010 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. .
Recommended publications
  • Quantification of Damages , in 3 ISSUES in COMPETITION LAW and POLICY 2331 (ABA Section of Antitrust Law 2008)
    Theon van Dijk & Frank Verboven, Quantification of Damages , in 3 ISSUES IN COMPETITION LAW AND POLICY 2331 (ABA Section of Antitrust Law 2008) Chapter 93 _________________________ QUANTIFICATION OF DAMAGES Theon van Dijk and Frank Verboven * This chapter provides a general economic framework for quantifying damages or lost profits in price-fixing cases. We begin with a conceptual framework that explicitly distinguishes between the direct cost effect of a price overcharge and the subsequent indirect pass-on and output effects of the overcharge. We then discuss alternative methods to quantify these various components of damages, ranging from largely empirical approaches to more theory-based approaches. Finally, we discuss the law and economics of price-fixing damages in the United States and Europe, with the focus being the legal treatment of the various components of price-fixing damages, as well as the legal standing of the various groups harmed by collusion. 1. Introduction Economic damages can be caused by various types of competition law violations, such as price-fixing or market-dividing agreements, exclusionary practices, or predatory pricing by a dominant firm. Depending on the violation, there are different parties that may suffer damages, including customers (direct purchasers and possibly indirect purchasers located downstream in the distribution chain), suppliers, and competitors. Even though the parties damaged and the amount of the damage may be clear from an economic perspective, in the end it is the legal framework within a jurisdiction that determines which violations can lead to compensation, which parties have standing to sue for damages, and the burden and standard of proof that must be met by plaintiffs and defendants.
    [Show full text]
  • Defining Data Science by a Data-Driven Quantification of the Community
    machine learning & knowledge extraction Article Defining Data Science by a Data-Driven Quantification of the Community Frank Emmert-Streib 1,2,* and Matthias Dehmer 3,4,5 1 Predictive Medicine and Data Analytics Lab, Department of Signal Processing, Tampere University of Technology, FI-33101 Tampere, Finland 2 Institute of Biosciences and Medical Technology, FI-33101 Tampere, Finland 3 Institute for Intelligent Production, Faculty for Management, University of Applied Sciences Upper Austria, Steyr Campus, A-4400 Steyr, Austria; [email protected] 4 Department of Mechatronics and Biomedical Computer Science, UMIT, A-6060 Hall in Tyrol, Austria 5 College of Computer and Control Engineering, Nankai University, Tianjin 300071, China * Correspondence: [email protected]; Tel.: +358-50-301-5353 Received: 4 December 2018; Accepted: 17 December 2018; Published: 19 December 2018 Abstract: Data science is a new academic field that has received much attention in recent years. One reason for this is that our increasingly digitalized society generates more and more data in all areas of our lives and science and we are desperately seeking for solutions to deal with this problem. In this paper, we investigate the academic roots of data science. We are using data of scientists and their citations from Google Scholar, who have an interest in data science, to perform a quantitative analysis of the data science community. Furthermore, for decomposing the data science community into its major defining factors corresponding to the most important research fields, we introduce a statistical regression model that is fully automatic and robust with respect to a subsampling of the data.
    [Show full text]
  • Workshop on Quantification, Communication, and Interpretation of Uncertainty in Simulation and Data Science
    Workshop on Quantification, Communication, and Interpretation of Uncertainty in Simulation and Data Science 1 Workshop on Quantification, Communication, and Interpretation of Uncertainty in Simulation and Data Science Ross Whitaker, William Thompson, James Berger, Baruch Fischhof, Michael Goodchild, Mary Hegarty, Christopher Jermaine, Kathryn S. McKinley, Alex Pang, Joanne Wendelberger Sponsored by This material is based upon work supported by the National Science Foundation under Grant No. (1136993). Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation. Abstract .........................................................................................................................................................................2 Workshop Participants .................................................................................................................................................2 Executive Summary .......................................................................................................................................................3 Overview ........................................................................................................................................................................3 Actionable Recommendations ......................................................................................................................................3 1
    [Show full text]
  • Quantification Strategies in Real-Time PCR Michael W. Pfaffl
    A-Z of quantitative PCR (Editor: SA Bustin) Chapter3. Quantification strategies in real-time PCR 87 Quantification strategies in real-time PCR Michael W. Pfaffl Chaper 3 pages 87 - 112 in: A-Z of quantitative PCR (Editor: S.A. Bustin) International University Line (IUL) La Jolla, CA, USA publication year 2004 Physiology - Weihenstephan, Technical University of Munich, Center of Life and Food Science Weihenstephan, Freising, Germany [email protected] Content of Chapter 3: Quantification strategies in real-time PCR Abstract 88 3.1. Introduction 88 3.2. Markers of a Successful Real-Time RT-PCR Assay 88 3.2.1. RNA Extraction 88 3.2.2. Reverse Transcription 90 3.2.3. Comparison of qRT-PCR with Classical End-Point Detection Method 91 3.2.4. Chemistry Developments for Real-Time RT-PCR 92 3.2.5. Real-Time RT-PCR Platforms 92 3.2.6. Quantification Strategies in Kinetic RT-PCR 92 3.2.6.1. Absolute Quantification 93 3.2.6.2. Relative Quantification 95 3.2.8. Real-Time PCR Amplification Efficiency 99 3.2.9. Data Evaluation 101 3.3. Automation of the Quantification Procedure 102 3.4. Normalization 103 3.5. Statistical Comparison 106 3.6. Conclusion 107 3.7 References 108 A-Z of quantitative PCR (Editor: SA Bustin) Chapter3. Quantification strategies in real-time PCR 88 Abstract This chapter analyzes the quantification strategies in real-time RT-PCR and all corresponding markers of a successful real-time RT-PCR. The following aspects are describes in detail: RNA extraction, reverse transcription (RT), and general quantification strategies—absolute vs.
    [Show full text]
  • First Steps in Relative Quantification Analysis of Multi-Plate Gene
    RealTime ready Application Note June 2011 First Steps in Relative Abstract/Introduction Quantification Analysis This technical application note describes the first steps in data analysis for relative quantification of gene expression of Multi-Plate Gene experiments performed using RealTime ready Custom Panels. The easy initial setup as well as the “Result Export” Expression Experiments procedure of the LightCycler® 480 Software is described. Further preparation of the data depends on the means of analysis. Three routes to analyze the data are described: 1. Spreadsheet calculation software 2. GenEx Software from MultiD Analysis Heiko Walch and Irene Labaere 3. qbasePLUS 2.0 from Biogazelle Roche Applied Science, Penzberg, Germany Whereas GenEx and qbasePLUS are software packages from third party vendors specialized in RT-qPCR data analysis (1, 2) the spreadsheet calculation approach can be seen as a generic procedure for performing subsequent analysis either in the spreadsheet software or in other sophisticated statistical tools such as R, SigmaPlot, etc. (3, 4) Note that this article does not focus on qPCR setup, experimental planning or correct selection of reference genes. For details on this important topics, see publications such as the MIQE guidelines (5), or other recently published scientific best practices for qPCR expression studies (6, 7, 8). For life science research only. Not for use in diagnostic procedures. RealTime ready Setting Up the Experiment and Selecting the Assays A thoroughly planned experiment is vital to good scientific The gene list was generated using the focus list of assays for data. The RealTime ready Configurator (9) offers various genes “Amplified/overexpressed genes in cancers”, based on a possibilities to facilitate the creation of a reasonable list of publication from Santarius et al.
    [Show full text]
  • Sociology and Science: the Making of a Social Scientific Method
    Am Soc DOI 10.1007/s12108-017-9348-y Sociology and Science: The Making of a Social Scientific Method Anson Au1 # The Author(s) 2017. This article is an open access publication Abstract Criticism against quantitative methods has grown in the context of Bbig- data^, charging an empirical, quantitative agenda with expanding to displace qualitative and theoretical approaches indispensable to the future of sociological research. Underscoring the strong convergences between the historical development of empiri- cism in the scientific method and the apparent turn to quantitative empiricism in sociology, this article uses content and hierarchical clustering analyses on the textual representations of journal articles from 1950 to 2010 to open dialogue on the episte- mological issues of contemporary sociological research. In doing so, I push towards the conceptualization of a social scientific method, inspired by the scientific method from the philosophy of science and borne out of growing constructions of a systematically empirical representation among sociology articles. I articulate how this social scientific method is defined by three dimensions – empiricism, and theoretical and discursive compartmentalization –, and how, contrary to popular expectations, knowledge pro- duction consequently becomes independent of choice of research method, bound up instead in social constructions that divide its epistemological occurrence into two levels: (i) the way in which social reality is broken down into data, collected and analyzed, and (ii) the way in which this data is framed and made to recursively influence future sociological knowledge production. In this way, empiricism both mediates and is mediated by knowledge production not through the direct manipulation of method or theory use, but by redefining the ways in which methods are being labeled and knowledge framed, remembered, and interpreted.
    [Show full text]
  • The History of Quantification and Objectivity in the Social Sciences
    Social Cosmos - URN:NBN:NL:UI:10-1-116041 The history of quantification and objectivity in the social sciences Eline N. van Basten Clinical and Health Psychology Abstract How can we account for the triumph of quantitative methodology in contemporary social sciences? This article reviews several historical works on the use of quantification in the pursuit of objectivity. During the eighteenth and nineteenth centuries, objectivity was increasingly valued due to the absence of an elite culture, increasing anonymity, and the rise of pseudosciences. Before and during World War I, financial and governmental pressures intensified the movement toward objectivity and quantification. Quantification became almost mandatory as a response to World War II and Cold War conditions of mistrust and disunity. In the next decades, research findings started to circulate across oceans and continents and quantification served international communication very well. During the 1980s, the discussed challenges were no longer evident and the 1990s were characterized by continuous argument over the arbitrariness of quantitative decision making. Since then, there have been few reform, and roughly the same criticism applies to current statistical use. One can conclude that quantification has served the demands of social scientists for transparency, neutrality, and communicability, but in order to advance, social scientists should re-evaluate their own critical and creative mind. Keywords: quantification, objectivity, statistics, transparency, neutrality, communicability Introduction Describing human phenomena in the language of numbers may be counterintuitive. Although none of the social sciences has truly internalized a quantitative paradigm (Smith, 1994), strict quantification came to be seen as the badge of scientific legitimacy (Porter, 1995).
    [Show full text]
  • Relative Quantification Getting Started Guide for the Applied Biosystems 7300/7500/7500 Fast Real-Time PCR System RQ Experiment Workflow
    Getting Started Guide Relative Quantification Introduction and Example Applied Biosystems 7300/7500/7500 Fast RQ Experiment Real-Time PCR System Designing an RQ Experiment Performing Primer Extended on mRNA 5′ 3′ 5′ cDNA Reverse Primer Oligo d(T) or random hexamer Reverse Synthesis of 1st cDNA strand 3′ 5′ cDNA Transcription Generating Data from STANDARD RQ Plates - Standard Generating Data from FAST RQ Plates - Fast System Generating Data in an RQ Study © Copyright 2004, Applied Biosystems. All rights reserved. For Research Use Only. Not for use in diagnostic procedures. Authorized Thermal Cycler This instrument is an Authorized Thermal Cycler. Its purchase price includes the up-front fee component of a license under United States Patent Nos. 4,683,195, 4,683,202 and 4,965,188, owned by Roche Molecular Systems, Inc., and under corresponding claims in patents outside the United States, owned by F. Hoffmann-La Roche Ltd, covering the Polymerase Chain Reaction ("PCR") process to practice the PCR process for internal research and development using this instrument. The running royalty component of that license may be purchased from Applied Biosystems or obtained by purchasing Authorized Reagents. This instrument is also an Authorized Thermal Cycler for use with applications licenses available from Applied Biosystems. Its use with Authorized Reagents also provides a limited PCR license in accordance with the label rights accompanying such reagents. Purchase of this product does not itself convey to the purchaser a complete license or right to perform the PCR process. Further information on purchasing licenses to practice the PCR process may be obtained by contacting the Director of Licensing at Applied Biosystems, 850 Lincoln Centre Drive, Foster City, California 94404.
    [Show full text]
  • Introduction to Quantification and Its Concerns
    Introduction to Quantification and Its Concerns Ma Jonathan Han Son 1. Introduction It took scientists centuries to figure out how the use of quantities could facilitate the development of science. Nowadays, advertisers, politicians and scholars always use quantities to convince the public that their claims really rest on something. Yet, it would be doubtful whether the numbers they use are solid enough to be that “something”. The answer lies on the process that turns concepts into quantities—quantification. In this essay, on top of introducing its history and purpose, I will raise some concerns about this powerful tool. 1.1 The definition of quantity A quantity is a property that exists as a multitude or magnitude. It could be discrete (the number of people could only be integers) or continuous (the intensity of a light bulb could vary in infinitely small steps).1 1.2 The idea of quantification Quantification is the mapping of a concept to numbers. These numbers would represent the quantity of the property associated with the concept. Take length as an example. At first, length was a subjective concept. 1 See “Quantity” in Wikipedia (Retrieved 07:30, April 27, 2011). 98 與自然對話 In Dialogue with Nature “Longer” things possess higher magnitudes of length. Although the concept (which may be expressed as a statement) “length” (“Longer” things possess higher magnitudes of length.) cannot be represented by a number, the property “length” of an object can be. Then the ruler was invented to provide a linear scale which quantifies the concept of length. Length thus became objective. After an international agreement on the definition of a standard ruler was reached, a standard unit (metre) of length became available.2 Since then, that “ruler” has been a definition of length that is internationally accepted.
    [Show full text]
  • Uncertainty Quantification and Global Sensitivity Analysis for Economic Models
    A Service of Leibniz-Informationszentrum econstor Wirtschaft Leibniz Information Centre Make Your Publications Visible. zbw for Economics Harenberg, Daniel; Marelli, Stefano; Sudret, Bruno; Winschel, Viktor Article Uncertainty quantification and global sensitivity analysis for economic models Quantitative Economics Provided in Cooperation with: The Econometric Society Suggested Citation: Harenberg, Daniel; Marelli, Stefano; Sudret, Bruno; Winschel, Viktor (2019) : Uncertainty quantification and global sensitivity analysis for economic models, Quantitative Economics, ISSN 1759-7331, Wiley, Hoboken, NJ, Vol. 10, Iss. 1, pp. 1-41, http://dx.doi.org/10.3982/QE866 This Version is available at: http://hdl.handle.net/10419/217135 Standard-Nutzungsbedingungen: Terms of use: Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Documents in EconStor may be saved and copied for your Zwecken und zum Privatgebrauch gespeichert und kopiert werden. personal and scholarly purposes. Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle You are not to copy documents for public or commercial Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich purposes, to exhibit the documents publicly, to make them machen, vertreiben oder anderweitig nutzen. publicly available on the internet, or to distribute or otherwise use the documents in public. Sofern die Verfasser die Dokumente unter Open-Content-Lizenzen (insbesondere CC-Lizenzen) zur Verfügung gestellt haben sollten, If the documents have been made available under an Open
    [Show full text]
  • A Quantification Technique for Measuring an Expected
    computers Article To Adapt or Not to Adapt: A Quantification Technique for Measuring an Expected Degree of Self-Adaptation † Sven Tomforde * and Martin Goller Intelligent Systems, Christian-Albrechts-Universität zu Kiel, 24118 Kiel, Germany; [email protected] * Correspondence: [email protected]; Tel.: +49-431-880-4844 † This paper is an extended version of our paper published in the Workshop on Self-Aware Computing (SeAC), held in conjunction with Foundations and Applications of Self* Systems (FAS* 2019). Received: 14 February 2020; Accepted: 15 March 2020; Published: 18 March 2020 Abstract: Self-adaptation and self-organization (SASO) have been introduced to the management of technical systems as an attempt to improve robustness and administrability. In particular, both mechanisms adapt the system’s structure and behavior in response to dynamics of the environment and internal or external disturbances. By now, adaptivity has been considered to be fully desirable. This position paper argues that too much adaptation conflicts with goals such as stability and user acceptance. Consequently, a kind of situation-dependent degree of adaptation is desired, which defines the amount and severity of tolerated adaptations in certain situations. As a first step into this direction, this position paper presents a quantification approach for measuring the current adaptation behavior based on generative, probabilistic models. The behavior of this method is analyzed in terms of three application scenarios: urban traffic control, the swidden farming model, and data communication protocols. Furthermore, we define a research roadmap in terms of six challenges for an overall measurement framework for SASO systems. Keywords: self-adaptation; quantification; system analysis; organic computing; metric; degree of adaptation 1.
    [Show full text]
  • Two Dogmas of Empiricism1a
    Two Dogmas of Empiricism1a Willard Van Orman Quine Originally published in The Philosophical Review 60 (1951): 20-43. Reprinted in W.V.O. Quine, From a Logical Point of View (Harvard University Press, 1953; second, revised, edition 1961), with the following alterations: "The version printed here diverges from the original in footnotes and in other minor respects: §§1 and 6 have been abridged where they encroach on the preceding essay ["On What There Is"], and §§3-4 have been expanded at points." Except for minor changes, additions and deletions are indicated in interspersed tables. I wish to thank Torstein Lindaas for bringing to my attention the need to distinguish more carefully the 1951 and the 1961 versions. Endnotes ending with an "a" are in the 1951 version; "b" in the 1961 version. (Andrew Chrucky, Feb. 15, 2000) Modern empiricism has been conditioned in large part by two dogmas. One is a belief in some fundamental cleavage between truths which are analytic, or grounded in meanings independently of matters of fact and truths which are synthetic, or grounded in fact. The other dogma is reductionism: the belief that each meaningful statement is equivalent to some logical construct upon terms which refer to immediate experience. Both dogmas, I shall argue, are ill founded. One effect of abandoning them is, as we shall see, a blurring of the supposed boundary between speculative metaphysics and natural science. Another effect is a shift toward pragmatism. 1. BACKGROUND FOR ANALYTICITY Kant's cleavage between analytic and synthetic truths was foreshadowed in Hume's distinction between relations of ideas and matters of fact, and in Leibniz's distinction between truths of reason and truths of fact.
    [Show full text]