Binary Data Consistency Test 1 Debit

Total Page:16

File Type:pdf, Size:1020Kb

Binary Data Consistency Test 1 Debit BINARY DATA CONSISTENCY TEST 1 DEBIT: A Simple Consistency Test For Binary Data 1 2 James A. J. Heathers ,​ Nicholas J. L. Brown ​ ​ 1. Northeastern University, Boston MA 2. University of Groningen, The Netherlands Correspondence to: [email protected] ​ Bouvé College of Health Sciences Northeastern University, 360 Huntington Avenue, Boston MA 02115. BINARY DATA CONSISTENCY TEST 2 Abstract Scientific papers occasionally report group membership coded as a binary variable [i.e., 0 or 1], and present the mean and standard deviation calculated from it in a table of descriptive statistics. This is redundant as the mean and standard deviation are not independent. This manuscript demonstrates this redundancy, and uses the observation as a simple error detection test to investigate the accuracy of published descriptive statistics, termed here DEBIT (DEscriptive BInary Test). Salient features of deploying the test are discussed, as are some anonymized examples where presented tables of descriptives appear to fail DEBIT. Keywords: error detection, metascience ​ BINARY DATA CONSISTENCY TEST 3 DEBIT: A Simple Consistency Test For Binary Data Within science, there is a pressing concern that methods and results may be underreported or under-specified. The inaccessibility of raw data during review (Mayernik, ​ Callaghan, Leigh, Tedds, & Worley, 2015) or in perpetuity (Vines et al., 2014), and the ​ ​ ​ underreporting of methodological details and/or irreproducibility of methods (Prinz, Schlange, & ​ Asadullah, 2011), are contributors to the present crisis in reproducibility and replicability ​ (Camerer et al., 2016, 2018). In this environment, it is unusual to consider information that is ​ overreported—that is, details included in scientific work although they contribute no additional ​ information. However, overreported metrics have the potential to form error detection tests (i.e., they can be used to investigate inconsistencies or errors in scientific publications), as they contain redundant elements that ought necessarily to be in agreement. Scientific papers commonly report measures of central tendency and dispersion to define sample characteristics. As this is ubiquitous, papers will occasionally—and unnecessarily— report both the mean and standard deviation of a binary variable, most typically from a group ​ ​ which has yes/no membership, coded numerically as 0 and 1. Examples include dichotomous age delineations (e.g., participants aged 25 or below, versus participants aged 26 or above), participants meeting a group membership criterion (e.g., depressed patients with BDI scores of 14 or above vs. non-depressed or recovering patients with BDI scores of 13 or below; Beck, Steer, & Brown, 1996), sex (male vs. female), geographical location (urban vs. rural), and so on. In text, these variables are often reported as a single percentage (e.g., “A sample of 70 ​ participants (47.1% female) was collected for analysis”) or as one or more raw numbers (e.g., ​ BINARY DATA CONSISTENCY TEST 4 “n = 85 urban and n = 35 rural participants returned the survey”). For inclusion in statistical ​ ​ ​ ​ ​ ​ ​ ​ ​ analyses for proportionality between groups as categories (e.g. using the chi-square test of independence), or for use as variables in a regression, these group memberships are often assigned a binary value (0 vs. 1) from which the mean and standard deviation are calculated. It is unclear why or how this reporting standard has arisen, because the standard deviation is entirely determined by the mean and cell sizes. It is trivial to demonstrate the redundancy of the standard deviation, and thus determine it contains no additional information about the sample of interest. Consider a sample with two groups (cell sizes a and b), which are assigned the binary ​ ​ ​ ​ values of 0 and 1 respectively with an overall sample size of N, hence: ​ ​ If this is the case, the standard deviation is a simple function of a and b: As , BINARY DATA CONSISTENCY TEST 5 As the sample standard deviation is invariably used, this can be modified to: This relationship can also be expressed in terms of the overall mean using the previous identity: As a consequence, any sample of binary variables has a mean and standard deviation that are precisely described by the two cell sizes, and as these mean/standard deviation pairs are commonly reported, we can treat them as a window to check the consistency of the presented figures. Similar to other methods of checking internal consistency, this identity is absolute, as it is when test statistics are back-calculated (e.g., with statcheck: Nuijten, Hartgerink, van Assen, ​ Epskamp, & Wicherts, 2016) or in the GRIM test, a method for using granularity to determine ​ whether reported means are possible (Brown & Heathers, 2016). Unlike SPRITE (Heathers, ​ ​ ​ Anaya, van der Zee, & Brown, 2018), a method for reconstructing potential datasets via iterating ​ individual changes in the constituent values, the SD of a binary variable requires no estimation and is absolute rather than probabilistic. For instance, if we report a sample (N = 280) with sex ​ ​ coded as a binary variable, with 127 male participants and 153 female participants, the standard deviation is exactly equal to 0.4987..., as: BINARY DATA CONSISTENCY TEST 6 For simplicity, we have termed this observation the DEscriptive BInary Test (DEBIT1). While the test is absolute if the numbers are perfectly specified, there are exceptions to this besides basic typographical or statistical errors: (1) Rounding In a sufficiently large sample, reporting any number to a low amount of decimal places (usually 2) or as a percentage may return a range of possible sample sizes. Assume a sample of N = 2,500, which is described as 17% patient population, 83% healthy participants (with the ​ numbers of participants in each condition being designated as P and H, respectively), with a ​ ​ ​ ​ reported SD of 0.37. Allowing for numbers very close to the rounding values, a check for ​ ​ consistency is now whether an SD of ≥0.365 to <0.375 is produced by any possible solution where N = P + H = 2500 (i.e., from ~16.5% to ~17.5% P and from ~82.5% to ~83.5% H). ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Hence, a range of possible solutions may fit the reported data; in this case, 396 ≤ P ≤ 422. ​ ​ (2) Unreported exclusions Real-world datasets frequently have incomplete items, which are presumably more common when data is collected unsupervised, under duress, under time pressure, when resistance is provoked by the content of the questions (eg. if on deeply personal matters), or with methods which do not compel a response (i.e. an mailed paper survey, or an automated survey which does not mandate that every question be answered to achieve completion). These deficiencies are, in general, more likely when research is completed on a large scale or at multiple testing sites. In this case, cell sizes or subsamples of individual items may not be implied by the overall sample size reported. 1 The name BInary DEscriptive Test (BIDET) was rejected after consulting a small focus group of colleagues. BINARY DATA CONSISTENCY TEST 7 (3) Altered data If a data set has been altered in certain ways—such as the accidental omission of part of the data due to an incorrect operation in a text editor or incorrect filtering in a statistical package, or if the descriptive statistics have simply been fabricated—then sample sizes, means, and standard deviations may not align as they should. (Note, however, that if the raw data for one or ​ ​ more variables have been fabricated, the descriptive statistics for these variables will be internally consistent if correctly reported.) Visualising DEBIT As these errors differ in magnitude (e.g., while a rounding error might produce an n1/n2 ​ ​ ​ ​ ​ pair that is slightly incorrect, other errors may be of larger magnitude), and the relevant numbers are presented en masse in tables of descriptives, a simple visualization can help to simplify the task of inspecting data. In any sample size of interest, the overall N can be split into every ​ ​ possible n1/n2 pair (x-axis), and expressed either in absolute terms or as a proportion. These ​ ​ ​ ​ ​ ​ points can be plotted against the corresponding standard deviations (y-axis). If an individual point does not lie on this line, it is necessarily incorrect. An example: In a hypothetical medium-sized sample of participants (women over the age of 75; N = 100), a small number answer a binary question positively (“are you still in the ​ ​ workforce?”; yes, n1 = 15) and a larger sub-sample answer the same question negatively (“are ​ ​ ​ you still in the workforce?”; no, n1 = 85). Figure 1 displays this visualization with SDs at 0.28, ​ ​ ​ 0.36, 0.44, and 0.52. BINARY DATA CONSISTENCY TEST 8 Figure 1. A simple DEBIT graph, with potential values seen at x=0.15 The four points in Figure 1 represent different classes of solutions. SD = 0.36 is correct ​ ​ ​ ​ for the sample/cell sizes, and as such it lies on the line at (15, 0.36). SD = 0.52 is trivially ​ ​ ​ ​ incorrect, and a test is not required to make this determination as it is impossible at any point; if n = 100, the maximum possible value for any SD of a standard experimental sample size is ​ ​ ​ ​ 0.50 + ε, where ε approaches 0 as n increases. SD = 0.28 and SD = 0.44 are both incorrect, and ​ ​ ​ ​ ​ ​ ​ ​ potentially provide useful additional information. These solutions may themselves fall into one of two categories: they may either correspond to a different mean (i.e. if SD = 0.44, n1 = 25 and ​ ​ ​ ​ ​ ​ n1 = 26 are both solutions), or they may not exist as per the GRIM test (Brown & Heathers, ​ ​ ​ ​ ​ ​ BINARY DATA CONSISTENCY TEST 9 2016), as these SDs are also affected by the relationship between granularity and the level of ​ rounding possible in the solutions. In this case, if we report all figures to 2 d.p., SD = 0.28 is ​ ​ ​ ​ impossible as it lies between n1 = 8 (SD = 0.27) and n2 = 9 (SD = 0.29).
Recommended publications
  • Generalized Linear Models (Glms)
    San Jos´eState University Math 261A: Regression Theory & Methods Generalized Linear Models (GLMs) Dr. Guangliang Chen This lecture is based on the following textbook sections: • Chapter 13: 13.1 – 13.3 Outline of this presentation: • What is a GLM? • Logistic regression • Poisson regression Generalized Linear Models (GLMs) What is a GLM? In ordinary linear regression, we assume that the response is a linear function of the regressors plus Gaussian noise: 0 2 y = β0 + β1x1 + ··· + βkxk + ∼ N(x β, σ ) | {z } |{z} linear form x0β N(0,σ2) noise The model can be reformulate in terms of • distribution of the response: y | x ∼ N(µ, σ2), and • dependence of the mean on the predictors: µ = E(y | x) = x0β Dr. Guangliang Chen | Mathematics & Statistics, San Jos´e State University3/24 Generalized Linear Models (GLMs) beta=(1,2) 5 4 3 β0 + β1x b y 2 y 1 0 −1 0.0 0.2 0.4 0.6 0.8 1.0 x x Dr. Guangliang Chen | Mathematics & Statistics, San Jos´e State University4/24 Generalized Linear Models (GLMs) Generalized linear models (GLM) extend linear regression by allowing the response variable to have • a general distribution (with mean µ = E(y | x)) and • a mean that depends on the predictors through a link function g: That is, g(µ) = β0x or equivalently, µ = g−1(β0x) Dr. Guangliang Chen | Mathematics & Statistics, San Jos´e State University5/24 Generalized Linear Models (GLMs) In GLM, the response is typically assumed to have a distribution in the exponential family, which is a large class of probability distributions that have pdfs of the form f(x | θ) = a(x)b(θ) exp(c(θ) · T (x)), including • Normal - ordinary linear regression • Bernoulli - Logistic regression, modeling binary data • Binomial - Multinomial logistic regression, modeling general cate- gorical data • Poisson - Poisson regression, modeling count data • Exponential, Gamma - survival analysis Dr.
    [Show full text]
  • The Hexadecimal Number System and Memory Addressing
    C5537_App C_1107_03/16/2005 APPENDIX C The Hexadecimal Number System and Memory Addressing nderstanding the number system and the coding system that computers use to U store data and communicate with each other is fundamental to understanding how computers work. Early attempts to invent an electronic computing device met with disappointing results as long as inventors tried to use the decimal number sys- tem, with the digits 0–9. Then John Atanasoff proposed using a coding system that expressed everything in terms of different sequences of only two numerals: one repre- sented by the presence of a charge and one represented by the absence of a charge. The numbering system that can be supported by the expression of only two numerals is called base 2, or binary; it was invented by Ada Lovelace many years before, using the numerals 0 and 1. Under Atanasoff’s design, all numbers and other characters would be converted to this binary number system, and all storage, comparisons, and arithmetic would be done using it. Even today, this is one of the basic principles of computers. Every character or number entered into a computer is first converted into a series of 0s and 1s. Many coding schemes and techniques have been invented to manipulate these 0s and 1s, called bits for binary digits. The most widespread binary coding scheme for microcomputers, which is recog- nized as the microcomputer standard, is called ASCII (American Standard Code for Information Interchange). (Appendix B lists the binary code for the basic 127- character set.) In ASCII, each character is assigned an 8-bit code called a byte.
    [Show full text]
  • Generalized Linear Models
    CHAPTER 6 Generalized linear models 6.1 Introduction Generalized linear modeling is a framework for statistical analysis that includes linear and logistic regression as special cases. Linear regression directly predicts continuous data y from a linear predictor Xβ = β0 + X1β1 + + Xkβk.Logistic regression predicts Pr(y =1)forbinarydatafromalinearpredictorwithaninverse-··· logit transformation. A generalized linear model involves: 1. A data vector y =(y1,...,yn) 2. Predictors X and coefficients β,formingalinearpredictorXβ 1 3. A link function g,yieldingavectoroftransformeddataˆy = g− (Xβ)thatare used to model the data 4. A data distribution, p(y yˆ) | 5. Possibly other parameters, such as variances, overdispersions, and cutpoints, involved in the predictors, link function, and data distribution. The options in a generalized linear model are the transformation g and the data distribution p. In linear regression,thetransformationistheidentity(thatis,g(u) u)and • the data distribution is normal, with standard deviation σ estimated from≡ data. 1 1 In logistic regression,thetransformationistheinverse-logit,g− (u)=logit− (u) • (see Figure 5.2a on page 80) and the data distribution is defined by the proba- bility for binary data: Pr(y =1)=y ˆ. This chapter discusses several other classes of generalized linear model, which we list here for convenience: The Poisson model (Section 6.2) is used for count data; that is, where each • data point yi can equal 0, 1, 2, ....Theusualtransformationg used here is the logarithmic, so that g(u)=exp(u)transformsacontinuouslinearpredictorXiβ to a positivey ˆi.ThedatadistributionisPoisson. It is usually a good idea to add a parameter to this model to capture overdis- persion,thatis,variationinthedatabeyondwhatwouldbepredictedfromthe Poisson distribution alone.
    [Show full text]
  • Modelling Binary Outcomes
    Modelling Binary Outcomes 01/12/2020 Contents 1 Modelling Binary Outcomes 5 1.1 Cross-tabulation . .5 1.1.1 Measures of Effect . .6 1.1.2 Limitations of Tabulation . .6 1.2 Linear Regression and dichotomous outcomes . .6 1.2.1 Probabilities and Odds . .8 1.3 The Binomial Distribution . .9 1.4 The Logistic Regression Model . 10 1.4.1 Parameter Interpretation . 10 1.5 Logistic Regression in Stata . 11 1.5.1 Using predict after logistic ........................ 13 1.6 Other Possible Models for Proportions . 13 1.6.1 Log-binomial . 14 1.6.2 Other Link Functions . 16 2 Logistic Regression Diagnostics 19 2.1 Goodness of Fit . 19 2.1.1 R2 ........................................ 19 2.1.2 Hosmer-Lemeshow test . 19 2.1.3 ROC Curves . 20 2.2 Assessing Fit of Individual Points . 21 2.3 Problems of separation . 23 3 Logistic Regression Practical 25 3.1 Datasets . 25 3.2 Cross-tabulation and Logistic Regression . 25 3.3 Introducing Continuous Variables . 26 3.4 Goodness of Fit . 27 3.5 Diagnostics . 27 3.6 The CHD Data . 28 3 Contents 4 1 Modelling Binary Outcomes 1.1 Cross-tabulation If we are interested in the association between two binary variables, for example the presence or absence of a given disease and the presence or absence of a given exposure. Then we can simply count the number of subjects with the exposure and the disease; those with the exposure but not the disease, those without the exposure who have the disease and those without the exposure who do not have the disease.
    [Show full text]
  • Section II Descriptive Statistics for Continuous & Binary Data (Including
    Section II Descriptive Statistics for continuous & binary Data (including survival data) II - Checklist of summary statistics Do you know what all of the following are and what they are for? One variable – continuous data (variables like age, weight, serum levels, IQ, days to relapse ) _ Means (Y) Medians = 50th percentile Mode = most frequently occurring value Quartile – Q1=25th percentile, Q2= 50th percentile, Q3=75th percentile) Percentile Range (max – min) IQR – Interquartile range = Q3 – Q1 SD – standard deviation (most useful when data are Gaussian) (note, for a rough approximation, SD 0.75 IQR, IQR 1.33 SD) Survival curve = life table CDF = Cumulative dist function = 1 – survival curve Hazard rate (death rate) One variable discrete data (diseased yes or no, gender, diagnosis category, alive/dead) Risk = proportion = P = (Odds/(1+Odds)) Odds = P/(1-P) Relation between two (or more) continuous variables (Y vs X) Correlation coefficient (r) Intercept = b0 = value of Y when X is zero Slope = regression coefficient = b, in units of Y/X Multiple regression coefficient (bi) from a regression equation: Y = b0 + b1X1 + b2X2 + … + bkXk + error Relation between two (or more) discrete variables Risk ratio = relative risk = RR and log risk ratio Odds ratio (OR) and log odds ratio Logistic regression coefficient (=log odds ratio) from a logistic regression equation: ln(P/1-P)) = b0 + b1X1 + b2X2 + … + bkXk Relation between continuous outcome and discrete predictor Analysis of variance = comparing means Evaluating medical tests – where the test is positive or negative for a disease In those with disease: Sensitivity = 1 – false negative proportion In those without disease: Specificity = 1- false positive proportion ROC curve – plot of sensitivity versus false positive (1-specificity) – used to find best cutoff value of a continuously valued measurement DESCRIPTIVE STATISTICS A few definitions: Nominal data come as unordered categories such as gender and color.
    [Show full text]
  • Yes, No, Maybe So: Tips and Tricks for Using 0/1 Binary Variables Laurie Hamilton, Healthcare Management Solutions LLC, Columbia MD
    NESUG 2012 Coders' Corner Yes, No, Maybe So: Tips and Tricks for Using 0/1 Binary Variables Laurie Hamilton, Healthcare Management Solutions LLC, Columbia MD ABSTRACT Many SAS® programmers are familiar with the use of 0/1 binary variables in various statistical procedures. But 0/1 variables are also useful in basic database construction, data profiling and QC techniques. By definition, a binary variable is a flavor of categorical variable, an outcome or response measure with only two possible values. In this paper, we will use a sample dataset composed of 0/1 numeric binary variables to demon- strate some tricks and tips for quick Data Profiling and Quality Assurance using basic SAS functions and the MEANS and FREQ procedures. INTRODUCTION Binary variables are a type of categorical variable, specifically those variables which can have only a Yes or No value. We see these types of variables often in Questionnaire type data, which is the example we will use in this paper. We will begin with a brief discussion of the options constructing 0/1 variables, including selection of data type and the implications for the coding of missing values. We will then look at some tips and tricks for using the SAS® functions SUM, NMISS and CAT to create summary variables from multiple binary variables across individual ob- servations and also demonstrate one method for constructing a Pattern variable which combines all the infor- mation in multiple binary variables into one character string. The SAS® procedures PROC MEANS and PROC FREQ are ideally suited to quickly profiling data composed of 0/1 numeric binary variables and we will explore some applications of those procedures using our sample data.
    [Show full text]
  • Data Representation
    Data Representation Data Representation Chapter Three A major stumbling block many beginners encounter when attempting to learn assembly language is the common use of the binary and hexadecimal numbering systems. Many programmers think that hexadecimal (or hex1) numbers represent absolute proof that God never intended anyone to work in assembly language. While it is true that hexadecimal numbers are a little different from what you may be used to, their advan- tages outweigh their disadvantages by a large margin. Nevertheless, understanding these numbering systems is important because their use simplifies other complex topics including boolean algebra and logic design, signed numeric representation, character codes, and packed data. 3.1 Chapter Overview This chapter discusses several important concepts including the binary and hexadecimal numbering sys- tems, binary data organization (bits, nibbles, bytes, words, and double words), signed and unsigned number- ing systems, arithmetic, logical, shift, and rotate operations on binary values, bit fields and packed data. This is basic material and the remainder of this text depends upon your understanding of these concepts. If you are already familiar with these terms from other courses or study, you should at least skim this material before proceeding to the next chapter. If you are unfamiliar with this material, or only vaguely familiar with it, you should study it carefully before proceeding. All of the material in this chapter is important! Do not skip over any material. In addition to the basic material, this chapter also introduces some new HLA state- ments and HLA Standard Library routines. 3.2 Numbering Systems Most modern computer systems do not represent numeric values using the decimal system.
    [Show full text]
  • Intro to Systems Digital Logic
    CS 31: Intro to Systems Digital Logic Kevin Webb Swarthmore College February 3, 2015 Reading Quiz Today • Hardware basics Circuits: Borrow some • Machine memory models paper if you need to! • Digital signals • Logic gates • Manipulating/Representing values in hardware • Adders • Storage & memory (latches) Hardware Models (1940’s) • Harvard Architecture: CPU Program Data (Control and Memory Memory Arithmetic) Input/Output • Von Neumann Architecture: CPU (Control and Program Arithmetic) and Data Memory Input/Output Von Neumann Architecture Model • Computer is a generic computing machine: • Based on Alan Turing’s Universal Turing Machine • Stored program model: computer stores program rather than encoding it (feed in data and instructions) • No distinction between data and instructions memory • 5 parts connected by buses (wires): • Memory, Control, Processing, Input, Output Memory Cntrl Unit | Processing Unit Input/Output addr bus cntrl bus data bus Memory CPU: Cntrl Unit ALU Input/Output MAR MDR PC IR registers addr bus cntrl bus data bus Memory: data and instructions are stored in memory memory is addressable: addr 0, 1, 2, … • Memory Address Register: address to read/write • Memory Data Register: value to read/write Processing Unit: executes instrs selected by cntrl unit • ALU (artithmetic logic unit):“Register” simmple functional units: ADD, SUB… • Registers: temporary storage directly accessible by instructions Control unit: determinesSmall, very order vast instorage which space. instrs execute • PC: program counter:Fixed addr size of
    [Show full text]
  • Nand2tetris Chapters 1
    1 Boolean Logic1 Such simple things, And we make of them something so complex it defeats us, Almost. —John Ashbery (b. 1927), American poet Every digital device—be it a personal computer, a cellular telephone, or a network router—is based on a set of chips designed to store and process information. Although these chips come in different shapes and forms, they are all made from the same building blocks: Elementary logic gates. The gates can be physically implemented in many different materials and fabrication technologies, but their logical behavior is consistent across all computers. In this chapter we start out with one primitive logic gate—Nand—and build all the other logic gates from it. The result is a rather standard set of gates, which will be later used to construct our computer’s processing and storage chips. This will be done in chapters 2 and 3, respectively. All the hardware chapters in the book, beginning with this one, have the same structure. Each chapter focuses on a well-defined task, designed to construct or integrate a certain family of chips. The prerequisite knowledge needed to approach this task is provided in a brief Background section. The next section provides a complete Specification of the chips’ abstractions, namely, the various services that they should deliver, one way or another. Having presented the what, a subsequent Implementation section proposes guidelines and hints about how the chips can be 1 This document is an adaptation of Chapter 1 of The Elements of Computing Systems, by Noam Nisan and Shimon Schocken, which the authors have graciously made available on their web site: http://nand2tetris.org.
    [Show full text]
  • Chapter 4: the Building Blocks: Binary Numbers, Boolean Logic, and Gates
    Objectives Chapter 4: The Building In this chapter, you will learn about: Blocks: Binary Numbers, The binary numbering system Boolean Logic, and Gates Boolean logic and gates Invitation to Computer Science, Building computer circuits C++ Version, Third Edition Control circuits Invitation to Computer Science, C++ Version, Third Edition 1 Invitation to Computer Science, C++ Version, Third Edition 2 Introduction The Binary Numbering System Chapter 4 focuses on hardware design (also A computer’s internal storage techniques are called logic design) different from the way people represent information in daily lives How to represent and store information inside a computer How to use the principles of symbolic logic to Information inside a digital computer is stored as design gates a collection of binary data How to use gates to construct circuits that perform operations such as adding and comparing numbers, and fetching instructions Invitation to Computer Science, C++ Version, Third Edition 3 Invitation to Computer Science, C++ Version, Third Edition 4 Binary Representation of Numeric and Textual Information Figure 4.2 Binary-to-Decimal Binary numbering system Conversion Table Base-2 Built from ones and zeros Each position is a power of 2 1101 = 1 x 2 3 + 1 x 2 2 + 0 x 2 1 + 1 x 2 0 Decimal numbering system Base-10 Each position is a power of 10 3052 = 3 x 10 3 + 0 x 10 2 + 5 x 10 1 + 2 x 10 0 Invitation to Computer Science, C++ Version, Third Edition 5 Invitation to Computer Science, C++ Version, Third Edition 6 Binary Representation
    [Show full text]
  • Binary Response and Logistic Regression Analysis
    Chapter 3 Binary Response and Logistic Regression Analysis February 7, 2001 Part of the Iowa State University NSF/ILI project Beyond Traditional Statistical Methods Copyright 2000 D. Cook, P. Dixon, W. M. Duckworth, M. S. Kaiser, K. Koehler, W. Q. Meeker and W. R. Stephenson. Developed as part of NSF/ILI grant DUE9751644. Objectives This chapter explains • the motivation for the use of logistic regression for the analysis of binary response data. • simple linear regression and why it is inappropriate for binary response data. • a curvilinear response model and the logit transformation. • the use of maximum likelihood methods to perform logistic regression. • how to assess the fit of a logistic regression model. • how to determine the significance of explanatory variables. Overview Modeling the relationship between explanatory and response variables is a fundamental activity encoun- tered in statistics. Simple linear regression is often used to investigate the relationship between a single explanatory (predictor) variable and a single response variable. When there are several explanatory variables, multiple regression is used. However, often the response is not a numerical value. Instead, the response is simply a designation of one of two possible outcomes (a binary response) e.g. alive or dead, success or failure. Although responses may be accumulated to provide the number of successes and the number of failures, the binary nature of the response still remains. Data involving the relationship between explanatory variables and binary responses abound in just about every discipline from engineering to, the natural sciences, to medicine, to education, etc. How does one model the relationship between explanatory variables and a binary response variable? This chapter looks at binary response data and its analysis via logistic regression.
    [Show full text]
  • MARIE: an Introduction to a Simple Computer
    00068_CH04_Null.qxd 10/18/10 12:03 PM Page 195 “When you wish to produce a result by means of an instrument, do not allow yourself to complicate it.” —Leonardo da Vinci CHAPTER MARIE: An Introduction 4 to a Simple Computer 4.1 INTRODUCTION esigning a computer nowadays is a job for a computer engineer with plenty of Dtraining. It is impossible in an introductory textbook such as this (and in an introductory course in computer organization and architecture) to present every- thing necessary to design and build a working computer such as those we can buy today. However, in this chapter, we first look at a very simple computer called MARIE: a Machine Architecture that is Really Intuitive and Easy. We then pro- vide brief overviews of Intel and MIPs machines, two popular architectures reflecting the CISC and RISC design philosophies. The objective of this chapter is to give you an understanding of how a computer functions. We have, therefore, kept the architecture as uncomplicated as possible, following the advice in the opening quote by Leonardo da Vinci. 4.2 CPU BASICS AND ORGANIZATION From our studies in Chapter 2 (data representation) we know that a computer must manipulate binary-coded data. We also know from Chapter 3 that memory is used to store both data and program instructions (also in binary). Somehow, the program must be executed and the data must be processed correctly. The central processing unit (CPU) is responsible for fetching program instructions, decod- ing each instruction that is fetched, and performing the indicated sequence of operations on the correct data.
    [Show full text]