Defining Accuracy, Precision & Trueness

Total Page:16

File Type:pdf, Size:1020Kb

Defining Accuracy, Precision & Trueness This publication provides technical information regarding the use, application, and metrology related to liquid handling instrumentation. I welcome DefiningAccuracy, Precision new words, or old words used & Trueness in new ways, Language Figure 1. Accurate results are achieved by improving influences both precision and trueness. provided the thinking Improving Accuracy result is more and careful use of words Decreasing Uncertainty when evaluating data allows precision, added us to understand how best to improve laboratory accuracy. color or greater Accuracy is a particularly important concept because it expressiveness. is foundational to the quality of laboratory measurements. William Safire Accuracy invokes an image of something that is correct, reliable and trustworthy. As a conceptual goal, accuracy Improving Trueness Improving is universally sought after. Errors Systematic Decreasing However, what exactly do we mean when we speak of accuracy? Try this experiment: The next time Improving Precision Decreasing Random Errors someone uses the word “accuracy”, engage in a conversation and try to understand as clearly as possible Removing Defining 6 key what they mean by the term. ambiguity terms These are some possibilities: Historically, there have been Six terms related to accuracy • Highly consistent results (e.g., two different ways that the are: Precision, Trueness, a low standard deviation, or word “accuracy” is used in the Accuracy, Random Error, small CV). context of liquid handling. Systematic Error and Uncertainty. We can use this word to There is a logical relationship • An average which is very close describe a single liquid delivery, between these six terms, as to the true value. and also how the average value shown in Figure 1 and Table 1. • Knowing that each measurement of a group of dispenses can correctly represents what is be evaluated for accuracy. This Accuracy present in the sample. “double usage” of the term is still is a combination of trueness common today, but recent work and precision. Good accuracy in developing definitions for requires good trueness and ISO IWA 151 (based on the good precision. Accuracy is vocabulary of metrology2) has measured and reported as provided more precise expla- an uncertainty. Thanks to the nations which help to clarify growing popularity of laboratory our thinking, and allow us to requirements standards such be more exact in what we are as ISO 170253, much has been talking about. written about uncertainty and the detailed procedures to how to calculate or estimate uncer- standard deviation (RSD) or tainty. Uncertainty is frequently coefficient of variation (CV). Table 1. Relationships between error concepts and the way presented in a very mathemat- Precision is necessary for achieving they are quantified. ical way, with lots of equations. good accuracy, but it is not suffi- CONCEPT QUANTITATIVE MEASUREMENT The mathematical expressions cient. Good accuracy requires in authoritative documents such both precision and trueness. Accuracy Uncertainty as the guide to the expression of uncertainty in measurement4, Trueness Precision Random Error can create the impression that is labeled on the vertical axis of uncertainty is a mysterious and Figure 1, and like precision is a Trueness Systematic Error difficult concept. It is helpful to concept. The measure of trueness remember that uncertainty is is systematic error. The idea is that simply a quantitative expression a measurement is true when it is that tells us the accuracy of a aimed squarely at the center of the measurement. target. A pipette or automated liquid handler which is true, will Precision deliver on average a result which is a concept meaning that results is close to the center. As shown are tightly clustered. Precision can in the upper left target in Figure 1, be achieved regardless of where it is possible to be true, while also the cluster falls on the target. having poor precision. Trueness and The degree of precision can be precision are independent of one Q: When can a liquid handling device be considered reliable? measured by quantifying the another. Each can be increased or A: liquid handling device is reliable if it maintains accuracy overall effect of all random errors decreased without changing the over a period of time. The reliability can only be established using descriptive statistics such other. by checking the method, using appropriate primary standards as standard deviation, relative and control specimens3. Q: What is an outlier? A: Outliers are extreme values which are outside of the For the mathematically inclined: expected range of values. They can occur by chance, but also may indicate an experimental error. Outliers should be investigated To determine systematic error (%SE) in an attempt to find a root cause. There are a many different tests to identify outliers5. N N N 111 VVVV−− T VV= i T Q: How many data points should I collect when testing for VV= ∑ VV= N i=1 i i %%SESE == ××100%100% ∑∑ precision and trueness? N i=1 V N i=1 VT T A: The number of data points will vary depending upon your laboratory’s needs, and whether you are testing for trueness, N precision or both. Please see Artel Lab Report, Issue 1, isN the1 average of all measured volumes; 1 How Many Data Points6. VV= ∑ i VV= Ni i=1 ∑is the number of replicate deliveries; N N i=1 References: 1 1. ISO IWA 15:2015, Specification and method for the determination VV= is a single measured volume; of performance of automated liquid handling systems. www.iwa15.org ∑VV−i T %SEN =i=1 ×100% is the target volume, the volume intended to be delivered. 2. JCGM 200:2013 International vocabulary of metrology – Basic and VT general concepts and associated terms (VIM 3rd edition). www.bipm.org/en/publications/guides/ To determine random error (%CV) 3. General requirements for the competence of testing and calibration laboratories. ISO/IEC 17025:2005. N N N 4. JCGM 100:2008 Evaluation of measurement data – Guide to the 1 2 2 VV= ∑ i expression of uncertainty in measurement www.bipm.org/en/ N i=1 ()VV()VVi −− ∑∑ i publications/guides/ 100%100% i=1i=1 %%CVCV == 5. NIST Engineering statistics Handbook, What are outliers in the VNVN−−11 data? www.itl.nist.gov/div898/handbook/prc/section1/prc16.htm 6. Artel Lab Report 1, How Many Data Points: www.artel-usa.com/ resource-library/how-many-data-points/ 19A3229D 25 Bradley Drive, Westbrook, Maine 04092 USA 888-406-3463 | [email protected] | © 2019 Artel®, Inc..
Recommended publications
  • Data Types Are Values
    Data Types Are Values James Donahue Alan Demers Data Types Are Values James Donahue Xerox Corporation Palo Alto Research Center 3333 Coyote Hill Road Palo Alto, California 94304 Alan Demers Computer Science Department Cornell University Ithaca, New York 14853 CSL -83-5 March 1984 [P83-00005] © Copyright 1984 ACM. All rights reserved. Reprinted with permission. A bst ract: An important goal of programming language research is to isolate the fundamental concepts of languages, those basic ideas that allow us to understand the relationship among various language features. This paper examines one of these underlying notions, data type, with particular attention to the treatment of generic or polymorphic procedures and static type-checking. A version of this paper will appear in the ACM Transact~ons on Programming Languages and Systems. CR Categories and Subject Descriptors: 0.3 (Programming Languages), 0.3.1 (Formal Definitions and Theory), 0.3.3 (Language Constructs), F.3.2 (Semantics of Programming Languages) Additional Keywords and Phrases: data types, polymorphism XEROX Xerox Corporation Palo Alto Research Center 3333 Coyote Hill Road Palo Alto, California 94304 DATA TYPES ARE VALVES 1 1. Introduction An important goal of programming language research is to isolate the fundamental concepts of languages, those basic ideas that allow us to understand the relationship among various language features. This paper examines one of these underlying notions, data type, and presents a meaning for this term that allows us to: describe a simple treatment of generic or polymorphic procedures that preserves full static type-checking and allows unrestricted use of recursion; and give a precise meaning to the phrase strong typing, so that Language X is strongly typed can be interpreted as a critically important theorem about the semantics of the language.
    [Show full text]
  • Ignificant Scientific Progress Is Increasingly the Result of National Or Confine Hot Plasma
    ADVERTISEMENT FEATURE LIGHTING THE WAY FOR TOMORROW ignificant scientific progress is increasingly the result of national or confine hot plasma. Its maximum repeatable plasma current can reach 1MA, S international collaboration. A particular strength of the University currently the highest in the world, while its diverted plasma discharge is the of Science and Technology of China (USTC) is its powerful facilities world’s longest. designed specifically to cater for large-scale science, which will help form In 2017, EAST achieved more than 100 seconds of steady-state, the bedrock of China’s second Comprehensive National Science Center, high-confinement mode (H-mode) operation, a world record. This has based in Hefei. implications for the International Thermonuclear Experimental Reactor (ITER), a huge international effort, in which China is a participant, aiming to Accelerating research with the Hefei Light Source build the infrastructure to provide clean nuclear fusion power. USTC has proven expertise in major national projects. With USTC’s support, International collaborations through EAST have already included a joint China’s synchrotron radiation accelerator was officially launched in 1983, experiment on steady-state operation with the DIII-D team of defence becoming the country’s first dedicated VUV and soft X-ray synchrotron contractor General Atomics in the United States, joint conferences and radiation facility — the Hefei Light Source (HLS). projects on plasma-wall interactions with Germany, and joint efforts with To better serve growing demand, phase II of the HLS (HLS-II) was Russia to translate research results. launched in 2010. In this phase a linear accelerator, an 800MeV storage ring and five beamline stations were built, all of which, plus the top-off operation More fusion power: Keda Torus eXperiment mode, have significantly improved the stability, brightness and service life Another device harnessing fusion power is USTC’s Keda Torus eXperiment of the light source.
    [Show full text]
  • Figureseer: Parsing Result-Figures in Research Papers
    FigureSeer: Parsing Result-Figures in Research Papers Noah Siegel, Zachary Horvitz, Roie Levin, Santosh Divvala, and Ali Farhadi Allen Institute for Artificial Intelligence University of Washington http://allenai.org/plato/figureseer Fig. 1: FigureSeer is an end-to-end framework for parsing result-figures in research papers. It automatically localizes figures, classifies them, and analyses their content (center). FigureSeer enables detailed indexing, retrieval, and redesign of result-figures, such as highlighting specific results (top-left), reformatting results (bottom-left), com- plex query answering (top-right), and results summarization (bottom-right). Abstract. `Which are the pedestrian detectors that yield a precision above 95% at 25% recall?' Answering such a complex query involves identifying and analyzing the results reported in figures within several research papers. Despite the availability of excellent academic search en- gines, retrieving such information poses a cumbersome challenge today as these systems have primarily focused on understanding the text content of scholarly documents. In this paper, we introduce FigureSeer, an end- to-end framework for parsing result-figures, that enables powerful search and retrieval of results in research papers. Our proposed approach au- tomatically localizes figures from research papers, classifies them, and analyses the content of the result-figures. The key challenge in analyzing the figure content is the extraction of the plotted data and its association with the legend entries. We address this challenge by formulating a novel graph-based reasoning approach using a CNN-based similarity metric. We present a thorough evaluation on a real-word annotated dataset to demonstrate the efficacy of our approach. 1 Computer Vision for Scholarly Big Data Academic research is flourishing at an unprecedented pace.
    [Show full text]
  • A National Prospective Study of Pornography Consumption and Gendered Attitudes Toward Women
    Sexuality & Culture (2015) 19:444–463 DOI 10.1007/s12119-014-9264-z ORIGINAL PAPER A National Prospective Study of Pornography Consumption and Gendered Attitudes Toward Women Paul J. Wright • Soyoung Bae Published online: 23 December 2014 Ó Springer Science+Business Media New York 2014 Abstract Whether consuming pornography leads to gendered attitudes toward women has been debated extensively. Researchers have primarily studied pornog- raphy’s contribution to gendered sexual attitudes such as rape myth acceptance and sexual callousness toward women. The present study explored associations between pornography consumption and nonsexual gender-role attitudes in a national, two- wave panel sample of US adults. Pornography consumption interacted with age to predict gender-role attitudes. Specifically, pornography consumption at wave one predicted more gendered attitudes at wave two for older—but not for younger— adults. Gender-role attitudes at wave one were included in this analysis. Pornog- raphy consumption was therefore associated with interindividual over time change in older adults’ gendered attitudes toward women. Older adults’ attitudes toward nonsexual gender roles are generally more regressive than those of younger adults. Thus, this finding is consistent with Wright’s (Commun Yearb 35:343–386, 2011) script acquisition, activation, application model (3AM) of media socialization, which posits that attitude change following media exposure is more likely for viewers’ whose preexisting behavioral scripts are less incongruous with scripts for behavior presented in mass media depictions. Contrary to the perspective that selective exposure explains associations between pornography consumption and content-congruent attitudes, gender-role attitudes at wave one did not predict por- nography consumption at wave two.
    [Show full text]
  • Introduction
    Introduction Pornography is a social toxin that destroys relationships, steals innocence, erodes compassion, breeds violence, and kills love. The issue of pornography is ground zero for all those concerned for the sexual health of our loved ones, communities, and society as a whole. As the following points illustrate, the breadth and depth of pornography’s influence on popular culture has created an intolerable situation that impinges on the freedoms and wellbeing of countless individuals. ▪ Young Age of First Exposure: A study of university students found that 93% of boys and 62% of girls had seen Internet pornography during adolescence. The researchers reported that the degree of exposure to paraphilic and deviant sexual activity before age 18 was of “particular concern.”1 Another sample has shown that among college males, nearly 49% first encountered pornography before age 13.2 ▪ Pervasive Use: A nationally representative survey found that 64% of young people, ages 13–24, actively seek out pornography weekly or more often.3 A popular tube site reports that in 2016, people watched 4.6 billion hours of pornography on its site alone;4 61% of visits occurred via smartphone.5 Eleven pornography sites are among the world’s top 300 most popular Internet sites. The most popular such site, at number 18, outranks the likes of eBay, MSN, and Netflix.6 1Chiara Sabina, Janis Wolak, and David Finkelhor, “The Nature and Dynamics of Internet Pornography Exposure for Youth,” CyberPsychology & Behavior 11, no. 6 (2008): 691–693. 2Chyng Sun, Ana Bridges, Jennifer Johnson, and Matt Ezzell, “Pornography and the Male Sexual Script: An Analysis of Consumption and Sexual Relations,” Archives of Sexual Behavior 45, no.
    [Show full text]
  • Pornography Consumption and Satisfaction: a Meta-Analysis (2017)
    See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/314197900 Pornography Consumption and Satisfaction: A Meta-Analysis: Pornography and Satisfaction Article in Human Communication Research · March 2017 DOI: 10.1111/hcre.12108 CITATIONS READS 0 76 4 authors, including: Robert Tokunaga University of Hawaiʻi at Mānoa 32 PUBLICATIONS 963 CITATIONS SEE PROFILE All content following this page was uploaded by Robert Tokunaga on 07 April 2017. The user has requested enhancement of the downloaded file. All in-text references underlined in blue are added to the original document and are linked to publications on ResearchGate, letting you access and read them immediately. Human Communication Research ISSN 0360-3989 ORIGINAL ARTICLE Pornography Consumption and Satisfaction: A Meta-Analysis Paul J. Wright1, Robert S. Tokunaga2, Ashley Kraus1, & Elyssa Klann3 1 The Media School, Indiana University, Bloomington, IN 47405, USA 2 Department of Communicology, University of Hawaii, Manoa, HI 96822, USA 3 School of Education, Indiana University, Bloomington, IN 47405, USA A classic question in the communication literature is whether pornography consumption affects consumers’ satisfaction. The present paper represents the first attempt to address this question via meta-analysis. Fifty studies collectively including more than 50,000 par- ticipants from 10 countries were located across the interpersonal domains of sexual and relational satisfaction and the intrapersonal domains of body and self satisfaction. Pornog- raphy consumption was not related to the intrapersonal satisfaction outcomes that were studied. However, pornography consumption was associated with lower interpersonal satis- faction outcomes in cross-sectional surveys, longitudinal surveys, and experiments. Associ- ations between pornography consumption and reduced interpersonal satisfaction outcomes were not moderated by their year of release or their publication status.
    [Show full text]
  • Reflections on the Growth and Development of Islamic Philosophy
    Ilorin Journal of Religious Studies, (IJOURELS) Vol.3 No.2, 2013, Pp.169-190 REFLECTIONS ON THE GROWTH AND DEVELOPMENT OF ISLAMIC PHILOSOPHY Abdulazeez Balogun SHITTU Department of Philosophy & Religions, Faculty of Arts, University of Abuja, P. M. B. 117, FCT, Abuja, Nigeria. [email protected], [email protected] Phone Nos.: +2348072291640, +2347037774311 Abstract As a result of secular dimension that the Western philosophy inclines to, many see philosophy as a phenomenon that cannot be attributed to religion, which led to hasty conclusion in some quarters that philosophy is against religion and must be seen and treated as such. This paper looks at the concept of philosophy in general and Islamic philosophy in particular. It starts by examining Muslim philosophers’ understanding of philosophy, and the wider meanings it attained in their philosophical thought, which do not only reflect in their works but also manifest in their deeds and lifestyles. The paper also tackles the stereotypes about the so-called “replication of Greek philosophy in Islamic philosophy.” It further unveils a total transformation and a more befitting outlook of Islamic philosophy accorded the whole enterprise of philosophy. It also exposes the distinctions between the Islamic philosophy and Western philosophy. Keywords: Islam, Philosophy, Reason, Revelation Introduction From the onset of the growth of Islam as a religious and political movement, Muslim thinkers have sought to understand the theoretical aspects of their faith by using philosophical concepts. The discussion of the notion of meaning in Islamic philosophy is heavily influenced by theological and legal debates about the interpretation of Islam, and about who has the right to pronounce on interpretation.
    [Show full text]
  • ICD-10 CM Official Guidelines for Coding and Reporting FY 2019
    ICD-10-CM Official Guidelines for Coding and Reporting FY 2019 (October 1, 2018 - September 30, 2019) Narrative changes appear in bold text Items underlined have been moved within the guidelines since the FY 2018 version Italics are used to indicate revisions to heading changes The Centers for Medicare and Medicaid Services (CMS) and the National Center for Health Statistics (NCHS), two departments within the U.S. Federal Government’s Department of Health and Human Services (DHHS) provide the following guidelines for coding and reporting using the International Classification of Diseases, 10th Revision, Clinical Modification (ICD-10-CM). These guidelines should be used as a companion document to the official version of the ICD-10- CM as published on the NCHS website. The ICD-10-CM is a morbidity classification published by the United States for classifying diagnoses and reason for visits in all health care settings. The ICD-10-CM is based on the ICD-10, the statistical classification of disease published by the World Health Organization (WHO). These guidelines have been approved by the four organizations that make up the Cooperating Parties for the ICD-10-CM: the American Hospital Association (AHA), the American Health Information Management Association (AHIMA), CMS, and NCHS. These guidelines are a set of rules that have been developed to accompany and complement the official conventions and instructions provided within the ICD-10-CM itself. The instructions and conventions of the classification take precedence over guidelines. These guidelines are based on the coding and sequencing instructions in the Tabular List and Alphabetic Index of ICD-10-CM, but provide additional instruction.
    [Show full text]
  • How Do I Know Whether to Trust a Research Result?
    HOW DO I KNOW WHETHER TO TRUST A RESEARCH RESULT? MARTIN SHEPPERD, BRUNEL UNIVERSITY LONDON, UK Magazines such as this, together with many journals are filled with articles presenting findings, new methods, tools and all kinds of software engineering advice. But how can we know if we can trust a research result? Or to put it another way, should the research influence decision making? For practitioners these are important questions. And it will come as no kind of surprise in a column such as this that the role of evidence is emphasised. It helps us decide whether the research can indeed be trusted. It is gratifying therefore to see that empirical evaluation is increasingly becoming a tool for modern software engineering researchers. So that should be the end of the matter. Look at the evi- dence. Unfortunately it would Inconsistent Results in Software Engineering seem not to be quite that sim- The following are three examples of systematic litera- ple. In many situations the ture reviews that have failed to find `conclusion stabil- evidence may be contradictory ity' [9] followed by a large experiment comprising many or at least equivocal. Fur- individual tests. thermore, this can happen even Jørgensen [5] reviewed 15 studies comparing model- when one examines the body based to expert-based estimation. Five of those studies of evidence using a systematic supported expert-based methods, five found no differ- literature review to identify all ence, and five supported model-based estimation. relevant studies and then meta- Mair and Shepperd [8] compared regression to analogy analysis (that is statistical tech- methods for effort estimation and similarly found con- niques to combine multiple re- flicting evidence.
    [Show full text]
  • The Scientific Method the Scientific Method Is a Process Used by Scientists to Study the World Around Them
    The Scientific Method The scientific method is a process used by scientists to study the world around them. It can also be used to test whether any statement is accurate. You can use the scientific method to study a leaf, a dog, an ocean, or the entire Universe. We all have questions about the world. The scientific method is there to test if your answer is correct. You could ask, "Why do dogs and cats have hair?" One answer might be that it keeps them warm. A good scientist would then come up with an experiment to test whether the statement was accurate. BOOM! It's the scientific method in action. 1. IDENTIFY THE PROBLEM The scientific method starts with identifying a problem and forming a question that can be tested. A scientific question can be answered by making observations with your five senses and gathering evidence. The question you ask needs to be something you can measure, so you can compare results you are interested in. For example, “How does fertilizer affect plant growth?” would be a testable scientific question. It’s important to do background research to find out what’s already written about your question before starting your experiment. 2. FORM A HYPOTHESIS The second step in the scientific method is to form a hypothesis. A hypothesis is a possible explanation for a set of observations or an answer to a scientific question. A hypothesis must be testable and measurable. This means that researchers must be able to carry out investi- gations and gather evidence that will either support or disprove the hypothesis.
    [Show full text]
  • Designing an Experiment
    H OW CAN WE U NDERSTAND OUR WATER R ESOURCES? Designing an Experiment he information in this chapter is a Every experiment has specific parts that can short summary of some topics that are be identified by students. These different Tcovered in depth in the book Students parts can all be checked off during the design and Research written by Cothron, Giese, and phase of an experiment. If all the parts of the Rezba. See the end of this chapter for full experiment have been accounted for and information on obtaining this book. The book considered carefully before the experiment is is an invaluable resource for any middle or started it is more likely to be a successful and high school science teacher. beneficial experience for the student. An experiment starts and finishes with the THE DIFFERENT PARTS OF AN EXPERIMENT factors that change during the experiment. There are different types of practical activities These are the variables. The experimenter will that can be carried out either by working purposely change one of the variables; this scientists or by science students. Only some of is the independent variable or manipulated these would strictly be considered experiments. variable. The second variable changes in When younger students begin learning how to response to the purposeful change; this is the carry out simple experiments the experiment dependent variable or responding variable. is often referred to as a “fair test.” The experi- For example, if students change the wing ment can be a test of the effect of different shape of a paper airplane and measure the actions carried out by the experimenter or a resulting time that the plane stays in flight, test comparing differing conditions as some the independent variable would be the wing action is carried out.
    [Show full text]
  • How to Use the ICF: a Practical Manual for Using the International Classification of Functioning, Disability and Health (ICF)
    How to use the ICF A Practical Manual for using the International Classification of Functioning, Disability and Health (ICF) Exposure draft for comment October 2013 World Health Organization Geneva How to use the ICF A Practical Manual for using the International Classification of Functioning, Disability and Health (ICF) Exposure draft for comment Suggested citation World Health Organization. How to use the ICF: A practical manual for using the International Classification of Functioning, Disability and Health (ICF). Exposure draft for comment. October 2013. Geneva: WHO Contents Preface to the ICF Practical Manual 1 Why should I read this Practical Manual? 1 What will I learn from reading this Practical Manual? 1 How is this Practical Manual organised? 2 Why was this Practical Manual written? 2 1 Getting started with the ICF 3 1.1 What is the ICF? 3 1.2 How can I use the ICF? 7 1.3 What does the ICF classify? 12 1.4 How does a classification such as the ICF relate to electronic records? 14 2 Describing functioning 15 2.1. How can I use the ICF to describe functioning? 15 2.2 What is the ICF coding structure? 18 2.3. How can I describe Body Functions and Body Structures using the ICF coding structure? 20 2.4 How can I describe Activities and Participation using the ICF? 22 2.5 How can I describe the impact of the Environment using the ICF? 25 2.6. How can I use the personal factors? 26 2.7 How can I use the ICF with existing descriptions of functioning? 27 3 Using the ICF in clinical practice and the education of health professionals 29 3.1 Can the ICF be used to enhance the training of health professionals? 29 3.2 How can the ICF be used in the education of health professionals? 31 3.3 How can I use the ICF to describe functioning in clinical practice? 34 3.4.
    [Show full text]