Travail De Bachelor Rapport Final
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Leveraging Posit Arithmetic in Deep Neural Networks
Leveraging Posit Arithmetic in Deep Neural Networks Master’s Thesis Course 2020–2021 Author Raul Murillo Montero Advisors Dr. Alberto A. del Barrio García Dr. Guillermo Botella Juan Master in Computer Science Engineering Faculty of Computer Science Complutense University of Madrid This document is prepared for double-sided printing. Leveraging Posit Arithmetic in Deep Neural Networks Master’s Thesis in Computer Science Engineering Department of Computer Architecture and Automation Author Raul Murillo Montero Advisors Dr. Alberto A. del Barrio García Dr. Guillermo Botella Juan Call: January 2021 Grade: 10 Master in Computer Science Engineering Faculty of Computer Science Complutense University of Madrid Course 2020–2021 Copyright c Raul Murillo Montero Acknowledgements To my advisors, Alberto and Guillermo, thank you for giving me the opportunity to embark on this project, for all the corrections, the constant suggestions for improve- ment, and your support. Thanks to my family and to all of you who have accompanied me on this journey and have made it a little easier. v COMPLUTENSE UNIVERSITY OF MADRID Abstract Faculty of Computer Science Department of Computer Architecture and Automation Master in Computer Science Engineering Leveraging Posit Arithmetic in Deep Neural Networks by Raul Murillo Montero The IEEE 754 Standard for Floating-Point Arithmetic has been for decades imple- mented in the vast majority of modern computer systems to manipulate and com- pute real numbers. Recently, John L. Gustafson introduced a new data type called positTM to represent real numbers on computers. This emerging format was designed with the aim of replacing IEEE 754 floating-point numbers by providing certain ad- vantages over them, such as a larger dynamic range, higher accuracy, bitwise iden- tical results across systems, or simpler hardware, among others. -
Study of the Posit Number System: a Practical Approach
STUDY OF THE POSIT NUMBER SYSTEM: A PRACTICAL APPROACH Raúl Murillo Montero DOBLE GRADO EN INGENIERÍA INFORMÁTICA – MATEMÁTICAS FACULTAD DE INFORMÁTICA UNIVERSIDAD COMPLUTENSE DE MADRID Trabajo Fin Grado en Ingeniería Informática – Matemáticas Curso 2018-2019 Directores: Alberto Antonio del Barrio García Guillermo Botella Juan Este documento está preparado para ser imprimido a doble cara. STUDY OF THE POSIT NUMBER SYSTEM: A PRACTICAL APPROACH Raúl Murillo Montero DOUBLE DEGREE IN COMPUTER SCIENCE – MATHEMATICS FACULTY OF COMPUTER SCIENCE COMPLUTENSE UNIVERSITY OF MADRID Bachelor’s Degree Final Project in Computer Science – Mathematics Academic year 2018-2019 Directors: Alberto Antonio del Barrio García Guillermo Botella Juan To me, mathematics, computer science, and the arts are insanely related. They’re all creative expressions. Sebastian Thrun Acknowledgements I have to start by thanking Alberto Antonio del Barrio García and Guillermo Botella Juan, the directors of this amazing project. Thank you for this opportunity, for your support, your help and for trusting me. Without you any of this would have ever been possible. Thanks to my family, who has always supported me and taught me that I am only limited by the limits I choose to put on myself. Finally, thanks to all of you who have accompanied me on this 5 year journey. Sharing classes, exams, comings and goings between the two faculties with you has been a wonderful experience I will always remember. vii Abstract The IEEE Standard for Floating-Point Arithmetic (IEEE 754) has been for decades the standard for floating-point arithmetic and is implemented in a vast majority of modern computer systems. -
Posits: an Alternative to Floating Point Calculations
Rochester Institute of Technology RIT Scholar Works Theses 5-2020 Posits: An Alternative to Floating Point Calculations Matt Wagner [email protected] Follow this and additional works at: https://scholarworks.rit.edu/theses Recommended Citation Wagner, Matt, "Posits: An Alternative to Floating Point Calculations" (2020). Thesis. Rochester Institute of Technology. Accessed from This Master's Project is brought to you for free and open access by RIT Scholar Works. It has been accepted for inclusion in Theses by an authorized administrator of RIT Scholar Works. For more information, please contact [email protected]. POSITS:AN ALTERNATIVE TO FLOATING POINT CALCULATIONS by MATT WAGNER GRADUATE PAPER Submitted in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE in Electrical Engineering Approved by: Mr. Mark A. Indovina, Senior Lecturer Graduate Research Advisor, Department of Electrical and Microelectronic Engineering Dr. Sohail A. Dianat, Professor Department Head, Department of Electrical and Microelectronic Engineering DEPARTMENT OF ELECTRICAL AND MICROELECTRONIC ENGINEERING KATE GLEASON COLLEGE OF ENGINEERING ROCHESTER INSTITUTE OF TECHNOLOGY ROCHESTER,NEW YORK MAY, 2020 I dedicate this paper to everyone along the way. Declaration Declaration I hereby declare that except where specific reference is made to the work of others, that all content of this Graduate Paper are original and have not been submitted in whole or in part for consideration for any other degree or qualification in this, or any other University. This Graduate Project is the result of my own work and includes nothing which is the outcome of work done in collaboration, except where specifically indicated in the text. -
Deckblatt KIT, 15-02
Up-to-date Interval Arithmetic From Closed Intervals to Connected Sets of Real Numbers Ulrich Kulisch Preprint 15/02 INSTITUT FÜR WISSENSCHAFTLICHES RECHNEN UND MATHEMATISCHE MO DELLBILDUNG Anschriften der Verfasser: Prof. Dr. Ulrich Kulisch Institut fur¨ Angewandte und Numerische Mathematik Karlsruher Institut fur¨ Technologie (KIT) D-76128 Karlsruhe Up-to-date Interval Arithmetic From closed intervals to connected sets of real numbers Ulrich Kulisch Institut f¨ur Angewandte und Numerische Mathematik Karlsruher Institut f¨ur Technologie Kaiserstrasse 12 D-76128 Karlsruhe GERMANY [email protected] Abstract. This paper unifies the representations of different kinds of computer arithmetic. It is motivated by ideas developed in the book The End of Error by John Gustafson [5]. Here interval arithmetic just deals with connected sets of real numbers. These can be closed, open, half-open, bounded or unbounded. The first chapter gives a brief informal review of computer arithmetic from early floating-point arithmetic to the IEEE 754 floating-point arithmetic standard, to conventional interval arith- metic for closed and bounded real intervals, to the proposed standard IEEE P1788 for interval arithmetic, to advanced computer arithmetic, and finally to the just recently defined and pub- lished unum and ubound arithmetic [5]. Then in chapter 2 the style switches from an informal to a pure and strict mathematical one. Different kinds of computer arithmetic follow an abstract mathematical pattern and are just special realizations of it. The basic mathematical concepts are condensed into an abstract ax- iomatic definition. A computer operation is defined via a monotone mapping of an arithmetic operation in a complete lattice onto a complete sublattice. -
Up-To-Date Interval Arithmetic from Closed Intervals to Connected Sets of Real Numbers
Up-to-date Interval Arithmetic From closed intervals to connected sets of real numbers Ulrich Kulisch Institut f¨ur Angewandte und Numerische Mathematik Karlsruher Institut f¨ur Technologie D-76128 Karlsruhe GERMANY [email protected] Abstract. This paper unifies the representations of different kinds of computer arithmetic. It is motivated by the book The End of Error by John Gustafson [5]. Here interval arithmetic just deals with connected sets of real numbers. These can be closed, open, half-open, bounded or unbounded. In an earlier paper [19] the author showed that different kinds of computer arithmetic like floating-point arithmetic, conventional interval arithmetic for closed real intervals and arithmetic for interval vectors and interval matrices can all be derived from an abstract axiomatic definition of computer arithmetic and are just special realizations of it. A computer operation is defined via a monotone mapping of an arithmetic operation in a complete lattice onto a complete sublattice. This paper shows that the newly defined unum and ubound arithmetic [5] can be deduced from the same abstract mathematical model. To a great deal unum and ubound arithmetic can be seen as an extension of arithmetic for closed real intervals to open and half-open real intervals, just to connected sets of real numbers. Deriving computer executable formulas for ubound arithmetic on the base of pure floating-point numbers (without the IEEE 754 exceptions) leads to a closed calculus that is totally free of exceptions, i.e., any arithmetic operation of the set +, −, ·,/, and the dot product for ubounds together with a number of elementary functions always delivers a ubound as result. -
Posit Arithmetic John L
Copyright © 2017 John L. Gustafson Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sub-license, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: This copyright and permission notice shall be included in all copies or substantial portions of the software. THE SOFTWARE IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES, OR OTHER LIABILITY, WHETHER IN AN ACTION OR CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. Posit Arithmetic John L. Gustafson 10 October 2017 1 Overview Unums are for expressing real numbers and ranges of real numbers. There are two modes of operation, selectable by the user: posit mode and valid mode. In posit mode, a unum behaves much like a floating-point number of fixed size, rounding to the nearest expressible value if the result of a calculation is not expressible exactly; however, the posit representation offers more accuracy and a larger dynamic range than floats with the same number of bits, as well as many other advantages. We can refer to these simply as posits for short, just as we refer to IEEE 754 Standard floating-point numbers as floats.