Tug2007-Slides-2X2.Pdf

Total Page:16

File Type:pdf, Size:1020Kb

Tug2007-Slides-2X2.Pdf Dedication ÅEÌ Professor Donald Knuth (Stanford) Extending TEX and Professor William Kahan (Berkeley) ÅEÌAFÇÆÌ with Floating-Point Arithmetic AF Nelson H. F. Beebe ÇÆÌ X and Department of Mathematics University of Utah E T Salt Lake City, UT 84112-0090 USA TEX Users Group Conference 2007 talk. – p. 1/30 TEX Users Group Conference 2007 talk. – p. 2/30 ÅEÌAFÇÆÌ Arithmetic in TEX and Arithmetic in ÅEÌAFÇÆÌ ÅEÌ ÅEÌ Binary integer arithmetic with 32 bits (T X \count ÅEÌAFÇÆÌ restricts input numbers to 12 integer bits: ≥ E registers) % mf expr Fixed-point arithmetic with sign bit, overflow bit, 14 gimme an expr: 4095 >> 4095 ≥ gimme an expr: 4096 integer bits, and 16 fractional bits (T X \dimen, E ! Enormous number has been reduced. \muskip, and \skip registers) AF >> 4095.99998 AF Overflow detected on division and multiplication but not gimme an expr: infinity >> 4095.99998 on addition (flaw (NHFB), feature (DEK)) gimme an expr: epsilon >> 0.00002 gimme an expr: 1/epsilon Gyrations sometimes needed in ÅEÌAFÇÆÌ to work ÇÆÌ ! Arithmetic overflow. ÇÆÌ Xwith and fixed-point numbers X and >> 32767.99998 Uh, oh.E A little while ago one of the quantities gimmeE an expr: 1/3 >> 0.33333 that I was computing got too large, so I’m afraid gimme an expr: 3*(1/3) >> 0.99998 T T your answers will be somewhat askew. You’ll gimme an expr: 1.2 • 2.3 >> •1.1 probably have to adopt different tactics next gimme an expr: 1.2 • 2.4 >> •1.2 time. But I shall try to carry on anyway. gimme an expr: 1.3 • 2.4 >> •1.09999 TEX Users Group Conference 2007 talk. – p. 3/30 TEX Users Group Conference 2007 talk. – p. 4/30 Historical remarks Historical remarks [cont] ÅEÌ ÅEÌ It is difficult today to appreciate that probably the biggest problem facing programmers in the early 1950s was Floating Point Arithmetic . The subject scaling numbers so as to achieve is not at all as trivial as most people think, acceptable precision from a fixed-point machine. AF and it involves a surprising amount of AF interesting information. Martin Campbell-Kelly Programming the Mark I: Donald E. Knuth ÇÆÌ The Art of Computer Programming: ÇÆÌ X and Early Programming Activity X and at the University of Manchester Seminumerical Algorithms, (1998) E Annals of the History of Computing E 2(2) 130–168 (1980) T T TEX Users Group Conference 2007 talk. – p. 5/30 TEX Users Group Conference 2007 talk. – p. 6/30 Historical remarks [cont] Why no floating-point arithmetic? ÅEÌ ÅEÌ Computer hardware designers can make their System dependence in precision, range, rounding, machines much more pleasant to use, underflow, overflow for example by providing Base varies: 2, 3 (Setun), 4 (Illiac II), 8 (Burroughs), floating-point arithmetic 10, 16 (IBM S/360), 256 (Illiac III), 10000 (Maple) which satisfies simple mathematical laws. AF Bizarre behavior when T X was developed: AF The facilities presently available on most E x y = y x (early Crays) machines make the job of rigorous error × 6 × analysis hopelessly difficult, but properly x = 1.0 x (Pr1me) designed operations would encourage 6 × ÇÆÌ x + x = 2 x (Pr1me) ÇÆÌ X and numerical analysts to provide better X and 6 × x = y but 1.0/(x y) gets zero-divide error subroutines which have certified accuracy. 6 − E E wrap between underflow and overflow (PDP-10) Donald E. Knuth T Computer Programming as an Art T job termination on overflow or zero-divide (most) ACM Turing Award Lecture (1973) No standardization: almost every vendor had unique floating-point system TEX Users Group Conference 2007 talk. – p. 7/30 TEX Users Group Conference 2007 talk. – p. 8/30 Why no floating-point ... [cont]? Why no floating-point ... [cont]? ÅEÌ ÅEÌ Language dependence: Input/output problem requires base conversion, and is Algol, Pascal, and SAIL (real) hard (e.g., conversion from 128-bit binary format can require more than 11500 decimal digits) Fortran (REAL, DOUBLE PRECISION, and sometimes REAL*16) DEK wrote A simple program whose proof isn’t C/C++ (double, float added in 1989, long double (1990) about TEX’s conversions between fixed-point in 1999) AF binary and decimal AF Java and C# (only float and double, but Most languages do not guarantee exact base arithmetic system is badly botched: see Kahan and conversion Darcy’s How Java’s Floating-Point Hurts ÇÆÌ ÇÆÌ X and XT and X guarantees identical line-breaking and Everyone Everywhere) E page-breaking across all platforms (floating-point CompilerE dependence: multiple precisions mapped to arithmeticE used only for interword glue calculations) T just one T ÅEÌAFÇÆÌ has no floating-point at all, and generates BSD compilers still provide no 80-bit format after 27 identical fonts on all systems years in hardware TEX Users Group Conference 2007 talk. – p. 9/30 TEX Users Group Conference 2007 talk. – p. 10/30 IEEE 754 binary standard (1985) IEEE 754 binary standard [cont] ÅEÌ ÅEÌ Preliminary version first implemented in Intel 8087 chip Nonstop computing model: sticky flags record (1980) exceptions Three formats defined: 32-bit, 64-bit, and 80-bit. Four rounding modes: 128-bit format available on some Alpha, IA-64, and to nearest with ties to even (default) SPARC systems. AF to + AF ∞ Nonzero normal numbers are rational: to x = ( 1)sf 2p, where f [1, 2) −∞ − × ∈ to zero (historical chopping) Signed zero ÇÆÌ generated from large/small and finite/0 ÇÆÌ X and X and Largest stored exponent represents Infinity when ±∞ NaN generated from 0/0, , / , and any fE = 0, quiet and signaling NaN (Not-a-Number) when E operation with a NaN operand∞−∞ ∞ ∞ f = 0 T 6 T NaN returned from functions when result is undefined Smallest stored exponent allows f to have leading in real arithmetic (e.g., √ 1) zeros with gradual underflow to subnormal values − TEX Users Group Conference 2007 talk. – p. 11/30 TEX Users Group Conference 2007 talk. – p. 12/30 IEEE 754R Precision and range Remark on floating-point arithmetic ÅEÌ ÅEÌ Binary Contrary to popular misconception, even in some books 32-bit 24b ( 7D) 1e-45 1e-38 3e+38 and compilers, floating-point arithmetic is not fuzzy. ≈ 64-bit 53b( 15D) 4e-324 2e-308 1e+308 Results are exact if they are representable ≈ 80-bit 64b( 19D) 3e-4951 3e-4932 1e+4932 ≈ Multiplication by power of base is always exact, in 128-bit 113b ( 34D) 6e-4966 3e-4932 1e+4932AF AF ≈ absence of underflow and overflow 256-bit 234b ( 70D) 2e-315723 5e-315653 3e+315652 ≈ Subtraction of numbers of like signs and exponents is Decimal exact 32-bit 7D 1e-101 1e-95 1e+96ÇÆÌ ÇÆÌ X and X and 64-bit 16D 1e-398 1e-383 1e+384 128-bitE 34D 1e-6176 1e-6143 1e+6144 E 256-bitT 70D 1e-1572932 1e-1572863 1e+15782864 T TEX Users Group Conference 2007 talk. – p. 13/30 TEX Users Group Conference 2007 talk. – p. 14/30 Binary versus decimal Binary versus decimal [cont] ÅEÌ ÅEÌ IEEE 854 Standard for Radix-Independent humans less uncomfortable with decimal arithmetic Floating-Point Arithmetic (1987, 1994) sales tax: 5% of 0.70 = 0.0349999 . in all binary older Cobol standards require 18D fixed-point precisions, instead of exact decimal 0.035. Thus, significant cumulative rounding errors in businesses Cobol 2002 requires 32D fixed-point and floating-point with many small transactions (food, telephone, . ) AF Proposals to add decimal arithmetic to C and C++ AF financial computations need fixed-point decimal (2005, 2006) arithmetic 25 years of Rexx and NetRexx scripting languages ÇÆÌ give valuable experience in arbitrary-precision decimalÇÆÌ Xhand and calculators use decimal arithmetic X and arithmetic additionalE decimal rounding rules (8 instead of 4) E excellent IBM decNumber library provides open source 9 T decimal arithmetic eliminates most base-conversion T decimal floating-point arithmetic with a billion (10 ) problems digits of precision and exponent magnitudes up to 999999999 TEX Users Group Conference 2007 talk. – p. 15/30 TEX Users Group Conference 2007 talk. – p. 16/30 Binary versus decimal [cont] Problems with IEEE 754 arithmetic ÅEÌ ÅEÌ Preliminary support in gcc for +, , , and / (late Language access to features slow: 27+ years and still − × 2006) based on subset of IBM decNumber library waiting! mathcw package provides C99-compliant run-time Programmer unfamiliarity, ignorance, and inexperience library for binary, and also for decimal, arithmetic Deficient educational system (NHFB 2005–2007) AF Partial implementations by some vendors (e.g., AF Three sizes defined for IEEE 754R: 32-bit (7D), 64-bit subnormals flush to zero, IA-32 has only one NaN, (16D), and 128-bit (34D) IA-32 and IA-64 have imperfect rounding, Java and C# IBM zSeries mainframes get IEEE 754 binary f.p. lack rounding modes and higher precisions) ÇÆÌ ÇÆÌ X(1999), and and decimal f.p. in firmware (2006) X and Long internal registers generally beneficial, but also IBME PowerPC chips add hardware decimal arithmetic produceE many computational surprises and double (2007) rounding, compromising portability T T Hardware support likely in future Intel IA-32 and Rounding behavior at underflow and overflow limits EM64T unspecified, and vendor dependent TEX Users Group Conference 2007 talk. – p. 17/30 TEX Users Group Conference 2007 talk. – p. 18/30 How decimal arithmetic is different Software floating-point arithmetic ÅEÌ ÅEÌ s p Nonzero normal numbers x = ( 1) f 2 , where f TEX and ÅEÌAFÇÆÌ must continue to guarantee is an integer: can simulate fixed-point− arithmetic× identical results across platforms Lack of normalization means multiple storage forms, Unspecified behavior of low-level arithmetic but 1., 1.0, 1.00, 1.000, ..
Recommended publications
  • Donald Knuth Fletcher Jones Professor of Computer Science, Emeritus Curriculum Vitae Available Online
    Donald Knuth Fletcher Jones Professor of Computer Science, Emeritus Curriculum Vitae available Online Bio BIO Donald Ervin Knuth is an American computer scientist, mathematician, and Professor Emeritus at Stanford University. He is the author of the multi-volume work The Art of Computer Programming and has been called the "father" of the analysis of algorithms. He contributed to the development of the rigorous analysis of the computational complexity of algorithms and systematized formal mathematical techniques for it. In the process he also popularized the asymptotic notation. In addition to fundamental contributions in several branches of theoretical computer science, Knuth is the creator of the TeX computer typesetting system, the related METAFONT font definition language and rendering system, and the Computer Modern family of typefaces. As a writer and scholar,[4] Knuth created the WEB and CWEB computer programming systems designed to encourage and facilitate literate programming, and designed the MIX/MMIX instruction set architectures. As a member of the academic and scientific community, Knuth is strongly opposed to the policy of granting software patents. He has expressed his disagreement directly to the patent offices of the United States and Europe. (via Wikipedia) ACADEMIC APPOINTMENTS • Professor Emeritus, Computer Science HONORS AND AWARDS • Grace Murray Hopper Award, ACM (1971) • Member, American Academy of Arts and Sciences (1973) • Turing Award, ACM (1974) • Lester R Ford Award, Mathematical Association of America (1975) • Member, National Academy of Sciences (1975) 5 OF 44 PROFESSIONAL EDUCATION • PhD, California Institute of Technology , Mathematics (1963) PATENTS • Donald Knuth, Stephen N Schiller. "United States Patent 5,305,118 Methods of controlling dot size in digital half toning with multi-cell threshold arrays", Adobe Systems, Apr 19, 1994 • Donald Knuth, LeRoy R Guck, Lawrence G Hanson.
    [Show full text]
  • Typeset MMIX Programs with TEX Udo Wermuth Abstract a TEX Macro
    TUGboat, Volume 35 (2014), No. 3 297 Typeset MMIX programs with TEX Example: In section 9 the lines \See also sec- tion 10." and \This code is used in section 24." are given. Udo Wermuth No such line appears in section 10 as it only ex- tends the replacement code of section 9. (Note that Abstract section 10 has in its headline the number 9.) In section 24 the reference to section 9 stands for all of ATEX macro package is presented as a literate pro- the eight code lines stated in sections 9 and 10. gram. It can be included in programs written in the If a section is not used in any other section then languages MMIX or MMIXAL without affecting the it is a root and during the extraction of the code a assembler. Such an instrumented file can be pro- file is created that has the name of the root. This file cessed by TEX to get nicely formatted output. Only collects all the code in the sequence of the referenced a new first line and a new last line must be entered. sections from the code part. The collection process And for each end-of-line comment a flag is set to for all root sections is called tangle. A second pro- indicate that the comment is written in TEX. cess is called weave. It outputs the documentation and the code parts as a TEX document. How to read the following program Example: The following program has only one The text that starts in the next chapter is a literate root that is defined in section 4 with the headline program [2, 1] written in a style similar to noweb [7].
    [Show full text]
  • RISC-V Instructioninstruction Setset
    PortingPorting HelenOSHelenOS toto RISC-VRISC-V http://d3s.mff.cuni.cz Martin Děcký [email protected] CHARLES UNIVERSITY IN PRAGUE FacultyFaculty ofof MathematicsMathematics andand PhysicsPhysics IntroductionIntroduction Two system-level projects RISC-V is an instruction set architecture, HelenOS is an operating system Martin Děcký, FOSDEM, January 30th 2016 Porting HelenOS to RISC-V 2 IntroductionIntroduction Two system-level projects RISC-V is an instruction set architecture, HelenOS is an operating system Both originally started in academia But with real-world motivations and ambitions Both still in the process of maturing Some parts already fixed, other parts can be still affected Martin Děcký, FOSDEM, January 30th 2016 Porting HelenOS to RISC-V 3 IntroductionIntroduction Two system-level projects RISC-V is an instruction set architecture, HelenOS is an operating system Both originally started in academia But with real-world motivations and ambitions Both still in the process of maturing Some parts already fixed, other parts can be still affected → Mutual evaluation of fitness Martin Děcký, FOSDEM, January 30th 2016 Porting HelenOS to RISC-V 4 IntroductionIntroduction Martin Děcký Computer science researcher Operating systems Charles University in Prague Co-author of HelenOS (since 2004) Original author of the PowerPC port Martin Děcký, FOSDEM, January 30th 2016 Porting HelenOS to RISC-V 5 RISC-VRISC-V inin aa NutshellNutshell Free (libre) instruction set architecture BSD license, in development since 2014 Goal: No royalties for
    [Show full text]
  • Implementation of a MIX Emulator: a Case Study of the Scala Programming Language Facilities
    ISSN 2255-8691 (online) Applied Computer Systems ISSN 2255-8683 (print) December 2017, vol. 22, pp. 47–53 doi: 10.1515/acss-2017-0017 https://www.degruyter.com/view/j/acss Implementation of a MIX Emulator: A Case Study of the Scala Programming Language Facilities Ruslan Batdalov1, Oksana Ņikiforova2 1, 2 Riga Technical University, Latvia Abstract – Implementation of an emulator of MIX, a mythical synchronous manner, possible errors in a program may remain computer invented by Donald Knuth, is used as a case study of unnoticed. In the authors’ opinion, these checks are useful in the features of the Scala programming language. The developed mastering how to write correct programs because similar emulator provides rich opportunities for program debugging, such as tracking intermediate steps of program execution, an errors often occur in a modern program despite all changes in opportunity to run a program in the binary or the decimal mode hardware and software technologies. Therefore, it would be of MIX, verification of correct synchronisation of input/output helpful if an emulator supported running programs in different operations. Such Scala features as cross-compilation, family modes and allowed checking that the execution result was the polymorphism and support for immutable data structures have same in all cases. proved to be useful for implementation of the emulator. The The programming language chosen by the authors for the authors of the paper also propose some improvements to these features: flexible definition of family-polymorphic types, implementation of an emulator supporting these features is integration of family polymorphism with generics, establishing Scala. This choice is arbitrary to some extent and rather full equivalence between mutating operations on mutable data dictated by the authors’ interest in the features of this types and copy-and-modify operations on immutable data types.
    [Show full text]
  • Processor Architectures
    CS143 Handout 18 Summer 2008 30 July, 2008 Processor Architectures Handout written by Maggie Johnson and revised by Julie Zelenski. Architecture Vocabulary Let’s review a few relevant hardware definitions: register: a storage location directly on the CPU, used for temporary storage of small amounts of data during processing. memory: an array of randomly accessible memory bytes each identified by a unique address. Flat memory models, segmented memory models, and hybrid models exist which are distinguished by the way locations are referenced and potentially divided into sections. instruction set: the set of instructions that are interpreted directly in the hardware by the CPU. These instructions are encoded as bit strings in memory and are fetched and executed one by one by the processor. They perform primitive operations such as "add 2 to register i1", "store contents of o6 into memory location 0xFF32A228", etc. Instructions consist of an operation code (opcode) e.g., load, store, add, etc., and one or more operand addresses. CISC: Complex instruction set computer. Older processors fit into the CISC family, which means they have a large and fancy instruction set. In addition to a set of common operations, the instruction set has special purpose instructions that are designed for limited situations. CISC processors tend to have a slower clock cycle, but accomplish more in each cycle because of the sophisticated instructions. In writing an effective compiler back-end for a CISC processor, many issues revolve around recognizing how to make effective use of the specialized instructions. RISC: Reduced instruction set computer. Many modern processors are in the RISC family, which means they have a relatively lean instruction set, containing mostly simple, general-purpose instructions.
    [Show full text]
  • The Art of Computer Programming, Vol. 4A
    THE ART OF COMPUTER PROGRAMMING Missing pages from select printings of Knuth, The Art of Computer Programming, Volume 4A (ISBN-13: 9780201038040 / ISBN-10: 0201038048). Copyright © 2011 Pearson Education, Inc. All rights reserved. DONALD E. KNUTH Stanford University 6 77 ADDISON–WESLEY Missing pages from select printings of Knuth, The Art of Computer Programming, Volume 4A (ISBN-13: 9780201038040 / ISBN-10: 0201038048). Copyright © 2011 Pearson Education, Inc. All rights reserved. Volume 4A / Combinatorial Algorithms, Part 1 THE ART OF COMPUTER PROGRAMMING Boston · Columbus · Indianapolis · New York · San Francisco Amsterdam · Cape Town · Dubai · London · Madrid · Milan Munich · Paris · Montréal · Toronto · Mexico City · São Paulo Delhi · Sydney · Hong Kong · Seoul · Singapore · Taipei · Tokyo Missing pages from select printings of Knuth, The Art of Computer Programming, Volume 4A (ISBN-13: 9780201038040 / ISBN-10: 0201038048). Copyright © 2011 Pearson Education, Inc. All rights reserved. The poem on page 437 is quoted from The Golden Gate by Vikram Seth (New York: Random House, 1986), copyright ⃝c 1986 by Vikram Seth. The author and publisher have taken care in the preparation of this book, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein. The publisher offers excellent discounts on this book when ordered in quantity forbulk purposes or special sales, which may include electronic versions and/or custom covers and content particular to your business, training goals, marketing focus, and branding interests. For more information, please contact: U.S.
    [Show full text]
  • Rewriting the Bible in 0?
    Technology Review - Rewriting the Bible in 0’s and 1’s Home Search Login Register My Profile Site Map Channels Infotech Biotech Nanotech Extra Rewriting the Bible in 0’s and 1’s September/October 1999 Inside By Steve Ditlea Magazine Forums Since the 1960s, Donald Knuth has been writing the sacred text of Newsletter computer programming. He’s a little behind schedule, but he has an excuse: he took time out to reinvent digitial typography. Scorecards Special Events Panel Series Nominate the When you write about Donald Next TR100! Knuth, it’s natural to sound scriptural. For nearly 40 years, the now-retired Stanford University professor has been writing the gospel of computer science, an epic Enter your email to called The Art of Computer receive our weekly Programming. The first three newsletter. volumes already constitute the Good Book for advanced software devotees, selling a million copies around the world in a dozen languages. His approach to code permeates the software culture. And lo, interrupting his calling for nine years, Donald Knuth wandered the wilderness of computer typography, creating a program that has become the Word in digital typesetting for scientific publishing. He called his software TeX, and offered it to all believers, rejecting the attempt by one tribe (Xerox) to assert ownership over its mathematical formulas. “Mathematics belongs to God,” he declared. But Knuth’s God is not above tricks on the faithful. In his TeX guide, The TeXbook, he writes that it “doesn’t always tell the truth” because the “technique of deliberate lying will actually make it easier for you to learn the ideas.” Now intent on completing his scriptures, the 61-year-old Knuth (ka- NOOTH) leads what he calls a hermit-like existence (with his wife) in the hills surrounding the university, having taken early retirement from teaching.
    [Show full text]
  • Gnu Assembler
    Using as The gnu Assembler (Sourcery G++ Lite 2010q1-188) Version 2.19.51 The Free Software Foundation Inc. thanks The Nice Computer Company of Australia for loaning Dean Elsner to write the first (Vax) version of as for Project gnu. The proprietors, management and staff of TNCCA thank FSF for distracting the boss while they gotsome work done. Dean Elsner, Jay Fenlason & friends Using as Edited by Cygnus Support Copyright c 1991, 92, 93, 94, 95, 96, 97, 98, 99, 2000, 2001, 2002, 2006, 2007, 2008, 2009 Free Software Foundation, Inc. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, with no Front-Cover Texts, and with no Back-Cover Texts. A copy of the license is included in the section entitled \GNU Free Documentation License". i Table of Contents 1 Overview :::::::::::::::::::::::::::::::::::::::: 1 1.1 Structure of this Manual :::::::::::::::::::::::::::::::::::::: 14 1.2 The GNU Assembler :::::::::::::::::::::::::::::::::::::::::: 15 1.3 Object File Formats::::::::::::::::::::::::::::::::::::::::::: 15 1.4 Command Line ::::::::::::::::::::::::::::::::::::::::::::::: 15 1.5 Input Files :::::::::::::::::::::::::::::::::::::::::::::::::::: 16 1.6 Output (Object) File:::::::::::::::::::::::::::::::::::::::::: 16 1.7 Error and Warning Messages :::::::::::::::::::::::::::::::::: 16 2 Command-Line Options::::::::::::::::::::::: 19 2.1 Enable Listings: `-a[cdghlns]'
    [Show full text]
  • Donald E. Knuth Papers SC0097
    http://oac.cdlib.org/findaid/ark:/13030/kt2k4035s1 Online items available Guide to the Donald E. Knuth Papers SC0097 Daniel Hartwig & Jenny Johnson Department of Special Collections and University Archives August 2018 Green Library 557 Escondido Mall Stanford 94305-6064 [email protected] URL: http://library.stanford.edu/spc Note This encoded finding aid is compliant with Stanford EAD Best Practice Guidelines, Version 1.0. Guide to the Donald E. Knuth SC00973411 1 Papers SC0097 Language of Material: English Contributing Institution: Department of Special Collections and University Archives Title: Donald E. Knuth papers Creator: Knuth, Donald Ervin, 1938- source: Knuth, Donald Ervin, 1938- Identifier/Call Number: SC0097 Identifier/Call Number: 3411 Physical Description: 39.25 Linear Feet Physical Description: 4.3 gigabyte(s)email files Date (inclusive): 1962-2018 Abstract: Papers reflect his work in the study and teaching of computer programming, computer systems for publishing, and mathematics. Included are correspondence, notes, manuscripts, computer printouts, logbooks, proofs, and galleys pertaining to the computer systems TeX, METAFONT, and Computer Modern; and to his books THE ART OF COMPUTER PROGRAMMING, COMPUTERS & TYPESETTING, CONCRETE MATHEMATICS, THE STANFORD GRAPHBASE, DIGITAL TYPOGRAPHY, SELECTED PAPERS ON ANALYSIS OF ALGORITHMS, MMIXWARE : A RISC COMPUTER FOR THE THIRD MILLENNIUM, and THINGS A COMPUTER SCIENTIST RARELY TALKS ABOUT. Special Collections and University Archives materials are stored offsite and must be paged 36-48 hours in advance. For more information on paging collections, see the department's website: http://library.stanford.edu/depts/spc/spc.html. Immediate Source of Acquisition note Gift of Donald Knuth, 1972, 1980, 1983, 1989, 1996, 1998, 2001, 2014, 2015, 2019.
    [Show full text]
  • Arxiv:1811.04035V1 [Cs.CR] 3 Nov 2018 Generated Random Numbers for Various Purposes
    A Search for Good Pseudo-random Number Generators : Survey and Empirical Studies a a a, Kamalika Bhattacharjee , Krishnendu Maity , Sukanta Das ∗ aDepartment of Information Technology, Indian Institute of Engineering Science and Technology, Shibpur, West Bengal, India 711103 Abstract In today’s world, several applications demand numbers which appear random but are generated by a background algorithm; that is, pseudo-random num- bers. Since late 19th century, researchers have been working on pseudo-random number generators (PRNGs). Several PRNGs continue to develop, each one de- manding to be better than the previous ones. In this scenario, this paper targets to verify the claim of so-called good generators and rank the existing genera- tors based on strong empirical tests in same platforms. To do this, the genre of PRNGs developed so far has been explored and classified into three groups – linear congruential generator based, linear feedback shift register based and cellular automata based. From each group, well-known generators have been chosen for empirical testing. Two types of empirical testing has been done on each PRNG – blind statistical tests with Diehard battery of tests, TestU01 library and NIST statistical test-suite and graphical tests (lattice test and space- time diagram test). Finally, the selected 29 PRNGs are divided into 24 groups and are ranked according to their overall performance in all empirical tests. Keywords: Pseudo-random number generator (PRNG), Diehard, TestU01, NIST, Lattice Test, Space-time Diagram I. Introduction History of human race gives evidence that, since the ancient times, people has arXiv:1811.04035v1 [cs.CR] 3 Nov 2018 generated random numbers for various purposes.
    [Show full text]
  • Proposal for a Tutorial at Iticse 2003 Teaching Computer Science Using MMIX
    Proposal for a tutorial at ITiCSE 2003 Teaching Computer Science Using MMIX Title Teaching Computer Science Using MMIX Organizer Prof. Dr. Heidi Anlauff, Prof. Dr. Axel B¨ottcher, and Prof. Dr. Martin Ruckert Fachhochschule Munc¨ hen Fachbereich Informatik/Mathematik Lothstr. 34 D-80335 Munc¨ hen GERMANY [email protected] +49-89-1265-1601 Category Half-day (three hours) Description Introduction MMIX is the successor of Donald Knuth's famous MIX-processor introduced in \The Art of Computer Programming\. Its clean RISC-design and easy to use tools (as- sembler and simulator) make it extremely suitable for use in introductory computer science courses. For advanced courses in Assembly Programming and Computer Ar- chitecture, a widely configurable pipeline simulator allows the inspection of internal details of a working RISC processor that are usually hidden by high level languages taught today. Furthermore, as MMIX will be a basis for demonstration of the algorithms presen- ted in \The Art of Computer Programming\, a thorough understanding will open the door to that wonderful series of books. Activities Introduction to Architecture and Programming of MMIX: We will present the fundamental architectural concepts of this very cleanly designed RISC machine: Register Set, Instruction Set, and Memory Layout. We will give hints on the critical points when using MMIX in class and share our experiences regarding teaching schedule and sequence of topics. This part includes usage of the assembler mmixal and standard simulator mmix with its built-in debugging features. Student Projects: We report on possible student projects that were tested in practice at our institution covering the basic features of MMIX.
    [Show full text]
  • The CWEB System of Structured Documentation
    The CWEB System of Structured Documentation (Version 3.64 — February 2002) Donald E. Knuth and Silvio Levy TEX is a trademark of the American Mathematical Society. Acrobat Reader is a trademark of Adobe Systems Incorporated. The printed form of this manual is copyright °c 1994 by Addison-Wesley Publishing Company, Inc. All rights reserved. The electronic form is copyright °c 1987, 1990, 1993, 2000 by Silvio Levy and Donald E. Knuth. Permission is granted to make and distribute verbatim copies of the electronic form of this document provided that the electronic copyright notice and this permission notice are preserved on all copies. Permission is granted to copy and distribute modified versions of the electronic form of this document under the conditions for verbatim copying, provided that the entire resulting derived work is distributed under the terms of a permission notice identical to this one. Individuals may make copies of the documentation from the electronic files for their own personal use. Internet page http://www−cs−faculty.stanford.edu/~knuth/cweb.html contains current info about CWEB and related topics. The CWEB System of Structured Documentation Donald E. Knuth and Silvio Levy This document describes a version of Don Knuth’s WEB system, adapted to C by Silvio Levy. Since its creation in 1987, CWEB has been revised and enhanced in various ways, by both Knuth and Levy. We now believe that its evolution is near an end; however, bug reports, suggestions and comments are still welcome, and should be sent to Levy ([email protected]). Readers who are familiar with Knuth’s memo “The WEB System of Structured Documentation” will be able to skim this material rapidly, because CWEB and WEB share the same philosophy and (essentially) the same syntax.
    [Show full text]