Lossy Polynomial Datapath Synthesis

Total Page:16

File Type:pdf, Size:1020Kb

Lossy Polynomial Datapath Synthesis Imperial College London Department of Electrical and Electronic Engineering Lossy Polynomial Datapath Synthesis Theo Drane February 2014 Supervised by George A. Constantinides and Peter Y. K. Cheung Submitted in part fulfilment of the requirements for the degree of Doctor of Philosophy in Electrical and Electronic Engineering of Imperial College London and the Diploma of Imperial College London 1 The copyright of this thesis rests with the author and is made available under a Creative Commons Attribution Non-Commercial No Derivatives licence. Researchers are free to copy, distribute or transmit the thesis on the condition that they attribute it, that they do not use it for commercial purposes and that they do not alter, transform or build upon it. For any reuse or redistribution, researchers must make clear to others the licence terms of this work. 2 Abstract The design of the compute elements of hardware, its datapath, plays a cru- cial role in determining the speed, area and power consumption of a device. The building blocks of datapath are polynomial in nature. Research into the implementation of adders and multipliers has a long history and develop- ments in this area will continue. Despite such efficient building block imple- mentations, correctly determining the necessary precision of each building block within a design is a challenge. It is typical that standard or uniform precisions are chosen, such as the IEEE floating point precisions. The hard- ware quality of the datapath is inextricably linked to the precisions of which it is composed. There is, however, another essential element that determines hardware quality, namely that of the accuracy of the components. If one were to implement each of the official IEEE rounding modes, significant dif- ferences in hardware quality would be found. But in the same fashion that standard precisions may be unnecessarily chosen, it is typical that compo- nents may be constructed to return one of these correctly rounded results, where in fact such accuracy is far from necessary. Unfortunately if a lesser accuracy is permissible then the techniques that exist to reduce hardware implementation cost by exploiting such freedom invariably produce an error with extremely difficult to determine properties. This thesis addresses the problem of how to construct hardware to effi- ciently implement fixed and floating-point polynomials while exploiting a global error freedom. This is a form of lossy synthesis. The fixed-point contributions include resource minimisation when implementing mutually exclusive polynomials, the construction of minimal lossy components with guaranteed worst case error and a technique for efficient composition of such components. Contributions are also made to how a floating-point polyno- mial can be implemented with guaranteed relative error. 3 Acknowledgements This thesis is another strand that links Imagination Technologies with Impe- rial College London's Department of Electrical and Electronic Engineering. Its inception is a testament to the vision of Imagination Technologies' Tony King-Smith and Martin Ashton and Imperial College London's Peter Che- ung and George Constantinides and for its execution it owes much to many. The thesis has grown at the same time that Imagination's Datapath group has grown. I have been incredibly fortunate to find six incredibly talented engineers who, luckily for me, took an interest in a field which I fell into quite by accident many years ago and have since made my home. For all their work, enthusiasm, ingenuity, tenacity and particular independence I sincerely thank Casper Van Benthem, Freddie Exall, Thomas Rose, Sam Elliott, Kenneth Rovers and Emiliano Morini. Particular mention goes to Freddie's staggering array of essential tools TBGen, Hectorator, Paretor and Decorator, Thomas for FRator, Casper and Kenneth's implementations of faithfully rounded floating-point multipliers and adders respectively and Sam's floating-point verification assistance. All without which this work would not have been possible. Thanks also to Imagination's Raeeka Yas- saie and Imperial's Clare Drysdale for all of their support and fascinating conversations on all matters industrial academic. Gratitude goes to Clifford Gibson and Jonathan Redshaw for being very understanding line managers as I tried to navigate two complementary yet competing sets of obligations. I would like to thank Carl Pixley and Himanshu Jain whose development of the paradigm shifting Synopsys' Hector has enabled my group to flourish, provided fascinating insight into our verification challenges and enabled me to share a verification success story in multiple countries. On the Imperial side, sincere thanks goes to David Boland, Samuel Bayliss and Josh Levine of the Circuits and Systems Group for their technical in- sight, critique and refreshingly broad conversation. Being involved in the shadow management of the EDA club beside David and Sam was a very 4 interesting journey, thanks to my companions for the ride. Thanks to EDA members for enriching my knowledge by the various talks and David Thomas for sharing his interesting work, unique approach to the field, clarity of pre- sentation and critique. I offer my supervisor, George Constantinides, my sincere gratitude for pushing this work to be the best it can be, his insight, vision, direction and incredible ability to quickly understand ideas, despite being presented, on occasion, with truly incomprehensible material. It is essential to thank my parents for giving me blank paper from a young age and luckily we all still use it. Finally it remains to thank my partner, James Van Der Walt, for his unending support and whose own work constantly reminded me that ultimately we do our work to improve the lives of others. I believe my work has enriched the field, improved and pushed my group's work, added value to the company and its products. This thesis has its roots in the continuous design challenges thrown up on a daily basis by working in the mobile graphics hardware sector. It is a truly exciting area for computer arithmetic, large amounts of datapath constrained by ever changing constraints on power, area, speed, precision and accuracy. Hopefully this thesis contributes a little to giving engineers the tools they need to do what must be done. I hope aspects of this thesis will live on in tools and code within Imagination, will be extended and improved by others and ultimately find its way into devices used by many. To those who may be interested in having one foot firmly in an academic setting and another in an industrial one and who wishes to stand and nudge the tide in both, I would say that it is one of the best things I have ever done. 5 Contents 1. Introduction 22 1.1. Statement of Originality . 25 1.2. Impact . 25 1.3. Thesis Organisation . 28 2. Background 30 2.1. Logic and Datapath Synthesis . 32 2.1.1. Integer Addition and Multiplication . 35 2.1.2. Datapath Synthesis Flow . 43 2.2. High-Level Synthesis . 44 2.3. Lossy Synthesis . 49 2.3.1. Word-length Optimisation . 49 2.3.2. Imprecise Operators . 51 2.3.3. Gate Level Imprecision . 53 2.4. Polynomials in Datapath . 55 2.5. Context of Contribution . 57 3. Preliminaries 60 3.1. Polynomials and Polynomial Rings . 61 3.2. Multivariate Division . 63 3.3. Gr¨obnerBases . 67 3.4. Elimination and Solutions to Systems of Multivariate Poly- nomials . 70 3.5. Membership of Vanishing Ideals . 73 4. Lossless Fixed-Point Polynomial Optimisation 79 4.1. Arithmetic Sum-Of-Products . 82 4.2. Motivational Example . 85 6 4.3. Control Logic Minimisation . 88 4.3.1. Determining the Total Degrees of Monomials in p . 89 4.3.2. Solving the Optimisation Problem . 92 4.3.3. Lifting the Restrictions . 95 4.3.4. Changing Variables . 98 4.4. Optimising the Optional Negations . 100 4.5. Overall Flow . 105 4.6. Formal Verification . 107 4.6.1. The Waterfall Verification . 112 4.6.2. Overall Verification Flow . 113 4.7. Experiments . 116 4.7.1. Control Logic Minimisation Experiments . 117 4.7.2. Optional Negation Experiments . 124 4.7.3. General Experiments . 128 4.7.4. Formal Verification Experiments . 135 5. Lossy Fixed-Point Components 137 5.1. Integer Multiplication . 139 5.1.1. Background on Truncation Multiplier Schemes . 139 5.1.2. Constructing Faithfully Rounded Multipliers . 143 5.1.3. Error Properties of Truncated Multipliers . 154 5.2. Multioperand Addition . 157 5.2.1. Optimal Truncation Theorem . 159 opt 5.2.2. Lemma 1: li = hi for i < k . 160 opt 5.2.3. Lemma 2: li = 0 for i > k . 161 5.2.4. Faithfully Rounded Array Theorem . 162 5.2.5. Application to Multiplier Architectures . 163 5.2.6. Experiments . 166 5.3. Constant Division . 172 5.3.1. Conditions for Round Towards Zero Schemes . 173 5.3.2. Conditions for Round To Nearest, Even and Faithfully Rounded Schemes . 175 5.3.3. Hardware Cost Heuristic . 176 5.3.4. Optimal Round Towards Zero Scheme . 176 5.3.5. Optimal Rounding Schemes . 179 5.3.6. Extension to Division of Two's Complement Numbers 179 7 5.3.7. Application to the Multiplication of Unsigned Normalised Numbers . 180 5.3.8. Experiments . 181 5.4. Formal Verification of Lossy Components . 182 6. Lossy Fixed-Point Polynomial Synthesis 185 6.1. Exploiting Errors for Arbitrary Arrays and Constant Division 187 6.2. Array Constructions . 189 6.3. Navigation of the Error Landscape . 192 6.3.1. Developing a Heuristic for the Navigation of the Error Landscape . 193 6.3.2. Example Navigations of the Error Landscape . 196 6.3.3. Procedure for Error Landscape Navigation . 210 6.4. Fixed-Point Polynomial Hardware Heuristic Cost Function . 214 6.4.1. Binary Integer Adder . 214 6.4.2. Binary Rectangular Arrays . 215 6.4.3.
Recommended publications
  • System Design for a Computational-RAM Logic-In-Memory Parailel-Processing Machine
    System Design for a Computational-RAM Logic-In-Memory ParaIlel-Processing Machine Peter M. Nyasulu, B .Sc., M.Eng. A thesis submitted to the Faculty of Graduate Studies and Research in partial fulfillment of the requirements for the degree of Doctor of Philosophy Ottaw a-Carleton Ins titute for Eleceical and Computer Engineering, Department of Electronics, Faculty of Engineering, Carleton University, Ottawa, Ontario, Canada May, 1999 O Peter M. Nyasulu, 1999 National Library Biôiiothkque nationale du Canada Acquisitions and Acquisitions et Bibliographie Services services bibliographiques 39S Weiiington Street 395. nie WeUingtm OnawaON KlAW Ottawa ON K1A ON4 Canada Canada The author has granted a non- L'auteur a accordé une licence non exclusive licence allowing the exclusive permettant à la National Library of Canada to Bibliothèque nationale du Canada de reproduce, ban, distribute or seU reproduire, prêter, distribuer ou copies of this thesis in microform, vendre des copies de cette thèse sous paper or electronic formats. la forme de microficbe/nlm, de reproduction sur papier ou sur format électronique. The author retains ownership of the L'auteur conserve la propriété du copyright in this thesis. Neither the droit d'auteur qui protège cette thèse. thesis nor substantial extracts fkom it Ni la thèse ni des extraits substantiels may be printed or otherwise de celle-ci ne doivent être imprimés reproduced without the author's ou autrement reproduits sans son permission. autorisation. Abstract Integrating several 1-bit processing elements at the sense amplifiers of a standard RAM improves the performance of massively-paralle1 applications because of the inherent parallelism and high data bandwidth inside the memory chip.
    [Show full text]
  • Block Ciphers: Fast Implementations on X86-64 Architecture
    Block Ciphers: Fast Implementations on x86-64 Architecture University of Oulu Department of Information Processing Science Master’s Thesis Jussi Kivilinna May 20, 2013 Abstract Encryption is being used more than ever before. It is used to prevent eavesdropping on our communications over cell phone calls and Internet, securing network connections, making e-commerce and e-banking possible and generally hiding information from unwanted eyes. The performance of encryption functions is therefore important as slow working implementation increases costs. At server side faster implementation can reduce the required capacity and on client side it can lower the power usage. Block ciphers are a class of encryption functions that are typically used to encrypt large bulk data, and thus make them a subject of many studies when endeavoring greater performance. The x86-64 architecture is the most dominant processor architecture in server and desktop computers; it has numerous different instruction set extensions, which make the architecture a target of constant new research on fast software implementations. The examined block ciphers – Blowfish, AES, Camellia, Serpent and Twofish – are widely used in various applications and their different designs make them interesting objects of investigation. Several optimization techniques to speed up implementations have been reported in previous research; such as the use of table look-ups, bit-slicing, byte-slicing and the utilization of “out-of-order” scheduling capabilities. We examine these different techniques and utilize them to construct new implementations of the selected block ciphers. Focus with these new implementations is in modes of operation which allow multiple blocks to be processed in parallel; such as the counter mode.
    [Show full text]
  • An FPGA-Accelerated Embedded Convolutional Neural Network
    Master Thesis Report ZynqNet: An FPGA-Accelerated Embedded Convolutional Neural Network (edit) (edit) 1000ch 1000ch FPGA 1000ch Network Analysis Network Analysis 2x512 > 1024 2x512 > 1024 David Gschwend [email protected] SqueezeNet v1.1 b2a ext7 conv10 2x416 > SqueezeNet SqueezeNet v1.1 b2a ext7 conv10 2x416 > SqueezeNet arXiv:2005.06892v1 [cs.CV] 14 May 2020 Supervisors: Emanuel Schmid Felix Eberli Professor: Prof. Dr. Anton Gunzinger August 2016, ETH Zürich, Department of Information Technology and Electrical Engineering Abstract Image Understanding is becoming a vital feature in ever more applications ranging from medical diagnostics to autonomous vehicles. Many applications demand for embedded solutions that integrate into existing systems with tight real-time and power constraints. Convolutional Neural Networks (CNNs) presently achieve record-breaking accuracies in all image understanding benchmarks, but have a very high computational complexity. Embedded CNNs thus call for small and efficient, yet very powerful computing platforms. This master thesis explores the potential of FPGA-based CNN acceleration and demonstrates a fully functional proof-of-concept CNN implementation on a Zynq System-on-Chip. The ZynqNet Embedded CNN is designed for image classification on ImageNet and consists of ZynqNet CNN, an optimized and customized CNN topology, and the ZynqNet FPGA Accelerator, an FPGA-based architecture for its evaluation. ZynqNet CNN is a highly efficient CNN topology. Detailed analysis and optimization of prior topologies using the custom-designed Netscope CNN Analyzer have enabled a CNN with 84.5 % top-5 accuracy at a computational complexity of only 530 million multiply- accumulate operations. The topology is highly regular and consists exclusively of convolu- tional layers, ReLU nonlinearities and one global pooling layer.
    [Show full text]
  • Advanced Synthesis Cookbook
    Advanced Synthesis Cookbook Advanced Synthesis Cookbook 101 Innovation Drive San Jose, CA 95134 www.altera.com MNL-01017-6.0 Document last updated for Altera Complete Design Suite version: 11.0 Document publication date: July 2011 © 2011 Altera Corporation. All rights reserved. ALTERA, ARRIA, CYCLONE, HARDCOPY, MAX, MEGACORE, NIOS, QUARTUS and STRATIX are Reg. U.S. Pat. & Tm. Off. and/or trademarks of Altera Corporation in the U.S. and other countries. All other trademarks and service marks are the property of their respective holders as described at www.altera.com/common/legal.html. Altera warrants performance of its semiconductor products to current specifications in accordance with Altera’s standard warranty, but reserves the right to make changes to any products and services at any time without notice. Altera assumes no responsibility or liability arising out of the application or use of any information, product, or service described herein except as expressly agreed to in writing by Altera. Altera customers are advised to obtain the latest version of device specifications before relying on any published information and before placing orders for products or services. Advanced Synthesis Cookbook July 2011 Altera Corporation Contents Chapter 1. Introduction Blocks and Techniques . 1–1 Simulating the Examples . 1–1 Using a C Compiler . 1–2 Chapter 2. Arithmetic Introduction . 2–1 Basic Addition . 2–2 Ternary Addition . 2–2 Grouping Ternary Adders . 2–3 Combinational Adders . 2–3 Double Addsub/ Basic Addsub . 2–3 Two’s Complement Arithmetic Review . 2–4 Traditional ADDSUB Unit . 2–4 Compressors (Carry Save Adders) . 2–5 Compressor Width 6:3 .
    [Show full text]
  • Usuba, Optimizing Bitslicing Compiler Darius Mercadier
    Usuba, Optimizing Bitslicing Compiler Darius Mercadier To cite this version: Darius Mercadier. Usuba, Optimizing Bitslicing Compiler. Programming Languages [cs.PL]. Sorbonne Université (France), 2020. English. tel-03133456 HAL Id: tel-03133456 https://tel.archives-ouvertes.fr/tel-03133456 Submitted on 6 Feb 2021 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. THESE` DE DOCTORAT DE SORBONNE UNIVERSITE´ Specialit´ e´ Informatique Ecole´ doctorale Informatique, Tel´ ecommunications´ et Electronique´ (Paris) Present´ ee´ par Darius MERCADIER Pour obtenir le grade de DOCTEUR de SORBONNE UNIVERSITE´ Sujet de la these` : Usuba, Optimizing Bitslicing Compiler soutenue le 20 novembre 2020 devant le jury compose´ de : M. Gilles MULLER Directeur de these` M. Pierre-Evariste´ DAGAND Encadrant de these` M. Karthik BHARGAVAN Rapporteur Mme. Sandrine BLAZY Rapporteur Mme. Caroline COLLANGE Examinateur M. Xavier LEROY Examinateur M. Thomas PORNIN Examinateur M. Damien VERGNAUD Examinateur Abstract Bitslicing is a technique commonly used in cryptography to implement high-throughput parallel and constant-time symmetric primitives. However, writing, optimizing and pro- tecting bitsliced implementations by hand are tedious tasks, requiring knowledge in cryptography, CPU microarchitectures and side-channel attacks. The resulting programs tend to be hard to maintain due to their high complexity.
    [Show full text]
  • Fpnew: an Open-Source Multi-Format Floating-Point Unit Architecture For
    1 FPnew: An Open-Source Multi-Format Floating-Point Unit Architecture for Energy-Proportional Transprecision Computing Stefan Mach, Fabian Schuiki, Florian Zaruba, Student Member, IEEE, and Luca Benini, Fellow, IEEE Abstract—The slowdown of Moore’s law and the power wall Internet of Things (IoT) domain. In this environment, achiev- necessitates a shift towards finely tunable precision (a.k.a. trans- ing high energy efficiency in numerical computations requires precision) computing to reduce energy footprint. Hence, we need architectures and circuits which are fine-tunable in terms of circuits capable of performing floating-point operations on a wide range of precisions with high energy-proportionality. We precision and performance. Such circuits can minimize the present FPnew, a highly configurable open-source transprecision energy cost per operation by adapting both performance and floating-point unit (TP-FPU) capable of supporting a wide precision to the application requirements in an agile way. The range of standard and custom FP formats. To demonstrate the paradigm of “transprecision computing” [1] aims at creating flexibility and efficiency of FPnew in general-purpose processor a holistic framework ranging from algorithms and software architectures, we extend the RISC-V ISA with operations on half-precision, bfloat16, and an 8bit FP format, as well as SIMD down to hardware and circuits which offer many knobs to vectors and multi-format operations. Integrated into a 32-bit fine-tune workloads. RISC-V core, our TP-FPU can speed up execution of mixed- The most flexible and dynamic way of performing nu- precision applications by 1.67x w.r.t.
    [Show full text]
  • Bit Slicing Repetitive Logic
    Bit Slicing Repetitive Logic Where logic blocks are duplicated within a system, there is much to gain from optimization. • Optimize single block for size. The effect is amplified by the number of identical blocks. • Optimize interconnect. With careful design, the requirement for routing channels between the blocks can be eliminated. Interconnection is by butting in 2 dimensions. 4001 Bit Slicing Instead of creating an ALU function by function, we create it slice by slice. A[7:0] B[7:0] A[7] B[7] A[0] B[0] Z[7] Z[7:0] Z[0] • Each bit slice is a full 1-bit ALU. • N are used to create an N–bit ALU. 4002 Bit Slicing FnAND FnOR FnXOR FnADD FnSHR FnSHL Cout SHRin A Z FA B A Cin A SHLin Z= A&B Z= A|B Z= A!=B Z= A+B Z= A>>1 Z= A<<1 • Simple 1–bit ALU. • The control lines select which function of A and B is fed to Z. • Some functions, e.g. Add, require extra data I/O. 4003 Bit Slicing FnAND FnAND Z Z Vdd GND B B A A • Data busses horizontal, control lines vertical. • Compact gate matrix implementation1. 1bit slice designs can also be built around standard cells although the full custom approach used here gives better results 4004 • Bit Sliced ALU (3-bits, scalable). CarryOut ShiftRightIn ShiftLeftOut FnAND FnOR FnXOR FnAdd FnSHR FnSHL Cout SHRin A Z[2] FA B[2] A[2] Cin A SHLin Cout SHRin A Z[1] FA B[1] A[1] Cin A SHLin Cout SHRin A Z[0] FA B[0] A[0] Cin A SHLin CarryIn ShiftRightOut ShiftLeftIn 4005 Bit Slicing We can extend this principle to the whole datapath.
    [Show full text]
  • Formally Verified Big Step Semantics out of X86-64 Binaries
    Formally Verified Big Step Semantics out of x86-64 Binaries Ian Roessle Freek Verbeek Binoy Ravindran Virginia Tech, USA Virginia Tech, USA Virginia Tech, USA [email protected] [email protected] [email protected] Abstract or systems where source code is unavailable due to propri- This paper presents a methodology for generating formally etary reasons. Various safety-critical systems in automotive, proven equivalence theorems between decompiled x86-64 aerospace, medical and military domains are built out of machine code and big step semantics. These proofs are built components where the source code is not available [38]. on top of two additional contributions. First, a robust and In such a context, certification plays a crucial role. Certi- tested formal x86-64 machine model containing small step fication can require a compliance proof based on formal semantics for 1625 instructions. Second, a decompilation- methods [32, 41]. Bottom-up formal verification can aid in into-logic methodology supporting both x86-64 assembly obtaining high levels of assurance for black-box components and machine code at large scale. This work enables black- running on commodity hardware, such as x86-64. box binary verification, i.e., formal verification of a binary A binary typically consists of blocks composed by control where source code is unavailable. As such, it can be applied flow. In this paper, a block is defined as a sequence of instruc- to safety-critical systems that consist of legacy components, tions that can be modeled with only if-then-else statements or components whose source code is unavailable due to (no loops).
    [Show full text]
  • Study of the Posit Number System: a Practical Approach
    STUDY OF THE POSIT NUMBER SYSTEM: A PRACTICAL APPROACH Raúl Murillo Montero DOBLE GRADO EN INGENIERÍA INFORMÁTICA – MATEMÁTICAS FACULTAD DE INFORMÁTICA UNIVERSIDAD COMPLUTENSE DE MADRID Trabajo Fin Grado en Ingeniería Informática – Matemáticas Curso 2018-2019 Directores: Alberto Antonio del Barrio García Guillermo Botella Juan Este documento está preparado para ser imprimido a doble cara. STUDY OF THE POSIT NUMBER SYSTEM: A PRACTICAL APPROACH Raúl Murillo Montero DOUBLE DEGREE IN COMPUTER SCIENCE – MATHEMATICS FACULTY OF COMPUTER SCIENCE COMPLUTENSE UNIVERSITY OF MADRID Bachelor’s Degree Final Project in Computer Science – Mathematics Academic year 2018-2019 Directors: Alberto Antonio del Barrio García Guillermo Botella Juan To me, mathematics, computer science, and the arts are insanely related. They’re all creative expressions. Sebastian Thrun Acknowledgements I have to start by thanking Alberto Antonio del Barrio García and Guillermo Botella Juan, the directors of this amazing project. Thank you for this opportunity, for your support, your help and for trusting me. Without you any of this would have ever been possible. Thanks to my family, who has always supported me and taught me that I am only limited by the limits I choose to put on myself. Finally, thanks to all of you who have accompanied me on this 5 year journey. Sharing classes, exams, comings and goings between the two faculties with you has been a wonderful experience I will always remember. vii Abstract The IEEE Standard for Floating-Point Arithmetic (IEEE 754) has been for decades the standard for floating-point arithmetic and is implemented in a vast majority of modern computer systems.
    [Show full text]
  • SSE Implementation of Multivariate Pkcs on Modern X86 Cpus
    SSE Implementation of Multivariate PKCs on Modern x86 CPUs Anna Inn-Tung Chen1, Ming-Shing Chen2, Tien-Ren Chen2, Chen-Mou Cheng1, Jintai Ding3, Eric Li-Hsiang Kuo2, Frost Yu-Shuang Lee1, and Bo-Yin Yang2 1 National Taiwan University, Taipei, Taiwan {anna1110,doug,frost}@crypto.tw 2 Academia Sinica, Taipei, Taiwan {mschen,trchen1103,lorderic,by}@crypto.tw 3 University of Cincinnati, Cincinnati, Ohio, USA [email protected] Abstract. Multivariate Public Key Cryptosystems (MPKCs) are often touted as future-proofing against Quantum Computers. It also has been known for efficiency compared to “traditional” alternatives. However, this advantage seems to erode with the increase of arithmetic resources in modern CPUs and improved algorithms, especially with respect to El- liptic Curve Cryptography (ECC). In this paper, we show that hard- ware advances do not just favor ECC. Modern commodity CPUs also have many small integer arithmetic/logic resources, embodied by SSE2 or other vector instruction sets, that are useful for MPKCs. In partic- ular, Intel’s SSSE3 instructions can speed up both public and private maps over prior software implementations of Rainbow-type systems up to 4×.Furthermore,MPKCs over fields of relatively small odd prime characteristics can exploit SSE2 instructions, supported by most mod- ern 64-bit Intel and AMD CPUs. For example, Rainbow over F31 can be up to 2× faster than prior implementations of similarly-sized systems over F16. Here a key advance is in using Wiedemann (as opposed to Gauss) solvers to invert the small linear systems in the central maps. We explain the techniques and design choices in implementing our chosen MPKC instances over fields such as F31, F16 and F256.
    [Show full text]
  • High-Throughput Elliptic Curve Cryptography Using AVX2 Vector Instructions
    High-Throughput Elliptic Curve Cryptography Using AVX2 Vector Instructions Hao Cheng, Johann Großsch¨adl,Jiaqi Tian, Peter B. Rønne, and Peter Y. A. Ryan DCS and SnT, University of Luxembourg 6, Avenue de la Fonte, L{4364 Esch-sur-Alzette, Luxembourg {hao.cheng,johann.groszschaedl,peter.roenne,peter.ryan}@uni.lu [email protected] Abstract. Single Instruction Multiple Data (SIMD) execution engines like Intel's Advanced Vector Extensions 2 (AVX2) offer a great potential to accelerate elliptic curve cryptography compared to implementations using only basic x64 instructions. All existing AVX2 implementations of scalar multiplication on e.g. Curve25519 (and alternative curves) are optimized for low latency. We argue in this paper that many real-world applications, such as server-side SSL/TLS handshake processing, would benefit more from throughput-optimized implementations than latency- optimized ones. To support this argument, we introduce a throughput- optimized AVX2 implementation of variable-base scalar multiplication on Curve25519 and fixed-base scalar multiplication on Ed25519. Both implementations perform four scalar multiplications in parallel, where each uses a 64-bit element of a 256-bit vector. The field arithmetic is based on a radix-229 representation of the field elements, which makes it possible to carry out four parallel multiplications modulo a multiple of p = 2255 − 19 in just 88 cycles on a Skylake CPU. Four variable-base scalar multiplications on Curve25519 require less than 250;000 Skylake cycles, which translates to a throughput of 32;318 scalar multiplications per second at a clock frequency of 2 GHz. For comparison, the to-date best latency-optimized AVX2 implementation has a throughput of some 21;000 scalar multiplications per second on the same Skylake CPU.
    [Show full text]
  • Floating-Point Formats.Pdf
    [Next] [Up/Previous] mrob Numbers Largenum Sequences Mandelbrot Men Core Values Search: • n particular: 0 00000000 00000000000000000000000 = 0 0 00000000 00000000000000000000001 = +1 * 2( -126) * 0.000000000000000000000012 = 2(-149) (Smallest positive value) ( -126) 0 00000000 10000000000000000000000 = +1 * 2 * 0.12 = 2**(-127) ( 1-127) 0 00000001 00000000000000000000000 = +1 * 2 * 1.02 = 2**(-126) (128-127) 0 10000000 00000000000000000000000 = +1 * 2 * 1.02 = 2 1 0 0 1 .5 .5 2^1 (129-127) 0 10000001 10100000000000000000000 = +1 * 2 * 1.1012 = 6.5 1.10 1 1 0 1 1 .5 .25 .125 1.624*2^2= 6.5 0 11111110 11111111111111111111111 = +1 * 2(254-127) * 1.111111111111111111111112 (Most positive finite value) 0 11111111 00000000000000000000000 = Infinity 0 11111111 00000100000000000000000 = NaN 1 00000000 00000000000000000000000 = -0 (128-127) 1 10000000 00000000000000000000000 = -1 * 2 * 1.02 = -2 (129-127) 1 10000001 10100000000000000000000 = -1 * 2 * 1.1012 = -6.5 1 11111110 11111111111111111111111 = -1 * 2(254-127) * 1.111111111111111111111112 (Most negative finite value) 1 11111111 00000000000000000000000 = -Infinity 1 11111111 00100010001001010101010 = NaNSearch • Site Map About PSC Contacts Employment RSS Feed PITTSBURGH SUPERCOMPUTING CENTER PSC Users Outreach & Training Services Research News Center Floating Point Introduction Int and unsigned int are approximations to the set of integers and the set of natural numbers. Unlike int and unsigned, the set of integers and the set of natural numbers is infinite. Because the set of int is finite, there is a maximum int and a minimum int. Ints are also contiguous. That is, between the minimum and maximum int, there are no missing values. To summarize: • The set of valid ints is finite.
    [Show full text]