DOCSLIB.ORG

Soft Vector Processors with Streaming Pipelines

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Soft Vector Processors with Streaming Pipelines Soft Vector Processors with Streaming Pipelines A. Severance y; z J. Edwards y H. Omidian z G. Lemieux y; z [email protected] [email protected] [email protected] [email protected] y VectorBlox Computing Inc. z Univ. of British Columbia Vancouver, BC Vancouver, BC ABSTRACT DDR2/ S VectorBlox Custom DDR3 C1 C Soft vector processors (SVPs) achieve significant performance MXP Pipe P1 gains through the use of parallel ALUs. However, since D$ M Custom ALUs are used in a time-multiplexed fashion, this does not C2 C Pipe P2 exploit a key strength of FPGA performance: pipeline par- S Scratchpad allelism. This paper shows how streaming pipelines can be Nios II/f Custom integrated into the datapath of a SVP to achieve dramatic C3 C M DMA Pipe P3 speedups. The SVP plays an important role in supplying I$ M Avalon Bus the pipeline with high-bandwidth input data and storing Custom Custom C4 C C Pipe P4 its results using on-chip memory. However, the SVP must Instructions also perform the housekeeping tasks necessary to keep the pipeline busy. In particular, it orchestrates data movement between on-chip memory and external DRAM, it pre- or Figure 1: System view of VectorBlox MXP post-processes the data using its own ALUs, and it controls the overall sequence of execution. Since the SVP is pro- grammed in C, these tasks are easier to develop and debug Custom Instructions DMA and Vector Work Queues, Instruction Decode & Control than using a traditional HDL approach. Using the N-body Address Generation problem as a case study, this paper illustrates how custom ABCD P1 P2 P3 P4 streaming pipelines are integrated into the SVP datapath S R/W Rd Σ and multiple techniques for generating them. Using a cus- DMA SrcA tom pipeline, we demonstrate speedups over 7,000 times and M performance-per-ALM over 100 times better than Nios II/f. DMA Scratchpad Align A The custom pipeline is also 50 times faster than a naive Intel Avalon Bus Wr Rd Core i7 processor implementation. DstC SrcB 1. INTRODUCTION Align C Align B Custom Pipelines Although capable of high performance, FPGAs are also difficult to program. Exploiting both wide and deep custom Figure 2: Internal view of VectorBlox MXP pipelines typically requires a hardware designer to design a custom system in VHDL or Verilog. Recently, the emergence of ESL tools such as Vivado HLS and Altera's OpenCL com- memory allocation and recursion are unavailable. Hence, piler allow software programmers to produce FPGA designs ESL tools are not the most effective way to make FPGAs using C or OpenCL. However, since all ESL tools translate a accessible to software programmers. high-level algorithm into an HDL, they share common draw- Another approach to supporting programmers is to pro- backs: changes to the algorithm require lengthy FPGA re- vide a soft vector processor (SVP). A SVP achieves high per- compiles, recompiling may run out of resources (eg, logic formance through wide data parallelism, efficient looping, blocks) or fail to meet timing, debugging support is very and prefetching. The main advantages of a SVP are scalable limited, and high-level algorithmic features such as dynamic performance and a traditional software programming model. Performance scaling is achieved by adding more ALUs, but beyond a certain point (eg, 64 ALUs) the increases in par- Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed allelism are eroded by clock frequency degradation. This for profit or commercial advantage and that copies bear this notice and the full citation ultimately limits performance scaling. on the first page. Copyrights for components of this work owned by others than the To increase performance of SVPs even further, they must author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or also harness deep pipeline parallelism. For example, most republish, to post on servers or to redistribute to lists, requires prior specific permission types of encryption (such as AES) need deep pipelines to and/or a fee. Request permissions from [email protected]. get significant speedup. Although processors (and SVPs) FPGA ’14 Monterey, CA, USA ACM 978-1-4503-2671-1/14/02 ...$15.00. are not built to exploit deep pipeline parallelism, FPGAs http://dx.doi.org/10.1145/2554688.2554774. support it very well. The natural questions then become: How can a SVP be VIPERS [4]. All three processors employed a hybrid vector- interfaced with deep pipelines to exploit both wide and deep SIMD model, where vectors are streamed sequentially over parallelism? What kind of performance can be achieved? time through replicated (parallel) execution units. What types of problems arise, and how can they be solved? VESPA included support for heterogeneous vector lanes [5], To investigate these questions, we developed the Vector- e.g. there are fewer multipliers than general-purpose ALUs. Blox MXP, shown in Figure 1 and devised a way to add Due to the mismatch between vector register file width and deep custom pipelines to the processor, shown in Figure 2. execution unit width, a parallel load queue was used to The interface is kept as simple as possible so that software buffer a vector for heterogeneous operations, and a separate programmers can eventually develop these custom pipelines output queue was used to buffer results before writeback. using C; we also show that a simple high-level synthesis tool This required additional memory and multiplexers. In con- can be created for this purpose. To demonstrate speedups, trast, this paper uses pre-existing alignment networks and we selected the N-body gravity problem as case study. In requires no additional buffering to solve the width mismatch this problem, each body exerts an attractive force on every problem for 2-input/1-output custom instructions. We show other body, resulting in an O(N 2) computation. The size how to add custom vector instructions that require more and direction of the force between two bodies depends upon operands using minimal additional buffering. their two masses as well as the distance between them. Solv- VEGAS [6] and VENICE [7] are refinements of the VIPERS ing the problem requires square root and divide, neither of processor, further tailoring the architecture for FPGAs. Im- which are native operations to the MXP. Hence, we start by provements include replacing the VRF with a scratchpad implementing simple custom instructions for the reciprocal memory to allow for arbitrary data packing and access, re- and square root operations. Then, we implement the entire moving vector length limits, enabling sub-word SIMD (four gravity equation as a deep pipeline. packed bytes or two packed shorts) within each lane, simpli- It is important to note that we view the problem of adding fied conditionals and flags to fit within FPGA BRAMs, and floating-point units (FPUs) as a special case of adding deep, a DMA-based memory interface rather than a traditional custom pipelines. FPUs are large in area, so many appli- vector load/store approach. cations will not need one FPU for every integer ALU. In Work by Cong et al. [8] created composable vector units. fact, many floating-point applications would find a single f- At compilation time, the DFG of a vector program was ex- p divide unit or f-p square root unit to be sufficient, along amined for clusters of operations that can be composed to- with several f-p adders and f-p multipliers. Also, FPUs are gether to create a new streaming instruction that uses mul- deeply pipelined, so they need very long vectors to keep their tiple operators and operands. This was done by chaining pipelines utilized, especially when many units are instanti- together existing functional units using an interconnection ated in parallel. So, for both area and performance reasons, network and multi-ported register file. This is similar to the programmer should control the number of integer units traditional vector chaining, but it was resolved statically separately from the number of f-p adders, the number of f- by the compiler (not dynamically the architecture) and en- p multipliers, etc. Hence, this paper is not just proposing coded into the instruction stream. This provided pipeline a method for connecting specialized pipelines, but also for parallelism, but was limited by the number of available op- connecting general floating-point operators to SVPs. erators and available register file ports. It is not easily ex- The main contribution of this work is introducing a mod- tended to support wide SIMD-style parallelism. The re- ular way of allowing users to add streaming pipelines into ported speedups were less than a factor of two. SVPs as custom vector instructions to get huge speedups. The FPVC, or floating point vector coprocessor, was de- On the surface, this appears to be a simple extension of the veloped by Kathiara and Leeser [9]. It adds a floating-point way custom instructions are added to scalar CPUs such as vector unit to the hard Xilinx PowerPC cores which can ex- Nios II. However, there are unique challenges to be able to ploit SIMD parallelism as well as pipeline parallelism. The stream data from multiple operands in a SVP. Also, scalar FPVC fetches its own VIRAM-like instructions and has its CPU custom instructions are often data starved, limiting own private register file. Unlike most other vector architec- their benefits. We show that SVPs can provide high-bandwidth tures, it can also execute its own scalar operations separate data streaming to properly utilize custom instructions.
Load more

Recommended publications
  • Efficient Parallel Algorithms for 3D Laplacian Smoothing on The
    applied sciences Article Efficient Parallel Algorithms for 3D Laplacian Smoothing on the GPU Lei Xiao 1, Guoxiang Yang 1,*, Kunyang Zhao 2,3 and Gang Mei 1,* 1 School of Engineering and Technology, China University of Geosciences (Beijing), Beijing 100083, China; [email protected] 2 Airport Engineering Civil Aviation R&D Base, China Airport Construction Group Co., Ltd., Beijing 100621, China; [email protected] 3 China Super-Creative Airport Technical Co., Ltd., Beijing 100621, China * Correspondence: [email protected] (G.Y.); [email protected] (G.M.); Tel.: +86-10-8232-2627 (G.Y.) Received: 13 November 2019; Accepted: 6 December 2019; Published: 11 December 2019 Abstract: In numerical modeling, mesh quality is one of the decisive factors that strongly affects the accuracy of calculations and the convergence of iterations. To improve mesh quality, the Laplacian mesh smoothing method, which repositions nodes to the barycenter of adjacent nodes without changing the mesh topology, has been widely used. However, smoothing a large-scale three dimensional mesh is quite computationally expensive, and few studies have focused on accelerating the Laplacian mesh smoothing method by utilizing the graphics processing unit (GPU). This paper presents a GPU-accelerated parallel algorithm for Laplacian smoothing in three dimensions by considering the influence of different data layouts and iteration forms. To evaluate the efficiency of the GPU implementation, the parallel solution is compared with the original serial solution. Experimental results show that our parallel implementation is up to 46 times faster than the serial version. Keywords: computational mesh processing; 3D laplacian smoothing; parallel algorithm; graphics processing unit 1.
    [Show full text]
  • Understanding the Performance of HPC Applications
    Understanding the Performance of HPC Applications Brian Gravelle March 2019 Abstract High performance computing is an important asset to scientific research, enabling the study of phe- nomena such as nuclear physics or climate change, that are difficult or impossible to be studied in traditional experiments or allowing researchers to utilize large amounts of data from experiments such as the Large Hadron Collider. No matter the use of HPC, the need for performance is always present; however, the fast-changing nature of computer systems means that software must be continually updated to run efficiently on the newest machines. In this paper, we discuss methods and tools used to understand the performance of an application running on HPC systems and how this understanding can translate into improved performance. We primarily focus on node-level issues, but also mention some of the basic issues involved with multi-node analysis as well. 1 Introduction In the modern world, supercomputing is used to approach many of the most important questions in science and technology. Computer simulations, machine learning programs, and other applications can all take ad- vantage of the massively parallel machines known as supercomputers; however, care must be taken to use these machines effectively. With the advent of multi- and many- core processors, GPGPUs, deep cache struc- tures, and FPGA accelerators, getting the optimal performance out of such machines becomes increasingly difficult. Although many modern supercomputers are theoretically capable of achieving tens or hundreds of petaflops, applications often only reach 15-20% of that peak performance. In this paper, we review recent research surrounding how users can understand and improve the performance of HPC applications.
    [Show full text]
  • Best Practice Guide Modern Processors
    Best Practice Guide Modern Processors Ole Widar Saastad, University of Oslo, Norway Kristina Kapanova, NCSA, Bulgaria Stoyan Markov, NCSA, Bulgaria Cristian Morales, BSC, Spain Anastasiia Shamakina, HLRS, Germany Nick Johnson, EPCC, United Kingdom Ezhilmathi Krishnasamy, University of Luxembourg, Luxembourg Sebastien Varrette, University of Luxembourg, Luxembourg Hayk Shoukourian (Editor), LRZ, Germany Updated 5-5-2021 1 Best Practice Guide Modern Processors Table of Contents 1. Introduction .............................................................................................................................. 4 2. ARM Processors ....................................................................................................................... 6 2.1. Architecture ................................................................................................................... 6 2.1.1. Kunpeng 920 ....................................................................................................... 6 2.1.2. ThunderX2 .......................................................................................................... 7 2.1.3. NUMA architecture .............................................................................................. 9 2.2. Programming Environment ............................................................................................... 9 2.2.1. Compilers ........................................................................................................... 9 2.2.2. Vendor performance libraries
    [Show full text]
  • SAMS Multi-Layout Memory: Providing Multiple Views of Data to Boost SIMD Performance
    SAMS Multi-Layout Memory: Providing Multiple Views of Data to Boost SIMD Performance Chunyang Gou, Georgi Kuzmanov, Georgi N. Gaydadjiev Computer Engineering Lab Faculty of Electrical Engineering, Mathematics and Computer Science Delft University of Technology, The Netherlands {C.Gou, G.K.Kuzmanov, G.N.Gaydadjiev}@tudelft.nl ABSTRACT layout and its continuity in the linear memory address space. We propose to bridge the discrepancy between data represen- It has been found that most SIMDized applications are in fa- tations in memory and those favored by the SIMD proces- vor of operating on SoA format for better performance[18, sor by customizing the low-level address mapping.Toachieve 20]. However, data representation in the system memory is this, we employ the extended Single-Affiliation Multiple-Stride mostly in the form of AoS because of two reasons. First, AoS (SAMS) parallel memory scheme at an appropriate level in the is the natural data representation in many scientific and en- memory hierarchy. This level of memory provides both Ar- gineering applications. Secondly, indirections to structured ray of Structures (AoS) and Structure of Arrays (SoA) views data, such as pointer or indexed array accesses, are in favor for the structured data to the processor, appearing to have of the AoS format. Therefore, a pragmatic problem in the maintained multiple layouts for the same data.Withsuch SIMDization arises: the need for dynamic data format trans- multi-layout memory, optimal SIMDization can be achieved. form between AoS and SoA, which results in significant perfor- Our synthesis results using TSMC 90nm CMOS technology mance degradation. To our best knowledge, no trivial solution indicate that the SAMS Multi-Layout Memory system has ef- for this problem has been previously proposed.
    [Show full text]
  • Kernel Optimization by Layout Restructuring
    THESE` PRESENT´ EE´ A` L’UNIVERSITE´ DE BORDEAUX ECOLE´ DOCTORALE DE MATHEMATIQUES´ ET D’INFORMATIQUE par Christopher Haine POUR OBTENIR LE GRADE DE DOCTEUR SPECIALIT´ E´ : INFORMATIQUE Kernel optimization by layout restructuring Date de soutenance : 3 Juillet 2017 Devant la commission d’examen compos´eede : Henri-Pierre CHARLES . Directeur de Recherche, CEA . Rapporteur Allen MALONY . Professeur, Universite´ de l’Oregon . Rapporteur Emmanuel JEANNOT . Directeur de Recherche, Inria . Examinateur Pascale ROSSE-LAURENT Ingenieur,´ Atos . Examinateur Olivier AUMAGE . Charge´ de Recherche, Inria . Encadrant Denis BARTHOU . Professeur des Universites,´ Bordeaux INP Directeur de These` 2017 2 Abstract Careful data layout design is crucial for achieving high performance, as nowadays processors waste a considerable amount of time being stalled by memory transactions, and in particular spa- cial and temporal locality have to be optimized. However, data layout transformations is an area left largely unexplored by state-of-the-art compilers, due to the difficulty to evaluate the possi- ble performance gains of transformations. Moreover, optimizing data layout is time-consuming, error-prone, and layout transformations are too numerous to be experimented by hand in hope to discover a high performance version. We propose to guide application programmers through data layout restructuring with an ex- tensive feedback, firstly by providing a comprehensive multidimensional description of the initial layout, built via analysis of memory traces collected from the application binary in fine aiming at pinpointing problematic strides at the instruction level, independently of the input language. We choose to focus on layout transformations, translatable to C-formalism to aid user understanding, that we apply and assess on case study composed of two representative multithreaded real-life applications, a cardiac wave simulation and lattice QCD simulation, with different inputs and parameters.
    [Show full text]
  • LLAMA: the Low Level Abstraction for Memory Access
    LLAMA: The Low Level Abstraction For Memory Access Bernhard Manfred Gruber1,2,3, Guilherme Amadio1, Jakob Blomer1, Alexander Matthes4,5, Ren´eWidera4, and Michael Bussmann2 1EP-SFT, CERN, Geneva, Switzerland 2Center for Advanced Systems Understanding, Saxony, Germany 3Technische Universit¨atDresden, Dresden, Germany 4Helmholtz-Zentrum Dresden - Rossendorf, Dresden, Germany 5LogMeIn, Dresden, Germany 31. May 2021 Abstract The performance gap between CPU and memory widens continuously. Choosing the best memory layout for each hardware architecture is increasingly important as more and more programs become memory bound. For portable codes that run across heterogeneous hardware architectures, the choice of the memory layout for data structures is therefore ideally decoupled from the rest of a program. This can be accomplished via a zero-runtime-overhead abstraction layer, underneath which memory layouts can be freely exchanged. We present the C++ library LLAMA, which provides such a data structure ab- straction layer with example implementations for multidimensional arrays of nested, structured data. LLAMA provides fully C++ compliant methods for defining and switching custom memory layouts for user-defined data types. Providing two close- to-life examples, we show that the LLAMA-generated AoS (Array of Struct) and SoA (Struct of Array) layouts produce identical code with the same performance characteristics as manually written data structures. LLAMA's layout-aware copy routines can significantly speed up transfer and reshuffling of data between layouts arXiv:2106.04284v1 [cs.PF] 8 Jun 2021 compared with naive element-wise copying. The library is fully extensible with third-party allocators and allows users to support their own memory layouts with custom mappings.
    [Show full text]
  • Intel(R) 64 and IA-32 Architectures Optimization Reference Manual
    N Intel® 64 and IA-32 Architectures Optimization Reference Manual Order Number: 248966-020 November 2009 INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. UNLESS OTHERWISE AGREED IN WRITING BY INTEL, THE INTEL PRODUCTS ARE NOT DESIGNED NOR IN- TENDED FOR ANY APPLICATION IN WHICH THE FAILURE OF THE INTEL PRODUCT COULD CREATE A SITU- ATION WHERE PERSONAL INJURY OR DEATH MAY OCCUR. Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "un- defined." Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information. The Intel® 64 architecture processors may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request. Hyper-Threading Technology requires a computer system with an Intel® processor supporting Hyper- Threading Technology and an HT Technology enabled chipset, BIOS and operating system.
    [Show full text]
  • Broadening the Applicability of FPGA-Based Soft Vector Processors
    Broadening the Applicability of FPGA-based Soft Vector Processors by Aaron Severance Bachelor of Science in Computer Engineering, Boston University, 2004 Master of Science in Electrical Engineering, University of Washington, 2006 A THESIS SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF Doctor of Philosophy in THE FACULTY OF GRADUATE AND POSTDOCTORAL STUDIES (Electrical and Computer Engineering) The University of British Columbia (Vancouver) March 2015 c Aaron Severance, 2015 Abstract A soft vector processor (SVP) is an overlay on top of FPGAs that allows data- parallel algorithms to be written in software rather than hardware, and yet still achieve hardware-like performance. This ease of use comes at an area and speed penalty, however. Also, since the internal design of SVPs are based largely on custom CMOS vector processors, there is additional opportunity for FPGA-specific optimizations and enhancements. This thesis investigates and measures the effects of FPGA-specific changes to SVPs that improve performance, reduce area, and improve ease-of-use; thereby expanding their useful range of applications. First, we address applications needing only moderate performance such as audio filtering where SVPs need only a small number (one to four) of parallel ALUs. We make implementation and ISA design decisions around the goals of producing a compact SVP that effectively utilizes existing BRAMs and DSP Blocks. The resulting VENICE SVP has 2× better performance per logic block than previous designs. Next, we address performance issues with algorithms where some vector ele- ments ‘exit early’ while others need additional processing. Simple vector predica- tion causes all elements to exhibit ‘worst case’ performance.
    [Show full text]
  • Intel 64 and IA-32 Architectures Optimization Reference Manual [PDF]
    Intel® 64 and IA-32 Architectures Optimization Reference Manual Order Number: 248966-033 June 2016 Intel technologies features and benefits depend on system configuration and may require enabled hardware, software, or service ac- tivation. Learn more at intel.com, or from the OEM or retailer. No computer system can be absolutely secure. Intel does not assume any liability for lost or stolen data or systems or any damages resulting from such losses. You may not use or facilitate the use of this document in connection with any infringement or other legal analysis concerning Intel products described herein. You agree to grant Intel a non-exclusive, royalty-free license to any patent claim thereafter drafted which includes subject matter disclosed herein. No license (express or implied, by estoppel or otherwise) to any intellectual property rights is granted by this document. The products described may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request. This document contains information on products, services and/or processes in development. All information provided here is subject to change without notice. Contact your Intel representative to obtain the latest Intel product specifications and roadmaps. Results have been estimated or simulated using internal Intel analysis or architecture simulation or modeling, and provided to you for informational purposes. Any differences in your system hardware, software or configuration may affect your actual performance. Copies of documents which have an order number and are referenced in this document, or other Intel literature, may be obtained by calling 1-800-548-4725, or by visiting http://www.intel.com/design/literature.htm.
    [Show full text]
  • Execution Unit ISA (Ivy Bridge)
    Intel® OpenSource HD Graphics Programmer’s Reference Manual (PRM) Volume 4 Part 3: Execution Unit ISA (Ivy Bridge) For the 2012 Intel® Core™ Processor Family May 2012 Revision 1.0 NOTICE: This document contains information on products in the design phase of development, and Intel reserves the right to add or remove product features at any time, with or without changes to this open source documentation. Doc Ref #: IHD-OS-V4 Pt 3 – 05 12 Creative Commons License You are free to Share — to copy, distribute, display, and perform the work Under the following conditions: Attribution. You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). No Derivative Works. You may not alter, transform, or build upon this work. INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL® PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. A "Mission Critical Application" is any application in which failure of the Intel Product could result, directly or indirectly, in personal injury or
    [Show full text]
  • Impact of Data Layouts on the Efficiency of GPU-Accelerated IDW Interpolation
    Mei and Tian SpringerPlus (2016) 5:104 DOI 10.1186/s40064-016-1731-6 RESEARCH Open Access Impact of data layouts on the efficiency of GPU‑accelerated IDW interpolation Gang Mei1,2* and Hong Tian3 *Correspondence: gang. [email protected] Abstract 1 School of Engineering This paper focuses on evaluating the impact of different data layouts on the compu- and Technolgy, China University of Geosciences, tational efficiency of GPU-accelerated Inverse Distance Weighting (IDW) interpolation No. 29 Xueyuan Road, algorithm. First we redesign and improve our previous GPU implementation that was Beijing 100083, China performed by exploiting the feature of CUDA dynamic parallelism (CDP). Then we Full list of author information is available at the end of the implement three versions of GPU implementations, i.e., the naive version, the tiled ver- article sion, and the improved CDP version, based upon five data layouts, including the Struc- ture of Arrays (SoA), the Array of Structures (AoS), the Array of aligned Structures (AoaS), the Structure of Arrays of aligned Structures (SoAoS), and the Hybrid layout. We also carry out several groups of experimental tests to evaluate the impact. Experimental results show that: the layouts AoS and AoaS achieve better performance than the layout SoA for both the naive version and tiled version, while the layout SoA is the best choice for the improved CDP version. We also observe that: for the two combined data layouts (the SoAoS and the Hybrid), there are no notable performance gains when compared to other three basic layouts. We recommend that: in practical applications, the layout AoaS is the best choice since the tiled version is the fastest one among three versions.
    [Show full text]