DOCSLIB.ORG

Arxiv:1807.01775V1 [Cs.MS] 3 Jul 2018 Libraries (FFTW, P3DFFT, PFFT, Cufft)

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Arxiv:1807.01775V1 [Cs.MS] 3 Jul 2018 Libraries (FFTW, P3DFFT, PFFT, Cufft) UP JORS software Latex paper template version 0.1 Software paper for submission to the Journal of Open Research Software To complete this template, please replace the blue text with your own. The paper has three main sections: (1) Overview; (2) Availability; (3) Reuse potential. Please submit the completed paper to: editor.jors@ubiquitypress.com (1) Overview Title FluidFFT: common API (C++ and Python) for Fast Fourier Transform HPC libraries Paper Authors 1. MOHANAN Ashwin Vishnua 2. BONAMY Cyrilleb 3. AUGIER Pierreb a Linn´eFlow Centre, Department of Mechanics, KTH, 10044 Stockholm, Sweden. b Univ. Grenoble Alpes, CNRS, Grenoble INP1, LEGI, 38000 Grenoble, France. Paper Author Roles and Affiliations 1. Ph.D. student, Linn´eFlow Centre, KTH Royal Institute of Technology, Sweden; 2. Research Engineer, LEGI, Universit´eGrenoble Alpes, CNRS, France; 3. Researcher, LEGI, Universit´eGrenoble Alpes, CNRS, France Abstract The Python package fluidfft provides a common Python API for performing Fast Fourier Transforms (FFT) in sequential, in parallel and on GPU with different FFT arXiv:1807.01775v1 [cs.MS] 3 Jul 2018 libraries (FFTW, P3DFFT, PFFT, cuFFT). fluidfft is a comprehensive FFT frame- work which allows Python users to easily and efficiently perform FFT and the asso- ciated tasks, such as as computing linear operators and energy spectra. We describe the architecture of the package composed of C++ and Cython FFT classes, Python \operator" classes and Pythran functions. The package supplies utilities to easily test itself and benchmark the different FFT solutions for a particular case and on a partic- ular machine. We present a performance scaling analysis on three different computing clusters and a microbenchmark showing that fluidfft is an interesting solution to write efficient Python applications using FFT. 1Institute of Engineering Univ. Grenoble Alpes UP JORS software Latex paper template version 0.1 Keywords Free and open-source library; Python; Fast Fourier Transform; Distributed; MPI; GPU; High performance computing Introduction Fast Fourier Transform (FFT) is a class of algorithms used to calculate the discrete Fourier transform, which traces back its origin to the groundbreaking work by Cooley & Tukey(1965). Ever since then, FFT as a computational tool has been applied in multiple facets of science and technology, including digital signal processing, image compression, spectroscopy, numerical simulations and scientific computing in general. There are many good libraries to perform FFT, in particular the de-facto standard FFTW(Frigo & Johnson 2005). A challenge is to efficiently scale FFT on clusters with the memory distributed over a large number of cores using Message Passing Interface (MPI). This is imperative to solve big problems faster and when the arrays do not fit in the memory of single computational node. A problem is that for one-dimensional FFT, all the data have to be located in the memory of the process that perform the FFT, so a lot of communications between processes are needed for 2D and 3D FFT. There are two strategies to distribute an array in the memory, the 1D (or slab) decom- position and the 2D (or pencil) decomposition. The 1D decomposition is more efficient when only few processes are used but suffers from an important limitation in terms of number of MPI processes that can be used. Utilizing 2D decomposition overcomes this limitation. Some of the well-known libraries are written in C, C++ and Fortran. The classical FFTW library supports MPI using 1D decomposition and hybrid parallelism using MPI and OpenMP. Other libraries, now implement the 2D decomposition: PFFT(Pippig 2013), P3DFFT(Pekurovsky 2012), 2decomp&FFT and so on. These libraries rely on MPI for the communications between processes, are optimized for supercomputers and scales well to hundreds of thousands of cores. However, since there is no common API, it is not simple to write applications that are able to use these libraries and to compare their performances. As a result, developers are met with a hard decision, which is to choose a library before the code is implemented. Apart from CPU-based parallelism, General Purpose computing on Graphical Process- ing Units (GPGPU) is also gaining traction in scientific computing. Scalable libraries written for GPGPU such as OpenCL and CUDA have emerged, with their own FFT implementations, namely clFFT and cuFFT respectively. Python can easily link these libraries through compiled extensions. For a Python developer, the following packages leverage this approach to perform FFT: • sequential FFT, using: { numpy.fft and scipy.fftpack which are essentially C and Fortran exten- sions for FFTPACK library. UP JORS software Latex paper template version 0.1 { pyFFTW which wraps FFTW library and provides interfaces similar to the numpy.fft and scipy.fftpack implementations. { mkl fft, which wraps Intel's MKL library and exposes python interfaces to act as drop-in replacements for numpy.fft and scipy.fftpack. • FFT with MPI, using: { mpiFFT4py and mpi4py-fft built on top of pyFFTW and numpy.fft. { pfft-python which provides extensions for PFFT library. • FFT with GPGPU, using: { Reikna, a pure python package which depends on PyCUDA and PyOpenCL { pytorch-fft: provides C extensions for cuFFT, meant to work with Py- Torch, a tensor library similar to NumPy. Although these Python packages are under active development, they suffer from certain drawbacks: • No effort so far to consolidate all possible FFT libraries, both sequential, MPI and GPGPU based under a single package with similar syntax. • Quite complicated even for the simplest use case scenarios. To understand how to use them, a novice user has to, at least, read the FFTW documentation. • No benchmarks between libraries and between the Python solutions and solutions based only on a compiled language (as C, C++ or Fortran). • Provides just the FFT and inverse FFT functions, no associated mathematical operators. The Python package fluidfft fills this gap by providing C++ classes and their Python wrapper classes for performing simple and common tasks with different FFT libraries. It has been written to make things easy while being as efficient as possible. It provides: • tests, • documentation and tutorials, • benchmarks, • operators for simple tasks (for example, compute the energy or the gradient of a field). UP JORS software Latex paper template version 0.1 In the present article, we shall start by describing the implementation of fluidfft including its design aspects and the code organization. Thereafter, we shall compare the performance of different classes in fluidfft in three computing clusters, and also describe, using microbenchmarks, how a Python function can be optimized to be as fast as a Fortran implementation. Finally, we show how we test and maintain the quality of the code base through continuous integration and mention some possible applications of fluidfft. Implementation and architecture The two major design goals of fluidfft are: • to support multiple FFT libraries under the same umbrella and expose the inter- face for both C++ and Python code development. • to keep the design of the interfaces as human-centric and easy to use as possible, without sacrificing performance. Both C++ and Python APIs provided by fluidfft currently support linking with FFTW (with and without MPI and OpenMP support enabled), MKL, PFFT, P3DFFT, cuFFT libraries. The classes in fluidfft offers API for performing double-precision2 computation with real-to-complex FFT, complex-to-real inverse FFT, and additional helper functions. C++ API The C++ API is implemented as a hierarchy of classes as shown in Fig.1. The naming convention used for the classes (<Type of FFT>With<Name of Library>) is a cue for how these are functioning internally. By utilizing inheritance, the classes share the same function names and syntax defined in the base classes, shown in white boxes in Fig.1. Some examples of such functions are: • alloc array X: Allocates array to store a physical array with real datatype for the current process. • alloc array K: Allocates array to store a spectral array with complex datatype for the current process. • init array X random: Allocates and initializes a physical array with random values. • test: Run tests for a class by comparing mean and mean energy values in an array before and after a set of fft and ifft calls. • bench: Benchmark the fft and ifft methods for certain number of iterations. 2Most C++ classes also support single-precision. UP JORS software Latex paper template version 0.1 BaseFFT BaseFFT2D BaseFFTMPI BaseFFT3D BaseFFT2DMPI BaseFFT3DMPI FFT2DWithFFTW1D FFT2DWithFFTW2D FFT2DWithCUFFT FFT3DWithFFTW3D FFT3DWithCUFFT FFT2DMPIWithFFTW1D FFT2DMPIWithFFTWMPI2D FFT3DMPIWithFFTWMPI3D FFT3DMPIWithFFTW1D FFT3DMPIWithPFFT FFT3DMPIWithP3DFFT Figure 1: Class hierarchy demonstrating object-oriented approach. The sequential classes are shown in red, the CUDA-based classes in magenta and the MPI-based classes in green. The arrows represent inheritance from parent to child class. Remaining methods which are specific to a library are defined in the corresponding child classes, depicted in coloured boxes in Fig.1, for example: • are parameters bad: Verifies whether the global array shape can be decomposed with the number of MPI processes available or not. If the parameters are com- patible, the method returns false. This method is called prior to initializing the class. • fft and ifft: Forward and inverse FFT methods. Let us illustrate with a trivial example, wherein we initialize
Load more
Loading...
Loading...
Loading...
Loading...
Loading...

17 pages remaining, click to load more.

Recommended publications
  • How to Write Fast Numerical Code: a Small Introduction
    How To Write Fast Numerical Code: A Small Introduction Srinivas Chellappa, Franz Franchetti, and Markus Puschel¨ Electrical and Computer Engineering Carnegie Mellon University {schellap, franzf, pueschel}@ece.cmu.edu Abstract. The complexity of modern computing platforms has made it increas- ingly difficult to write numerical code that achieves the best possible perfor- mance. Straightforward implementations based on algorithms that minimize the operations count often fall short in performance by an order of magnitude. This tutorial introduces the reader to a set of general techniques to improve the per- formance of numerical code, focusing on optimizations for the computer’s mem- ory hierarchy. Two running examples are used to demonstrate these techniques: matrix-matrix multiplication and the discrete Fourier transform. 1 Introduction The growth in the performance of computing platforms in the past few decades has followed a reliable pattern usually referred to as Moore’s Law. Moore observed in 1965 [53] that the number of transistors per chip roughly doubles every 18 months and predicted—correctly—that this trend would continue. In parallel, due to the shrinking size of transistors, CPU frequencies could be increased at roughly the same exponential rate. This trend has been the big supporter for many performance demanding applica- tions in scientific computing (such as climate modeling and other physics simulations), consumer computing (such as audio, image, and video processing), and embedded com- puting (such as control, communication, and signal processing). In fact, these domains have a practically unlimited need for performance (for example, the ever growing need for higher resolution videos), and it seems that the evolution of computers is well on track to support these needs.
    [Show full text]
  • The Design and Implementation of FFTW3 Matteo Frigo and Steven G
    1 The Design and Implementation of FFTW3 Matteo Frigo and Steven G. Johnson (Invited Paper) Abstract— FFTW is an implementation of the discrete Fourier of a multi-dimensional array. (Most implementations sup- transform (DFT) that adapts to the hardware in order to port only a single DFT of contiguous data.) maximize performance. This paper shows that such an approach • FFTW supports DFTs of real data, as well as of real can yield an implementation that is competitive with hand- optimized libraries, and describes the software structure that symmetric/antisymmetric data (also called discrete co- makes our current FFTW3 version flexible and adaptive. We sine/sine transforms). further discuss a new algorithm for real-data DFTs of prime size, The interaction of the user with FFTW occurs in two a new way of implementing DFTs by means of machine-specific stages: planning, in which FFTW adapts to the hardware, “SIMD” instructions, and how a special-purpose compiler can and execution, in which FFTW performs useful work for the derive optimized implementations of the discrete cosine and sine transforms automatically from a DFT algorithm. user. To compute a DFT, the user first invokes the FFTW planner, specifying the problem to be solved. The problem is Index Terms— FFT, adaptive software, Fourier transform, a data structure that describes the “shape” of the input data— cosine transform, Hartley transform, I/O tensor. array sizes and memory layouts—but does not contain the data itself. In return, the planner yields a plan, an executable data I. INTRODUCTION structure that accepts the input data and computes the desired DFT.
    [Show full text]
  • Numerical Libraries
    Numerical libraries M.Cremonesi May 2016 Numerical libraries Numerical libraries are collections of functions that implement a variety of mathematical algorithms. These may include low level operations such as matrix-vector arithmetics or random functions, but also more complicated algorithms such as Fast Fourier Transforms or Minimization Problems. Numerical libraries Linear algebra operations are among the most common problems solved in numerical libraries. Typical operations are: Scalar products: s = ∑ai .b i Linear Systems: Aij ⋅ x j = bi Eigenvalue Equations: Aij ⋅ x j = α ⋅ xi Numerical libraries Libraries should be used in programs: • To avoid code repeating • To enhance program functionality • To avert numerical errors • To gain efficiency As far as parallel computing is concerned many versions of numerical libraries are available to run efficiently in different computer environments. Numerical libraries Many numerical libraries have been written to solve linear system equations efficiently. Linear problems are of the kind: find x := A . x = b Not linear problems may be solved with a sequence of linear problems. Numerical libraries Solving a linear system with Gaussian elimination can take a lot of time and memory, for large matrices. This is why many libraries use iterative solvers. They are based on finding solution of the problem by calculating successive approximations, even though convergence can not always be guaranteed. Numerical libraries Iterative solvers are faster and use less memory but a check for correctness must be computed at each step, and a pre- conditioner is usually needed. The condition number associated to a linear equation A.x = b gives a bound on how inaccurate the solution x will be after approximate solution.
    [Show full text]
  • The Fastest Fourier Transform in the West (MIT-LCS-TR-728)
    The Fastest Fourier Transform in the West (MIT-LCS-TR-728) Matteo Frigo1 Steven G. Johnson2 Massachusetts Institute of Technology September 11, 1997 Matteo Frigo was supported in part by the Defense Advanced Research Projects Agency (DARPA) under Grant N00014-94-1-0985. Steven G. Johnson was supported in part by a DoD NDSEG Fellowship, an MIT Karl Taylor Compton Fellowship, and by the Materials Research Science and Engineering Center program of the National Science Foundation under award DMR-9400334. This paper is a technical report of the MIT Labroratory for Computer Science MIT-LCS-TR-728 1MIT Laboratory for Computer Science, 545 Technology Square NE43-203, Cambridge, MA 02139. athena@theory.lcs.mit.edu 2Massachusetts Institute of Technology, 77 Massachusetts Avenue, 12-104, Cambridge, MA 02139. stevenj@mit.edu Abstract This paper describes FFTW, a portable C package for computing the one- and multidimen- sional complex discrete Fourier transform (DFT). FFTW is typically faster than all other publicly available DFT software, including the well-known FFTPACK and the code from Numerical Recipes. More interestingly, FFTW is competitive with or better than propri- etary, highly-tuned codes such as Sun's Performance Library and IBM's ESSL library. FFTW implements the Cooley-Tukey fast Fourier transform, and is freely available on the Web at http://theory.lcs.mit.edu/Äfftw. Three main ideas are the keys to FFTW's performance. First, the computation of the transform is performed by an executor consisting of highly-optimized, composable blocks of C code called codelets. Second, at runtime, a planner ®nds an ef®cient way (called a `plan') to compose the codelets.
    [Show full text]
  • Matteo Frigo Steven G. Johnson This Manual Is for FFTW (Version 3.3.10, 10 December 2020)
    FFTW for version 3.3.10, 10 December 2020 Matteo Frigo Steven G. Johnson This manual is for FFTW (version 3.3.10, 10 December 2020). Copyright c 2003 Matteo Frigo. Copyright c 2003 Massachusetts Institute of Technology. Permission is granted to make and distribute verbatim copies of this manual provided the copyright notice and this permission notice are preserved on all copies. Permission is granted to copy and distribute modified versions of this manual under the conditions for verbatim copying, provided that the entire resulting derived work is distributed under the terms of a permission notice identical to this one. Permission is granted to copy and distribute translations of this manual into another language, under the above conditions for modified versions, except that this permission notice may be stated in a translation approved by the Free Software Foundation. i Table of Contents 1 Introduction ::::::::::::::::::::::::::::::::::::: 1 2 Tutorial :::::::::::::::::::::::::::::::::::::::::: 3 2.1 Complex One-Dimensional DFTs ::::::::::::::::::::::::::::::: 3 2.2 Complex Multi-Dimensional DFTs :::::::::::::::::::::::::::::: 5 2.3 One-Dimensional DFTs of Real Data ::::::::::::::::::::::::::: 6 2.4 Multi-Dimensional DFTs of Real Data :::::::::::::::::::::::::: 7 2.5 More DFTs of Real Data :::::::::::::::::::::::::::::::::::::: 10 2.5.1 The Halfcomplex-format DFT :::::::::::::::::::::::::::: 11 2.5.2 Real even/odd DFTs (cosine/sine transforms) ::::::::::::: 11 2.5.3 The Discrete Hartley Transform :::::::::::::::::::::::::: 13 3 Other
    [Show full text]
  • Sun Performance Library User's Guide for Fortran and C
    Sun Performance Library User’s Guide for Fortran and C Forte Developer 6 update 2 (Sun WorkShop 6 update 2) Sun Microsystems, Inc. 901 San Antonio Road Palo Alto, CA 94303 U.S.A. 650-960-1300 Part No. 806-7995-10 July 2001, Revision A Send comments about this document to: docfeedback@sun.com Copyright 2001 Sun Microsystems, Inc., 901 San Antonio Road • Palo Alto, CA 94303-4900 USA. All rights reserved. This product or document is distributed under licenses restricting its use, copying, distribution, and decompilation. No part of this product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors, if any. Third-party software, including font technology, is copyrighted and licensed from Sun suppliers. Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is a registered trademark in the U.S. and other countries, exclusively licensed through X/Open Company, Ltd. For Netscape™, Netscape Navigator™, and the Netscape Communications Corporation logo™, the following notice applies: Copyright 1995 Netscape Communications Corporation. All rights reserved. Sun, Sun Microsystems, the Sun logo, docs.sun.com, AnswerBook2, Solaris, SunOS, JavaScript, SunExpress, Sun WorkShop, Sun WorkShop Professional, Sun Performance Library, Sun Performance WorkShop, Sun Visual WorkShop, and Forte are trademarks, registered trademarks, or service marks of Sun Microsystems, Inc. in the U.S. and other countries. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. in the U.S. and other countries. Products bearing SPARC trademarks are based upon an architecture developed by Sun Microsystems, Inc.
    [Show full text]
  • 13.11 Discrete Fourier Transform 431
    13.11 DISCRETE FOURIER TRANSFORM 431 1.5 8 1 6 0.5 4 50 100 150 200 250 -0.5 2 -1 -1.5 50 100 150 200 250 INPUT OUTPUT 13.11 Discrete Fourier Transform Input description: A sequence of n real or complex values hi,0≤ i ≤ n − 1, sampled at uniform intervals from a function h. n−1 2πikm/n Problem description: The discrete Fourier transform Hm = k=0 hke for 0 ≤ m ≤ n − 1. Discussion: Although computer scientists tend to be fairly ignorant about Fourier transforms, electrical engineers and signal processors eat them for breakfast. Func- tionally, Fourier transforms provide a way to convert samples of a standard time- series into the frequency domain. This provides a dual representation of the function in which certain operations become easier than in the time domain. Applications of Fourier transforms include: • Filtering – Taking the Fourier transform of a function is equivalent to rep- resenting it as the sum of sine functions. By eliminating undesirable high- and/or low-frequency components (i.e. , dropping some of the sine functions) and taking an inverse Fourier transform to get us back into the time domain, we can filter an image to remove noise and other artifacts. For example, the sharp spike in the figure above represents the period of the single sine function that closely models the input data. The rest is noise. • Image compression – A smoothed, filtered image contains less information than the original, while retaining a similar appearance. By eliminating the coefficients of sine functions that contribute relatively little to the image, we can reduce the size of the image at little cost in image fidelity.
    [Show full text]
  • Fast Fourier Transform Using Parallel Processing for Medical
    FAST FOURIER TRANSFORM USING PARALLEL PROCESSING FOR MEDICAL APPLICATIONS A Thesis Presented to The Graduate Faculty of The University of Akron In Partial Fulfillment of the Requirements for the Degree Master of Science Vinod Jagtap May, 2010 ` FAST FOURIER TRANSFORM USING PARALLEL PROCESSING FOR MEDICAL APPLICATIONS Vinod Jagtap Thesis Approved: Accepted: _______________________ _______________________ Advisor Dean of the College Dr. Dale H. Mugler Dr. George K. Haritos _______________________ _______________________ Co-Advisor Dean of the Graduate School Dr. Wolfgang Pelz Dr. George R. Newkome _______________________ _______________________ Department Chair Date Dr. Daniel Sheffer ii ` TABLE OF CONTENTS Page LIST OF TABLES ............................................................................................................. vi LIST OF FIGURES .......................................................................................................... vii CHAPTER I. INTRODUCTION ...........................................................................................................1 II.LITERATURE REVIEW 2.1 Fourier Transform ...........................................................................................3 2.2 Discrete Fourier Transform .............................................................................4 2.2.1 DFT .....................................................................................................4 2.2.2 Definition ............................................................................................6
    [Show full text]
  • Matteo Frigo Steven G. Johnson This Manual Is for FFTW (Version 3.3.2, 28 April 2012)
    FFTW for version 3.3.2, 28 April 2012 Matteo Frigo Steven G. Johnson This manual is for FFTW (version 3.3.2, 28 April 2012). Copyright c 2003 Matteo Frigo. Copyright c 2003 Massachusetts Institute of Technology. Permission is granted to make and distribute verbatim copies of this manual provided the copyright notice and this permission notice are preserved on all copies. Permission is granted to copy and distribute modified versions of this manual under the conditions for verbatim copying, provided that the entire resulting derived work is distributed under the terms of a permission notice identical to this one. Permission is granted to copy and distribute translations of this manual into another language, under the above conditions for modified versions, except that this permission notice may be stated in a translation approved by the Free Software Foundation. i Table of Contents 1 Introduction::::::::::::::::::::::::::::::::::::: 1 2 Tutorial :::::::::::::::::::::::::::::::::::::::::: 3 2.1 Complex One-Dimensional DFTs ::::::::::::::::::::::::::::::: 3 2.2 Complex Multi-Dimensional DFTs ::::::::::::::::::::::::::::: 5 2.3 One-Dimensional DFTs of Real Data ::::::::::::::::::::::::::: 6 2.4 Multi-Dimensional DFTs of Real Data:::::::::::::::::::::::::: 7 2.5 More DFTs of Real Data :::::::::::::::::::::::::::::::::::::: 10 2.5.1 The Halfcomplex-format DFT :::::::::::::::::::::::::::: 11 2.5.2 Real even/odd DFTs (cosine/sine transforms) :::::::::::: 11 2.5.3 The Discrete Hartley Transform :::::::::::::::::::::::::: 13 3 Other Important Topics:::::::::::::::::::::::
    [Show full text]
  • AN ADAPTIVE SOFTWARE ARCHITECTURE for the FFT Matteo Frigo MIT Laboratory for Computer Science 545 Technology Square NE43
    FFTW: AN ADAPTIVE SOFTWARE ARCHITECTURE FOR THE FFT Matteo Frigo Steven G. Johnson MIT Laboratory for Computer Science Massachusetts Institute of Technology 545 Technology Square NE43-203 77 Massachusetts Avenue, 12-104 Cambridge, MA 02139 Cambridge, MA 02139 athena@theory.lcs.mit.edu stevenj@alum.mit.edu fftw_plan plan; ABSTRACT COMPLEX A[n], B[n]; FFT literature has been mostly concerned with minimizing the number of floating-point operations performed by an algorithm. /* plan the computation */ Unfortunately, on present-day microprocessors this measure is far plan = fftw_create_plan(n); less important than it used to be, and interactions with the pro- cessor pipeline and the memory hierarchy have a larger impact /* execute the plan */ on performance. Consequently, one must know the details of a fftw(plan, A); computer architecture in order to design a fast algorithm. In this paper, we propose an adaptive FFT program that tunes the com- /* the plan can be reused for putation automatically for any particular hardware. We compared other inputs of size N */ our program, called FFTW, with over 40 implementations of the fftw(plan, B); FFT on 7 machines. Our tests show that FFTW’s self-optimizing approach usually yields significantly better performance than all Figure 1: Simplified example of FFTW’s use. The user must first other publicly available software. FFTW also compares favorably create a plan, which can be then used at will. with machine-specific, vendor-optimized libraries. similar adaptive techniques could be applied successfully to other 1. INTRODUCTION problems. The discrete Fourier transform (DFT) is an important tool in many In FFTW, the computation of the transform is accomplished by branches of science and engineering [1] and has been studied ex- an executor that consists of highly optimized, composable blocks tensively [2].
    [Show full text]
  • Fast Fourier Transform Discrete Fourier Transform Pair
    14. Fast Fourier Transform Discrete Fourier Transform pair 2 = • Given real at = ( = 0, 1, 2, … , − 1) = 0 1 2 ... − 1 0 2 = 2 = 1 = () = = = = 1 = = Computation of Discrete Fourier Transform N is even = 0 1 2 ... 2 − 1 • Given real at = ( = 0, 1, 2, … , − 1) 0 2 1 1 • Compute complex = ⋅ = ⋅ ≡ ( = 0, 1, 2 … , − 1) • Direct computation of discrete Fourier transform (DFT): compute and store 1 = × compute and temporarily store ⋅ 1 = ⋅ × compute and temporarily store ⋅ …………………… • The number of computation is N. 1 • The total number of real multiplications ≈ 4 , or = ⋅ × the total number of complex multiplications ≈ • There are many different fast algorithms to compute DFT involves total number of complex multiplications less than . Cooley–Tukey FFT Algorithm • The best-known FFT algorithm (radix-2 decimation) is that developed in 1965 by J. Cooley and J. Tukey which reduces the number of complex multiplications to ( log). Cooley, J. & Tukey, J. 1965, An algorithm for the machine calculation of complex Fourier series, Mathematics of Computation, vol.19, No.90, pp.297-301. James William Cooley John Wilder Tukey Carl Friedrich Gauss (born 1926) (1915 – 2000) (1777 – 1855) • But it was later discovered that Cooley and Tukey had independently re-invented an algorithm known to Carl Friedrich Gauss around 1805. Radix-2 Decimation = N is even 1 = 0 1 2 ... /2 − 1 = ⋅ = 0, 1, 2 … , − 1
    [Show full text]
  • Introduction to Scientific Libraries
    Introduction to Scientific Libraries M. Guarrasi, M. Cremonesi, F. Affinito - CINECA 2015/10/27 Numerical Libraries •Groups of functions or subroutines •They implement various numerical algorithms, e.g: •Simple arithmetic operations; •Linear algebra; •FFT; •Solver for minimization problems; •Random generators; Numerical Libraries Why we should use NLs? •Improve modularity •Standardization •Portability •Efficency •Ready to use Numerical Libraries Disadvantages: Hidden details Unknown Algorithms Too many confidence in the implementation: E.g.: the algorithm works on only in some specific cases Numerical Libraries Agenda: •Linear Algebra: •BLAS/PBLAS •LAPACK/SCALAPAK •ARPAK/P_ARPACK •PETSc •…. •AMR: •METHIS/ ParaMETHIS •PARAMESH •CHOMBO •FFT: •FFTPACK •FFTW •2DECOMP&FFT •P3DFFT •I/O: •HDF5 •NETCDF Numerical Libraries (Linear Algebra) Serial Linear Algebra Packages • BLAS essl (IBM AIX) mkl (Intel) threaded acml (AMD) • LAPACK plasma (ICL – Univ. Tennessee) magma (ICL – Univ. Tennessee) → hybrid • PBLAS Parallel (distributed) Linear Algebra Packages (for dense matrices) • ScaLAPACK dplasma (ICL – Univ. Tennessee) • ARPACK Eigenvalues Problems (for sparse • P_ARPACK matrices) • PETSc → Sparse (non-)Linear Systems Linear Algebra Libraries BLAS/CBLAS •La Basic Linear Algebra Subprograms is one of the first libraries (written in 1979). •It includes simple operation between vectors and matrixes (e.g. scalar product, scalar operations, transposition,..); •It is currently used by other numerical libraries ; • Several distributions was created. •Available on several architectures. Language: FORTRAN, C Availability: public domain Developers: Jack Dongarra, ORNL and Eric Grosse, Bell Labs Distributors: NETLIB Ref.: The University of Tennessee at Knoxville and Bell Laboratories Linear Algebra Libraries BLAS/CBLAS BLAS lev. 1: Fortran subroutine for simple algebra operations (scalar- vector op.s). Developed in 1977. BLAS lev. 2: Vectors-matrices operations.
    [Show full text]