Intel® Math Kernel Library

Total Page:16

File Type:pdf, Size:1020Kb

Intel® Math Kernel Library IntelIntel®® MathMath KernelKernel LibraryLibrary ReleaseRelease 7.07.0 MarchMarch 20052005 IntelIntel®® MKLMKL PurposePurpose z Performance, performance, performance! z Intel’s scientific and engineering floating point math library z Initially only basic linear algebra subroutines (BLAS) and fast Fourier transformations (FFT) z Address: – Solvers such as linear algebra package (LAPACK) and BLAS – Eigenvector/eigenvalue solvers (BLAS, LAPACK) – Some quantum chemistry needs (dgemm) – PDEs, signal processing, seismic, solid-state physics (FFTs) – General scientific, financial - vector transcendental functions, vector markup language (VML) z Tune for Intel processors – current & future Intel and the Intel logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States or other countries IntelIntel®® MKLMKL PurposePurpose –– DonDon’’tsts z ButBut dondon’’tt useuse IntelIntel MKLMKL onon …… X’ 4x4 X Y’ Transformation Y Z’ = matrix Z But you could W’ W use Intel® IPP1 Geometric transformation z DonDon’’tt useuse IntelIntel MKLMKL onon ““smallsmall”” countscounts z DonDon’’tt callcall vectorvector mathmath functionsfunctions onon smallsmall nn 1Intel Integrated Performance Primitives Intel and the Intel logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States or other countries IntelIntel®® MKLMKL ContentsContents BLAS (basic linear algebra subroutines) z Level 1 BLAS – vector-vector operations – 15 function types – 48 functions z Level 2 BLAS – matrix-vector operations – 26 function types – 66 functions z Level 3 BLAS – matrix-matrix operations – 9 function types – 30 functions z Extended BLAS – level 1 BLAS for sparse vectors – 8 function types – 24 functions Intel and the Intel logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States or other countries IntelIntel®® MKLMKL ContentsContents LAPACKLAPACK (linear(linear algebraalgebra package)package) – Solvers and eigensolvers, hundreds of routines! – More than 1000 user callable and support routines FFTsFFTs (fast(fast FourierFourier transforms)transforms) – One and two dimensional – With and without frequency ordering (bit reversal) VMLVML (vector(vector mathmath library)library) – Set of vectorized transcendental functions – Most of libm functions, but faster DirectDirect SparseSparse solversolver ((PardisoPardiso*)*) Intel and the Intel logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States or other countries IntelIntel®® MKLMKL ContentsContents z MostMost ofof IntelIntel MKLMKL isis FortranFortran interfaceinterface z LegacyLegacy ofof highhigh performanceperformance computationcomputation z BLAS,BLAS, LAPACKLAPACK areare bothboth Fortran,Fortran, makemake upup mostmost ofof librarylibrary z CBLASCBLAS interfaceinterface –– moremore convenientconvenient forfor C/C++C/C++ programmerprogrammer toto callcall BLASBLAS Intel and the Intel logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States or other countries IntelIntel®® MKLMKL ContentsContents -- EnvironmentEnvironment z SupportsSupports cdeclcdecl andand CVFCVF defaultdefault interfacesinterfaces z SupportsSupports IntelIntel andand CVFCVF FortranFortran compilerscompilers –– importimport forfor thisthis supportsupport relatesrelates toto runtimeruntime librarieslibraries z SupportsSupports Linux*Linux* andand Windows*Windows* OSOS z StaticStatic andand dynamicallydynamically linkedlinked librarieslibraries z SupportsSupports allall processorsprocessors –– 3232--bitbit andand 6464--bitbit z LargeLarge setset ofof teststests andand examplesexamples z ExtensiveExtensive documentationdocumentation Intel and the Intel logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States or other countries ThreadingThreading z Most of Intel® MKL could be threaded but … – Limited resource is memory bandwidth – Threading level 1, level 2 BLAS mostly ineffective ( O(n) ) z Numerous opportunities for threading – Level 3 BLAS ( O(n3) ) – LAPACK ( O(n3) ) – FFTs ( O(n log(n) ) – VML? Depends on processor and function z All threading uses OpenMP* z All Intel MKL is designed and compiled for thread safety Intel and the Intel logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States or other countries HowHow toto LinkLink WithWith MKLMKL onon ItaniumItanium®® z Set path to installation directory – E.g. export MKLPATH=/opt/intel/mkl z Static sample: – ld myprog.o $MKLPATH/libmkl_lapack.a $MKLPATH/libmkl_ipf.a - L$MKLPATH -lguide -lpthread – Itanium®-based processor static linking of LAPACK and kernels. Processor dispatcher will call the appropriate kernel for the system at runtime. z Dynamic sample: – ld myprog.o -L$MKLPATH -lmkl_lapack64 -lmkl -lguide -lpthread – Dynamic linking on Itanium®-based platforms, LAPACK library (double precision functions), Itanium-based processor kernels. Shared object dispatcher will dynamically load the appropriate shared object with specific kernel for the system at runtime Intel and the Intel logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States or other countries BLASBLAS ReviewReview z 33 ““levelslevels”” ofof functionsfunctions ++ sparsesparse – Level 1: vector-vector operations – Level 2: vector-matrix operations – Level 3: matrix-matrix operations – Sparse: level 1 operations on sparse vectors z ““LevelsLevels”” followfollow historyhistory – Level 1 in early 70’s – Level 2 in mid-70’s followed immediately by level 3 The Intel logo is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States or other countries BLASBLAS NamingNaming ConventionsConventions z GeneralGeneral scheme:scheme: <precision><name><modifier><precision><name><modifier> z precision:precision: oneone oror twotwo lettersletters – 1 letter implies input and output are same type s = single, d = double, c = single complex, z = double complex – 2 letters input and output are different cs, zd: complex in, real out; sc, dz: real in, complex out The Intel logo is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States or other countries BLASBLAS NamingNaming ConventionsConventions z LevelLevel 11 BLAS:BLAS: <precision><name><modifier><precision><name><modifier> where modifiers are c: conjugated (cdotc), u: unconjugated (cdotu), g: givens (srotg) z LevelLevel 2,2, 33 BLASBLAS <name><name>:: g: general - ge: general; gb: band s: symmetric - sy: symmetric; sp: packed; sb: band h: Hermitian - he: Hermitian; hp: packed ; hb: band t: triangular - tr: triangular; tp: packed; tb: band The Intel logo is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States or other countries BLASBLAS NamingNaming ConventionsConventions z LevelLevel 22 <modifier><modifier> mv: matrix-vector; sv: solve (vector operations); r: rank update; r2: rank 2 update dger: double-precision general rank update: AA :=:= alphaalpha ** xx ** yy’’ ++ AA z LevelLevel 33 <modifier><modifier> mm: matrix-matrix; sm: solve (matrix operations); r: rank update; r2: rank 2 update dsyr2k: double-precision symmetric rank-2 update The Intel logo is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States or other countries RNGRNG FunctionsFunctions z Gaussian (RPM, Box-Muller Methods) z Exponential z Laplace z Uniform (a,b), (-a,a) z Weibull z Rayleigh z Cauchy z Lognormal z Discrete Uniform [a,b) z Geometric z Bernoulli z Others DGEMMDGEMM onon IPF2:IPF2: NN == 10241024 100% 90% 80% 70% 90%-100% 60% 80%-90% 50% % pe ak 70%-80% 40% 60%-70% 30% 20% 50%-60% 10% 40%-50% 0% 30%-40% 960 20%-30% 256 1024 512 224 k 128 10%-20% 128 80 72 56 m 40 32 0%-10% 8 1.0 GHz Itanium™ 2 Processor8 – in 6.0 update LINPACKLINPACK onon 1.01.0 GHzGHz IPF2IPF2 16000 14000 12000 10000 1 CPU 8000 2 CPU MFLOPS 4 CPU 6000 4000 2000 0 160 320 640 1000 1280 2000 2560 3000 4000 5000 5120 6000 7000 8000 9000 10000 11000 12000 14000 Number of Equations 2D2D DFTs*onDFTs*on 900900 MHzMHz IPF2IPF2 4000 3500 3000 2500 1P 2000 1500 2P MFLOPS 1000 500 0 128 384 640 900 1152 1440 1728 1920 2250 *Single precision complex Transform Siz4e MKL 6.0 β update 1D1D DFTs*onDFTs*on 900900 MHzMHz IPF2IPF2 3000 2500 2000 1500 1P MFLOPS 1000 500 0 96 192 384 768 1152 1536 1920 *Single precision complex Transform Size MKL 6.0 β update MKLMKL Status,Status, PlansPlans z CurrentCurrent ProductionProduction ReleaseRelease isis 7.27.2 aavailablevailable inin 22 versionsversions – Standard MKL – Cluster MKL – Standard MKL _ ScaLAPACK z VersionVersion 7.2.17.2.1 –– toto bebe releasedreleased inin Q1/2005Q1/2005 – Improvements on Itanium® – BLAS:DGEMM: 1-3% improvement for TN and TT cases – BLAS:*TRMV, ZGERC, ZGERU: 20-30% improvement – VML – vdPowx: improved for special cases – To be released in Q3/2004 FutureFuture ReleasesReleases ofof MKLMKL z NewNew capabilitiescapabilities – C++ Wrappers – Iterative Sparse Solver – LAPACK 4.0 support – Additional statistical functions – Support for upcoming Intel processors – More… • IntelIntel®® ClusterCluster MKLMKL – Distributed Memory DFTs – Distributed Memory sparse solver – Additional ScaLAPACK performance optimizations MKLMKL SummarySummary z EasyEasy wayway toto portableportable codecode forfor allall IntelIntel®® architectures,architectures, Linux*Linux* andand Windows*Windows* z MKLMKL forfor ItaniumItanium®® processorprocessor pathpath toto easyeasy highhigh performanceperformance forfor applicationsapplications z TechnicalTechnical computationcomputation supportsupport ––linearlinear algebraalgebra (BLAS,(BLAS, LAPACK)LAPACK) ––FFTsFFTs ––vectorvector transcendentalstranscendentals (VML)(VML) ––ClusterCluster computingcomputing beingbeing addedadded .
Recommended publications
  • Using Intel® Math Kernel Library and Intel® Integrated Performance Primitives in the Microsoft* .NET* Framework
    Using Intel® MKL and Intel® IPP in Microsoft* .NET* Framework Using Intel® Math Kernel Library and Intel® Integrated Performance Primitives in the Microsoft* .NET* Framework Document Number: 323195-001US.pdf 1 Using Intel® MKL and Intel® IPP in Microsoft* .NET* Framework INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL® PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER, AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. UNLESS OTHERWISE AGREED IN WRITING BY INTEL, THE INTEL PRODUCTS ARE NOT DESIGNED NOR INTENDED FOR ANY APPLICATION IN WHICH THE FAILURE OF THE INTEL PRODUCT COULD CREATE A SITUATION WHERE PERSONAL INJURY OR DEATH MAY OCCUR. Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined." Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information. The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications.
    [Show full text]
  • Intel(R) Math Kernel Library for Linux* OS User's Guide
    Intel® Math Kernel Library for Linux* OS User's Guide MKL 10.3 - Linux* OS Document Number: 315930-012US Legal Information Legal Information INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL(R) PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER, AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. UNLESS OTHERWISE AGREED IN WRITING BY INTEL, THE INTEL PRODUCTS ARE NOT DESIGNED NOR INTENDED FOR ANY APPLICATION IN WHICH THE FAILURE OF THE INTEL PRODUCT COULD CREATE A SITUATION WHERE PERSONAL INJURY OR DEATH MAY OCCUR. Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined." Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information. The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request. Contact your local Intel sales office or your distributor to obtain the latest specifications and before placing your product order.
    [Show full text]
  • Intel® Math Kernel Library for Windows* OS User's Guide
    Intel® Math Kernel Library for Windows* OS User's Guide Intel® MKL - Windows* OS Document Number: 315930-027US Legal Information Contents Contents Legal Information................................................................................7 Introducing the Intel® Math Kernel Library...........................................9 Getting Help and Support...................................................................11 Notational Conventions......................................................................13 Chapter 1: Overview Document Overview.................................................................................15 What's New.............................................................................................15 Related Information.................................................................................15 Chapter 2: Getting Started Checking Your Installation.........................................................................17 Setting Environment Variables ..................................................................17 Compiler Support.....................................................................................19 Using Code Examples...............................................................................19 What You Need to Know Before You Begin Using the Intel® Math Kernel Library...............................................................................................19 Chapter 3: Structure of the Intel® Math Kernel Library Architecture Support................................................................................23
    [Show full text]
  • 0 BLIS: a Modern Alternative to the BLAS
    0 BLIS: A Modern Alternative to the BLAS FIELD G. VAN ZEE and ROBERT A. VAN DE GEIJN, The University of Texas at Austin We propose the portable BLAS-like Interface Software (BLIS) framework which addresses a number of short- comings in both the original BLAS interface and present-day BLAS implementations. The framework allows developers to rapidly instantiate high-performance BLAS-like libraries on existing and new architectures with relatively little effort. The key to this achievement is the observation that virtually all computation within level-2 and level-3 BLAS operations may be expressed in terms of very simple kernels. Higher-level framework code is generalized so that it can be reused and/or re-parameterized for different operations (as well as different architectures) with little to no modification. Inserting high-performance kernels into the framework facilitates the immediate optimization of any and all BLAS-like operations which are cast in terms of these kernels, and thus the framework acts as a productivity multiplier. Users of BLAS-dependent applications are supported through a straightforward compatibility layer, though calling sequences must be updated for those who wish to access new functionality. Experimental performance of level-2 and level-3 operations is observed to be competitive with two mature open source libraries (OpenBLAS and ATLAS) as well as an established commercial product (Intel MKL). Categories and Subject Descriptors: G.4 [Mathematical Software]: Efficiency General Terms: Algorithms, Performance Additional Key Words and Phrases: linear algebra, libraries, high-performance, matrix, BLAS ACM Reference Format: ACM Trans. Math. Softw. 0, 0, Article 0 ( 0000), 31 pages.
    [Show full text]
  • Intel® Parallel Studio Xe 2017 Runtime
    Intel® Parallel StudIo Xe 2017 runtIme Release Notes 26 July 2016 Contents 1 Introduction ................................................................................................................................................... 1 1.1 What Every User Should Know About This Release ..................................................................... 1 2 Product Contents ......................................................................................................................................... 2 3 System Requirements ................................................................................................................................ 3 3.1 Processor Requirements........................................................................................................................... 3 3.2 Disk Space Requirements ......................................................................................................................... 3 3.3 Operating System Requirements .......................................................................................................... 3 3.4 Memory Requirements .............................................................................................................................. 3 3.5 Additional Software Requirements ...................................................................................................... 3 4 Issues and Limitations ..............................................................................................................................
    [Show full text]
  • 0 BLIS: a Framework for Rapidly Instantiating BLAS Functionality
    0 BLIS: A Framework for Rapidly Instantiating BLAS Functionality FIELD G. VAN ZEE and ROBERT A. VAN DE GEIJN, The University of Texas at Austin The BLAS-like Library Instantiation Software (BLIS) framework is a new infrastructure for rapidly in- stantiating Basic Linear Algebra Subprograms (BLAS) functionality. Its fundamental innovation is that virtually all computation within level-2 (matrix-vector) and level-3 (matrix-matrix) BLAS operations can be expressed and optimized in terms of very simple kernels. While others have had similar insights, BLIS reduces the necessary kernels to what we believe is the simplest set that still supports the high performance that the computational science community demands. Higher-level framework code is generalized and imple- mented in ISO C99 so that it can be reused and/or re-parameterized for different operations (and different architectures) with little to no modification. Inserting high-performance kernels into the framework facili- tates the immediate optimization of any BLAS-like operations which are cast in terms of these kernels, and thus the framework acts as a productivity multiplier. Users of BLAS-dependent applications are given a choice of using the the traditional Fortran-77 BLAS interface, a generalized C interface, or any other higher level interface that builds upon this latter API. Preliminary performance of level-2 and level-3 operations is observed to be competitive with two mature open source libraries (OpenBLAS and ATLAS) as well as an established commercial product (Intel MKL). Categories and Subject Descriptors: G.4 [Mathematical Software]: Efficiency General Terms: Algorithms, Performance Additional Key Words and Phrases: linear algebra, libraries, high-performance, matrix, BLAS ACM Reference Format: ACM Trans.
    [Show full text]
  • Accelerating Spark ML Applications Date Published: 2020-01-16 Date Modified
    Best Practices Accelerating Spark ML Applications Date published: 2020-01-16 Date modified: https://docs.cloudera.com/ Legal Notice © Cloudera Inc. 2021. All rights reserved. The documentation is and contains Cloudera proprietary information protected by copyright and other intellectual property rights. No license under copyright or any other intellectual property right is granted herein. Copyright information for Cloudera software may be found within the documentation accompanying each component in a particular release. Cloudera software includes software from various open source or other third party projects, and may be released under the Apache Software License 2.0 (“ASLv2”), the Affero General Public License version 3 (AGPLv3), or other license terms. Other software included may be released under the terms of alternative open source licenses. Please review the license and notice files accompanying the software for additional licensing information. Please visit the Cloudera software product page for more information on Cloudera software. For more information on Cloudera support services, please visit either the Support or Sales page. Feel free to contact us directly to discuss your specific needs. Cloudera reserves the right to change any products at any time, and without notice. Cloudera assumes no responsibility nor liability arising from the use of products, except as expressly agreed to in writing by Cloudera. Cloudera, Cloudera Altus, HUE, Impala, Cloudera Impala, and other Cloudera marks are registered or unregistered trademarks in the United States and other countries. All other trademarks are the property of their respective owners. Disclaimer: EXCEPT AS EXPRESSLY PROVIDED IN A WRITTEN AGREEMENT WITH CLOUDERA, CLOUDERA DOES NOT MAKE NOR GIVE ANY REPRESENTATION, WARRANTY, NOR COVENANT OF ANY KIND, WHETHER EXPRESS OR IMPLIED, IN CONNECTION WITH CLOUDERA TECHNOLOGY OR RELATED SUPPORT PROVIDED IN CONNECTION THEREWITH.
    [Show full text]
  • Intel Threading Building Blocks
    Praise for Intel Threading Building Blocks “The Age of Serial Computing is over. With the advent of multi-core processors, parallel- computing technology that was once relegated to universities and research labs is now emerging as mainstream. Intel Threading Building Blocks updates and greatly expands the ‘work-stealing’ technology pioneered by the MIT Cilk system of 15 years ago, providing a modern industrial-strength C++ library for concurrent programming. “Not only does this book offer an excellent introduction to the library, it furnishes novices and experts alike with a clear and accessible discussion of the complexities of concurrency.” — Charles E. Leiserson, MIT Computer Science and Artificial Intelligence Laboratory “We used to say make it right, then make it fast. We can’t do that anymore. TBB lets us design for correctness and speed up front for Maya. This book shows you how to extract the most benefit from using TBB in your code.” — Martin Watt, Senior Software Engineer, Autodesk “TBB promises to change how parallel programming is done in C++. This book will be extremely useful to any C++ programmer. With this book, James achieves two important goals: • Presents an excellent introduction to parallel programming, illustrating the most com- mon parallel programming patterns and the forces governing their use. • Documents the Threading Building Blocks C++ library—a library that provides generic algorithms for these patterns. “TBB incorporates many of the best ideas that researchers in object-oriented parallel computing developed in the last two decades.” — Marc Snir, Head of the Computer Science Department, University of Illinois at Urbana-Champaign “This book was my first introduction to Intel Threading Building Blocks.
    [Show full text]
  • Intel® Math Kernel Library 10.1 for Windows*, Linux*, and Mac OS* X
    Intel® Math Kernel Library 10.1 for Windows*, Linux*, and Mac OS* X Product Brief The Flagship for High-Performance Computing Intel® Math Kernel Library 10.1 Math Software for Windows*, Linux*, and Mac OS* X Intel® Math Kernel Library (Intel® MKL) is a library of highly optimized, extensively threaded math routines for science, engineering, and financial applications that require maximum performance. Availability • Intel® C++ Compiler Professional Editions (Windows, Linux, Mac OS X) • Intel® Fortran Compiler Professional Editions (Windows, Linux, Mac OS X) • Intel® Cluster Toolkit Compiler Edition (Windows, Linux) • Intel® Math Kernel Library 10.1 (Windows, Linux, Mac OS X) Functionality “By adopting the • Linear Algebra—BLAS and LAPACK • Fast Fourier Transforms Intel MKL DGEMM • Linear Algebra—ScaLAPACK • Vector Math Library libraries, our standard • Linear Algebra—Sparse Solvers • Vector Random Number Generators benchmarks timing DGEMM Threaded Performance Intel® Xeon® Quad-Core Processor E5472 3.0GHZ, 8MB L2 Cache,16GB Memory Intel® Xeon® Quad-Core Processor improved between Redhat 5 Server Intel® MKL 10.1; ATLAS 3.8.0 DGEMM Function 43 percent and 71 Intel MKL - 8 Threads Intel MKL - 1 Thread ATLAS - 8 Threads 100 percent…” ATLAS - 1 Thread 90 Matt Dunbar 80 Software Developer, 70 ABAQUS, Inc. s 60 p GFlo 50 40 30 20 10 0 4 6 8 2 4 0 8 2 8 4 6 0 4 2 4 8 6 6 8 9 10 11 12 13 14 16 18 19 20 22 25 32 38 51 Matrix Size (M=20000, N=4000, K=64, ..., 512) Features and Benefits Vector Random Number Generators • Outstanding performance Intel MKL Vector Statistical Library (VSL) is a collection of 9 random number generators and 22 probability distributions • Multicore and multiprocessor ready that deliver significant performance improvements in physics, • Extensive parallelism and scaling chemistry, and financial analysis.
    [Show full text]
  • The BLAS API of BLASFEO: Optimizing Performance for Small Matrices
    The BLAS API of BLASFEO: optimizing performance for small matrices Gianluca Frison1, Tommaso Sartor1, Andrea Zanelli1, Moritz Diehl1;2 University of Freiburg, 1 Department of Microsystems Engineering (IMTEK), 2 Department of Mathematics email: [email protected] February 5, 2020 This research was supported by the German Federal Ministry for Economic Affairs and Energy (BMWi) via eco4wind (0324125B) and DyConPV (0324166B), and by DFG via Research Unit FOR 2401. Abstract BLASFEO is a dense linear algebra library providing high-performance implementations of BLAS- and LAPACK-like routines for use in embedded optimization and other applications targeting relatively small matrices. BLASFEO defines an API which uses a packed matrix format as its native format. This format is analogous to the internal memory buffers of optimized BLAS, but it is exposed to the user and it removes the packing cost from the routine call. For matrices fitting in cache, BLASFEO outperforms optimized BLAS implementations, both open-source and proprietary. This paper investigates the addition of a standard BLAS API to the BLASFEO framework, and proposes an implementation switching between two or more algorithms optimized for different matrix sizes. Thanks to the modular assembly framework in BLASFEO, tailored linear algebra kernels with mixed column- and panel-major arguments are easily developed. This BLAS API has lower performance than the BLASFEO API, but it nonetheless outperforms optimized BLAS and especially LAPACK libraries for matrices fitting in cache. Therefore, it can boost a wide range of applications, where standard BLAS and LAPACK libraries are employed and the matrix size is moderate. In particular, this paper investigates the benefits in scientific programming languages such as Octave, SciPy and Julia.
    [Show full text]
  • Intel Libraries
    Agenda • Intel® Math Kernel Library • Intel® Integrated Performance Primitives • Intel® Data Analytics Acceleration Library Intel IPP Overview 1 Optimization Notice Copyright © 2014, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Intel® Math Kernel Library (Intel® MKL) 2 Powered by the Energy Science & Engineering Financial Signal Digital Research Design Analytics Processing Content Intel® Math Kernel Library (Intel® MKL) Creation ‒ Speeds math processing in scientific, ‒ Unleash the performance of Intel® Core, engineering and financial applications Intel® Xeon and Intel® Xeon Phi™ product ‒ Functionality for dense and sparse linear families algebra (BLAS, LAPACK, PARDISO), FFTs, ‒ Optimized for single core vectorization and vector math, summary statistics and cache utilization more ‒ Coupled with automatic OpenMP*-based ‒ Provides scientific programmers and parallelism for multi-core, manycore and domain scientists coprocessors 15 ‒ Interfaces to de-facto standard APIs from ‒ Scales to PetaFlop (10 floating-point C++, Fortran, C#, Python and more operations/second) clusters and beyond ‒ Support for Linux*, Windows* and OS X* ‒ Included in Intel® Parallel Studio XE and operating systems Intel® System Studio Suites ‒ Extract great performance with minimal effort **http://www.top500.org Used on the World’s Fastest Supercomputers** 3 Optimization Notice Copyright © 2014, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimized
    [Show full text]
  • Intel(R) Math Kernel Library for the Windows* OS User's Guide
    Intel® Math Kernel Library for the Windows* OS User’s Guide August 2008 Document Number: 315930-006US World Wide Web: http://developer.intel.com Version Version Information Date -001 Original issue. Documents Intel® Math Kernel Library (Intel® MKL) 9.1 beta January 2007 release. -002 Documents Intel® MKL 9.1 gold release. Document restructured. More June 2007 aspects of ILP64 interface discussed. Section “Selecting Between Static and Dynamic Linking” added to chapter 5; section “Changing the Number of Pro- cessors for Threading at Run Time” and details on redefining memory func- tions added to chapter 6; section ”Calling LAPACK, BLAS, and CBLAS Routines from C Language Environments” added to chapter 7. Cluster content is orga- nized into one separate chapter 9 “Working with Intel® Math Kernel Library Cluster Software” and restructured, appropriate links added. -003 Documents Intel® MKL 10.0 Beta release. Layered design model has been September 2007 described in chapter 3 and the content of the entire book adjusted to the model. New Intel MKL threading controls have been described in chapter 6. The User’s Guide for Intel MKL merged with the one for Intel MKL Cluster Edi- tion to reflect consolidation of the respective products. -004 Documents Intel® MKL 10.0 Gold release. Intel® Compatibility OpenMP* run- October 2007 time compiler library (libiomp) has been described. -005 Documents Intel® MKL 10.1 beta release. Information on dummy libraries in May 2008 Table "High-level directory structure" has been further detailed. Information on the Intel MKL configuration file removed. Instructions on creation/configur- ing of a project running an Intel MKL example in the Microsoft Visual Studio* IDE have been added to chapter 4.
    [Show full text]