DOCSLIB.ORG

Intel® HPC Orchestrator Delivering Innovation, Integration, Validation, and Support Across the HPC System Software Stack

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Intel® HPC Orchestrator Delivering Innovation, Integration, Validation, and Support Across the HPC System Software Stack PRODUCT BRIEF Intel® HPC Orchestrator Delivering innovation, integration, validation, and support across the HPC system software stack High-Performance Computing (HPC) maintaining a validated, reliable system and compatibility challenges. This task is transforming our world and our software stack and more time develop- is never-ending because of the rapid businesses, delivering unprecedented ing differentiated capabilities for users. release cycles and updates of individual insight and innovation to scientists, components. engineers, analysts, companies, and The Challenge Intel® HPC Orchestrator — more. But integrating, testing, validat- HPC system software stacks are made ing, and maintaining an HPC system Solving HPC Integration and up of dozens of components that must software stack is a costly, ongoing, and Validation Challenges all be integrated and validated before time-consuming effort. an organization’s HPC applications Leveraging years of Intel HPC software Intel® HPC Orchestrator is changing all can run on top of that stack. Ensuring experience and expertise, Intel HPC of that. It enables HPC system design- stable, reliable versions of all stack Orchestrator is a family of Intel-sup- ers, installers, and managers to spend components is an enormous task due ported products designed to simplify less time integrating, configuring, and to the numerous interdependencies HPC system software stack implemen- tation and maintenance. It provides a modular pre-integrated, pre-tested, and pre-validated software stack that INTEL® HPC ORCHESTRATOR SYSTEM SOFTWARE PLATFORM can significantly reduce the time re- quired to perform those tasks. Intel HPC Orchestrator is based on the community-developed system soft- ware stack from OpenHPC, a Linux* Foundation Collaborative Project. The OpenHPC community was formed to integrate commonly required HPC components, such as provisioning tools, resource management, I/O cli- ents, development tools, and a variety of scientific libraries. Intel has been an integral contributor to OpenHPC, including seeding the community with a fully integrated and validated system software framework. Intel HPC Orchestrator provides ad- vanced testing, validation, and ongoing Intel® HPC Orchestrator 2 support for the software platform. It preserving the application-facing inter- Intel Validated also includes proprietary software to face that enables Independent Software Intel HPC Orchestrator includes ad- aid in system support and application Vendor (ISV) applications and user vanced integration testing between development, such as the Intel® Parallel applications to run consistently across components, validation at scale (sys- Studio XE 2017 Cluster Edition suite, different systems utilizing Intel HPC tems up to 1,000 nodes) and testing on installed and ready for activation with a Orchestrator system software. specific platform configurations (e.g., 90-day evaluation license. processor and memory). Hardware- Benefits Unique to Intel® HPC specific testing and validation includes Intel HPC Orchestrator will continue new Intel components, including Intel® to implement new OpenHPC innova- Orchestrator Xeon® processor v4 family, Intel® Xeon tions and improvements into the future, Intel HPC Orchestrator builds on the Phi™ product family, and Intel® Omni- while working to ensure all components framework of the OpenHPC system Path Fabric, as well as the Lustre* file work together seamlessly so technical software stack with the addition of system client software. resources can focus on developing and proprietary software to add popular enhancing specific HPC solutions. development tools, compilers, and Intel Supported libraries—and to assist in supportabil- The Intel HPC Orchestrator system The Intel HPC Orchestrator system ity of the overall software platform. It software platform provides multiple software platform utilizes a hierarchi- also includes a full commercial license levels of support via OEM and channel cal structure, allowing the tracking of with technical support for the Altair partners. The support subscriptions dependencies across multiple MPI and PBS Professional* workload manager. include ongoing, validated system soft- compiler families. The system software The system software is integrated, ware updates across the software stack. stack is modular and customizable, en- validated, and supported with updates Professional Level 3 support is pro- abling components to be easily substi- and technical support provided by a vided by Intel HPC engineers, covering tuted and revalidated. It gives Original team of experienced Intel HPC software integration issues for key components Equipment Manufacturers (OEMs) the engineers. to resolution. Open source community ability to differentiate and add unique components are triaged and provided value for their HPC customers, while best-effort support. Level 1 and Level 2 technical support services are also INTEL® HPC ORCHESTRATOR SYSTEM SOFTWARE — KEY COMPONENTS available, as are standard and prior- ity service level agreements. Technical FUNCTIONAL AREAS COMPONENTS Support for Intel® Parallel Studio XE Base OS Compatibility1 SLES 12 SP2, RHEL 7.3, CentOS 7.3 2017 Cluster Edition and Lustre* file Administrative Tools Conman*, Ganglia*, Intel® Cluster Checker, Lmod*, LosF*, system client requires purchase of the Nagios*, pdsh, prun, EasyBuild*, Spack*, genders, mrsh, respective license and support contract, clustershell sold separately. Provisioning Warewulf Key Features and Capabilities Resource Management PBS Pro*, SLURM, MUNGE* Runtimes OpenMP*, Intel® Parallel Studio XE Runtimes for Intel® MPI Lib, • Stateless and Stateful Provisioning Intel® TBB Runtimes , Intel® MKL, Intel® DAAL and Intel® IPP • Warewulf based I/O Services Lustre* file system client software, shine • Bare metal installation Numerical/Scientific Libraries Boost*, GSL, FFTW, Metis, PETSc, Trilinos*, Hypre*, SuperLU*, • Image-based install MUMPS*, Intel® MKL • Templated installation scripts I/O Libraries HDF5 (pHDF5), NetCDF (including C++ and Fortran interfaces), Adios • Editable configuration input file Compiler Families GNU (gcc, g++, gfortran), Intel Parallel Studio XE 2017 Cluster • Hierarchical structure, multiple Edition (icc,icpc,ifort) development environment support MPI Families MVAPICH2, OpenMPI, Intel MPI • Multiple MPI families Development Tools Autotools (autoconf, automake, libtool), Valgrind,R, SciPy/ • Multiple compiler support NumPy, Intel® Inspector • Common scientific libraries Performance Tools PAPI, IMB, mpiP, pdtoolkit TAU, Intel® Advisor, Intel® Trace included for multiple MPI/compiler Analyzer and Collector, Intel® VTune Amplifier combinations Intel® HPC Orchestrator 3 • Includes integrated administrative tools INTEL® HPC ORCHESTRATOR INCLUDES INTEGRATED INSTALLATION OF INTEL® PARALLEL + and flexible development environment STUDIO XE 2017 CLUSTER EDITION • Utilizes common Linux update INTEL® PARALLEL STUDIO XE 2017 CLUSTER EDITION COMPONENTS INCLUDED mechanisms (e.g., YUM, Zypper) Intel® C/C++ Compiler - industry leading performance Intel® Parallel Studio XE Intel® Fortran Compiler - industry leading performance Cluster Edition Intel® Math Kernel Library - fast math library BUILD Makes it easier to boost application perfor- Intel® Integrated Performance Primitives - image, signal & data processing mance on today’s and tomorrow’s highly Intel® Threading Building Blocks - threading library parallel processors and coprocessors. Intel® Data Analytics Acceleration Library - machine learning & analytics Intel® Performance Libraries Intel® Distribution for Python* - integrated, high-performance Ramp up performance on the latest Python environment platforms with math, data analytics/ma- Intel® Vtune™ Amplifier XE - performance profiler chine learning, media, and parallel ANALYZE Intel® Advisor - vectorization optimization and thread prototyping template libraries. Intel® Inspector - memory and thread debugging Intel Analysis, Profiling Intel® MPI Library - message passing interface library & Architecture Profile and analyze shared and SCALE Intel® Trace Analyzer and Collector - MPI profiling, tuning, and analysis distributed memory architectures and Intel® Cluster Checker - cluster diagnostic expert system identify hotspots and performance + 90-day evaluation license provided for system installation. Renewals may be purchased through existing distribution partners. bottlenecks. Analyze and define parallel architecture methods for vectorization and threading. Intel Compilers High-performance C/C++/Fortran stan- dards-driven compilers produce optimized code that can run significantly faster by BALANCING SIMPLICITY AND CUSTOMIZATION taking advantage of ever-increasing core counts and vector register widths. The Right Balance of Simplicity and Customization Intel HPC Orchestrator is designed to provide a balance between simplicity and TURNKEY INTEL® HPC customizability. It combines ease-of-use, SOFTWARE STACK ORCHESTRATOR performance, and scalability, while al- lowing for customization. It is targeted at technical and commercial users—includ- ing research, enterprise, and academic IPICIY users—with vertical HPC applications. The software platform enables provisioning of compute nodes from the system head node, utilizing either diskless or diskful boot methods. Intel HPC Orchestrator simplifies system software component INTEGRATE YOUR OWN SOFTWARE STACK integration, validation, and configuration across the HPC system software stack. CTOIAIO [email protected] | (303) 431-4606 | aspsys.com At Aspen Systems our mission is to provide leading best-in-class solutions to High Performance Computing (HPC) users and administrators. We are proud to service all key market sectors including government, universities, corporations and anywhere research and science can be found. ISO 9001:2008 Certified. GSA Contract #GS-35F-0192K. Aspen Systems, turning complex problems into simple solutions. [email protected] | (303) 431-4606 | aspsys.com.
Load more

Recommended publications
  • Sagemath and Sagemathcloud
    Viviane Pons Ma^ıtrede conf´erence,Universit´eParis-Sud Orsay [email protected] { @PyViv SageMath and SageMathCloud Introduction SageMath SageMath is a free open source mathematics software I Created in 2005 by William Stein. I http://www.sagemath.org/ I Mission: Creating a viable free open source alternative to Magma, Maple, Mathematica and Matlab. Viviane Pons (U-PSud) SageMath and SageMathCloud October 19, 2016 2 / 7 SageMath Source and language I the main language of Sage is python (but there are many other source languages: cython, C, C++, fortran) I the source is distributed under the GPL licence. Viviane Pons (U-PSud) SageMath and SageMathCloud October 19, 2016 3 / 7 SageMath Sage and libraries One of the original purpose of Sage was to put together the many existent open source mathematics software programs: Atlas, GAP, GMP, Linbox, Maxima, MPFR, PARI/GP, NetworkX, NTL, Numpy/Scipy, Singular, Symmetrica,... Sage is all-inclusive: it installs all those libraries and gives you a common python-based interface to work on them. On top of it is the python / cython Sage library it-self. Viviane Pons (U-PSud) SageMath and SageMathCloud October 19, 2016 4 / 7 SageMath Sage and libraries I You can use a library explicitly: sage: n = gap(20062006) sage: type(n) <c l a s s 'sage. interfaces .gap.GapElement'> sage: n.Factors() [ 2, 17, 59, 73, 137 ] I But also, many of Sage computation are done through those libraries without necessarily telling you: sage: G = PermutationGroup([[(1,2,3),(4,5)],[(3,4)]]) sage : G . g a p () Group( [ (3,4), (1,2,3)(4,5) ] ) Viviane Pons (U-PSud) SageMath and SageMathCloud October 19, 2016 5 / 7 SageMath Development model Development model I Sage is developed by researchers for researchers: the original philosophy is to develop what you need for your research and share it with the community.
    [Show full text]
  • Intel® Parallel Studio
    Intel® Parallel Studio Product Brief Parallelism for Your Development Lifecycle Intel® Parallel Studio Intel® Parallel Studio brings comprehensive parallelism to C/C++ Microsoft Visual Studio* application development. Parallel Studio was created in direct response to the concerns of software industry leaders and developers. From the way the products work together to support the development lifecycle to their unique feature sets, parallelism is now easier and more viable than ever before. The tools are designed so those new to parallelism can learn as they go, and experienced parallel programmers can work more efficiently and with more confidence. Parallel Studio is interoperable with common parallel programming libraries and API standards, such as Intel® Threading Building Blocks (Intel® TBB) and OpenMP*, and provides an immediate opportunity to realize the benefits of multicore platforms. “Intel® Parallel Studio makes the new Envivio 4Caster Series Transcoder’s development faster and more efficient. The tools included in Intel Parallel Studio, such as Intel® Parallel Inspector, Intel® Parallel Amplifier, and Intel® Parallel Composer (which consists of the Intel® C++ Compiler, Intel® IPP, and Intel® TBB) shortens our overall software development time by increasing the code’s reliability and its performance in a multicore multithreaded environment. At the qualification stage, the number of dysfunctions is reduced due to a safer implementation, and the bug tracking becomes easier too. Intel Parallel Studio globally speeds up our software products’ time-to-market”. Eric Rosier V.P. Engineering Envivio Intel® Parallel Studio Tools c. How can you actually boost performance of your threaded application on multicore processors and make the performance scale with additional cores? Intel® Parallel Studio Workflow The workflow diagram below depicts a typical usage model across all Intel Parallel Studio Addresses the Issues Listed Above.
    [Show full text]
  • Tuto Documentation Release 0.1.0
    Tuto Documentation Release 0.1.0 DevOps people 2020-05-09 09H16 CONTENTS 1 Documentation news 3 1.1 Documentation news 2020........................................3 1.1.1 New features of sphinx.ext.autodoc (typing) in sphinx 2.4.0 (2020-02-09)..........3 1.1.2 Hypermodern Python Chapter 5: Documentation (2020-01-29) by https://twitter.com/cjolowicz/..................................3 1.2 Documentation news 2018........................................4 1.2.1 Pratical sphinx (2018-05-12, pycon2018)...........................4 1.2.2 Markdown Descriptions on PyPI (2018-03-16)........................4 1.2.3 Bringing interactive examples to MDN.............................5 1.3 Documentation news 2017........................................5 1.3.1 Autodoc-style extraction into Sphinx for your JS project...................5 1.4 Documentation news 2016........................................5 1.4.1 La documentation linux utilise sphinx.............................5 2 Documentation Advices 7 2.1 You are what you document (Monday, May 5, 2014)..........................8 2.2 Rédaction technique...........................................8 2.2.1 Libérez vos informations de leurs silos.............................8 2.2.2 Intégrer la documentation aux processus de développement..................8 2.3 13 Things People Hate about Your Open Source Docs.........................9 2.4 Beautiful docs.............................................. 10 2.5 Designing Great API Docs (11 Jan 2012)................................ 10 2.6 Docness.................................................
    [Show full text]
  • Michael Steyer Technical Consulting Engineer Intel Architecture, Graphics & Software Analysis Tools
    Michael Steyer Technical Consulting Engineer Intel Architecture, Graphics & Software Analysis Tools Optimization Notice Copyright © 2020, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Aspects of HPC/Throughput Application Performance What are the Aspects of Performance Intel Hardware Features Multi-core Intel® Omni Intel® Optane™ Intel® Advanced Intel® Path HBM DC persistent Vector Xeon® Extensions 512 Architecture memory (Intel® AVX-512) processor Distributed memory Memory I/O Threading CPU Core Message size False Sharing File I/O Threaded/serial ratio uArch issues (IPC) Rank placement Access with strides I/O latency Thread Imbalance Vectorization Rank Imbalance Latency I/O waits RTL overhead FPU usage efficiency RTL Overhead Bandwidth System-wide I/O (scheduling, forking) Network Bandwidth NUMA Synchronization Cluster Node Core Optimization Notice Copyright © 2020, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. IntelWhat Parallel are the Studio Aspects Tools covering of Performance the Aspects Intel Hardware Features Multi-core Intel® Intel® Omni Intel® Optane™ Advanced Intel®Path DC persistent Intel® Vector HBM Extensions Architectur Intel® VTune™memory AmplifierXeon® processor 512 (Intel® Tracee Intel®AVX-512) DistributedAnalyzer memory Memory I/O Threading AdvisorCPU Core Messageand size False Sharing File I/O Threaded/serial ratio uArch issues (IPC) Rank placement Access with strides I/O latency Thread Imbalance Vectorization RankCollector Imbalance Latency I/O waits RTL overhead FPU usage efficiency RTL Overhead Bandwidth System-wide I/O (scheduling, forking) Network Bandwidth NUMA Synchronization Cluster Node Core Optimization Notice Copyright © 2020, Intel Corporation. All rights reserved.
    [Show full text]
  • Accelerate AI, HPC, Enterprise & Cloud Applications
    Accelerate AI, HPC, Enterprise & Cloud Applications April 2019 @ CiTIUS: Centro Singular de Investigación en Tecnoloxías da Información Intel Computing Performance and Software Products (CPDP) Edmund Preiss Agenda • Intel Software Development Tools • Intel optimized AI Solutions Optimization Notice Copyright © 2018, Intel Corporation. All rights reserved. 3 *Other names and brands may be claimed as the property of others. Intel® Software Developer Tools & SDKs Intel® Parallel Studio XE Intel® System Studio Comprehensive Enterprise , HPC Embedded Tools Suite Tools suite Comprehensive, all-in-one, cross-platform Shared and distributed memory system & IoT development tool suite systems Simplifies system bring-up, boosts Code creation and versatile SW performance and power efficiency, Analysis Tools strengthens system reliability Intel® Media Server Studio OpenVINO™ Media Encode/Decode Tools Machine Learning / Deep Learning Inference Media SDK Computer Vision SDK Graphics Perf Analyzer Deep Learning (DL) Deployment Toolkit Computer Vision SDK Deep Learning Algorithms Open CL SDK Optimized DL Frameworks Context SDK Optimization Notice Copyright © 2018, Intel Corporation. All rights reserved. INTEL CONFIDENTIAL 11 *Other names and brands may be claimed as the property of others. What’s Inside Intel® Parallel Studio XE Comprehensive Software Development Tool Suite Cluster Edition Composer Edition Professional Edition BUILD ANALYZE SCALE Compilers & Libraries Analysis Tools Cluster Tools C / C++ Compiler Intel® Math Kernel Library Intel® VTune™
    [Show full text]
  • Intel® Software Products Highlights and Best Practices
    Intel® Software Products Highlights and Best Practices Edmund Preiss Business Development Manager Entdecken Sie weitere interessante Artikel und News zum Thema auf all-electronics.de! Hier klicken & informieren! Agenda • Key enhancements and highlights since ISTEP’11 • Industry segments using Intel® Software Development Products • Customer Demo and Best Practices Copyright© 2012, Intel Corporation. All rights reserved. 2 *Other brands and names are the property of their respective owners. Key enhancements & highlights since ISTEP’11 3 All in One -- Intel® Cluster Studio XE 2012 Analysis & Correctness Tools Shared & Distributed Memory Application Development Intel Cluster Studio XE supports: -Shared Memory Processing MPI Libraries & Tools -Distributed Memory Processing Compilers & Libraries Programming Models -Hybrid Processing Copyright© 2012, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. Intel® VTune™ Amplifier XE New VTune Amplifier XE features very well received by Software Developers Key reasons : • More intuitive – Improved GUI points to application inefficiencies • Preconfigured & customizable analysis profiles • Timeline View highlights concurrency issues • New Event/PC counter ratio analysis concept easy to grasp Copyright© 2012, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. Intel® VTune™ Amplifier XE The Old Way versus The New Way The Old Way: To see if there is an issue with branch misprediction, multiply event value (86,400,000) by 14 cycles, then divide by CPU_CLK_UNHALTED.THREAD (5,214,000,000). Then compare the resulting value to a threshold. If it is too high, investigate. The New Way: Look at the Branch Mispredict metric, and see if any cells are pink.
    [Show full text]
  • An Introduction to Numpy and Scipy
    An introduction to Numpy and Scipy Table of contents Table of contents ............................................................................................................................ 1 Overview ......................................................................................................................................... 2 Installation ...................................................................................................................................... 2 Other resources .............................................................................................................................. 2 Importing the NumPy module ........................................................................................................ 2 Arrays .............................................................................................................................................. 3 Other ways to create arrays............................................................................................................ 7 Array mathematics .......................................................................................................................... 8 Array iteration ............................................................................................................................... 10 Basic array operations .................................................................................................................. 11 Comparison operators and value testing ....................................................................................
    [Show full text]
  • 5. Oneapi in Der Praxis
    Praxis Gekonntes Zusammenspiel von HPC und AI im Alltag der Software-Entwickler oneAPI in der Praxis von Harald Odendahl Aus Parallel Studio XE wird oneAPI Toolkit: Software-Entwickler können ab Dezember 2020 auf die neue Generation der Programmier-Tools von Intel zugreifen. Die klassischen Intel-Tools sowie der professionelle Kunden-Support bleiben erhalten. Der Praxiseinsatz wird jedoch mächtig erweitert. Mit oneAPI bekräftigt Intel seinen Umschwung zu einer „Software First“-Strategie, um die Herausforderungen und Bedürfnisse der Programmierer bei der Entwicklung hochperformanter wissenschaftlicher und technischer Applikationen sowie KI-Anwendungen zu priorisieren. Das Design neuer Architekturen und Komponenten wie CPUs oder GPUs soll nun gleichzeitig und im Einklang mit den Innovationen bei Programmiermodellen und Entwicklertools erfolgen. So kündigte Intel auf der (virtuellen) Konferenz SuperComputing 2020 an, dass das von Native-Code-Entwicklern geschätzte und intensiv genutzte Intel Parallel Studio XE Toolkit ab Anfang 2021 von den neuen Toolkits der Produktfamilie oneAPI abgelöst werden wird. Intel will auf diesem Weg auch seinen Entwicklerkreis erweitern und bietet deshalb eine Reihe separater Toolkits für verschiedene Anwendungsgebiete. Historisch gesehen sind die klassischen Intel-Entwicklertools die Compiler für C/C++ sowie Fortran, die Analyse-Tools für Code- Optimierung sowie die bestbewährten Bibliotheken, wie zum Beispiel MKL oder IPP. Alle Komponenten werden in den neuen Toolkits vollständig übernommen. Die Leistungen für professionelle Nutzer, wie direkter Support von Intel-Ingenieuren und die Softwarewartung, bleiben bei weitgehend gleicher Preisstruktur erhalten. Erweiterte Tool-Palette für neue Nutzerkreise Im Packaging wird es jedoch eine Reihe von Änderungen geben. Zunächst führt Intel ein sogenanntes „oneAPI Base Toolkit“ ein, das einerseits die wesentlichen Komponenten für die architekturübergreifende Entwicklung zur Verfügung stellt und andererseits als Grundlage für weitere Toolkits dient.
    [Show full text]
  • Intel® Parallel Studio Xe 2017 Runtime
    Intel® Parallel StudIo Xe 2017 runtIme Release Notes 26 July 2016 Contents 1 Introduction ................................................................................................................................................... 1 1.1 What Every User Should Know About This Release ..................................................................... 1 2 Product Contents ......................................................................................................................................... 2 3 System Requirements ................................................................................................................................ 3 3.1 Processor Requirements........................................................................................................................... 3 3.2 Disk Space Requirements ......................................................................................................................... 3 3.3 Operating System Requirements .......................................................................................................... 3 3.4 Memory Requirements .............................................................................................................................. 3 3.5 Additional Software Requirements ...................................................................................................... 3 4 Issues and Limitations ..............................................................................................................................
    [Show full text]
  • Bioimage Analysis Fundamentals in Python with Scikit-Image, Napari, & Friends
    Bioimage analysis fundamentals in Python with scikit-image, napari, & friends Tutors: Juan Nunez-Iglesias ([email protected]) Nicholas Sofroniew ([email protected]) Session 1: 2020-11-30 17:30 UTC – 2020-11-30 22:00 UTC Session 2: 2020-12-01 07:30 UTC – 2020-12-01 12:00 UTC ## Information about the tutors Juan Nunez-Iglesias is a Senior Research Fellow at Monash Micro Imaging, Monash University, Australia. His work on image segmentation in connectomics led him to contribute to the scikit-image library, of which he is now a core maintainer. He has since co-authored the book Elegant SciPy and co-created napari, an n-dimensional image viewer in Python. He has taught image analysis and scientific Python at conferences, university courses, summer schools, and at private companies. Nicholas Sofroniew leads the Imaging Tech Team at the Chan Zuckerberg Initiative. There he's focused on building tools that provide easy access to reproducible, quantitative bioimage analysis for the research community. He has a background in mathematics and systems neuroscience research, with a focus on microscopy and image analysis, and co-created napari, an n-dimensional image viewer in Python. ## Title and abstract of the tutorial. Title: **Bioimage analysis fundamentals in Python** **Abstract** The use of Python in science has exploded in the past decade, driven by excellent scientific computing libraries such as NumPy, SciPy, and pandas. In this tutorial, we will explore some of the most critical Python libraries for scientific computing on images, by walking through fundamental bioimage analysis applications of linear filtering (aka convolutions), segmentation, and object measurement, leveraging the napari viewer for interactive visualisation and processing.
    [Show full text]
  • Pandas: Powerful Python Data Analysis Toolkit Release 0.25.3
    pandas: powerful Python data analysis toolkit Release 0.25.3 Wes McKinney& PyData Development Team Nov 02, 2019 CONTENTS i ii pandas: powerful Python data analysis toolkit, Release 0.25.3 Date: Nov 02, 2019 Version: 0.25.3 Download documentation: PDF Version | Zipped HTML Useful links: Binary Installers | Source Repository | Issues & Ideas | Q&A Support | Mailing List pandas is an open source, BSD-licensed library providing high-performance, easy-to-use data structures and data analysis tools for the Python programming language. See the overview for more detail about whats in the library. CONTENTS 1 pandas: powerful Python data analysis toolkit, Release 0.25.3 2 CONTENTS CHAPTER ONE WHATS NEW IN 0.25.2 (OCTOBER 15, 2019) These are the changes in pandas 0.25.2. See release for a full changelog including other versions of pandas. Note: Pandas 0.25.2 adds compatibility for Python 3.8 (GH28147). 1.1 Bug fixes 1.1.1 Indexing • Fix regression in DataFrame.reindex() not following the limit argument (GH28631). • Fix regression in RangeIndex.get_indexer() for decreasing RangeIndex where target values may be improperly identified as missing/present (GH28678) 1.1.2 I/O • Fix regression in notebook display where <th> tags were missing for DataFrame.index values (GH28204). • Regression in to_csv() where writing a Series or DataFrame indexed by an IntervalIndex would incorrectly raise a TypeError (GH28210) • Fix to_csv() with ExtensionArray with list-like values (GH28840). 1.1.3 Groupby/resample/rolling • Bug incorrectly raising an IndexError when passing a list of quantiles to pandas.core.groupby. DataFrameGroupBy.quantile() (GH28113).
    [Show full text]
  • Scipy and Numpy
    www.it-ebooks.info SciPy and NumPy Eli Bressert Beijing • Cambridge • Farnham • Koln¨ • Sebastopol • Tokyo www.it-ebooks.info 9781449305468_text.pdf 1 10/31/12 2:35 PM SciPy and NumPy by Eli Bressert Copyright © 2013 Eli Bressert. All rights reserved. Printed in the United States of America. Published by O’Reilly Media, Inc., 1005 Gravenstein Highway North, Sebastopol, CA 95472. O’Reilly books may be purchased for educational, business, or sales promotional use. Online editions are also available for most titles (http://my.safaribooksonline.com). For more information, contact our corporate/institutional sales department: (800) 998-9938 or [email protected]. Interior Designer: David Futato Project Manager: Paul C. Anagnostopoulos Cover Designer: Randy Comer Copyeditor: MaryEllen N. Oliver Editors: Rachel Roumeliotis, Proofreader: Richard Camp Meghan Blanchette Illustrators: EliBressert,LaurelMuller Production Editor: Holly Bauer November 2012: First edition Revision History for the First Edition: 2012-10-31 First release See http://oreilly.com/catalog/errata.csp?isbn=0636920020219 for release details. Nutshell Handbook, the Nutshell Handbook logo, and the O’Reilly logo are registered trademarks of O’Reilly Media, Inc. SciPy and NumPy, the image of a three-spined stickleback, and related trade dress are trademarks of O’Reilly Media, Inc. Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and O’Reilly Media, Inc., was aware of a trademark claim, the designations have been printed in caps or initial caps. While every precaution has been taken in the preparation of this book, the publisher and authors assume no responsibility for errors or omissions, or for damages resulting from the use of the information contained herein.
    [Show full text]