Open-Source Libraries

Total Page:16

File Type:pdf, Size:1020Kb

Open-Source Libraries Open-Source Libraries Technical Publications March 2021 The information contained herein is considered proprietary and confidential information of Paanini Innovations India Private Limited, the legal entity name of JIFFY.ai, and its release would offer a substantial benefit to competitors offering similar services. This material includes descriptions of methodologies and concepts derived through substantial analysis, research, study, and development efforts undertaken by JIFFY.ai. No part of this document may be reproduced by any means or transmitted without the prior written permission of JIFFY.ai except the copies made or transmitted internally by you to evaluate this proposal. You will not publish, disclose or divulge to any person, firm or corporation, or use directly or indirectly for your benefit or the benefit of any other person, firm or corporation, any of the information made available to you. In addition, you will take such precautions as you deem necessary and reasonable to prevent the dissemination of the information to others by any of your employees. All copies of this document (or any portion thereof) and any accompanying electronic copies should be returned to JIFFY.ai. Neither submission by JIFFY.ai nor your acceptance of this document, in whole or in part, constitutes acceptance by JIFFY.ai of any contractual terms contained in your Request for Proposal, if any, and shall not form a binding agreement between the parties. Such an agreement shall only exist upon the execution of a mutually acceptable contract by both parties. Except as otherwise outlined in such a contract, JIFFY.ai makes no representations or warranties to you, JIFFY.ai is designed, created, and owned by Paanini. All rights reserved. You can find the most up-to-date technical documentation on the Jiffy Documentation portal at https://docs.jiffy.ai/. The Jiffy Documentation portal also provides information on the latest product updates, how to get started with Jiffy, how to learn, and master automation using Jiffy, and detailed solutions of the commonly faced issues. Document Feedback JIFFY.ai welcomes your suggestions for improving our documentation. If you have comments, send your feedback to [email protected]. 1 Version History Version No Date Author Change Description 1.0 03rd March 2021 Technical Publications Document Created 2 TABLE OF CONTENTS 1. FOSS 4 2. Server YUM Packages 7 3. JIFFY Client Packages 8 4. Automation Related Packages 9 5. JAVASCRIPT Packages in Server Side 9 3 1. FOSS Name/ Version Number License amqp(2.2.1) Java 1.8 Armeria Apache Spring Boot Apache Spring boot Eureka Apache Spring amqp Apache License Spring boot JPA Apache License Spring JDBC Apache License Spring Security Apache Tomcat Embed Apache 2.0 Apache Ant 1.9.6 Apache License Junit 4.11 Eclipse Public License 1.0 HtmlUnit 2.19 Apache License, Version 2.0 Jackson Databind Apache License (AL) 2.0 Jackson 2.7 Apache License (AL) 2.0 Jackson Core Apache License (AL) 2.0 Jackson annotations Apache License (AL) 2.0 Plexus Common Utilities Apache 2.0 Commons Lang 2.4 Apache 2.0 Apache Commons BeanUtils » 1.8.0 Apache 2.0 Apache Commons Collections » 3.2 Apache 2.0 Json lib 3.1.1 Apache 2.0 EZMorph 2.0.0 Apache 2.0 Oro 2.0.8 Apache SLF4J API Module » 1.7.13 MIT Apache XBean :: Spring » 4. Apache 2.0 Apache Commons IO » 1.3.2 Apache 2.0 Apache Commons Codec » 1.4 Apache 2.0 Commons DBCP2 Apache 2.0 Commons CSV Apache 2.0 Commons Net Apache 2.0 Commons Exec Apache 2.0 Java Servlet API CCDL Mozilla Rhino » 1.7.7 MPL 2.0 FreeMarker Apache License Apache HttpClient Apache 2.0 JMS API » 2.0.1 CDDL 2 Apache Kafka » 0.8.0 Apache 2.0 Hornetq Core » 2.2.5.Final Apache 2.0 The Netty Project » 3.2.1.Final Apache 2.0, LGPL 2.1 Jbossall Client » 4.2.2.GA LGPL h2database Mozilla Public License Version 4 httpmime Apache 2.0 XOM LGPL JSON javax mail-api Oracle javax mail Oracle ews-java-api MIT License jmockit Xbean-classloader Apache 2.0 jai-imageio-jpeg2000 pdfbox Apache 2.0 bcprov-jdk15 BouncyCastle bcmail-jdk15 BouncyCastle icu4j ICU tomcat juli Apache 2.0 JNA 4.0.0 JJWT 0.9.1 Apache 2.0 python 3.7.6 Python Software Foundation amqp ( Version: 2.5.2) BSD anyjson( Version: 0.3.3) BSD backports.ssl-match-hostname( Version: Python Software Foundation License 3.5.0.1) Apache Software License (Apache License, bcrypt( Version: 3.1.7) Version 2.0) beautifulsoup4==4.8.2 MIT certifi==2019.11.28 Mozilla Public License 2.0 (MPL 2.0) GNU Library or Lesser General Public License chardet==3.0.4 (LGPL) cx-Oracle==7.3.0 Python Software Foundation License Cython==0.29.14 Apache Software License Django==2.2.8 BSD GNU Lesser General Public License v3 (LGPLv3) ldap3==2.6.1 (LGPL v3) supervisor==4.1.0 BSD-derived django-datatables-view==1.19.1 Apache Software License django-extensions==2.2.6 MIT django-mptt==0.11.0 MIT django-oraclepool==1.4 Apache Software License django-reversion==3.0.5 BSD django-timezones==0.2 BSD gitdb2==2.0.6 BSD GitPython==3.0.5 BSD gunicorn==20.0.4 MIT idna==2.8 BSD ipython==7.11.1 BSD jsonpickle==1.2 BSD librabbitmq==2.0.0 Mozilla Public License 1.0 5 lxml==4.5.0 BSD pbkdf2==1.3 MIT pika==1.1.0 BSD Pillow==7.0.0 HPND psycopg2==2.8.4 Lesser General Public License (LGPL) Apache Software License, BSD License, Public pycryptodome==3.9.4 Domain (BSD, Public Domain, Apache) pyminizip==0.2.4 zlib/libpng License pyral==1.4.2 BSD python-dateutil==2.6.1 BSD pytz==2019.3 MIT requests==2.22.0 Apache Software License simplejson==3.17.0 MIT, AFL six==1.14.0 MIT Python Software Foundation License (MIT threadpool==1.3.2 license) tornado==6.0.3 Apache Software License urllib3==1.25.8 MIT hvac==0.9.6 Apache Software License wand==0.5.7 MIT appdirs==1.4.3 MIT requests-toolbelt==0.9.1 Apache Software License isodate==0.6.0 BSD defusedxml==0.6.0 Python Software Foundation License (PSFL) cached-property==1.5.1 BSD zeep==3.4.0 MIT Flask==1.1.1 BSD Flask-HTTPAuth==3.3.0 MIT APScheduler==3.6.3 MIT djangorestframework==3.11.0 BSD psutil==5.6.7 BSD django-grappelli==2.13.3 BSD sqlparse==0.3.0 BSD django-ipware==2.0.2 MIT django-axes==4.5.4 MIT django_rest_swagger==2.2.0 BSD pyasn1==0.4.8 BSD pyasn1_modules==0.2.8 BSD python-ldap==3.2.0 Python Software Foundation License OSI Approved, Apache Software License, BSD uritemplate==3.0.1 License itypes==1.1.0 BSD coreschema==0.0.4 BSD coreapi==2.3.3 BSD openapi-codec==1.3.2 BSD future==0.18.2 MIT 6 pyopenSSL==19.1.0 Apache Software License cffi==1.13.2 MIT ipaddress==1.0.23 Python Software Foundation License pycparser==2.19 BSD enum34==1.1.6 BSD cryptography==2.8 Apache Software License, BSD License PyJWT==1.7.1 MIT djangorestframework-simplejwt==3.3 MIT pyparsing==2.4.7 MIT packaging==20.3 Apache Software License, BSD License 2. SERVER YUM PACKAGES Name/ Version Number License epel-release GPLv2 zip BSD unzip BSD zlib-devel zlib and Boost bzip2 BSD bzip2-devel BSD readline-devel GPLv3+ GPLv3+ and GPLv3+ with exceptions and gcc GPLv2+ with exceptions and LGPLv2+ and BSD supervisor ZPLv2.1 and BSD and MIT policycoreutils-python GPLv2 python-lxml.x86_64 BSD libxml2-devel MIT java-1.8.0-openjdk GPL libxslt-devel MIT python-devel Python Software Foundation openssl OpenSSL openssl-devel OpenSSL libffi-devel MIT and Public Domain libjpeg-turbo-devel IJG MIT and BSD and ASL 2.0 and ISC and Python python2-pip and (ASL 2.0 or BSD) and LGPLv2+ redhat-lsb GPLv2 libaio LGPLv2+ telnet BSD lsof zlib and Sendmail and LGPLv2+ GPLv3+ and GPLv3+ with exceptions and gcc-c++ GPLv2+ with exceptions and LGPLv2+ and BSD cyrus-sasl-devel BSD python-devel MIT 7 openldap-devel OpenLDAP nginx 1.17.8 - 2-clause BSD license erlang-22.1.8-1.el7.x86_64 ERLANG PUBLIC LICENSE Version 1.1 rabbitmq-server-3.8.2-1.el7.noarch MPL v1.1 ImageMagick-6.9.0 GPL V3 freetype-2.4.3 BSD License ghostscript-9.26 AGPL v3 libjpeg-turbo-devel IJG jpegsrc.v9b lcms2-2.7 MIT libiconv-1.13.1 libpng-1.6.31 Zlib tiff-3.9.4 postgresql96-9.6.2-2PGDG.rhel6.x86_64 PostgreSQL License postgresql96-contrib-9.6.2-2PGDG.rhel6.x86_64 PostgreSQL License postgresql96-devel-9.6.2-2PGDG.rhel6.x86_64 PostgreSQL License postgresql96-libs-9.6.2-2PGDG.rhel6.x86_64 PostgreSQL License postgresql96-server-9.6.2-2PGDG.rhel6.x86_64 PostgreSQL License 3. JIFFY CLIENT PACKAGES Name/ Version Number License bleach==3.1.0 Apache License v2; see LICENSE file certifi==2019.11.28 MPL chardet==3.0.4 GPL Cython==0.29.14 Apache License v2 docutils==0.16 BSD future==0.18.2 Python Software Foundation License (PSF) idna==2.8 BSD 3-Clause psutil==5.6.7 BSD 3-Clause pyasn1==0.4.8 BSD 2-Clause pyasn1-modules==0.2.8 BSD 2-Clause Pygments==2.5.2 BSD 2-Clause pythonnet==2.4.0 MIT readme==0.7.1 Apache License v2; see LICENSE file readme-renderer==24.0 Apache License v2; see LICENSE file requests==2.22.0 Apache License v2; see LICENSE file selenium==2.53.1 Apache License 2.0 six==1.14.0 MIT Unidecode==1.1.1 GPL urllib3==1.25.8 MIT webencodings==0.5.1 BSD 8 4.
Recommended publications
  • Netapp Solutions for Hadoop Reference Architecture: Cloudera Faiz Abidi (Netapp) and Udai Potluri (Cloudera) June 2018 | WP-7217
    White Paper NetApp Solutions for Hadoop Reference Architecture: Cloudera Faiz Abidi (NetApp) and Udai Potluri (Cloudera) June 2018 | WP-7217 In partnership with Abstract There has been an exponential growth in data over the past decade and analyzing huge amounts of data in a reasonable time can be a challenge. Apache Hadoop is an open- source tool that can help your organization quickly mine big data and extract meaningful patterns from it. However, enterprises face several technical challenges when deploying Hadoop, specifically in the areas of cluster availability, operations, and scaling. NetApp® has developed a reference architecture with Cloudera to deliver a solution that overcomes some of these challenges so that businesses can ingest, store, and manage big data with greater reliability and scalability and with less time spent on operations and maintenance. This white paper discusses a flexible, validated, enterprise-class Hadoop architecture that is based on NetApp E-Series storage using Cloudera’s Hadoop distribution. TABLE OF CONTENTS 1 Introduction ........................................................................................................................................... 4 1.1 Big Data ..........................................................................................................................................................4 1.2 Hadoop Overview ...........................................................................................................................................4 2 NetApp E-Series
    [Show full text]
  • Trident Development Framework
    Trident Development Framework Tom MacAdam Jim Covill Kathleen Svendsen Martec Limited Prepared By: Martec Limited 1800 Brunswick Street, Suite 400 Halifax, Nova Scotia B3J 3J8 Canada Contractor's Document Number: TR-14-85 (Control Number: 14.28008.1110) Contract Project Manager: David Whitehouse, 902-425-5101 PWGSC Contract Number: W7707-145679/001/HAL CSA: Malcolm Smith, Warship Performance, 902-426-3100 x383 The scientific or technical validity of this Contract Report is entirely the responsibility of the Contractor and the contents do not necessarily have the approval or endorsement of the Department of National Defence of Canada. Contract Report DRDC-RDDC-2014-C328 December 2014 © Her Majesty the Queen in Right of Canada, as represented by the Minister of National Defence, 2014 © Sa Majesté la Reine (en droit du Canada), telle que représentée par le ministre de la Défense nationale, 2014 Working together for a safer world Trident Development Framework Martec Technical Report # TR-14-85 Control Number: 14.28008.1110 December 2014 Prepared for: DRDC Atlantic 9 Grove Street Dartmouth, Nova Scotia B2Y 3Z7 Martec Limited tel. 902.425.5101 1888 Brunswick Street, Suite 400 fax. 902.421.1923 Halifax, Nova Scotia B3J 3J8 Canada email. [email protected] www.martec.com REVISION CONTROL REVISION REVISION DATE Draft Release 0.1 10 Nov 2014 Draft Release 0.2 2 Dec 2014 Final Release 10 Dec 2014 PROPRIETARY NOTICE This report was prepared under Contract W7707-145679/001/HAL, Defence R&D Canada (DRDC) Atlantic and contains information proprietary to Martec Limited. The information contained herein may be used and/or further developed by DRDC Atlantic for their purposes only.
    [Show full text]
  • A Comprehensive Study of Bloated Dependencies in the Maven Ecosystem
    Noname manuscript No. (will be inserted by the editor) A Comprehensive Study of Bloated Dependencies in the Maven Ecosystem César Soto-Valero · Nicolas Harrand · Martin Monperrus · Benoit Baudry Received: date / Accepted: date Abstract Build automation tools and package managers have a profound influence on software development. They facilitate the reuse of third-party libraries, support a clear separation between the application’s code and its ex- ternal dependencies, and automate several software development tasks. How- ever, the wide adoption of these tools introduces new challenges related to dependency management. In this paper, we propose an original study of one such challenge: the emergence of bloated dependencies. Bloated dependencies are libraries that the build tool packages with the application’s compiled code but that are actually not necessary to build and run the application. This phenomenon artificially grows the size of the built binary and increases maintenance effort. We propose a tool, called DepClean, to analyze the presence of bloated dependencies in Maven artifacts. We ana- lyze 9; 639 Java artifacts hosted on Maven Central, which include a total of 723; 444 dependency relationships. Our key result is that 75:1% of the analyzed dependency relationships are bloated. In other words, it is feasible to reduce the number of dependencies of Maven artifacts up to 1=4 of its current count. We also perform a qualitative study with 30 notable open-source projects. Our results indicate that developers pay attention to their dependencies and are willing to remove bloated dependencies: 18/21 answered pull requests were accepted and merged by developers, removing 131 dependencies in total.
    [Show full text]
  • Study of the Utility of Text Classification Based Software
    Study of the Utility of Text Classification Based Software Architecture Recovery Method RELAX for Maintenance Daniel Link Kamonphop Srisopha Barry Boehm University of Southern California University of Southern California University of Southern California Los Angeles, California, USA Los Angeles, California, USA Los Angeles, California, USA [email protected] [email protected] [email protected] ABSTRACT ACM Reference Format: Background. The software architecture recovery method RELAX Daniel Link, Kamonphop Srisopha, and Barry Boehm. 2021. Study of the Utility of Text Classification Based Software Architecture Recovery Method produces a concern-based architectural view of a software sys- RELAX for Maintenance. In ACM / IEEE International Symposium on Em- tem graphically and textually from that system’s source code. The pirical Software Engineering and Measurement (ESEM) (ESEM ’21), Octo- method has been implemented in software which can recover the ber 11–15, 2021, Bari, Italy. ACM, New York, NY, USA, 6 pages. https: architecture of systems whose source code is written in Java. //doi.org/10.1145/3475716.3484194 Aims. Our aim was to find out whether the availability of archi- tectural views produced by RELAX can help maintainers who are 1 INTRODUCTION new to a project in becoming productive with development tasks While several definitions of what a software architecture is exist sooner, and how they felt about working in such an environment. [11], e.g., the set of design decisions about a software system [13], Method. We conducted a user study with nine participants. They they all refer to the structure of a software system and the reasoning were subjected to a controlled experiment in which maintenance process that led to that structure.
    [Show full text]
  • Groups and Activities Report 2017
    Groups and Activities Report 2017 ISBN 978-92-9083-491-5 This report is released under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. 2 | Page CERN IT Department Groups and Activities Report 2017 CONTENTS GROUPS REPORTS 2017 Collaborations, Devices & Applications (CDA) Group ............................................................................. 6 Communication Systems (CS) Group .................................................................................................... 11 Compute & Monitoring (CM) Group ..................................................................................................... 16 Computing Facilities (CF) Group ........................................................................................................... 20 Databases (DB) Group ........................................................................................................................... 23 Departmental Infrastructure (DI) Group ............................................................................................... 27 Storage (ST) Group ................................................................................................................................ 28 ACTIVITIES AND PROJECTS REPORTS 2017 CERN openlab ........................................................................................................................................ 34 CERN School of Computing (CSC) .........................................................................................................
    [Show full text]
  • Bae Systems Information and Electronic Systems Integration Inc
    BAE SYSTEMS INFORMATION AND ELECTRONIC SYSTEMS INTEGRATION INC. GEOSPATIAL EXPLOITATION PRODUCTS® PLATFORM SOFTWARE LICENSE AGREEMENT THIS SOFTWARE LICENSE AGREEMENT (“AGREEMENT”) APPLIES TO ANY SOFTWARE PRODUCT(S) THAT MAY BE PROVIDED BY BAE SYSTEMS INFORMATION AND ELECTRONIC SYSTEMS INTEGRATION INC. (“LICENSOR”) TO YOU (“LICENSEE”), INCLUDING BUT NOT LIMITED TO GXP XPLORER®, SOCET GXP®, SOCET SET®, GXP WEBVIEW®, GXP INMOTION™, GXP INMOTION™ SERVER, GXP JPIP SERVER, GXP OPSVIEW™ AND IF APPLICABLE (AS SPECIFICALLY IDENTIFIED IN THE APPLICABLE ORDERING DOCUMENT OR CONTRACT) THE GXP XPLORER SERVER TO DIB CONNECTOR (EACH SEPARATELY REFERRED TO BELOW AS “GXP SOFTWARE”). READ THE TERMS AND CONDITIONS OF THIS AGREEMENT CAREFULLY BEFORE (1) OPENING THE PACKAGE OR DOWNLOADING THE FILE CONTAINING THE GXP SOFTWARE, OR (2) CLICKING THE “I ACCEPT” BUTTON. THE GXP SOFTWARE AND THE ACCOMPANYING USER DOCUMENTATION (EACH REFERRED TO AS THE “PROGRAM”) ARE COPYRIGHTED AND LICENSED - NOT SOLD. BY OPENING THE SOFTWARE PACKAGE, OR CLICKING “I ACCEPT”, YOU ARE ACCEPTING AND AGREEING TO THE TERMS OF THIS AGREEMENT. IF YOU DO NOT ACCEPT THE TERMS AND CONDITIONS OF THIS AGREEMENT PROMPTLY RETURN THE UNOPENED PACKAGE TO THE PARTY FROM WHOM IT WAS ACQUIRED, CANCEL THE DOWNLOAD OR CANCEL THE INSTALLATION. IF YOU ARE A UNITED STATES (“U.S”) GOVERNMENT CUSTOMER, ACCEPTANCE OF THESE TERMS ARE EFFECTUATED BY ACCEPTANCE OF A PROPOSAL, QUOTE, OR OTHER ORDERING DOCUMENT OR CONTRACT INCORPORATING THIS AGREEMENT BY REFERENCE OR OTHERWISE OR BY CONTRACTING OFFICER EXECUTION OF THIS AGREEMENT. THIS AGREEMENT REPRESENTS THE ENTIRE AGREEMENT CONCERNING THE LICENSING OF THE PROGRAM BETWEEN LICENSEE AND LICENSOR, AND IT SUPERSEDES AND REPLACES IN ITS ENTIRETY ANY PRIOR PROPOSAL, REPRESENTATION, OR UNDERSTANDING BETWEEN THE PARTIES.
    [Show full text]
  • Msbridge: Opensees Pushover and Earthquake Analysis of Multi-Span Bridges - User Manual
    STRUCTURAL SYSTEMS RESEARCH PROJECT Report No. SSRP–14/04 MSBRIDGE: OPENSEES PUSHOVER AND EARTHQUAKE ANALYSIS OF MULTI-SPAN BRIDGES - USER MANUAL by AHMED ELGAMAL JINCHI LU KEVIN MACKIE Final Report Submitted to the California Department of Transportation (Caltrans) under Contract No. 65A0445. Department of Structural Engineering May 2014 University of California, San Diego La Jolla, California 92093-0085 University of California, San Diego Department of Structural Engineering Structural Systems Research Project Report No. SSRP-14/03 MSBridge: OpenSees Pushover and Earthquake Analysis of Multi-span Bridges - User Manual by Ahmed Elgamal Professor of Geotechnical Engineering Jinchi Lu Assistant Project Scientist Kevin Mackie Associate Professor of Structural Engineering at University of Central Florida Final Report Submitted to the California Department of Transportation under Contract No. 65A0445 Department of Structural Engineering University of California, San Diego La Jolla, California 92093-0085 May 2014 ii Technical Report Documentation Page 1. Report No. 2. Government Accession No. 3. Recipient’s Catalog No. 4. Title and Subtitle 5. Report Date MSBridge: OpenSees Pushover and Earthquake Analysis May 2014 of Multi-span Bridges - User Manual 6. Performing Organization Code 7. Author(s) 8. Performing Organization Report No. Ahmed Elgamal and Jinchi Lu UCSD / SSRP-14/04 9. Performing Organization Name and Address 10. Work Unit No. (TRAIS) Department of Structural Engineering School of Engineering University of California, San Diego 11. Contract or Grant No. La Jolla, California 92093-0085 65A0445 12. Sponsoring Agency Name and Address 13. Type of Report and Period Covered Final Report California Department of Transportation Division of Engineering Services 14. Sponsoring Agency Code th 1801 30 St., MS-9-2/5i Sacramento, California 95816 15.
    [Show full text]
  • CDP DATA CENTER 7.1 Laurent Edel : Solution Engineer Jacques Marchand : Solution Engineer Mael Ropars : Principal Solution Engineer
    CDP DATA CENTER 7.1 Laurent Edel : Solution Engineer Jacques Marchand : Solution Engineer Mael Ropars : Principal Solution Engineer 30 Juin 2020 SPEAKERS • © 2019 Cloudera, Inc. All rights reserved. AGENDA • CDP DATA CENTER OVERVIEW • DETAILS ABOUT MAJOR COMPONENTS • PATH TO CDP DC && SMART MIGRATION • Q/A © 2019 Cloudera, Inc. All rights reserved. CLOUDERA DATA PLATFORM © 2020 Cloudera, Inc. All rights reserved. 4 ARCHITECTURE CIBLE : ENTERPRISE DATA CLOUD CDP Cloud Public CDP On-Prem (platform-as-a-service) (installable software) © 2020 Cloudera, Inc. All rights reserved. 5 CDP DATA CENTER OVERVIEW CDP Data Center (installable software) NEW CDP Data Center features include: Cloudera Manager • High-performance SQL analytics • Real-time stream processing, analytics, and management • Fine-grained security, enterprise metadata, and scalable data lineage • Support for object storage (tech preview) • Single pane of glass for management - multi-cluster support Enterprise analytics and data management platform, built for hybrid cloud, optimized for bare metal and ready for private cloud Cloudera Runtime © 2020 Cloudera, Inc. All rights reserved. 6 A NEW OPEN SOURCE DISTRIBUTION FOR BETTER CAPABILITY Cloudera Runtime - created from the best of CDH and HDP Deprecate competitive Merge overlapping Keep complementary Upgrade shared technologies technologies technologies technologies © 2019 Cloudera, Inc. All rights reserved. 7 COMPONENT LIST CDP Data Center 7.1(May) 2020 • Cloudera Manager 7.1 • HBase 2.2 • Key HSM 7.1 • Kafka Schema Registry 0.8
    [Show full text]
  • Kyuubi Release 1.3.0 Kent
    Kyuubi Release 1.3.0 Kent Yao Sep 30, 2021 USAGE GUIDE 1 Multi-tenancy 3 2 Ease of Use 5 3 Run Anywhere 7 4 High Performance 9 5 Authentication & Authorization 11 6 High Availability 13 6.1 Quick Start................................................ 13 6.2 Deploying Kyuubi............................................ 47 6.3 Kyuubi Security Overview........................................ 76 6.4 Client Documentation.......................................... 80 6.5 Integrations................................................ 82 6.6 Monitoring................................................ 87 6.7 SQL References............................................. 94 6.8 Tools................................................... 98 6.9 Overview................................................. 101 6.10 Develop Tools.............................................. 113 6.11 Community................................................ 120 6.12 Appendixes................................................ 128 i ii Kyuubi, Release 1.3.0 Kyuubi™ is a unified multi-tenant JDBC interface for large-scale data processing and analytics, built on top of Apache Spark™. In general, the complete ecosystem of Kyuubi falls into the hierarchies shown in the above figure, with each layer loosely coupled to the other. For example, you can use Kyuubi, Spark and Apache Iceberg to build and manage Data Lake with pure SQL for both data processing e.g. ETL, and analytics e.g. BI. All workloads can be done on one platform, using one copy of data, with one SQL interface. Kyuubi provides the following features: USAGE GUIDE 1 Kyuubi, Release 1.3.0 2 USAGE GUIDE CHAPTER ONE MULTI-TENANCY Kyuubi supports the end-to-end multi-tenancy, and this is why we want to create this project despite that the Spark Thrift JDBC/ODBC server already exists. 1. Supports multi-client concurrency and authentication 2. Supports one Spark application per account(SPA). 3. Supports QUEUE/NAMESPACE Access Control Lists (ACL) 4.
    [Show full text]
  • Performance Tuning Apache Drill on Hadoop Clusters with Evolutionary Algorithms
    Performance tuning Apache Drill on Hadoop Clusters with Evolutionary Algorithms Proposing the algorithm SIILCK (Society Inspired Incremental Learning through Collective Knowledge) Roger Bløtekjær Thesis submitted for the degree of Master of science in Informatikk: språkteknologi 30 credits Institutt for informatikk Faculty of mathematics and natural sciences UNIVERSITY OF OSLO Spring 2018 Performance tuning Apache Drill on Hadoop Clusters with Evolutionary Algorithms Proposing the algorithm SIILCK (Society Inspired Incremental Learning through Collective Knowledge) Roger Bløtekjær c 2018 Roger Bløtekjær Performance tuning Apache Drill on Hadoop Clusters with Evolutionary Algorithms http://www.duo.uio.no/ Printed: Reprosentralen, University of Oslo 0.1 Abstract 0.1.1 Research question How can we make a self optimizing distributed Apache Drill cluster, for high performance data readings across several file formats and database architec- tures? 0.1.2 Overview Apache Drill enables the user to perform schema-free querying of distributed data, and ANSI SQL programming on top of NoSQL datatypes like JSON or XML - typically in a Hadoop cluster. As it is with the core Hadoop stack, Drill is also highly customizable, with plenty of performance tuning parame- ters to ensure optimal efficiency. Tweaking these parameters however, requires deep domain knowledge and technical insight, and even then the optimal con- figuration may not be evident. Businesses will want to use Apache Drill in a Hadoop cluster, without the hassle of configuring it, for the most cost-effective implementation. This can be done by solving the following problems: • How to apply evolutionary algorithms to automatically tune a distributed Apache Drill configuration, regardless of cluster environment.
    [Show full text]
  • Pro Opengl for C# Developers High-Performance 2D and 3D Graphics for Desktop, Web, Ios and Android
    F. Ramos Pro OpenGL for C# Developers High-Performance 2D and 3D Graphics for Desktop, Web, iOS and Android ▶ Access the hugely popular OpenGL graphics API in C#, without the need to use C++.Build your own game engine with 2D and 3D support.Target multiple platforms with your next game. OpenGL is widely considered the industry standard in high performance graphics for gaming, virtual reality and visualization. Unlike DirectX, OpenGL can be used on a wide range of platforms beyond Windows, from Linux to iOS and PlayStation Vita. Pro OpenGL for C# Developers shows you how to harness this powerful API from your language of choice, C#, and start creating professional-quality games and interactive graphics applications. 1st ed. 2014, 450 p. The book starts with an introduction to the OpenGL API and a guide to the process A product of Apress involved in rendering graphics, known as the graphics pipeline. You'll also meet OpenTK, the fully managed wrapper that makes it easy and painless to work with OpenGL in C# (or any other .NET language). Chapters 2 and 3 take you through the process of building your Printed book game engine, covering topics like architecture, object-oriented design and test-driven development in the context of game development. You'll begin to discover the power of Softcover OpenGL, build your first rendering demo, and learn techniques for rendering 2D in 3D, and ISBN 978-1-4842-0050-6 3D in 2D! (That is, a 2D world in a 3D game engine, and a 3D scene on a 2D display.) ▶ 44,95 € | £35.50 ▶ *48,10 € (D) | 49,45 € (A) | CHF 60.00 Further chapters dive deep into specific areas of graphic programming: shaders, particle systems, animation and path finding.
    [Show full text]
  • Apache Calcite: a Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources
    Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources Edmon Begoli Jesús Camacho-Rodríguez Julian Hyde Oak Ridge National Laboratory Hortonworks Inc. Hortonworks Inc. (ORNL) Santa Clara, California, USA Santa Clara, California, USA Oak Ridge, Tennessee, USA [email protected] [email protected] [email protected] Michael J. Mior Daniel Lemire David R. Cheriton School of University of Quebec (TELUQ) Computer Science Montreal, Quebec, Canada University of Waterloo [email protected] Waterloo, Ontario, Canada [email protected] ABSTRACT argued that specialized engines can offer more cost-effective per- Apache Calcite is a foundational software framework that provides formance and that they would bring the end of the “one size fits query processing, optimization, and query language support to all” paradigm. Their vision seems today more relevant than ever. many popular open-source data processing systems such as Apache Indeed, many specialized open-source data systems have since be- Hive, Apache Storm, Apache Flink, Druid, and MapD. Calcite’s ar- come popular such as Storm [50] and Flink [16] (stream processing), chitecture consists of a modular and extensible query optimizer Elasticsearch [15] (text search), Apache Spark [47], Druid [14], etc. with hundreds of built-in optimization rules, a query processor As organizations have invested in data processing systems tai- capable of processing a variety of query languages, an adapter ar- lored towards their specific needs, two overarching problems have chitecture designed for extensibility, and support for heterogeneous arisen: data models and stores (relational, semi-structured, streaming, and • The developers of such specialized systems have encoun- geospatial). This flexible, embeddable, and extensible architecture tered related problems, such as query optimization [4, 25] is what makes Calcite an attractive choice for adoption in big- or the need to support query languages such as SQL and data frameworks.
    [Show full text]