Hortonworks Data Platform Apache Solr Search Installation (May 17, 2018)

Total Page:16

File Type:pdf, Size:1020Kb

Hortonworks Data Platform Apache Solr Search Installation (May 17, 2018) Hortonworks Data Platform Apache Solr Search Installation (May 17, 2018) docs.cloudera.com Hortonworks Data Platform May 17, 2018 Hortonworks Data Platform: Apache Solr Search Installation Copyright © 2012-2018 Hortonworks, Inc. Some rights reserved. The Hortonworks Data Platform, powered by Apache Hadoop, is a massively scalable and 100% open source platform for storing, processing and analyzing large volumes of data. It is designed to deal with data from many sources and formats in a very quick, easy and cost-effective manner. The Hortonworks Data Platform consists of the essential set of Apache Hadoop projects including MapReduce, Hadoop Distributed File System (HDFS), HCatalog, Pig, Hive, HBase, ZooKeeper and Ambari. Hortonworks is the major contributor of code and patches to many of these projects. These projects have been integrated and tested as part of the Hortonworks Data Platform release process and installation and configuration tools have also been included. Unlike other providers of platforms built using Apache Hadoop, Hortonworks contributes 100% of our code back to the Apache Software Foundation. The Hortonworks Data Platform is Apache-licensed and completely open source. We sell only expert technical support, training and partner-enablement services. All of our technology is, and will remain free and open source. Please visit the Hortonworks Data Platform page for more information on Hortonworks technology. For more information on Hortonworks services, please visit either the Support or Training page. Feel free to Contact Us directly to discuss your specific needs. Except where otherwise noted, this document is licensed under Creative Commons Attribution ShareAlike 4.0 License. http://creativecommons.org/licenses/by-sa/4.0/legalcode ii Hortonworks Data Platform May 17, 2018 Table of Contents 1. Introduction ................................................................................................................. 1 2. HDP Search 3.0 ............................................................................................................ 2 2.1. HDP Search 3.0 Release Notes ........................................................................... 2 2.1.1. HDP Search 3.0 New Features ................................................................ 2 2.1.2. HDP Search 3.0 Behavioral Changes ........................................................ 2 2.1.3. HDP Search 3.0 Apache Solr Version Information .................................... 3 2.1.4. HDP Search 3.0 Known Issues ................................................................. 3 2.2. HDP Search 3.0 - Getting Ready ........................................................................ 3 2.2.1. HDP Search 3.0 Minimum System Requirements ..................................... 3 2.2.2. Using a Local Repository ........................................................................ 4 2.3. Installing HDP Search 3.0 Management Pack ..................................................... 8 2.4. Installing HDP Search 3.0 Manually ................................................................... 9 3. HDP Search 2.2.10 - Deprecated ................................................................................. 11 3.1. HDP Search 2.2.10 Release Notes .................................................................... 11 3.1.1. HDP Search 2.2.10 New Features .......................................................... 11 3.1.2. HDP Search 2.2.10 Behavioral Changes ................................................. 11 3.1.3. HDP Search 2.2.10 Apache Solr Version Information ............................. 11 3.1.4. HDP Search 2.2.10 Known Issues .......................................................... 11 3.2. HDP Search 2.2.10 - Getting Ready .................................................................. 11 3.2.1. Meet Minimum System Requirements ................................................... 11 3.2.2. Using a Local Repository ....................................................................... 12 3.3. Installing HDP Search 2.2.10 Management Pack .............................................. 17 3.4. Installing HDP Search 2.2.10 Manually ............................................................. 18 4. Upgrading HDP Search ............................................................................................... 20 iii Hortonworks Data Platform May 17, 2018 List of Tables 2.1. HDP Search ............................................................................................................... 2 2.2. HDP Search ............................................................................................................... 2 3.1. HDP Search - 2.2.10 ................................................................................................. 11 iv Hortonworks Data Platform May 17, 2018 1. Introduction HDP Search is a full-text search server, designed for enterprise-level performance, flexibility, scalability, and fault-tolerance. HDP Search exposes REST-like HTTP/XML and JSON APIs for use with a wide range of programming languages. HDP Search includes: • Apache Solr 5.5.5 (for HDP Search 2.2.10) or Apache Solr 6.6.2 (for HDP Search 3.0) • Banana 1.6.12 • JARs for integration with Hadoop, Hive, HBase and Pig • Software development kits for Storm (not available with HDP Search 3.0) and Spark Note HDP Search is a separate product and does NOT come with the HDP platform. The high-level steps for using HDP search are as follows: 1. Install and deploy HDP Search, either manually or by using Ambari. 2. Ingest documents from sources such as HDFS. 3. Index the data. Documents, and updates to documents, will be available for search almost immediately after being indexed. 4. Perform a wide range of basic and advanced operations on the indexed documents. Resources: • This document describes software requirements for HDP Search, followed by installation instructions for specific operating systems. • For information about configuring indexes, ingesting documents, and searching indexed documents, see Getting Started with Solr. • For detailed information about connecting to data sources and ingesting data on secure and non-secure clusters, see the Connector User Guide. • For detailed information on using Banana with Solr, see the Guide to Banana Dashboards. • For help troubleshooting issues with HDP Search, see Troubleshooting HDP Search. 1 Hortonworks Data Platform May 17, 2018 2. HDP Search 3.0 • HDP Search 3.0 Release Notes [2] • HDP Search 3.0 - Getting Ready [3] • Installing HDP Search 3.0 Management Pack [8] • Upgrading HDP Search 2.1. HDP Search 3.0 Release Notes The HDP Search 3.0 Release Notes summarize and describe the following information released in HDP Search 3.0: • HDP Search 3.0 New Features [2] • HDP Search 3.0 Behavioral Changes [2] • HDP Search 3.0 Apache Solr Version Information [3] • HDP Search 3.0 Known Issues [3] Note HDP Search is a separate product and does NOT come with the HDP platform. 2.1.1. HDP Search 3.0 New Features HDP 3.0 includes the following new feature: Table 2.1. HDP Search Feature Description Apache Solr 6.6.2 Support for Apache Solr 6.6.2 has been added to the Management Pack 2.1.2. HDP Search 3.0 Behavioral Changes HDP Search 3.0 introduces the following change in behavior as compared to previous HDP Search versions: Table 2.2. HDP Search Description Reference Storm Solr Connector The Storm Solr connector from Lucidworks is no longer supported, and has not been included in this release. More Information Ambari 2.6.0 Behavioral Changes 2 Hortonworks Data Platform May 17, 2018 2.1.3. HDP Search 3.0 Apache Solr Version Information HDP Search 3.0 is based on Apache Solr 6.6.2 (Apache Solr Release Notes). 2.1.4. HDP Search 3.0 Known Issues Please choose Map Reduce as the execution engine for Hive queries related to the Solr index. Tez will NOT work because Lucidwork's Hive SerDe does not yet support Hive 2 officially. It has been roadmapped for a future release. Currently, only Tez on Hive 1.x is supported. Refer to the Ambari Troubleshooting Guide for additional information. 2.2. HDP Search 3.0 - Getting Ready This section describes information and materials that you should get ready before installing HDP Search 3.0. • HDP Search 3.0 Minimum System Requirements [3] • Using a Local Repository [4] 2.2.1. HDP Search 3.0 Minimum System Requirements To use HDP Search, your system must meet the following minimum requirements. 2.2.1.1. HDP Search 3.0 Operating System Requirements HDP Search 3.0 is supported on the following operating systems: • 64-bit CentOS 6 and 7 • 64-bit Red Hat Enterprise Linux (RHEL) 6 and 7 • 64-bit Oracle Linux 6 and 7 • 64-bit SUSE Linux Enterprise Server (SLES) 11, SP3/SP4 • 64-bit SUSE Linux Enterprise Server (SLES) 12 • 64-bit Debian 7 • 64-bit Ubuntu 12 and 14 2.2.1.2. JDK Requirements - HDP Search 3.0 HDP Search 3.0 requires Oracle or OpenJDK Java 1.8 or higher. Make sure your $JAVA_HOME and $PATH variables are set to the correct version; for example: export JAVA_HOME=/usr/java/default export PATH=$JAVA_HOME/bin:$PATH 3 Hortonworks Data Platform May 17, 2018 2.2.1.3. HDP Search 3.0 HDP Requirements HDP Search 3.0 is tested and certified with HDP 2.6.x and the following HDP components. Component Version Apache Hadoop 2.7.3 Apache HBase 1.1.2 Apache Hive 1.2.1 Apache Pig 0.16.0 Apache Spark 2.2.0 2.2.2. Using a Local Repository Local repositories are frequently used in enterprise clusters that have limited outbound internet access. In these scenarios, local packages provide more
Recommended publications
  • Red Hat Enterprise Linux 8 Installing, Managing, and Removing User-Space Components
    Red Hat Enterprise Linux 8 Installing, managing, and removing user-space components An introduction to AppStream and BaseOS in Red Hat Enterprise Linux 8 Last Updated: 2021-06-25 Red Hat Enterprise Linux 8 Installing, managing, and removing user-space components An introduction to AppStream and BaseOS in Red Hat Enterprise Linux 8 Legal Notice Copyright © 2021 Red Hat, Inc. The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/ . In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version. Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law. Red Hat, Red Hat Enterprise Linux, the Shadowman logo, the Red Hat logo, JBoss, OpenShift, Fedora, the Infinity logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries. Linux ® is the registered trademark of Linus Torvalds in the United States and other countries. Java ® is a registered trademark of Oracle and/or its affiliates. XFS ® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries. MySQL ® is a registered trademark of MySQL AB in the United States, the European Union and other countries.
    [Show full text]
  • Using the Mysql Yum Repository Abstract
    Using the MySQL Yum Repository Abstract This document provides some basic instructions for using the MySQL Yum Repository to install and upgrade MySQL. It is excerpted from the MySQL 5.6 Reference Manual. For legal information, see the Legal Notices. For help with using MySQL, please visit the MySQL Forums, where you can discuss your issues with other MySQL users. Document generated on: 2021-09-23 (revision: 70881) Table of Contents Preface and Legal Notices ............................................................................................................ v 1 Installing MySQL on Linux Using the MySQL Yum Repository ..................................................... 1 2 Replacing a Third-Party Distribution of MySQL Using the MySQL Yum Repository ........................ 5 3 Upgrading MySQL with the MySQL Yum Repository ................................................................... 9 iii iv Preface and Legal Notices This document provides some basic instructions for using the MySQL Yum Repository to install and upgrade MySQL. It is excerpted from the MySQL 5.6 Reference Manual. Licensing information—MySQL 5.6. This product may include third-party software, used under license. If you are using a Commercial release of MySQL 5.6, see the MySQL 5.6 Commercial Release License Information User Manual for licensing information, including licensing information relating to third-party software that may be included in this Commercial release. If you are using a Community release of MySQL 5.6, see the MySQL 5.6 Community Release License Information User Manual for licensing information, including licensing information relating to third-party software that may be included in this Community release. Licensing information—MySQL NDB Cluster 7.3. This product may include third-party software, used under license. If you are using a Commercial release of NDB Cluster 7.3, see the MySQL NDB Cluster 7.3 Commercial Release License Information User Manual for licensing information relating to third-party software that may be included in this Commercial release.
    [Show full text]
  • Managing Software with Yum
    Fedora Core 4 Managing software with yum Stuart Ellis Edited by Paul W. Frields Copyright © 2005 Red Hat, Inc. and others. The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/. The original authors of this document, and Red Hat, designate the Fedora Project as the "Attribution Party" for purposes of CC-BY-SA. In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version. Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law. Red Hat, Red Hat Enterprise Linux, the Shadowman logo, JBoss, MetaMatrix, Fedora, the Infinity Logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries. For guidelines on the permitted uses of the Fedora trademarks, refer to https:// fedoraproject.org/wiki/Legal:Trademark_guidelines. Linux® is the registered trademark of Linus Torvalds in the United States and other countries. Java® is a registered trademark of Oracle and/or its affiliates. XFS® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries. All other trademarks are the property of their respective owners. 1. Introduction ............................................................................................................................. 2 1.1. Purpose ....................................................................................................................... 2 1.2. Audience ....................................................................................................................
    [Show full text]
  • Red Hat Developer Toolset 9 User Guide
    Red Hat Developer Toolset 9 User Guide Installing and Using Red Hat Developer Toolset Last Updated: 2020-08-07 Red Hat Developer Toolset 9 User Guide Installing and Using Red Hat Developer Toolset Zuzana Zoubková Red Hat Customer Content Services Olga Tikhomirova Red Hat Customer Content Services [email protected] Supriya Takkhi Red Hat Customer Content Services Jaromír Hradílek Red Hat Customer Content Services Matt Newsome Red Hat Software Engineering Robert Krátký Red Hat Customer Content Services Vladimír Slávik Red Hat Customer Content Services Legal Notice Copyright © 2020 Red Hat, Inc. The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/ . In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version. Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law. Red Hat, Red Hat Enterprise Linux, the Shadowman logo, the Red Hat logo, JBoss, OpenShift, Fedora, the Infinity logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries. Linux ® is the registered trademark of Linus Torvalds in the United States and other countries. Java ® is a registered trademark of Oracle and/or its affiliates. XFS ® is a trademark of Silicon Graphics International Corp.
    [Show full text]
  • CIT 470: Advanced Network and System Administration Slide #1 CIT 470: Advanced Network and System Administration Slide #2
    Topics 1. The Problem of Software Installation 2. Package Management Systems CIT 470: Advanced Network and 3. Using RPM System Administration 4. Finding RPMs Package Management 5. Building RPMs CIT 470: Advanced Network and System Administration Slide #1 CIT 470: Advanced Network and System Administration Slide #2 Software Installation What’s the problem? 1. Customization What prerequisites does your software have? Select options like language. What prereqs do your prereq packages have? Select file set. How do you handle conflicts? What if two programs install/modify same file? 2. Install new files in appropriate locations. Does your install work on every type of computer? 3. Modify existing configuration files. How do you handle upgrades? 4. Make software available to user. What if user has customized configuration? Shell configuration (PATH, etc.) What if ownerships/permissions have changed? GUI configuration (menu, icons, etc.) What if user needs old and new versions? How do you uninstall software? CIT 470: Advanced Network and System Administration Slide #3 CIT 470: Advanced Network and System Administration Slide #4 Package Manager Features UNIX Package Management Systems • Build management. deb: Debian system uses dpkg and APT. • Dependency tracking. pkgadd: Solaris packaging system. • Querying. portage: Gentoo uses with emerge. • Reversibility. ports: BSD ports system. • Verification. RPM: Redhat packaging system. • Version control. tgz: Tarballs used by Slackware. CIT 470: Advanced Network and System Administration Slide #5 CIT 470: Advanced Network and System Administration Slide #6 1 RPM RPM Package Names RPM Package Manager <name>-<version>-<release>.<arch>.rpm – Originally stood for Red Hat Package Manager – Came with Red Hat Linux 2.0 in 1995.
    [Show full text]
  • Sudo Subscription-Manager Repos \ --Enable Rhel-7-Server-Rpms
    Buy the book on Amazon https://www.amazon.co.uk/dp/B08CF33XM2 50 yum repository details in /etc/yum.repos.d • Under /etc/yum.repos.d are the files which define the repositories to be used; for the CentOS 8 distribution these include: ♦ CentOS-Base.repo - contains the BaseOS repository details. ♦ CentOS-AppStream.repo - used to install AppStream packages from the distribution. • For our own in-house courses, the above repo files have been edited on the training systems so that the machine looks only to the training server vespa on the local network when installing or updating packages; this can be seen as follows: $ yum -v repolist • There should be three main repositories: Repo-id : AppStream-FA Repo-name : CentOS-8 - AppStream from FA server Repo-revision : 8.3.2011 Repo-distro-tags : [cpe:/o:centos:centos:8]: , 8, C, O, S, e, n, t Repo-updated : Tue 15 Dec 2020 03:05:32 PM GMT Repo-pkgs : 5,754 Repo-available-pkgs : 5,058 Repo-size : 6.9 G Repo-baseurl : http://192.168.200.41/centos/8/AppStream Repo-expire : 172,800 second(s) (last: Thu 31 Dec 2020 05:34:39 PM GMT) 50 of 617 First Alternative 2021 51 Repo-filename : /etc/yum.repos.d/CentOS-AppStream.repo Repo-id : BaseOS-FA Repo-name : CentOS-8 - Base on FA local http server Repo-revision : 8.3.2011 Repo-distro-tags : [cpe:/o:centos:centos:8]: , 8, C, O, S, e, n, t Repo-updated : Tue 15 Dec 2020 03:05:26 PM GMT Repo-pkgs : 1,697 Repo-available-pkgs : 1,695 Repo-size : 1.1 G Repo-baseurl : http://192.168.200.41/centos/8/BaseOS Repo-expire : 172,800 second(s) (last: Thu 31 Dec 2020 05:34:41
    [Show full text]
  • VNC Instruction for GNU/Linux
    VNC Instruction for GNU/Linux 1. Install “ TigerVNC Viewer ”. You can get it with package manager command line as below: • On Ubuntu / Mint / Debian sudo apt-get install vncviewer • On Fedora / CentOS / Scientific Linux sudo yum install tigervnc • On Arch Linux sudo pacman -Syy tigervnc 2. Open “Terminal”, and ssh to “csevnc.cse.csusb.edu” using the following command: ssh -L 5900:localhost:5900 <YourCoyoteID>@csevnc.cse.csusb.edu (Note: Replace “<YourCoyoteID>” with your Coyote ID) 3. If this is the first time you remote access to this server, you may see the following information. When you see that, just type “yes” and hit “Enter”. 4. Type in your Coyote password and hit Enter. 5. Open TigerVNC Viewer. Here are 2 ways to open it: ● From Application: Click on the icon shown in the applications list. ● From command line: Keep the current terminal tab from Step 2 open, and open a new tab or a new terminal window. Then, run command vncviewer in the new tab or window. CSUSB School of CSE 01/19/2018 hn 6. In the pop-up window, type in “localhost”, then hit Enter (or click on “Connect” ). (The pop-up window may vary depending on the distribution of Linux system) 7. Now you should see the GUI of the remote computer. Login with your Coyote ID as Username and Coyote password as Password. 8. Once you have done your work, close the VNC viewer window, and run command exit in the terminal tab from Step 2 to log out from the remote server. CSUSB School of CSE 01/19/2018 hn.
    [Show full text]
  • Gestione Del Software Installazione E Gestione Repository
    Gestione del Software Installazione e gestione repository Niccolò Izzo [email protected] Benvenuti Qui trovate queste slide software.izzo.ovh Fate tante domande! Oggi vedremo come Niccolò Izzo Corsi Linux Avanzati 2015 - POuL Oggi vedremo come Installare il Software Niccolò Izzo Corsi Linux Avanzati 2015 - POuL Oggi vedremo come Installare il Software Gestire i repository Niccolò Izzo Corsi Linux Avanzati 2015 - POuL Compilazione Niccolò Izzo Corsi Linux Avanzati 2015 - POuL Compilazione Pro Codice ottimizzato e personalizzato Possibile il controllo sui sorgenti Niccolò Izzo Corsi Linux Avanzati 2015 - POuL Compilazione Pro Codice ottimizzato e personalizzato Possibile il controllo sui sorgenti Contro Lenta per software complessi Non tiene traccia del software Niccolò Izzo Corsi Linux Avanzati 2015 - POuL Compilazione Pro Codice ottimizzato e personalizzato Possibile il controllo sui sorgenti Contro Lenta per software complessi Non tiene traccia del software Anche se in alcuni casi è l'unica possibilità. Niccolò Izzo Corsi Linux Avanzati 2015 - POuL I pacchetti precompilati Niccolò Izzo Corsi Linux Avanzati 2015 - POuL I pacchetti precompilati Principalmente sono due: .rpm per RHEL, Fedora e le loro derivate .deb per Debian, Ubuntu e le loro derivate Niccolò Izzo Corsi Linux Avanzati 2015 - POuL I pacchetti precompilati Principalmente sono due: .rpm per RHEL, Fedora e le loro derivate .deb per Debian, Ubuntu e le loro derivate Ma esistono anche .tgz per Slackware .pkg.tar.xz per Arch Linux Niccolò Izzo Corsi Linux Avanzati 2015 - POuL Le operazioni base Per installare un pacchetto Debian based # dpkg -i pacchetto.deb RPM based # rpm -i pacchetto.rpm Niccolò Izzo Corsi Linux Avanzati 2015 - POuL Le operazioni base Per rimuovere un pacchetto Debian based # dpkg -r pacchetto RPM based # rpm -r pacchetto Niccolò Izzo Corsi Linux Avanzati 2015 - POuL Manca ancora qualcosa..
    [Show full text]
  • Basic Linux & Package Management
    Basic Linux & Package Management Original slides from GTFO Security outline ● Linux ○ What it is? ○ Commands ○ Filesystem / Shell ○ Package Management Services run on Linux ● mail ● dns ● web ● central authentication ● router ● database ● virtual machines ● voip ● anything Linux ● The core of many computers and devices ○ Android ○ Ubuntu Desktop ○ Red Hat / Fedora ● Linux is a term to describe a set of tools ○ Command line programs ○ Programs such as email and websites ○ Shell scripts ○ Free and Open Source approach ○ Layout of filesystem Linux ● Linux has distributions/variants ○ Debian/RedHat/SUSE ■ Ubuntu - Debian based ■ Mint - Debian based ■ Fedora - RedHat based ■ CentOS - RedHat based ■ Trisquel - Debian based basic commands man top pwd chmod, chown, cd, ls, cp, mv, rm chgrp mkdir ps cat, less netstat vi, nano, emacs who grep, lsof which sudo, su passwd cat $cat filename #write the file to the screen $cat > filename #write input to a file $echo hi | cat #take input from a bash pipe $echo hi | cat | cat grep $cat filename | grep "hello" $cat filename | grep -v "hello" $cat /usr/share/dict/words | grep -B 5 base $cat /usr/share/dict/words | grep -A 5 base grep $head prints out the top of a file $tail prints out the bottom of a file $more shows a file a page at a time $less same as more but lets to scroll up moving files $mv filename1 filename2 same renaming $cp filename1 filename2 two files exist now $cat filename1 > filename2 directories $mkdir directory1 creates a folder $cd directory1 moves into a new folder $cd .. moves out of
    [Show full text]
  • Building Linux Distribution Packages with Docker
    Building Linux distribution packages with Docker Bruno Cornec HPE EMEA EG Presales Strategist WW Linux Community Lead, HPE Open Source Pro ession !"#0 – October 20'( #$#A Custo%ers Solution Inno&ation Center Grenoble Ma)ing the ne+ style o ,T a reality # o » './ years o success, +orld +ide programs, including Cloud Center o Excellence, C Big Data Center o Excellence, Open Source Solutions ,nitiati!e, 0,SC to HP Intel Architecture Migrations, N ! Center o Excellence, EMEA Networking Customer 1isit Center and more » C Complete ,- 23$$/ systems, 4$$$/ net+ork ports, .$$/ -B storage5 o » Port olio o 3$/ ready to demo solutions +it* access to our ecosystem o Partners P » Complete test 6 !alidation en!ironment » Strategic partners*ip +it* Intel, '.7year long standing colla&oration » Strategic partners*ip +it* "ed Hat 87year colla&oration 2OSS,5 o % » e A uni9ue proo point in t*e industry +it* a pro!en ser!ice o:ering d e & i L Mission: Accelerate t*e adoption o new and inno!ati!e solutions &y creating simple and re+arding end7to7end customer experiences t*at &ene it our customers and partners, in a p o compelling and engaging colla&orative en!ironment. h s k …more information available at http://www.hpintelco.net r o ' Introducing m(sel) ● So t+are engineering and <nices since '=>>; – Mostly Con iguration Management Systems 2CMS5, Build systems, 9uality tools, on multiple commercial <nix systems – ?isco!ered Open Source 6 Linux 2OSL5 6 made irst contri&utions in '==4 – @ull time on OSL since '==5, irst as HP reseller t*en AHP ● Currently; –
    [Show full text]
  • A Smart Way to Manage Packages in Yocto Project
    A Smart Way to Manage Packages in Yocto Project Mar 11th, 2016 Fan Xin, Fujitsu Computer Technologies Limited 1378ka02 Copyright 2016 FUJITSU COMPUTER TECHNOLOGIES LIMITED whoami Fan Xin, Fujitsu Computer Technologies Ltd. Embedded Linux Developer In-House Embedded Linux Distributor of Fujitsu Our Distribution includes LTSI Kernel and is built with Yocto Project Our Distribution is used for IVI, Server System Controller, Storage System, Network Equipment, Printer, etc. IVI:In-Vehicle Infotainment 1 Copyright 2016 FUJITSU COMPUTER TECHNOLOGIES LIMITED Fujitsu’s contribution for Yocto Project meta-openembedded.git top contributors by employer (2015-01-01 to 2015-12-31) None 625 (46.1%) Wind River 309 (22.8%) Fujitsu 160 (11.8%) Intel 82 (6.0%) Mentor Graphics 34 (2.5%) O.S. Systems 24 (1.8%) National Instruments 19 (1.4%) MontaVista 16 (1.2%) OpenDreambox 12 (0.9%) Freescale 9 (0.7%) Linaro 8 (0.6%) ENEA AB 5 (0.4%) Leica 5 (0.4%) Aker Security Solutions 4 (0.3%) BMW 3 (0.2%) 2 Copyright 2016 FUJITSU COMPUTER TECHNOLOGIES LIMITED Agenda Package Manager Comparison Package Management Problem Analysis in Yocto Project Introduction of Smart Package Manager Fujitsu’s Contribution and Next Step 3 Copyright 2016 FUJITSU COMPUTER TECHNOLOGIES LIMITED Package Manager Comparison 4 Copyright 2016 FUJITSU COMPUTER TECHNOLOGIES LIMITED Package Manager Package Manager A collection of software tools that automates the process of installing, upgrading, configuring, and removing computer programs Deals with packages, distributions of software
    [Show full text]
  • Package Management Security
    Package Management Security Justin Cappos, Justin Samuel, Scott Baker, John H. Hartman University of Arizona Computer Science Department {justin, jsamuel, bakers, jhh}@cs.arizona.edu Abstract Package management is the task of determining which packages should be installed on a host and then downloading and installing those packages. This paper examines the popular package managers APT and YUM and presents nine feasible attacks on them. There are attacks that install malicious packages, deny users package updates, or cause the host to crash. This work identifies three rules of package management security: don’t trust the repository, the trusted entity with the most information should be the one who signs, and don’t install untrusted packages. The violation of these rules leads to the described vulnerabilities. Unfortunately, many of the flaws are architectural in nature, so repair requires more than patches to APT and YUM. While the rules of package management security argue that the design of existing package managers is insufficient, they do not prescribe how to provide security. This led to the development of three de- sign principles for building a secure package manager: selective trust delegation, customized repository views, and explicitly treating the repository as untrusted. These principles were used to construct a pack- age manager Stork which is not vulnerable to the attacks identified for YUM and APT. Stork has been in use for four years and has managed over half a million clients. 1 Introduction Package managers are a popular way to distribute software (bundled into archives called packages) for modern operating systems [4, 11, 37].
    [Show full text]