DOCSLIB.ORG

Hortonworks Data Platform (Hdp®) Administration Fast Track 5 Days | Foundation

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Hortonworks Data Platform (Hdp®) Administration Fast Track 5 Days | Foundation TRAINING OFFERING HORTONWORKS DATA PLATFORM (HDP®) ADMINISTRATION FAST TRACK 5 DAYS | FOUNDATION This 5 day training course is designed primarily for systems administrators and platform architects who need to understand HDP cluster capabilities, and manage HDP clusters. Topics include: Understanding HDF capabilities, Apache Hadoop, Apache YARN, HDFS, and other Hadoop ecosystem components. Students will understand how to administer, manage, and monitor HDP clusters. PREREQUISITES Students should be familiar with server or platform software concepts and have a basic understanding of system administration. TARGET AUDIENCE For students who range from understanding server software concepts to system administrators and platform architects who plan on administering HDP clusters. FORMAT 50% Lecture/Discussion 50% Hands-on Labs AGENDA SUMMARY Day 1: Introduction to Hadoop and Ambari Day 2: Managing HDFS, YARN Architecture and Management Day 3: The YARN Capacity Scheduler, High Availability, Monitoring and Backups Day 4: Advanced HDFS & YARN Services Day 5: Additional HDP Components and Tuning DAY 1 OBJECTIVES • Describe Apache Hadoop • Summarize the Purpose of the Hortonworks Data Platform Software Frameworks • List Hadoop Cluster Management Choices • Describe Apache Ambari • Identify Hadoop Cluster Deployment Options • Plan for Hadoop Cluster Deployments • Perform an Interactive HDP Installation using Apache Ambari • Install Apache Ambari • Describe the Differences Between Hadoop Users, Hadoop Service Owners and Ambari Users • Manage Users, Groups and Permissions • Identify Hadoop Configuration Files • Summarize Operations of the Web UI Tool • Manage Hadoop Service Configuration Properties using the Ambari Web UI • Manage Client Configuration Files Using the Command-line Interface DAY 1 LABS • Setting Up the Lab Environment • Installing HDP • Managing Apache Ambari Users and Groups • Managing Hadoop Services About Hortonworks Hortonworks is a leading innovator at creating, distributing and supporting enterprise-ready open data platforms. Our mission is to manage the world’s data. We have a single-minded focus on driving innovation in open source communities such as Apache Hadoop, NiFi, and Spark. Our open Connected Data Platforms power Modern Data Applications that deliver actionable intelligence from all data: data-in-motion and data-at-rest. Along with our 1600+ partners, we provide the expertise, training and services that allows our customers to unlock the transformational value of data across any line of business. We are Powering the Future of Data™. Contact For further information visit www.hortonworks.com +1 408 675-0983 +1 855 8-HORTON INTL: +44 (0) 20 3826 1405 © 2011-2016 Hortonworks Inc. All Rights Reserved. Privacy Policy | Terms of Service DAY 2 OBJECTIVES • Describe the Hadoop Distributed File System (HDFS) • Perform HDFS Shell Operations • Use the Ambari Files View • Use WebHDFS • Protect Data using HDFS Access Control Lists (ACLs) • Describe HDFS Architecture and Operation • Manage HDFS using Ambari Web, NameNode and DataNode UIs • Manage HDFS using Command-line Tools • Enable and Manage HDFS Quotas • Identify Reasons to Add, Replace and Delete Worker Nodes • Configure and Run HDFS Balancer • Decommission and Re-commission a Worker Node • Move a Master Component • Summarize the Purpose and Benefits of Rack Awareness • Configure Rack Awareness DAY 2 LABS • Using Hadoop Storage • Using WebHDFS • Using HDFS Access Control Lists • Managing Hadoop Storage • Managing HDFS Quotas • Adding, Decommissioning, and Re-commissioning Worker Nodes • Configuring Rack Awareness About Hortonworks Hortonworks is a leading innovator at creating, distributing and supporting enterprise-ready open data platforms. Our mission is to manage the world’s data. We have a single-minded focus on driving innovation in open source communities such as Apache Hadoop, NiFi, and Spark. Our open Connected Data Platforms power Modern Data Applications that deliver actionable intelligence from all data: data-in-motion and data-at-rest. Along with our 1600+ partners, we provide the expertise, training and services that allows our customers to unlock the transformational value of data across any line of business. We are Powering the Future of Data™. Contact For further information visit www.hortonworks.com +1 408 675-0983 +1 855 8-HORTON INTL: +44 (0) 20 3826 1405 © 2011-2016 Hortonworks Inc. All Rights Reserved. Privacy Policy | Terms of Service DAY 3 OBJECTIVES • Describe YARN Resource Management • Summarize YARN Architecture and Operation • Identify and Use YARN Management Options • Summarize YARN Response to Component Failure • Understand the Basics of Running a Sample YARN Application, Including: o MapReduce and Tez o Apache Pig o Apache Hive • Summarize the Purpose and Operation of the YARN Capacity Scheduler • Configure and Manager YARN Queues • Control Access to YARN Queues DAY 3 LABS • Managing the YARN Service Using the Apache Ambari Web UI • Managing the YARN Service Using the CLI Commands • Running Sample YARN Applications • Setting Up for the Capacity Scheduler • Managing YARN Containers and Queues • Managing YARN ACLs and User Limits • Working with YARN Node Labels About Hortonworks Hortonworks is a leading innovator at creating, distributing and supporting enterprise-ready open data platforms. Our mission is to manage the world’s data. We have a single-minded focus on driving innovation in open source communities such as Apache Hadoop, NiFi, and Spark. Our open Connected Data Platforms power Modern Data Applications that deliver actionable intelligence from all data: data-in-motion and data-at-rest. Along with our 1600+ partners, we provide the expertise, training and services that allows our customers to unlock the transformational value of data across any line of business. We are Powering the Future of Data™. Contact For further information visit www.hortonworks.com +1 408 675-0983 +1 855 8-HORTON INTL: +44 (0) 20 3826 1405 © 2011-2016 Hortonworks Inc. All Rights Reserved. Privacy Policy | Terms of Service DAY 4 OBJECTIVES • Summarize the Purpose of NameNode HA • Configure NameNode HA using Ambari • Summarize the Purpose of ResourceManager HA • Configure ResourceManager HA using Ambari • Summarize the Purpose and Operation of Ambari Metrics • Describe Features and Benefits of the Ambari Dashboard • Summarize the Purpose and Operation of Ambari Alerts • Configure Ambari Alerts • Summarize Hadoop Backup Considerations • Enable and Manage HDFS Snapshots • Copy Data Using DistCp • Use Snapshots and DistCp Together • Identify the Purpose and Operation of Heterogeneous HDFS Storage • Identify HDFS NFS Gateway Use Cases • Install and Configure an HDFS NFS Gateway • Summarize the Purpose and Operation of HDFS Centralized Caching DAY 4 LABS • Configuring NameNode High Availability • Configuring ResourceManager High Availability • Managing Apache Ambari Alerts • Managing HDFS Snapshots • Using DistCP • Configuring HDFS Storage Policies • Configuring an NFS Gateway • Configuring HDFS Centralized Cache About Hortonworks Hortonworks is a leading innovator at creating, distributing and supporting enterprise-ready open data platforms. Our mission is to manage the world’s data. We have a single-minded focus on driving innovation in open source communities such as Apache Hadoop, NiFi, and Spark. Our open Connected Data Platforms power Modern Data Applications that deliver actionable intelligence from all data: data-in-motion and data-at-rest. Along with our 1600+ partners, we provide the expertise, training and services that allows our customers to unlock the transformational value of data across any line of business. We are Powering the Future of Data™. Contact For further information visit www.hortonworks.com +1 408 675-0983 +1 855 8-HORTON INTL: +44 (0) 20 3826 1405 © 2011-2016 Hortonworks Inc. All Rights Reserved. Privacy Policy | Terms of Service DAY 5 OBJECTIVES • Configure YARN Queues, Tez, and Hive Properties to Support Performance Goals • Recall Basic Facts About Hive and the Hive Architecture • Recall the Requirements and Benefits of Hive HA • Summarize the Hive HA Architecture and Operation • Configure and Test Hive HA • Recall the Purpose, Job Types, Structure and Benefits of Oozie • Install and Configure Oozie using Ambari • Deploy and Manage a Sample Oozie Workflow • Identify Characteristics of Ambari Local Versus LDAP Users and Groups • Integrate Ambari Server with LDAP • Summarize the Purpose and Benefits of Ambari Blueprints • Recall the Process Used to Deploy a Cluster Using Ambari Blueprints • Configure Ambari Blueprints Logical Cluster Configuration Files • Recall the Definition of an HDP Stack and Interpret its Version Number • View the Current Stack and Identify Compatible Ambari Software Versions • Recall the Types and Methods of Upgrades Available in HDP • Describe the Rolling Upgrade Process, Restrictions, and Pre-Upgrade Checklist • Perform a Rolling Upgrade Using the Ambari Web UI DAY 5 LABS • Configuring Apache Hive High Availability • Managing Workflows Using Apache Oozie • Integrating Apache Ambari with AD/LDAP • Automating Cluster Provisioning using Apache Ambari • Performing an HDP Upgrade Revised 02/27/2018 About Hortonworks Hortonworks is a leading innovator at creating, distributing and supporting enterprise-ready open data platforms. Our mission is to manage the world’s data. We have a single-minded focus on driving innovation in open source communities such as Apache Hadoop, NiFi, and Spark. Our open Connected Data Platforms power Modern Data Applications that deliver actionable intelligence from all data: data-in-motion and data-at-rest. Along with our 1600+ partners, we provide the expertise, training and services that allows our customers to unlock the transformational value of data across any line of business. We are Powering the Future of Data™. Contact For further information visit www.hortonworks.com +1 408 675-0983 +1 855 8-HORTON INTL: +44 (0) 20 3826 1405 © 2011-2016 Hortonworks Inc. All Rights Reserved. Privacy Policy | Terms of Service .
Load more

Recommended publications
  • Extended Version
    Sina Sheikholeslami C u rriculum V it a e ( Last U pdated N ovember 2 0 18) Website: http://sinash.ir Present Address : https://www.kth.se/profile/sinash EIT Digital Stockholm CLC , https://linkedin.com/in/sinasheikholeslami Isafjordsgatan 26, Email: si [email protected] 164 40 Kista (Stockholm), [email protected] Sweden [email protected] Educational Background: • M.Sc. Student of Data Science, Eindhoven University of Technology & KTH Royal Institute of Technology, Under EIT-Digital Master School. 2017-Present. • B.Sc. in Computer Software Engineering, Department of Computer Engineering and Information Technology, Amirkabir University of Technology (Tehran Polytechnic). 2011-2016. • Mirza Koochak Khan Pre-College in Mathematics and Physics, Rasht, National Organization for Development of Exceptional Talents (NODET). Overall GPA: 19.61/20. 2010-2011. • Mirza Koochak Khan Highschool in Mathematics and Physics, Rasht, National Organization for Development of Exceptional Talents (NODET). Overall GPA: 19.17/20, Final Year's GPA: 19.66/20. 2007-2010. Research Fields of Interest: • Distributed Deep Learning, Hyperparameter Optimization, AutoML, Data Intensive Computing Bachelor's Thesis: • “SDMiner: A Tool for Mining Data Streams on Top of Apache Spark”, Under supervision of Dr. Amir H. Payberah (Defended on June 29th 2016). Computer Skills: • Programming Languages & Markups: o F luent in Java, Python, Scala, JavaS cript, C/C++, A ndroid Pr ogram Develop ment o Familia r wit h R, SAS, SQL , Nod e.js, An gula rJS, HTM L, JSP •
    [Show full text]
  • Poweredge R640 Apache Hadoop
    A Principled Technologies report: Hands-on testing. Real-world results. The science behind the report: Run compute-intensive Apache Hadoop big data workloads faster with Dell EMC PowerEdge R640 servers This document describes what we tested, how we tested, and what we found. To learn how these facts translate into real-world benefits, read the report Run compute-intensive Apache Hadoop big data workloads faster with Dell EMC PowerEdge R640 servers. We concluded our hands-on testing on October 27, 2019. During testing, we determined the appropriate hardware and software configurations and applied updates as they became available. The results in this report reflect configurations that we finalized on October 15, 2019 or earlier. Unavoidably, these configurations may not represent the latest versions available when this report appears. Our results The table below presents the throughput each solution delivered when running the HiBench workloads. Dell EMC™ PowerEdge™ R640 Dell EMC PowerEdge R630 Percentage more throughput solution solution Latent Dirichlet Allocation 4.13 1.94 112% (MB/sec) Random Forest (MB/sec) 100.66 94.43 6% WordCount (GB/sec) 5.10 3.45 47% The table below presents the minutes each solution needed to complete the HiBench workloads. Dell EMC PowerEdge R640 Dell EMC PowerEdge R630 Percentage less time solution solution Latent Dirichlet Allocation 17.11 36.25 52% Random Forest 5.55 5.92 6% WordCount 4.95 7.32 32% Run compute-intensive Apache Hadoop big data workloads faster with Dell EMC PowerEdge R640 servers November 2019 System configuration information The table below presents detailed information on the systems we tested.
    [Show full text]
  • TR-4744: Secure Hadoop Using Apache Ranger with Netapp In
    Technical Report Secure Hadoop using Apache Ranger with NetApp In-Place Analytics Module Deployment Guide Karthikeyan Nagalingam, NetApp February 2019 | TR-4744 Abstract This document introduces the NetApp® In-Place Analytics Module for Apache Hadoop and Spark with Ranger. The topics covered in this report include the Ranger configuration, underlying architecture, integration with Hadoop, and benefits of Ranger with NetApp In-Place Analytics Module using Hadoop with NetApp ONTAP® data management software. TABLE OF CONTENTS 1 Introduction ........................................................................................................................................... 4 1.1 Overview .........................................................................................................................................................4 1.2 Deployment Options .......................................................................................................................................5 1.3 NetApp In-Place Analytics Module 3.0.1 Features ..........................................................................................5 2 Ranger ................................................................................................................................................... 6 2.1 Components Validated with Ranger ................................................................................................................6 3 NetApp In-Place Analytics Module Design with Ranger..................................................................
    [Show full text]
  • Hortonworks Data Platform
    Hortonworks Data Platform Apache Ambari Installation for IBM Power Systems (November 15, 2018) docs.cloudera.com Hortonworks Data Platform November 15, 2018 Hortonworks Data Platform: Apache Ambari Installation for IBM Power Systems Copyright © 2012-2018 Hortonworks, Inc. Some rights reserved. The Hortonworks Data Platform, powered by Apache Hadoop, is a massively scalable and 100% open source platform for storing, processing and analyzing large volumes of data. It is designed to deal with data from many sources and formats in a very quick, easy and cost-effective manner. The Hortonworks Data Platform consists of the essential set of Apache Hadoop projects including MapReduce, Hadoop Distributed File System (HDFS), HCatalog, Pig, Hive, HBase, ZooKeeper and Ambari. Hortonworks is the major contributor of code and patches to many of these projects. These projects have been integrated and tested as part of the Hortonworks Data Platform release process and installation and configuration tools have also been included. Unlike other providers of platforms built using Apache Hadoop, Hortonworks contributes 100% of our code back to the Apache Software Foundation. The Hortonworks Data Platform is Apache-licensed and completely open source. We sell only expert technical support, training and partner-enablement services. All of our technology is, and will remain free and open source. Please visit the Hortonworks Data Platform page for more information on Hortonworks technology. For more information on Hortonworks services, please visit either the Support or Training page. Feel free to Contact Us directly to discuss your specific needs. Except where otherwise noted, this document is licensed under Creative Commons Attribution ShareAlike 4.0 License.
    [Show full text]
  • Professional Summary Technical Skills
    PROF ESSIONAL SUMMARY • Over 7.5 years of professional IT experience in analysis, design, development and implementation, support of Enterprise Application Integration. • Experience in installation, configuration, deployment and troubleshooting of TIBCO Active Enterprise Suite of applications TIBCO BusinessWorks, TIBCO Designer, TIBCO Rendezvous, TIBCO EMS, TIBCO Administrator and TIBCO Spotfire. • Good hands on experience in Web Services using SOAP, WSDL and Schemas XSD with strong skills in understanding and implementing Service Oriented Architecture (SOA). • Knowledge in using TIBCO Administrator for User Management, Resource Management and Application Management. • Well conversant in using TIBCO messaging standards including EMS and Rendezvous. • Deployed BusinessWorks interfaces for Fault Tolerance and Load balancing modes. • Knowledge and Experience in handling and supporting (L3) ESB architecture. • Having experience in Application development, deployment, debugging and troubleshooting. • Extensively handled overall responsibility Project deployment to SIT, UAT and PROD Environment using UNIX and TIBCO Admin. • Experience of analysing and defect fixing in SIT and UAT Environment. • Well conversant in Handling Technical Interview Sessions. • Experience of Project planning, Tracking, Risk analysis, counter action deployment. • Good Interpersonal, Analytic, Leadership, Verbal and Written skills. • Highly intuitive, self-motivated and energetic team player and adaptable to challenging environments. TECHNICAL SKILLS • Tibco Skills : TIBCO Business works, TIBCO iProcess, TIBCO AMX BPM suites, TIBCO Business Events, TIBCO Spotfire, TIBCO Active Space, TIBCO Administrator, TIBCO EMS, TIBCO RV, TIBCO Adapters, TIBCO Hawk, ESB and SOA frameworks. • Language: Java, J2EE (JDBC, RMI, Servlets, JSP, EJB, JMS), C, C++, C#, SQL, PL/SQL, XML, shell script. • DataBase: Oracle 8, 8i, 9i, 10g,SQL, PostgreSQL • Open Source: Apache Kafka, Apache Nifi, Apache Ambari, HDP Administration.
    [Show full text]
  • HPC-ABDS High Performance Computing Enhanced Apache Big Data Stack
    HPC-ABDS High Performance Computing Enhanced Apache Big Data Stack Geoffrey C. Fox, Judy Qiu, Supun Kamburugamuve Shantenu Jha, Andre Luckow School of Informatics and Computing RADICAL Indiana University Rutgers University Bloomington, IN 47408, USA Piscataway, NJ 08854, USA fgcf, xqiu, [email protected] [email protected], [email protected] Abstract—We review the High Performance Computing En- systems as they illustrate key capabilities and often motivate hanced Apache Big Data Stack HPC-ABDS and summarize open source equivalents. the capabilities in 21 identified architecture layers. These The software is broken up into layers so that one can dis- cover Message and Data Protocols, Distributed Coordination, Security & Privacy, Monitoring, Infrastructure Management, cuss software systems in smaller groups. The layers where DevOps, Interoperability, File Systems, Cluster & Resource there is especial opportunity to integrate HPC are colored management, Data Transport, File management, NoSQL, SQL green in figure. We note that data systems that we construct (NewSQL), Extraction Tools, Object-relational mapping, In- from this software can run interoperably on virtualized or memory caching and databases, Inter-process Communication, non-virtualized environments aimed at key scientific data Batch Programming model and Runtime, Stream Processing, High-level Programming, Application Hosting and PaaS, Li- analysis problems. Most of ABDS emphasizes scalability braries and Applications, Workflow and Orchestration. We but not performance and one of our goals is to produce summarize status of these layers focusing on issues of impor- high performance environments. Here there is clear need tance for data analytics. We highlight areas where HPC and for better node performance and support of accelerators like ABDS have good opportunities for integration.
    [Show full text]
  • Code Smell Prediction Employing Machine Learning Meets Emerging Java Language Constructs"
    Appendix to the paper "Code smell prediction employing machine learning meets emerging Java language constructs" Hanna Grodzicka, Michał Kawa, Zofia Łakomiak, Arkadiusz Ziobrowski, Lech Madeyski (B) The Appendix includes two tables containing the dataset used in the paper "Code smell prediction employing machine learning meets emerging Java lan- guage constructs". The first table contains information about 792 projects selected for R package reproducer [Madeyski and Kitchenham(2019)]. Projects were the base dataset for cre- ating the dataset used in the study (Table I). The second table contains information about 281 projects filtered by Java version from build tool Maven (Table II) which were directly used in the paper. TABLE I: Base projects used to create the new dataset # Orgasation Project name GitHub link Commit hash Build tool Java version 1 adobe aem-core-wcm- www.github.com/adobe/ 1d1f1d70844c9e07cd694f028e87f85d926aba94 other or lack of unknown components aem-core-wcm-components 2 adobe S3Mock www.github.com/adobe/ 5aa299c2b6d0f0fd00f8d03fda560502270afb82 MAVEN 8 S3Mock 3 alexa alexa-skills- www.github.com/alexa/ bf1e9ccc50d1f3f8408f887f70197ee288fd4bd9 MAVEN 8 kit-sdk-for- alexa-skills-kit-sdk- java for-java 4 alibaba ARouter www.github.com/alibaba/ 93b328569bbdbf75e4aa87f0ecf48c69600591b2 GRADLE unknown ARouter 5 alibaba atlas www.github.com/alibaba/ e8c7b3f1ff14b2a1df64321c6992b796cae7d732 GRADLE unknown atlas 6 alibaba canal www.github.com/alibaba/ 08167c95c767fd3c9879584c0230820a8476a7a7 MAVEN 7 canal 7 alibaba cobar www.github.com/alibaba/
    [Show full text]
  • Kylo Data Lakes Configuration Deployed in Public Cloud Environments in Single Node Mode
    Master of Science in Computer Science September 2019 Kylo Data Lakes Configuration deployed in Public Cloud environments in Single Node Mode Rong Peng Faculty of Computing, Blekinge Institute of Technology, 371 79 Karlskrona, Sweden This thesis is submitted to the Faculty of Computing at Blekinge Institute of Technology in partial fulfilment of the requirements for the degree of Master of Science in Computer Science. The thesis is equivalent to 20 weeks of full time studies. The authors declare that they are the sole authors of this thesis and that they have not used any sources other than those listed in the bibliography and identified as references. They further declare that they have not submitted this thesis at any other institution to obtain a degree. Contact Information: Author(s): Rong Peng E-mail: [email protected] University advisor: Dr. Emiliano Casalicchio Department of Computer Science Industrial advisors: Kim Hindart Daniel Gustafsson City Network Hosting AB Faculty of Computing Internet : www.bth.se Blekinge Institute of Technology Phone : +46 455 38 50 00 SE-371 79 Karlskrona, Sweden Fax : +46 455 38 50 57 2 ABSTRACT Data Lake is a platform for centralized storage of massive, multiple sources and multiple types of data, and can quickly process and analyze data. It is essentially an advanced enterprise data architecture. The high demand for big data storage and analytics leads data lake emerging nowadays. Organizations hope to generate business profit from their data by building a data lake. However, it is worth noting that the promising concept of data lake is still evolving today.
    [Show full text]
  • Apache Ambari Operations (May 17, 2018)
    Hortonworks Data Platform Apache Ambari Operations (May 17, 2018) docs.cloudera.com Hortonworks Data Platform May 17, 2018 Hortonworks Data Platform: Apache Ambari Operations Copyright © 2012-2018 Hortonworks, Inc. Some rights reserved. The Hortonworks Data Platform, powered by Apache Hadoop, is a massively scalable and 100% open source platform for storing, processing and analyzing large volumes of data. It is designed to deal with data from many sources and formats in a very quick, easy and cost-effective manner. The Hortonworks Data Platform consists of the essential set of Apache Hadoop projects including MapReduce, Hadoop Distributed File System (HDFS), HCatalog, Pig, Hive, HBase, ZooKeeper and Ambari. Hortonworks is the major contributor of code and patches to many of these projects. These projects have been integrated and tested as part of the Hortonworks Data Platform release process and installation and configuration tools have also been included. Unlike other providers of platforms built using Apache Hadoop, Hortonworks contributes 100% of our code back to the Apache Software Foundation. The Hortonworks Data Platform is Apache-licensed and completely open source. We sell only expert technical support, training and partner-enablement services. All of our technology is, and will remain free and open source. Please visit the Hortonworks Data Platform page for more information on Hortonworks technology. For more information on Hortonworks services, please visit either the Support or Training page. Feel free to Contact Us directly to discuss your specific needs. Except where otherwise noted, this document is licensed under Creative Commons Attribution ShareAlike 4.0 License. http://creativecommons.org/licenses/by-sa/4.0/legalcode ii Hortonworks Data Platform May 17, 2018 Table of Contents 1.
    [Show full text]
  • Apache Ambari Troubleshooting (May 19, 2017)
    Hortonworks Data Platform Apache Ambari Troubleshooting (May 19, 2017) docs.cloudera.com hdp-ambari-troubleshooting May 19, 2017 Hortonworks Data Platform: Apache Ambari Troubleshooting Copyright © 2012-2016 Hortonworks, Inc. All rights reserved. The Hortonworks Data Platform, powered by Apache Hadoop, is a massively scalable and 100% open source platform for storing, processing and analyzing large volumes of data. It is designed to deal with data from many sources and formats in a very quick, easy and cost-effective manner. The Hortonworks Data Platform consists of the essential set of Apache Hadoop projects including MapReduce, Hadoop Distributed File System (HDFS), HCatalog, Pig, Hive, HBase, ZooKeeper and Ambari. Hortonworks is the major contributor of code and patches to many of these projects. These projects have been integrated and tested as part of the Hortonworks Data Platform release process and installation and configuration tools have also been included. Unlike other providers of platforms built using Apache Hadoop, Hortonworks contributes 100% of our code back to the Apache Software Foundation. The Hortonworks Data Platform is Apache-licensed and completely open source. We sell only expert technical support, training and partner-enablement services. All of our technology is, and will remain free and open source. Please visit the Hortonworks Data Platform page for more information on Hortonworks technology. For more information on Hortonworks services, please visit either the Support or Training page. Feel free to Contact Us directly to discuss your specific needs. Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
    [Show full text]
  • Koverse Release 2.7
    Koverse Release 2.7 Sep 12, 2018 Contents 1 Quick Start Guide 1 2 Usage Guide 17 3 Administration Guide 75 4 Developer Documentation 113 5 Access Control 169 i ii CHAPTER 1 Quick Start Guide This Quick Start guide for Koverse is intended for users who want to get up and running quickly with Koverse. It steps through the installation of Koverse, ingesting data and executing queries. Check out the Koverse User Guide for complete documentation of all features and installation instructions. 1.1 Recommendations The recommended Operating System is RHEL 6.x or Centos 6.x. Recommended Hadoop Release is Cloudera Manager 5.5 with Accumulo 1.7 Parcel and Service installed. See http: //www.cloudera.com/documentation/other/accumulo/latest/PDF/Apache-Accumulo-Installation-Guide.pdf for more details. Recommended Koverse release can be found at http://repo.koverse.com/latest/csd 1.1.1 Infrastructure and Software Koverse and the open source software it leverages must be run on a system with no less than 10 GB of memory. For workloads beyond simple examples and testing we recommend a properly provisioned Hadoop cluster with five or more nodes. Using the Cloudera QuickStart VM is not recommended. See http://www.koverse.com/question/ using-the-cloudera-quick-start-vim-and-the-koverse-parcel for more information. 1 Koverse, Release 2.7 1.2 Installation 1.2.1 Amazon Web Services Installation Using Koverse with AWS Marketplace The paid AMI available in the AWS marketplace is an easy way to get a Koverse instance up and running if you do not need to install on existing infrastructure.
    [Show full text]
  • Testsmelldescriber Enabling Developers’ Awareness on Test Quality with Test Smell Summaries
    Bachelor Thesis January 31, 2018 TestSmellDescriber Enabling Developers’ Awareness on Test Quality with Test Smell Summaries Ivan Taraca of Pfullendorf, Germany (13-751-896) supervised by Prof. Dr. Harald C. Gall Dr. Sebastiano Panichella software evolution & architecture lab Bachelor Thesis TestSmellDescriber Enabling Developers’ Awareness on Test Quality with Test Smell Summaries Ivan Taraca software evolution & architecture lab Bachelor Thesis Author: Ivan Taraca, [email protected] URL: http://bit.ly/2DUiZrC Project period: 20.10.2018 - 31.01.2018 Software Evolution & Architecture Lab Department of Informatics, University of Zurich Acknowledgements First of all, I like to thank Dr. Harald Gall for giving me the opportunity to write this thesis at the Software Evolution & Architecture Lab. Special thanks goes out to Dr. Sebastiano Panichella for his instructions, guidance and help during the making of this thesis, without whom this would not have been possible. I would also like to express my gratitude to Dr. Fabio Polomba, Dr. Yann-Gaël Guéhéneuc and Dr. Nikolaos Tsantalis for providing me access to their research and always being available for questions. Last, but not least, do I want to thank my parents, sisters and nephews for the support and love they’ve given all those years. Abstract With the importance of software in today’s society, malfunctioning software can not only lead to disrupting our day-to-day lives, but also large monetary damages. A lot of time and effort goes into the development of test suites to ensure the quality and accuracy of software. But how do we elevate the quality of test code? This thesis presents TestSmellDescriber, a tool with the ability to generate descriptions detailing potential problems in test cases, which are collected by conducting a Test Smell analysis.
    [Show full text]