Interset 5.9.3 Installation and Configuration Guide Interset 5.9.3 Installation and Configuration Guide

Total Page:16

File Type:pdf, Size:1020Kb

Interset 5.9.3 Installation and Configuration Guide Interset 5.9.3 Installation and Configuration Guide Micro Focus Interset 5.9.3 Installation and Configuration Guide Interset 5.9.3 Installation and Configuration Guide © Copyright 2020 Micro Focus or one of its affiliates. The only warranties for products and services of Micro Focus and its affiliates and licensors (“Micro Focus”) are as may be set forth in the express warranty statements accompanying such products and ser- vices. Nothing herein should be construed as constituting an additional warranty. Micro Focus shall not be liable for technical or editorial errors or omissions contained herein. The information contained herein is sub- ject to change without notice. Except as specifically indicated otherwise, this document contains confidential information and a valid license is required for possession, use or copying. If this work is provided to the U.S. Government, con- sistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Docu- mentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor's standard commercial license. - 2 - Interset 5.9.3 Installation and Configuration Guide Contents Introduction 7 Supported Environments 7 Supported Data Sources 9 Intended Audience 10 Installation 10 How to Use This Guide 11 Additional Support 12 Prerequisites 13 Interset Cluster Components 15 Interset Components 15 Third-party Components 15 Component Distribution 18 Interset Configuration 18 Create a Local YUM Repository for Offline Installation 22 Install a New Interset Cluster 25 Copy and Untar the Interset Installer Archive 27 Edit the Interset Installer Configuration File 28 Edit the Secure Properties File 30 Download Oracle JDK 8 and the Java Cryptography Extension (JCE) 31 Perform the Base Configuration of All Nodes 32 Install the Ambari Server 35 Install the Ambari Cluster 39 Change the Ambari Administrator Password 49 Configure Ambari Managed Services 51 Install Cloudera Manager 52 Install the Cloudera Cluster 53 Add Services 57 Configure Cloudera Managed Services 60 - 3 - Interset 5.9.3 Installation and Configuration Guide Generate the TLS Certificates 62 Configure the Key Distribution Centre (KDC) 63 Configure Kerberos on Ambari 64 Configure Ambari with TLS 67 Configure Kerberos on Cloudera 69 Configure Cloudera with TLS 69 Install the Interset Schema Registry 70 Configure the Master Node 71 Configure the Stream Node 72 Configure the Search Node 73 Configure the Reporting Node 74 Configure Authentication 77 Local Interset Authentication 77 LDAP Authentication 78 SAML Authentication 81 Configure Single Sign-on with SAML and Okta 92 Configure Workflow 94 Install Apache Nifi 97 Configure a New Data Source 98 Configure an SSL Context Service 99 Create a Process Group 100 Configure the Schema Registry 100 Enable the Controller Services 101 Configure the Data Flow 101 Start the Data Flow 107 Run Analytics 110 Running Analytics in a secure environment 110 Configure the Search Indexes 111 Enable Windowed Analytics 116 Configure the 'Peek-Back' Window for Windowed Analytics 116 - 4 - Interset 5.9.3 Installation and Configuration Guide Appendix A: Configure the Sample Data 118 Create the Samples Tenant 118 Create an Administrator User for the Samples Tenant 118 Copy the Interset Sample Datasets 119 Configure the Sample Authentication Data Source 119 Run Analytics 119 Appendix B: Run the Enable Kerberos Wizard on Cloudera 120 Getting Started 120 Setup KDC 121 Manage krb5.conf 122 Setup KDC Account 123 Configure Kerberos 124 Summary 124 Appendix C: Optional Installations and Configurations 125 Configure Redundancy & High Availability (Optional) 125 Enable HDP Services (e.g. HBase, HDFS, Storm, YARN, ZooKeeper) High Availability 125 Enable HDFS High Availability (HA) 128 Enable YARN High Availability 129 Enable HBase High Availability 129 Enable Storm High Availability (HA) 130 Enable ZooKeeper High Availability 131 Enable Elasticsearch High Availability 132 Configure DXL (Optional) 132 Set Up the McAfee ESM Parser 135 Configure Splunk (Optional) 136 Edit the rules.conf Configuration File 136 Restart the Workflow Engine 136 Configure the Splunk KV_MODE 137 Configure Phantom (Optional) 137 Configure the Phantom API 137 - 5 - Interset 5.9.3 Installation and Configuration Guide Edit the rules.conf Configuration File 137 Validate the Phantom Integration 138 Appendix D: Configure NiFi To Use LDAP 139 nifi.properties 139 login-identity-provider.xml 140 authorizers.xml 141 Multiple NiFi nodes: Node Identity Provider 143 Secured Enviornment certificates 144 Appendix E: Add New Nodes to an Existing Cloudera Cluster 145 Appendix F: Assigning services to a New node in Cloudera 150 Index 152 - 6 - Interset 5.9.3 Installation and Configuration Guide Introduction This guide describes how to install and configure Interset 5.9.3. It also provides an overview of the Interset cluster requirements, dependencies, components, and best practices information. Interset uses data science and advanced analytics to identify the top risky entities and behaviors occur- ring in your organization. Using your organization's data, Interset establishes the normal behavior for your organizational entities and then, using advanced analytics, identifies the anomalous behaviors that con- stitute potential risks such as compromised accounts, insider threats, or other cyber threats. Interset's innovative user experience, true machine learning, and big data platform easily identify and pri- oritize high risk anomalies, allowing your security practitioners to instantly explore the underlying raw event data. The Interset analytical models apply risk scores to individual users to provide security teams with relevant, prioritized information quickly enough to stop the activity before data loss occurs. Interset is a server-based product that is deployed in a clustered configuration. This means that the soft- ware is distributed across multiple machines, where each machine (which can be a physical machine or a virtual machine running on a VM server such as VMware ESX) is called a node. The distribution of load and responsibilities across multiple nodes is what makes the Interset solution a scalable system that can handle large amounts of data: the more nodes in your deployment, the more data Interset can handle. Important: This guide provides instructions for the secure installation and configuration of Inter- set software and its associated platform. For information about installing Interset in an unsecured environment, Contact Micro Focus Customer Support at https://soft- waresupport.softwaregrp.com/. We recommend that you deploy the Interset product and platform in a segregated net- work with as little external access as possible (for example, exposing only the ports required for installation to the IP address(es) performing the installation -- TCP 22, 443, 8080). Following the installation, additional exceptions should be created for management and end-user networks. Whenever possible, we recommend that end-users have access only to the Report- ing node on TCP 443; this provides access to the Interset UI and API. Admin- istrators should have significantly broader access, and it is generally recommended that this be handled via firewall rules and/or SSH tunnelling. Supported Environments Interset Analytics 5.9.3 is supported in the following x86_64 environments: l CentOS 7.6 l Red Hat Enterprise 7.6 - 7 - Interset 5.9.3 Installation and Configuration Guide Interset 5.9.3 is supported with the following third-party components: l Oracle OpenJDK 8u201/211 l Elasticsearch 6.8.1 Interset 5.9.3 is supported with HDP 3.1.0, including the following components: Ambari 2.7.3.0 AsyncHBase 1.8.2 Avro 1.8.2 Hadoop 3.1.1 HBase 2.0.2 Hortonworks Schema Registry 0.5.3 Kafka 2.0.0 NiFi 1.10.0 Phoenix 5.0.0 Scala 2.11.8 Spark 2.3.2 Storm 1.2.1 ZooKeeper 3.4.6 TLS 1.2 - 8 - Interset 5.9.3 Installation and Configuration Guide Interset 5.9.3 is supported with CDH 6.1.1, including the following components: AsyncHBase 1.8.2 Avro 1.8.2 Hadoop 3.0.0 HBase 2.1.1 Hortonworks Schema Registry 0.5.3 Kafka 2.0 NiFi 1.10.0 Phoenix 5.0.0-HBase-2.1.0-cdh6.1.1 Scala 2.11.8 Spark 2.4 Storm 1.2.1 ZooKeeper 3.4.5 TLS 1.2 Interset 5.9.3 supports the following Web browsers: l Google Chrome 74 and above l Mozilla Firefox 67 and above Supported Data Sources Interset 5.9.3 supports the following data sources. For .csv data sources, the delimiter can be customized. l Active Directory ® l Active Directory event logs stored in McAfee Enterprise Security Manager (ESM) ® l Active Directory event logs stored in Splunk l Active Directory event logs stored in Micro Focus ArcSight Logger l Active Directory event logs stored in IBM QRadar l Windows Security event logs (.csv) l Interset-extracted Windows event logs (.csv) l Universal Windows event logs (.csv) l Windows Event Viewer-extracted event logs (.csv) l Active Directory authentication logs l Universal Alerts stored in third-party DLP systems (.csv) l NetFlow l Version 5 l Version 9 l Version 10 (IPFIX) - 9 - Interset 5.9.3 Installation and Configuration Guide l Repository l Perforce l P4AUDIT logs l Perforce Structured Server audit logs l GitHub Enterprise audit logs l Universal repository logs (.csv) l Pluggable Authentication Module (PAM) AuditD logs (.csv) l Printer logs l Windows printer events stored in Splunk l Windows event logs (.csv) l Universal logs (.csv) l Universal Web Proxy (.csv) l Violations l Email Data l VPN Interset 5.9.3 data ingest uses NiFi for data extraction, transformation, and loading. It supports the pro- cessing of data set files in the following compression formats: l tar l gzip l tar gzip To ingest packaged data from other containers such as Arcsight, IBM QRadar, McAfee ESM, and Splunk, please contact Micro Focus Customer Support at https://softwaresupport.softwaregrp.com/. Intended Audience This Guide assumes that you are an experienced system administrator with sound Linux skills and are familiar with your organization's server environment, security infrastructure, and data sources.
Recommended publications
  • Extended Version
    Sina Sheikholeslami C u rriculum V it a e ( Last U pdated N ovember 2 0 18) Website: http://sinash.ir Present Address : https://www.kth.se/profile/sinash EIT Digital Stockholm CLC , https://linkedin.com/in/sinasheikholeslami Isafjordsgatan 26, Email: si [email protected] 164 40 Kista (Stockholm), [email protected] Sweden [email protected] Educational Background: • M.Sc. Student of Data Science, Eindhoven University of Technology & KTH Royal Institute of Technology, Under EIT-Digital Master School. 2017-Present. • B.Sc. in Computer Software Engineering, Department of Computer Engineering and Information Technology, Amirkabir University of Technology (Tehran Polytechnic). 2011-2016. • Mirza Koochak Khan Pre-College in Mathematics and Physics, Rasht, National Organization for Development of Exceptional Talents (NODET). Overall GPA: 19.61/20. 2010-2011. • Mirza Koochak Khan Highschool in Mathematics and Physics, Rasht, National Organization for Development of Exceptional Talents (NODET). Overall GPA: 19.17/20, Final Year's GPA: 19.66/20. 2007-2010. Research Fields of Interest: • Distributed Deep Learning, Hyperparameter Optimization, AutoML, Data Intensive Computing Bachelor's Thesis: • “SDMiner: A Tool for Mining Data Streams on Top of Apache Spark”, Under supervision of Dr. Amir H. Payberah (Defended on June 29th 2016). Computer Skills: • Programming Languages & Markups: o F luent in Java, Python, Scala, JavaS cript, C/C++, A ndroid Pr ogram Develop ment o Familia r wit h R, SAS, SQL , Nod e.js, An gula rJS, HTM L, JSP •
    [Show full text]
  • Poweredge R640 Apache Hadoop
    A Principled Technologies report: Hands-on testing. Real-world results. The science behind the report: Run compute-intensive Apache Hadoop big data workloads faster with Dell EMC PowerEdge R640 servers This document describes what we tested, how we tested, and what we found. To learn how these facts translate into real-world benefits, read the report Run compute-intensive Apache Hadoop big data workloads faster with Dell EMC PowerEdge R640 servers. We concluded our hands-on testing on October 27, 2019. During testing, we determined the appropriate hardware and software configurations and applied updates as they became available. The results in this report reflect configurations that we finalized on October 15, 2019 or earlier. Unavoidably, these configurations may not represent the latest versions available when this report appears. Our results The table below presents the throughput each solution delivered when running the HiBench workloads. Dell EMC™ PowerEdge™ R640 Dell EMC PowerEdge R630 Percentage more throughput solution solution Latent Dirichlet Allocation 4.13 1.94 112% (MB/sec) Random Forest (MB/sec) 100.66 94.43 6% WordCount (GB/sec) 5.10 3.45 47% The table below presents the minutes each solution needed to complete the HiBench workloads. Dell EMC PowerEdge R640 Dell EMC PowerEdge R630 Percentage less time solution solution Latent Dirichlet Allocation 17.11 36.25 52% Random Forest 5.55 5.92 6% WordCount 4.95 7.32 32% Run compute-intensive Apache Hadoop big data workloads faster with Dell EMC PowerEdge R640 servers November 2019 System configuration information The table below presents detailed information on the systems we tested.
    [Show full text]
  • TR-4744: Secure Hadoop Using Apache Ranger with Netapp In
    Technical Report Secure Hadoop using Apache Ranger with NetApp In-Place Analytics Module Deployment Guide Karthikeyan Nagalingam, NetApp February 2019 | TR-4744 Abstract This document introduces the NetApp® In-Place Analytics Module for Apache Hadoop and Spark with Ranger. The topics covered in this report include the Ranger configuration, underlying architecture, integration with Hadoop, and benefits of Ranger with NetApp In-Place Analytics Module using Hadoop with NetApp ONTAP® data management software. TABLE OF CONTENTS 1 Introduction ........................................................................................................................................... 4 1.1 Overview .........................................................................................................................................................4 1.2 Deployment Options .......................................................................................................................................5 1.3 NetApp In-Place Analytics Module 3.0.1 Features ..........................................................................................5 2 Ranger ................................................................................................................................................... 6 2.1 Components Validated with Ranger ................................................................................................................6 3 NetApp In-Place Analytics Module Design with Ranger..................................................................
    [Show full text]
  • Hortonworks Data Platform
    Hortonworks Data Platform Apache Ambari Installation for IBM Power Systems (November 15, 2018) docs.cloudera.com Hortonworks Data Platform November 15, 2018 Hortonworks Data Platform: Apache Ambari Installation for IBM Power Systems Copyright © 2012-2018 Hortonworks, Inc. Some rights reserved. The Hortonworks Data Platform, powered by Apache Hadoop, is a massively scalable and 100% open source platform for storing, processing and analyzing large volumes of data. It is designed to deal with data from many sources and formats in a very quick, easy and cost-effective manner. The Hortonworks Data Platform consists of the essential set of Apache Hadoop projects including MapReduce, Hadoop Distributed File System (HDFS), HCatalog, Pig, Hive, HBase, ZooKeeper and Ambari. Hortonworks is the major contributor of code and patches to many of these projects. These projects have been integrated and tested as part of the Hortonworks Data Platform release process and installation and configuration tools have also been included. Unlike other providers of platforms built using Apache Hadoop, Hortonworks contributes 100% of our code back to the Apache Software Foundation. The Hortonworks Data Platform is Apache-licensed and completely open source. We sell only expert technical support, training and partner-enablement services. All of our technology is, and will remain free and open source. Please visit the Hortonworks Data Platform page for more information on Hortonworks technology. For more information on Hortonworks services, please visit either the Support or Training page. Feel free to Contact Us directly to discuss your specific needs. Except where otherwise noted, this document is licensed under Creative Commons Attribution ShareAlike 4.0 License.
    [Show full text]
  • Professional Summary Technical Skills
    PROF ESSIONAL SUMMARY • Over 7.5 years of professional IT experience in analysis, design, development and implementation, support of Enterprise Application Integration. • Experience in installation, configuration, deployment and troubleshooting of TIBCO Active Enterprise Suite of applications TIBCO BusinessWorks, TIBCO Designer, TIBCO Rendezvous, TIBCO EMS, TIBCO Administrator and TIBCO Spotfire. • Good hands on experience in Web Services using SOAP, WSDL and Schemas XSD with strong skills in understanding and implementing Service Oriented Architecture (SOA). • Knowledge in using TIBCO Administrator for User Management, Resource Management and Application Management. • Well conversant in using TIBCO messaging standards including EMS and Rendezvous. • Deployed BusinessWorks interfaces for Fault Tolerance and Load balancing modes. • Knowledge and Experience in handling and supporting (L3) ESB architecture. • Having experience in Application development, deployment, debugging and troubleshooting. • Extensively handled overall responsibility Project deployment to SIT, UAT and PROD Environment using UNIX and TIBCO Admin. • Experience of analysing and defect fixing in SIT and UAT Environment. • Well conversant in Handling Technical Interview Sessions. • Experience of Project planning, Tracking, Risk analysis, counter action deployment. • Good Interpersonal, Analytic, Leadership, Verbal and Written skills. • Highly intuitive, self-motivated and energetic team player and adaptable to challenging environments. TECHNICAL SKILLS • Tibco Skills : TIBCO Business works, TIBCO iProcess, TIBCO AMX BPM suites, TIBCO Business Events, TIBCO Spotfire, TIBCO Active Space, TIBCO Administrator, TIBCO EMS, TIBCO RV, TIBCO Adapters, TIBCO Hawk, ESB and SOA frameworks. • Language: Java, J2EE (JDBC, RMI, Servlets, JSP, EJB, JMS), C, C++, C#, SQL, PL/SQL, XML, shell script. • DataBase: Oracle 8, 8i, 9i, 10g,SQL, PostgreSQL • Open Source: Apache Kafka, Apache Nifi, Apache Ambari, HDP Administration.
    [Show full text]
  • HPC-ABDS High Performance Computing Enhanced Apache Big Data Stack
    HPC-ABDS High Performance Computing Enhanced Apache Big Data Stack Geoffrey C. Fox, Judy Qiu, Supun Kamburugamuve Shantenu Jha, Andre Luckow School of Informatics and Computing RADICAL Indiana University Rutgers University Bloomington, IN 47408, USA Piscataway, NJ 08854, USA fgcf, xqiu, [email protected] [email protected], [email protected] Abstract—We review the High Performance Computing En- systems as they illustrate key capabilities and often motivate hanced Apache Big Data Stack HPC-ABDS and summarize open source equivalents. the capabilities in 21 identified architecture layers. These The software is broken up into layers so that one can dis- cover Message and Data Protocols, Distributed Coordination, Security & Privacy, Monitoring, Infrastructure Management, cuss software systems in smaller groups. The layers where DevOps, Interoperability, File Systems, Cluster & Resource there is especial opportunity to integrate HPC are colored management, Data Transport, File management, NoSQL, SQL green in figure. We note that data systems that we construct (NewSQL), Extraction Tools, Object-relational mapping, In- from this software can run interoperably on virtualized or memory caching and databases, Inter-process Communication, non-virtualized environments aimed at key scientific data Batch Programming model and Runtime, Stream Processing, High-level Programming, Application Hosting and PaaS, Li- analysis problems. Most of ABDS emphasizes scalability braries and Applications, Workflow and Orchestration. We but not performance and one of our goals is to produce summarize status of these layers focusing on issues of impor- high performance environments. Here there is clear need tance for data analytics. We highlight areas where HPC and for better node performance and support of accelerators like ABDS have good opportunities for integration.
    [Show full text]
  • Code Smell Prediction Employing Machine Learning Meets Emerging Java Language Constructs"
    Appendix to the paper "Code smell prediction employing machine learning meets emerging Java language constructs" Hanna Grodzicka, Michał Kawa, Zofia Łakomiak, Arkadiusz Ziobrowski, Lech Madeyski (B) The Appendix includes two tables containing the dataset used in the paper "Code smell prediction employing machine learning meets emerging Java lan- guage constructs". The first table contains information about 792 projects selected for R package reproducer [Madeyski and Kitchenham(2019)]. Projects were the base dataset for cre- ating the dataset used in the study (Table I). The second table contains information about 281 projects filtered by Java version from build tool Maven (Table II) which were directly used in the paper. TABLE I: Base projects used to create the new dataset # Orgasation Project name GitHub link Commit hash Build tool Java version 1 adobe aem-core-wcm- www.github.com/adobe/ 1d1f1d70844c9e07cd694f028e87f85d926aba94 other or lack of unknown components aem-core-wcm-components 2 adobe S3Mock www.github.com/adobe/ 5aa299c2b6d0f0fd00f8d03fda560502270afb82 MAVEN 8 S3Mock 3 alexa alexa-skills- www.github.com/alexa/ bf1e9ccc50d1f3f8408f887f70197ee288fd4bd9 MAVEN 8 kit-sdk-for- alexa-skills-kit-sdk- java for-java 4 alibaba ARouter www.github.com/alibaba/ 93b328569bbdbf75e4aa87f0ecf48c69600591b2 GRADLE unknown ARouter 5 alibaba atlas www.github.com/alibaba/ e8c7b3f1ff14b2a1df64321c6992b796cae7d732 GRADLE unknown atlas 6 alibaba canal www.github.com/alibaba/ 08167c95c767fd3c9879584c0230820a8476a7a7 MAVEN 7 canal 7 alibaba cobar www.github.com/alibaba/
    [Show full text]
  • Kylo Data Lakes Configuration Deployed in Public Cloud Environments in Single Node Mode
    Master of Science in Computer Science September 2019 Kylo Data Lakes Configuration deployed in Public Cloud environments in Single Node Mode Rong Peng Faculty of Computing, Blekinge Institute of Technology, 371 79 Karlskrona, Sweden This thesis is submitted to the Faculty of Computing at Blekinge Institute of Technology in partial fulfilment of the requirements for the degree of Master of Science in Computer Science. The thesis is equivalent to 20 weeks of full time studies. The authors declare that they are the sole authors of this thesis and that they have not used any sources other than those listed in the bibliography and identified as references. They further declare that they have not submitted this thesis at any other institution to obtain a degree. Contact Information: Author(s): Rong Peng E-mail: [email protected] University advisor: Dr. Emiliano Casalicchio Department of Computer Science Industrial advisors: Kim Hindart Daniel Gustafsson City Network Hosting AB Faculty of Computing Internet : www.bth.se Blekinge Institute of Technology Phone : +46 455 38 50 00 SE-371 79 Karlskrona, Sweden Fax : +46 455 38 50 57 2 ABSTRACT Data Lake is a platform for centralized storage of massive, multiple sources and multiple types of data, and can quickly process and analyze data. It is essentially an advanced enterprise data architecture. The high demand for big data storage and analytics leads data lake emerging nowadays. Organizations hope to generate business profit from their data by building a data lake. However, it is worth noting that the promising concept of data lake is still evolving today.
    [Show full text]
  • Apache Ambari Operations (May 17, 2018)
    Hortonworks Data Platform Apache Ambari Operations (May 17, 2018) docs.cloudera.com Hortonworks Data Platform May 17, 2018 Hortonworks Data Platform: Apache Ambari Operations Copyright © 2012-2018 Hortonworks, Inc. Some rights reserved. The Hortonworks Data Platform, powered by Apache Hadoop, is a massively scalable and 100% open source platform for storing, processing and analyzing large volumes of data. It is designed to deal with data from many sources and formats in a very quick, easy and cost-effective manner. The Hortonworks Data Platform consists of the essential set of Apache Hadoop projects including MapReduce, Hadoop Distributed File System (HDFS), HCatalog, Pig, Hive, HBase, ZooKeeper and Ambari. Hortonworks is the major contributor of code and patches to many of these projects. These projects have been integrated and tested as part of the Hortonworks Data Platform release process and installation and configuration tools have also been included. Unlike other providers of platforms built using Apache Hadoop, Hortonworks contributes 100% of our code back to the Apache Software Foundation. The Hortonworks Data Platform is Apache-licensed and completely open source. We sell only expert technical support, training and partner-enablement services. All of our technology is, and will remain free and open source. Please visit the Hortonworks Data Platform page for more information on Hortonworks technology. For more information on Hortonworks services, please visit either the Support or Training page. Feel free to Contact Us directly to discuss your specific needs. Except where otherwise noted, this document is licensed under Creative Commons Attribution ShareAlike 4.0 License. http://creativecommons.org/licenses/by-sa/4.0/legalcode ii Hortonworks Data Platform May 17, 2018 Table of Contents 1.
    [Show full text]
  • Apache Ambari Troubleshooting (May 19, 2017)
    Hortonworks Data Platform Apache Ambari Troubleshooting (May 19, 2017) docs.cloudera.com hdp-ambari-troubleshooting May 19, 2017 Hortonworks Data Platform: Apache Ambari Troubleshooting Copyright © 2012-2016 Hortonworks, Inc. All rights reserved. The Hortonworks Data Platform, powered by Apache Hadoop, is a massively scalable and 100% open source platform for storing, processing and analyzing large volumes of data. It is designed to deal with data from many sources and formats in a very quick, easy and cost-effective manner. The Hortonworks Data Platform consists of the essential set of Apache Hadoop projects including MapReduce, Hadoop Distributed File System (HDFS), HCatalog, Pig, Hive, HBase, ZooKeeper and Ambari. Hortonworks is the major contributor of code and patches to many of these projects. These projects have been integrated and tested as part of the Hortonworks Data Platform release process and installation and configuration tools have also been included. Unlike other providers of platforms built using Apache Hadoop, Hortonworks contributes 100% of our code back to the Apache Software Foundation. The Hortonworks Data Platform is Apache-licensed and completely open source. We sell only expert technical support, training and partner-enablement services. All of our technology is, and will remain free and open source. Please visit the Hortonworks Data Platform page for more information on Hortonworks technology. For more information on Hortonworks services, please visit either the Support or Training page. Feel free to Contact Us directly to discuss your specific needs. Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
    [Show full text]
  • Koverse Release 2.7
    Koverse Release 2.7 Sep 12, 2018 Contents 1 Quick Start Guide 1 2 Usage Guide 17 3 Administration Guide 75 4 Developer Documentation 113 5 Access Control 169 i ii CHAPTER 1 Quick Start Guide This Quick Start guide for Koverse is intended for users who want to get up and running quickly with Koverse. It steps through the installation of Koverse, ingesting data and executing queries. Check out the Koverse User Guide for complete documentation of all features and installation instructions. 1.1 Recommendations The recommended Operating System is RHEL 6.x or Centos 6.x. Recommended Hadoop Release is Cloudera Manager 5.5 with Accumulo 1.7 Parcel and Service installed. See http: //www.cloudera.com/documentation/other/accumulo/latest/PDF/Apache-Accumulo-Installation-Guide.pdf for more details. Recommended Koverse release can be found at http://repo.koverse.com/latest/csd 1.1.1 Infrastructure and Software Koverse and the open source software it leverages must be run on a system with no less than 10 GB of memory. For workloads beyond simple examples and testing we recommend a properly provisioned Hadoop cluster with five or more nodes. Using the Cloudera QuickStart VM is not recommended. See http://www.koverse.com/question/ using-the-cloudera-quick-start-vim-and-the-koverse-parcel for more information. 1 Koverse, Release 2.7 1.2 Installation 1.2.1 Amazon Web Services Installation Using Koverse with AWS Marketplace The paid AMI available in the AWS marketplace is an easy way to get a Koverse instance up and running if you do not need to install on existing infrastructure.
    [Show full text]
  • Testsmelldescriber Enabling Developers’ Awareness on Test Quality with Test Smell Summaries
    Bachelor Thesis January 31, 2018 TestSmellDescriber Enabling Developers’ Awareness on Test Quality with Test Smell Summaries Ivan Taraca of Pfullendorf, Germany (13-751-896) supervised by Prof. Dr. Harald C. Gall Dr. Sebastiano Panichella software evolution & architecture lab Bachelor Thesis TestSmellDescriber Enabling Developers’ Awareness on Test Quality with Test Smell Summaries Ivan Taraca software evolution & architecture lab Bachelor Thesis Author: Ivan Taraca, [email protected] URL: http://bit.ly/2DUiZrC Project period: 20.10.2018 - 31.01.2018 Software Evolution & Architecture Lab Department of Informatics, University of Zurich Acknowledgements First of all, I like to thank Dr. Harald Gall for giving me the opportunity to write this thesis at the Software Evolution & Architecture Lab. Special thanks goes out to Dr. Sebastiano Panichella for his instructions, guidance and help during the making of this thesis, without whom this would not have been possible. I would also like to express my gratitude to Dr. Fabio Polomba, Dr. Yann-Gaël Guéhéneuc and Dr. Nikolaos Tsantalis for providing me access to their research and always being available for questions. Last, but not least, do I want to thank my parents, sisters and nephews for the support and love they’ve given all those years. Abstract With the importance of software in today’s society, malfunctioning software can not only lead to disrupting our day-to-day lives, but also large monetary damages. A lot of time and effort goes into the development of test suites to ensure the quality and accuracy of software. But how do we elevate the quality of test code? This thesis presents TestSmellDescriber, a tool with the ability to generate descriptions detailing potential problems in test cases, which are collected by conducting a Test Smell analysis.
    [Show full text]