DOCSLIB.ORG

Setting up a Highly Configurable, Scalable Nimbus Cloud Test Bed Running on a MANET

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Setting up a Highly Configurable, Scalable Nimbus Cloud Test Bed Running on a MANET Setting Up a Highly Configurable, Scalable Nimbus Cloud Test Bed Running on a MANET Master’s Project Report By Joshua McKee (Advisor: Patricia J. Teller, Ph.D.) Department of Computer Science The University of Texas at El Paso December 2014 Acknowledgements This work would not have been possible without the software and technical assistance provided by FutureGrid. In particular, we extend our sincere thanks to Kate Keahey and Pierre Riteau of the University of Chicago for their assistance. Also, we wish to acknowledge the economic support provided by the Army Research Laboratory through the Army High Performance Computing Research Center (AHPCRC), Stanford University Award 60300261-107307-B. ii Contents Chapter 1: Introduction ................................................................................................................................ 1 Chapter 2: Related Work .............................................................................................................................. 4 2.1 Cloud Computing Test Beds ............................................................................................................... 5 2.2 FutureGrid .......................................................................................................................................... 6 Chapter 3: Design ......................................................................................................................................... 7 3.1 High-level Design ................................................................................................................................ 7 3.2 Software Selected to Implement High-level Design ........................................................................... 8 Chapter 4: Implementation ........................................................................................................................ 12 4.1 Setting up Nimbus on a MANET ....................................................................................................... 12 4.2.1 Setting up VM Bridging using Wireless Cards ............................................................................ 12 4.1.2 Configuring Nimbus to Run on a MANET .................................................................................. 14 4.2 Making Nimbus Resource Aware ..................................................................................................... 16 Chapter 5: Automatic Configuration .......................................................................................................... 18 5.1 Flowcharts ........................................................................................................................................ 18 5.2 Automation Scripts ........................................................................................................................... 19 5.2.1 Test Bed Management Scripts ................................................................................................... 20 5.2.2 Test Bed Management Core Scripts .......................................................................................... 20 5.2.2.1 manage-host core scripts ................................................................................................... 20 5.2.2.1.1 add-host ...................................................................................................................... 20 5.2.2.1.2 remove-host ................................................................................................................ 21 5.2.2.1.3 update-hosts ............................................................................................................... 22 5.2.2.1.4 list-hosts ...................................................................................................................... 22 5.2.2.2 manage-olsrd-hosts core scripts ........................................................................................ 22 5.2.2.2.1 add-olsrd-host ............................................................................................................. 22 5.2.2.2.2 remove-olsrd-host ....................................................................................................... 23 5.2.2.2.3 update-olsrd-hosts ...................................................................................................... 23 5.2.2.2.4 update-olsrd-host ........................................................................................................ 24 5.2.2.2.5 list-olsrd-hosts ............................................................................................................. 25 5.2.2.3 manage-nimbus-head-node core scripts ............................................................................ 25 5.2.2.3.1 setup-nimbus-head-node ............................................................................................ 25 5.2.2.3.2 remove-nimbus-head-node ......................................................................................... 26 iii 5.2.2.3.3 update-nimbus-head-node ......................................................................................... 27 5.2.2.4.8 list-nimbus-head-node ................................................................................................ 27 5.2.2.4 manage-nimbus-vmm-node core scripts ............................................................................ 27 5.2.2.4.1 add-nimbus-vmm-node ............................................................................................... 27 5.2.2.4.2 remove-nimbus-vmm-node ........................................................................................ 29 5.2.2.4.3 update-nimbus-vmm-nodes ........................................................................................ 30 5.2.2.4.4 update-nimbus-vmm-node ......................................................................................... 30 5.2.2.4.5 connect-nimbus-vmm-to-head ................................................................................... 31 5.2.2.4.6 disconnect-nimbus-vmm-from-head .......................................................................... 32 5.2.2.4.7 is-nimbus-vmm-connected-to-head ............................................................................ 32 5.2.2.4.8 list-nimbus-vmm-nodes ............................................................................................... 33 5.2.2.5 manage-nimbus-client-nodes core scripts ......................................................................... 33 5.2.2.5.1 add-nimbus-client-node .............................................................................................. 33 5.2.2.5.2 remove-nimbus-client-node ........................................................................................ 34 5.2.2.5.3 update-nimbus-client-nodes ....................................................................................... 34 5.2.2.5.4 update-nimbus-client-node ......................................................................................... 35 5.2.2.5.5 list-nimbus-client-nodes .............................................................................................. 35 5.2.2.6 manage-phantom-vm core scripts ..................................................................................... 35 5.2.2.6.1 setup-for-phantom-vm ................................................................................................ 35 5.2.2.6.3 remove-phantom-vm-setup ........................................................................................ 36 5.2.2.6.2 create-phantom-vm .................................................................................................... 37 5.2.2.6.4 setup-adhoc-gateway .................................................................................................. 38 5.2.3 Other Test Bed Management Scripts .................................................................................... 38 5.2.3.1 Setup .................................................................................................................................. 38 5.2.3.1.1 setup ............................................................................................................................ 38 Chapter 6: Demonstration and Observations ............................................................................................ 40 6.1 Functionality Offered by aNTRuM .................................................................................................... 40 6.2 Observations .................................................................................................................................... 41 6.2.1 Network Communication Observations .................................................................................... 41 6.2.2 Device Load Observations ......................................................................................................... 42 Chapter 7: Conclusions and Future Work .................................................................................................. 43 7.1 Conclusions ...................................................................................................................................... 43 iv 7.2 Future Work ..................................................................................................................................... 44 Bibliography ..............................................................................................................................................
Load more

Recommended publications
  • Google Cloud Issue Summary Multiple Products - 2020-08-19 All Dates/Times Relative to US/Pacific
    Google Cloud Issue Summary Multiple Products - 2020-08-19 All dates/times relative to US/Pacific Starting on August 19, 2020, from 20:55 to 03:30, multiple G Suite and Google Cloud Platform products experienced errors, unavailability, and delivery delays. Most of these issues involved creating, uploading, copying, or delivering content. The total incident duration was 6 hours and 35 minutes, though the impact period differed between products, and impact was mitigated earlier for most users and services. We understand that this issue has impacted our valued customers and users, and we apologize to those who were affected. DETAILED DESCRIPTION OF IMPACT Starting on August 19, 2020, from 20:55 to 03:30, Google Cloud services exhibited the following issues: ● Gmail: The Gmail service was unavailable for some users, and email delivery was delayed. About ​ 0.73% of Gmail users (both consumer and G Suite) active within the preceding seven days experienced 3 or more availability errors during the outage period. G Suite customers accounted for 27% of affected Gmail users. Additionally, some users experienced errors when adding attachments to messages. Impact on Gmail was mitigated by 03:30, and all messages delayed by this incident have been delivered. ● Drive: Some Google Drive users experienced errors and elevated latency. Approximately 1.5% of Drive ​ users (both consumer and G Suite) active within the preceding 24 hours experienced 3 or more errors during the outage period. ● Docs and Editors: Some Google Docs users experienced issues with image creation actions (for ​ example, uploading an image, copying a document with an image, or using a template with images).
    [Show full text]
  • Hybrid Cloud Foundation
    Hybrid Cloud Foundation Explore, Plan, Implement Hybrid Cloud Foundation is your on-ramp to Azure. This This offering includes modules focusing on Core Azure, Microsoft Services Solution Offering will help you learn Azure IaaS, Azure Operations, and Azure Workloads. The about Azure so that you can make informed design Operations module is a discovery and planning workshop. decisions leading to an Enterprise-grade implementation The Core, IaaS, and Workload modules include a technical to meet your business needs and strategies. design workstream, and a hands-on exploration and implementation workstream. Outcomes Reduce cloud Prepare for new Accelerate cloud adoption risk operating models adoption Benefit from cloud adoption Cloud completely changes how IT is Take your hybrid solution to market expertise shaped over thousands delivered and managed. Gain quickly with a structured approach of engagements with Fortune 500 insights and recommendations for and detailed guidance based on and other Enterprise organizations running and operating in the cloud. our past experience. around the world. Capabilities Hybrid Cloud Foundation Modules Related offerings Core Azure Design (3 weeks) Azure Workloads for SAP (6+ weeks): Focus on design decisions core to Azure: subscription Azure Workloads for SQL (6+ weeks): model, naming conventions, identity, security, and external Design and implement a specific VM-based workload. network connectivity. Azure Migration Pilot (3 weeks): Migrate your first VM- based workloads to Azure. Azure IaaS Design (6 weeks) Extend your core Azure design. Focus on the design Azure Operations Jumpstart (5 weeks): Deep planning to decisions to enable Azure IaaS capabilities: compute, help your people, process, technology shift for operating storage, networking, and extending on-premises in the cloud.
    [Show full text]
  • Opennebula 5.4 Deployment Guide Release 5.4.15
    OpenNebula 5.4 Deployment guide Release 5.4.15 OpenNebula Systems Jun 19, 2018 This document is being provided by OpenNebula Systems under the Creative Commons Attribution-NonCommercial- Share Alike License. THE DOCUMENT IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IM- PLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE DOCUMENT. i CONTENTS 1 Cloud Design 1 1.1 Overview.................................................1 1.2 Open Cloud Architecture.........................................2 1.3 VMware Cloud Architecture.......................................7 1.4 OpenNebula Provisioning Model.................................... 13 2 OpenNebula Installation 19 2.1 Overview................................................. 19 2.2 Front-end Installation.......................................... 19 2.3 MySQL Setup.............................................. 25 3 Node Installation 27 3.1 Overview................................................. 27 3.2 KVM Node Installation......................................... 28 3.3 vCenter Node Installation........................................ 34 3.4 Verify your Installation.......................................... 42 4 Authentication Setup 50 4.1 Overview................................................. 50 4.2
    [Show full text]
  • Comparative Study of Eucalyptus, Open Stack and Nimbus
    International Journal of Soft Computing and Engineering (IJSCE) ISSN: 2231-2307, Volume-4 Issue-6, January 2015 Comparative Study of Eucalyptus, Open Stack and Nimbus Lakshmi D Kurup, Chandni Chandawalla, Zalak Parekh, Kunjita Sampat Abstract- Cloud computing is a Service Oriented Architecture ii. PaaS (Platform as a Service): A platform as a which reduces information technology overhead for the end-user service (PaaS) offering, usually depicted in all- and provides great flexibility, reduced total cost of ownership, on- cloud diagrams between the SaaS layer above it demand services and many other benefits. Hence it delivers all IT and the IaaS layer below, is a broad collection of related capabilities as services rather than product .Services on application infrastructure (middleware) services cloud are divided into three broad categories: Software as a Service, Infrastructure as a Service & Platform as a Service. (including application platform, integration, Same as services cloud is also classified as Private Cloud, Public business process management and database Cloud & Hybrid Cloud. Private cloud is gaining popularity, not services). However, the hype surrounding the PaaS only among large organizations but also small and medium concept is focused mainly on application PaaS enterprises. To deploy public or private cloud there are many (aPaaS) as the representative of the whole open source software platforms available such as Eucalyptus, category. Nimbus, OpenStack, Open Nebula, Cloud Stack and Amazon iii. SaaS (Software as a Service): Gartner defines Web Services. In this paper, we provide a comparative study of software as a service (SaaS) as software that is three open source cloud management platforms: Eucalyptus, owned, delivered and managed remotely by one or OpenStack and Nimbus.
    [Show full text]
  • A Survey of Collaborative Tools in Software Development
    1 INTRODUCTION A Survey of Collaborative Tools in Software Development Anita Sarma Institute for Software Research Donald Bren School of Information and Computer Sciences University of California, Irvine [email protected] ISR Technical Report # UCI-ISR-05-3 March 22, 2005 1 Introduction Collaboration is at the heart of software development. Virtually all software devel- opment requires collaboration among developers within and outside their project teams, to achieve a common objective. It has in fact been shown that about 70% of a software engineer’s time is spent on collaborative activities [219]. Indeed, col- laboration in software development has been studied by researchers in the fields of Software Engineering and Computer Supported Cooperative Work (CSCW) since the 1980s and has produced a wide range of collaborative tools. Enabling software developers to collaborate effectively and effortlessly is a difficult task. The collaboration needs of the team depend to a large extent on environmental factors such as, the organizational structure of the team, the domain for which the software is produced, the product structure, and individual team members. Accordingly, research in collaborative development has produced a host of tools, each typically focussing on a different aspect of collaboration. Most teams have their favorite repertoire of tools that has been built from historical use. These tools may not always be the best suited for the team, but the team still uses them nevertheless as the inertia and cost of trying out new tools surpasses the benefits. A number of classification frameworks exist that can be used to classify collaborative tools. In addition to placing the various tools in context, developers can use these frameworks to select the right mix of tools fit for their needs.
    [Show full text]
  • Chameleon: Building an Experimental Instrument for Computer Science
    www. chameleoncloud.org CHAMELEON: BUILDING AN EXPERIMENTAL INSTRUMENT FOR COMPUTER SCIENCE AS APPLICATION OF CLOUD COMPUTING Kate Keahey Argonne National Laboratory Computation Institute, University of Chicago [email protected] HEPiX October 20th, 2016 Berkeley, CA OCTOBER 20, 2016 1 CHAMELEON IN A NUTSHELL Chameleon is a facility for Computer Science experimentaon Project started 10/14, public availability since 07/15 1,000+ users, 200+ research projects It is reconfigurable: “as close as possible to having it in your lab” Up-to-date and fine-grain informaon about resources Allows you to reserve isolated nodes, reconfigure nodes at bare metal level, reboot, power on/off, custom kernel, console access, etc. It is also large-scale: “support Big Data, Big Compute research” ~650 nodes (~14,500 cores), 5 PB of storage distributed over 2 sites connected with 100G network It is complementary to other testbeds such as GENI Chameleon is an open testbed Open to all non-commercial CS research projects NSF-funded naonal facility Create account, then create or join a project (less than 24 hour review) Find out more at www.chameleoncloud.org! www. chameleoncloud.org CHAMELEON HARDWARE To UTSA, GENI, Future Partners Switch Standard Core Services Cloud Unit Front End and Data 504 x86 Compute Servers 42 compute Mover Nodes 48 Dist. Storage Servers 4 storage 102 Heterogeneous Servers x2 16 Mgt and Storage Nodes Chameleon Core Network Chicago SCUs connect to 100Gbps uplink public network AusTn core and fully (each site) connected to each other Heterogeneous Switch Cloud Units Standard Core Services Alternate Processors Cloud Unit 3.6 PB Central File and Networks 42 compute Systems, Front End 4 storage and Data Movers x10 www.
    [Show full text]
  • A Comparative Study of Current Open-Source Infrastructure As a Service Frameworks
    A Comparative Study of Current Open-source Infrastructure as a Service Frameworks Theo Lynn, Graham Hunt, David Corcoran, John Morrison and Philip Healy Irish Centre for Cloud Computing, Dublin 9, Ireland Keywords: Cloud Computing, Open Source, IaaS, Openstack, Cloudstack, Opennebula, Eucalyptus. Abstract: With the growth of cloud computing in recent years, several commercial and open source IaaS frameworks have emerged. The development of open source IaaS solutions offers a free and flexible alternative to commercial cloud services. The main contribution of this paper is to provide a qualitative comparative of current open-source IaaS frameworks. Existing research papers examining open source IaaS frameworks have focused on comparing OpenStack with a small number of alternatives. However, current research fails to adequately compare all major open source frameworks in a single study and notably lacks the inclusion of CloudStack. Our research paper provides the first overview of the five main open source cloud IaaS frameworks – OpenStack, CloudStack, OpenNebula, Eucalyptus and Nimbus. As such, this review provides researchers and potential users with an up to date and comprehensive overview of the features of each solution and allows for an easy comparison between the open source solutions. 1 INTRODUCTION the freedom to modify the source code and build a cloud that is pluggable and open to extensions while Cloud Computing technologies have seen significant reducing costs and avoiding vendor lock-in (Zhang adoption in recent years by enterprises, researchers et al., 2013; Wen et al. 2012; Bist et al., 2013). The and individuals. It is forecast that the Cloud development of open source solutions is of particular Computing industry will reach a market size of $241 importance for the further proliferation of private billion by 2020 (Reid and Kilster, 2011).
    [Show full text]
  • Guest OS Compatibility Guide
    Guest OS Compatibility Guide Guest OS Compatibility Guide Last Updated: September 29, 2021 For more information go to vmware.com. Introduction VMware provides the widest virtualization support for guest operating systems in the industry to enable your environments and maximize your investments. The VMware Compatibility Guide shows the certification status of operating system releases for use as a Guest OS by the following VMware products: • VMware ESXi/ESX Server 3.0 and later • VMware Workstation 6.0 and later • VMware Fusion 2.0 and later • VMware ACE 2.0 and later • VMware Server 2.0 and later VMware Certification and Support Levels VMware product support for operating system releases can vary depending upon the specific VMware product release or update and can also be subject to: • Installation of specific patches to VMware products • Installation of specific operating system patches • Adherence to guidance and recommendations that are documented in knowledge base articles VMware attempts to provide timely support for new operating system update releases and where possible, certification of new update releases will be added to existing VMware product releases in the VMware Compatibility Guide based upon the results of compatibility testing. Tech Preview Operating system releases that are shown with the Tech Preview level of support are planned for future support by the VMware product but are not certified for use as a Guest OS for one or more of the of the following reasons: • The operating system vendor has not announced the general availability of the OS release. • Not all blocking issues have been resolved by the operating system vendor.
    [Show full text]
  • Cloud Computing with Nimbus March 2009, OGF25
    Cloud Computing with Nimbus March 2009, OGF25 Thilo Kielmann (slides by Kate Keahey [email protected]) Nimbus Nimbus goals Allow providers to build clouds Private clouds (privacy, expense considerations) E.g., Workspace Service: open source EC2 implementation Allow users to use cloud computing Do whatever it takes to enable scientists to use IaaS E.g.,Context Broker: creates turnkey virtual clusters Allow developers to experiment with Nimbus For research or usability/performance improvements Community extensions and contributions, e.g Ian Gable and his team (UVIC) contributed a monitoring component First released in September 2005 3/2/09 The Nimbus Toolkit: http//workspace.globus.org The Workspace Service Pool Pool Pool node node node VWS Service Pool Pool Pool node node node Pool Pool Pool node node node Pool Pool Pool node node node 3/2/09 The Nimbus Toolkit: http//workspace.globus.org The Workspace Service The workspace service publishes information about each workspace Pool Pool Pool node node node VWS Service Pool Pool Pool node node node Users can find out information about their Pool Pool Pool workspace (e.g. what IP node node node the workspace was bound to) Pool Pool Pool node node node Users can interact directly with their workspaces the same way the would with a physical machine. 3/2/09 The Nimbus Toolkit: http//workspace.globus.org Workspace Service: Interfaces and Clients Two kinds of interfaces: Web Service Resource Framework (WSRF) Web Services + state management (WS-Notification) Cloud client (similar commads
    [Show full text]
  • Main Application Version 7.18 This Documentation Is Provided Under Restrictions on Use and Are Protected by Intellectual Property Laws
    Architecture Main application Version 7.18 This documentation is provided under restrictions on use and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this documentation, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. © 2021 Creatio. All rights reserved. Table of Contents | 3 Table of Contents Main application 4 Creatio layers 4 Creatio infrastructure 5 Horizontal scaling 9 Deployment options 11 © 2021 Creatio. All rights reserved. Main application | 4 Main application Beginner The classic three-tier Creatio architecture is cross-platform, flexibile, and scalable. The presentation layer lets users access Creatio UI via a web browser or a mobile app for Android or iOS. Creatio application layer is available for the .NET Framework and .NET Core platforms, and can be deployed on Windows, Linux, and macOS web servers. Creatio supports Microsoft SQL Server, Oracle, and PostgreSQL for persistent storage on the data layer. Creatio supports version control system server integration, which allows for multi-user development. The Creatio architecture supports horizontal scaling and different deployment methods: cloud and on-site (with or without fault tolerance). Creatio layers Creatio has a classic three-tier architecture with the following layers: data, application, presentation.
    [Show full text]
  • Rackspace Service Blocks: Complex Cloud Operations Gain Advanced Operational Guidance and Support from Certified Cloud Specialists
    Rackspace Service Blocks: Complex Cloud Operations Gain advanced operational guidance and support from certified cloud specialists. Large organizations and businesses running highly complex cloud About Rackspace environments often require customized cloud architecture and access Rackspace is your trusted partner across cloud, to highly skilled cloud resources. Finding the right level of technical applications, security, data and infrastructure. expertise can be challenging, because talent is scarce, expensive and hard to retain. Rackspace® Complex Cloud Operations help you manage • A leader in the 2018 Gartner Magic Quadrant ongoing operational challenges and keep you informed on ever-evolving for Public Cloud Infrastructure Managed cloud features. Service Providers, Worldwide • 3,000+ cloud experts Experts Dedicated to Your Success • Hosting provider for more than half of the Rackspace is a next-generation cloud services provider that manages the Fortune 100 full cloud lifecycle. Complex Cloud Operations offers access to advanced technical resources to better manage public cloud operations and • 20+ years of hosting experience infrastructure architecture. • Customers in 150+ countries • 3,000+ AWS accreditations Key Features • 1,000+ AWS certifications Rackspace offers a range of robust features to support complex cloud operations including: • 1,300+ Microsoft certifications worldwide • 200+ Microsoft-certified professionals Expertise: Expert technical resources, including solution architects, lead engineers, container and Kubernetes experts, and DevOps professionals • 150+ Microsoft Azure certifications worldwide help optimize public cloud operations and architectural infrastructure. • 100+ Microsoft Azure-certified professionals Optimized Custom Configurations: Custom configurations include • 13 Microsoft partner certifications monitoring services, OS optimization, patch management, alert response • Five-time Microsoft Hosting Partner of the Year runbooks and deployment management.
    [Show full text]
  • An Experimental Study of Load Balancing of Opennebula Open-Source Cloud Computing Platform
    An Experimental Study of Load Balancing of OpenNebula Open-Source Cloud Computing Platform A B M Moniruzzaman, StudentMember, IEEE Kawser Wazed Nafi Syed Akther Hossain, Member, IEEE & ACM Abstract— Cloud Computing is becoming a viable computing organization existing computing infrastructure into a private or solution for services oriented computing. Several open-source hybrid cloud [3]. Eucalyptus, CloudStack, OpenStack and cloud solutions are available to these supports. Open-source OpenNebula are the most popular open-source cloud solutions software stacks offer a huge amount of customizability without used as to build such community cloud platforms. Eucalyptus huge licensing fees. As a result, open source software are widely is open source cloud software for building AWS-compatible used for designing cloud, and private clouds are being built private and hybrid clouds [4]. Apache CloudStack is open increasingly in the open source way. Numerous contributions source software designed to deploy and manage large networks have been made by the open-source community related to of virtual machines Infrastructure as a Service (IaaS) cloud private-IaaS-cloud. OpenNebula - a cloud platform is one of the computing platform [5]. OpenStack is a cloud operating system popular private cloud management software. However, little has that controls large pools of compute, storage, and networking been done to systematically investigate the performance evaluation of this open-source cloud solution in the existing resources throughout a datacenter, all managed through a literature. The performance evaluation aids new and existing dashboard that gives administrators control while empowering research, industry and international projects when selecting their users to provision resources through a web interface [6].
    [Show full text]