Adriano Vogel Surveying the Robustness and Analyzing the Performance Impact of Open Source Infrastructure As a Service Managemen

Total Page:16

File Type:pdf, Size:1020Kb

Adriano Vogel Surveying the Robustness and Analyzing the Performance Impact of Open Source Infrastructure As a Service Managemen ADRIANO VOGEL SURVEYING THE ROBUSTNESS AND ANALYZING THE PERFORMANCE IMPACT OF OPEN SOURCE INFRASTRUCTURE AS A SERVICE MANAGEMENT TOOLS Três de Maio 2015 ADRIANO VOGEL SURVEYING THE ROBUSTNESS AND ANALYZING THE PERFORMANCE IMPACT OF OPEN SOURCE INFRASTRUCTURE AS A SERVICE MANAGEMENT TOOLS Undergraduate Thesis Sociedade Educacional Três de Maio Faculdade Três de Maio Curso de Tecnologia em Redes de Computadores Advisor: M. Sc. Dalvan Griebler Três de Maio 2015 AGRADECIMENTOS Este trabalho é dedicado a minha familia por todo o apoio e pela paciência nos momentos que estive ausente para a realização desse estudo. Um agradecimento especial ao meu orientador Dalvan Griebler, tanto pela oportunidade e confiança para esse trabalho, quanto pelo esforço da orientação e revisão da escrita. Agradeço também pela equipe do grupo de pesquisa LARCC e projeto HiPerfCloud pelo suporte e oportunidade de discussões. TERMO DE APROVAÇÃO ADRIANO VOGEL SURVEYING THE ROBUSTNESS AND ANALYZING THE PERFORMANCE IMPACT OF OPEN SOURCE INFRASTRUCTURE AS A SERVICE MANAGEMENT TOOLS Relatório aprovado como requisito parcial para obtenção do título de Tecnólogo em Redes de Computadores concedido pela Faculdade de Tecnologia em Redes de Computadores da Sociedade Educacional Três de Maio, pela seguinte Banca examinadora: Orientador: Prof. Dalvan Griebler, M.Sc. Faculdade de Tecnologia em Redes de Computadores da SETREM Drando. Fauzi de Moraes Shubeita Faculdade de Tecnologia em Redes de Computadores da SETREM M.Sc. Vinícius da Silveira Serafim Faculdade de Tecnologia em Redes de Computadores da SETREM Dr. Claudio Schepke Universidade Federal do Pampa (UNIPAMPA) - Alegrete Três de Maio, 07 de agosto de 2015. ABSTRACT Cloud computing is an alternative to offer computational resources for users link dif- ferent technologies (virtualization, grid computing, cluster and parallel processing). Firstly, public cloud providers started offering services and computational resources over the Internet. Meanwhile, the private clouds began to deploy solutions inside the corporations domain. This cloud type becomes suitable because it increases the secu- rity and flexibility and avoids a third party dependency. Currently, there are several IaaS open source cloud solutions available to build a public or private cloud. However, their robustness is still unknown as well as the performance impacts. In this thesis, the goal was to evaluate these IaaS tools, concerning the features and support for robustness (flexibility and resilience). Also, a survey state of the art for performance on a cloud was conducted to highlight cloud’s challenges and potential solutions for reducing its performance overhead. The results demonstrated that the open source cloud IaaS so- lutions can provide high robustness levels and are suitable for enterprise applications. Therefore, the most flexible IaaS tool is the CloudStack as well as the OpenStack is the most resilient. Additionally, an equation to find the reliability rates for experiments on the cloud was created due to the performance variation problem found in the survey. Keywords: Cloud Computing, Infrastructure as a Service, Survey, Perfor- mance Analysis, Computer Networks. ABSTRACT A computação em nuvem surgiu como uma alternativa para oferecer recursos com- putacionais através da utilização de tecnologias consolidadas nas últimas décadas (virtualização, computação em grade, cluster e processamento paralelo). Dessa forma, os provedores de nuvem pública surgiram oferecendo serviços e recursos computa- cionais através da internet. Ao mesmo tempo, o conceito de nuvem privada surgiu, nessa tecnologia a nuvem é implantada dentro do domínio das empresa utilizando a própria infraestrutura. Nesse estudo, as soluções para nuvens do tipo IaaS foram availiadas em relação as características e ao suporte para robustez de nuvem (flex- ibilidade e resiliência). Além disso, foi conduzida uma pesquisa do estado da arte para desempenho em nuvem buscando destacar os desafios e prováveis soluções para reduzir a degradação da performance de aplicações executadas na nuvem. Os resultados mostram que algumas soluções de código aberto para nuvem IaaS podem alcançar elevados níveis de robustez e podem ser adequadas para a execução de aplicações corporativas. Ainda, foi desenvolvida uma equação para encontrar o nível de confiabilidade de experimentos. Keywords: Computação em Nuvem, Infraestrutura como Serviço, Survey, Análise de desempenho, Redes de Computadores. LIST OF FIGURES 2.1 CPU components and interactions. 38 2.2 Memory hierarchy. 39 2.3 SISD architecture. 41 2.4 MIMD architecture. 41 2.5 Shared (left) and distributed (right) memory MIMD. 42 2.6 Types of Cloud Services. 50 2.7 3 Types of Cloud. 54 2.8 Example of load distribution. 61 2.9 Workstation Distributed System model. 62 3.1 Cloudstack architecture. 72 3.2 Cloudstack infrastructure overview. 73 3.3 Cloudstack deployment architecture overview. 74 3.4 OpenNebula infrastructure overview. 75 3.5 Eucalyptus components. 76 3.6 Eucalyptus architecture overview. 77 3.7 Nimbus deployment. 79 3.8 OpenStack overview. 80 3.9 OpenStack conceptual architecture. 80 3.10 IaaS proposed taxonomy. 85 3.11 IaaS survey flexibility scores overview. 101 3.12 IaaS survey flexibility support percentage. 101 3.13 IaaS survey resilience overall scores. 104 3.14 IaaS survey resilience percentage. 104 3.15 IaaS tools robustness. 106 3.16 Virtualization performance overhead factors. 109 3.17 IaaS overview. Adapted from Celesti et al. (2013). 119 3.18 IaaS resources provision. 120 3.19 OSv architecture. 123 3.20 Hypervisor and container virtualization. 124 LIST OF TABLES 1.1 Activities schedule. 26 1.2 Estimated costs. 27 3.1 Related Surveys. 84 3.2 IaaS survey flexibility overview. 92 3.3 IaaS survey tools flexibility(a). 94 3.4 IaaS survey tools flexibility(b). 95 3.5 IaaS tools resilience. 103 3.6 Performance variation overview. 112 LIST OF ABBREVIATIONS AND ACRONYMS API Application Programming Interface AWS Amazon Web Service COV Coefficient of Variation CRM Customer Relationship Management DHCP Dynamic Host Configuration Protocol DNS Domain Name System EC2 Elastic Compute Cloud ERP Enterprise Resource Planning GPL General Public License HPC High-performance computing IaaS Infrastructure as a Service IP Internet Protocol LAN Local Area Network LARCC Laboratory of Advanced Researches for Cloud Computing LVM Logical Volume Management LXC Linux Containers MAN Metropolitan Area Network MBW Memory Bandwidth Benchmark MIMD Multiple-Instruction, Multiple-Data MISD Multiple-Instruction, Single-Data NASA National Aeronautics and Space Administration NFS Network File System NVP Network Virtualization Platform PaaS Platform as a Service RHEL Red Hat Enterprise Linux SaaS Software as a Service SCM Supply Chain Management SETREM Sociedade Educacional Três de Maio SIMD Single-Instruction, Multiple-Data SISD Single-Instruction, Single-Data SMB Server Message Block SSH Secure Shell OS Operating System OSG Object Storage Gateways OVS OpenVSwitch QCOW QEMU Copy On Write QEMU Quick Emulator QoS Quality of Service iSCSI Internet Small Computer System Interface TCP/IP Transmission Control Protocol/Internet Protocol TFTP Trivial File Transfer Protocol VHD Virtual Hard Disk VM Virtual Machine VMDK Virtual Machine Disk VMFS Virtual Machine File System VMM Virtual Machine Monitor WAN Wide Area Network CONTENTS INTRODUCTION .................................... 15 CHAPTER1: RESEARCH PLAN ........................... 18 1.1 THEME . 18 1.1.1 Theme Delimitation ............................. 18 1.2 PROBLEM . 19 1.3 HYPOTHESES . 20 1.4 VARIABLES . 20 1.5 OBJECTIVES . 20 1.5.1 General Objective ............................. 20 1.5.2 Specific Objectives ............................. 21 1.6 JUSTIFICATION . 21 1.7 METHODOLOGY . 23 1.7.1 Methods ................................... 23 1.7.2 Procedures ................................. 25 1.7.3 Research Techniques ........................... 25 1.8 RESOURCES . 25 1.8.1 Human Resources ............................. 25 1.8.2 Material Resources ............................. 26 1.8.3 Institutional resources ........................... 26 1.9 SCHEDULE . 26 1.10 ESTIMATED COSTS . 27 CHAPTER2: LITERATURE REVIEW ........................ 28 2.1 DEFINITION OF TERMS . 28 2.1.1 Operating System ............................. 28 2.1.2 Computer Networks ............................ 28 2.1.3 Performance Evaluation .......................... 29 2.1.3.1 Response Time (Latency) .......................... 30 2.1.3.2 Throughput .................................. 31 13 2.1.3.3 Speedup ................................... 31 2.1.3.4 Efficiency ................................... 32 2.1.4 Resource Isolation ............................. 32 2.1.5 Statistical Significance .......................... 33 2.1.6 Survey .................................... 33 2.1.7 Open Source ................................ 34 2.1.8 Quality-of-Services ............................. 34 2.2 BACKGROUND . 35 2.2.1 Computer Architecture .......................... 36 2.2.2 Flynn’s Taxonomy ............................. 40 2.2.3 Computing Applications .......................... 43 2.2.3.1 Scientific Parallel Applications ....................... 43 2.2.3.2 Enterprise Applications ........................... 44 2.2.4 Benchmarks ................................. 45 2.2.4.1 Resource Isolation .............................. 45 2.2.4.2 Parallel and Enterprise Benchmark Suites/Workloads .......... 46 2.2.5 Cloud Computing .............................. 48 2.2.5.1 Service Model ...............................
Recommended publications
  • October 2011 Vol
    NoSQL GREG BURD Hypervisors and Virtual Machines: Implementation Insights on the x86 Architecture DON REVELLE Conference Reports from the 2011 USENIX Annual Technical Conference, HotPar, and more OCTOBER 2011 VOL. 36, NO. 5 THE ADVANCED COMPUTING SYSTEMS ASSOCIATION THE ADVANCED COMPUTING SYSTEMS ASSOCIATION usenix_login_oct11_covers.indd 1 9.9.11 5:55 PM UPCOMING EVENTS 23rd ACM Symposium on Operating Systems 9th USENIX Symposium on Networked Systems Principles (SOSP 2011) Design and Implementation (NSDI ’12) SPONSORED BY ACM SIGOPS IN COOPERATION WITH USENIX SPONSORED BY USENIX IN COOPERATION WITH ACM SIGCOMM AND ACM SIGOPS October 23–26, 2011, Cascais, Portugal April 25–27, 2012, San Jose, CA http://sosp2011.gsd.inesc-id.pt http://www.usenix.org/nsdi12 ACM Symposium on Computer Human Interac- tion for Management of Information Technology 2012 USENIX Federated Conferences Week (CHIMIT 2011) June 12–15, 2012, Boston, MA, USA http://www.usenix.org/fcw12 SPONSORED BY ACM IN ASSOCIATION WITH USENIX December 4–5, 2011, Boston, MA 2012 USENIX Annual Technical Conference http://chimit.acm.org/ (USENIX ATC ’12) June 13–15, 2012, Boston, MA 25th Large Installation System Administration http://www.usenix.org/atc12 Conference (LISA ’11) Paper titles and abstracts due January 10, 2012 SPONSORED BY USENIX IN COOPERATION WITH LOPSA December 4–9, 2011, Boston, MA 21st USENIX Security Symposium http://www.usenix.org/lisa11 (USENIX Security ’12) August 6–10, 2012, Bellevue, WA ACM/IFIP/USENIX 12th International Middleware Conference (Middleware 2011)
    [Show full text]
  • FVD: a High-Performance Virtual Machine Image Format for Cloud
    FVD: a High-Performance Virtual Machine Image Format for Cloud Chunqiang Tang IBM T.J. Watson Research Center [email protected] http://www.research.ibm.com/people/c/ctang/ Note: This paper describes the copy-on-write, copy- 1 Introduction on-read, and adaptive prefetching capabilities of FVD. The compact image capability of FVD is described Cloud Computing is widely considered as the next big separately in a companion paper entitled “Compact thing in IT evolution. In a Cloud like Amazon EC2 [1], Image Support in Fast Virtual Disk (FVD)”, which the storage space for virtual machines’ virtual disks can is available at https://researcher.ibm.com/ be allocated from multiple sources: the host’s direct- researcher/view project.php?id=1852 attached storage (DAS, i.e., local disk), network-attached storage (NAS), or storage area network (SAN). These op- Abstract tions offer different performance, reliability, and avail- ability at different prices. DAS is at least several times This paper analyzes the gap between existing hyper- cheaper than NAS and SAN, but DAS limits the avail- visors’ virtual disk capabilities and the requirements in ability and mobility of VMs. a Cloud, and proposes a solution called FVD (Fast Vir- tual Disk). FVD consists of an image format and a To get the best out of the different technologies, a block device driver designed for QEMU. Despite the ex- Cloud usually offers a combination of block-device stor- istence of many popular virtual machine (VM) image age services to VMs. For instance, Amazon Web Ser- formats, FVD came out of our unsatisfied needs in the vices (AWS) [2] offers to a VM both ephemeral storage IBM Cloud.
    [Show full text]
  • Starwind Vsan Free Download Starwind Virtual San Free Download
    starwind vsan free download Starwind virtual san free download. Most people looking for Starwind virtual san free downloaded: StarWind Virtual SAN. StarWind Virtual SAN is entirely software-based, hypervisor-centric virtual machine storage. Programs for query ″starwind virtual san free download″ PC SWOS-Total Pack. PC SWOS-Total Pack is an all-in-one PC Sensible Soccer package that offers you an integrated front-end for starting PC SWOS. StarWind RAM Disk. RAM Disk is a program that allows the emulation of the virtual drives to be more than 1000 times faster than your local hard drive. of the virtual drives to . is a fast virtual disk that . Amiga SWOS-Total Pack. This is an all-in-one Amiga Sensible Soccer package. The program can be played online using the specially modified . StarWind V2V Converter. StarWind V2V Converter is a software that allows for conversion of VMs from one format to another, basically “cloning” them and keeping the original file intact. tool for StarWind HyperConverged Appliance . into hypervisors, StarWind V2V Converter . StarWind iSCSI Initiator. StarWind iSCSI Initiator is a program that uses standard TCP/IP to transmit data packets. StarWind iSCSI Initiator . and emulates ( virtualizes ) it over . StarWind V2V Image Converter. StarWind V2V Converter allows you to convert VMs from one format to another, basically “cloning” them and keeping the original file intact. designed for virtualization administrators, who . into hypervisors, StarWind V2V Converter . StarWind. This software combined with StarPort iSCSI initiator running on client allows you to export any local CD and DVD . supported), "redirect" virtual hard disk . backups and virtual tapes .
    [Show full text]
  • Compact Image Support in Fast Virtual Disk (FVD)
    Compact Image Support in Fast Virtual Disk (FVD) Chunqiang Tang IBM T.J. Watson Research Center [email protected] http://www.research.ibm.com/people/c/ctang/ Abstract may cause severe fragmentation and increase disk seek Fast Virtual Disk (FVD) is a flexible, high- distances. Specifically, when a guest OS creates or re- performance image format designed for QEMU. It sup- sizes a guest file system, it writes out the guest file sys- ports compact image, copy-on-write, copy-on-read, and tem metadata, which are all grouped together and put at adaptive prefetching. This paper focuses on the compact the beginning of the image by existing compact image image feature of FVD. The other features of FVD are formats, despite the fact that the guest file system meta- described in a separate paper [6]. Source code and docu- data’s virtual block addresses are deliberately scattered mentation of FVD are available at the FVD Web site [2]. across the virtual disk for better reliability and locality, e.g., co-locating inodes and file content blocks in block 1 Introduction groups. As a result, it causes a long disk seek distance Many popular image formats support compact images, between accessing the metadata of a file in the guest file including QEMU QCOW2 [3], QEMU QED [5], Vir- system and accessing the file’s content blocks. Experi- tualBox VDI [7], VMWare VMDK [8], and Microsoft mental results in Figure 7 of [6] show that the disk seek VHD [4]. FVD is designed to address some fundamen- distance with a QCOW2 image is 5.6 times longer than tal limitations of these image formats.
    [Show full text]
  • Étude Comparative Entre Les Performances Du Volume LVM En Allocation Dynamique Et Du Fichier Image RAW De La Plateforme De Virtualisation KVM/QEMU
    Étude comparative entre les performances du volume LVM en allocation dynamique et du fichier image RAW de la plateforme de virtualisation KVM/QEMU Par Adil Ratli Essai présenté au CeFTI en vue de l’obtention du grade de maître en technologies de l’information (maîtrise en génie logiciel incluant un cheminement de type cours en technologies de l’information) FACULTÉ DES SCIENCES UNIVERSITÉ DE SHERBROOKE Longueuil, Québec, Canada, Juin 2020 Sommaire La virtualisation consiste à exécuter plusieurs systèmes d’exploitation (machines virtuelles) sur la même machine physique. Les ressources de cette dernière sont partagées par toutes les machines virtuelles. Par conséquent, une optimisation de l’utilisation de ces ressources s’avère nécessaire pour tirer le maximum de gains et de performances. Une bonne gestion de l’espace de stockage virtuel a un impact majeur sur l’amélioration des performances de la machine virtuelle. L’objectif principal du présent essai consiste à évaluer l’impact du format du stockage des disques virtuels sur les performances d’entrée-sortie. Il se limite à deux formats particuliers : le fichier image RAW et le volume LVM en mode allocation dynamique. La mise en place d'une infrastructure de virtualisation nécessite de nombreuses décisions quant au choix des techniques les plus appropriées pour obtenir les meilleures performances. Le choix du format de stockage utilisé par les VM ne fait pas exception et un banc d’essai permettant de mesurer les performances de chaque format s’avère utile. Cette étude propose une solution à cette problématique en suivant une méthodologie qui repose sur une recherche quantitative.
    [Show full text]
  • Nuix Ediscovery User Guide V4.2
    Nuix eDiscovery User Guide Version 4.2 Nuix believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS IS.” NUIX MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Use, copying, and distribution of any Nuix software described in this publication requires an applicable software license. February 2013 Nuix eDiscovery User Guide v 4.2 PAGE 2 of 390 Contents Nuix eDiscovery User Guide .................................................................................................... 9 Introduction ............................................................................................................................. 10 Key features of Nuix 4.2 .................................................................................................... 10 Automatic Classification ............................................................................................ 10 Document Navigator Filter ......................................................................................... 10 Batch Load Details .................................................................................................... 10 Cluster Runs .............................................................................................................. 10 Search Macros..........................................................................................................
    [Show full text]
  • Using Solid-State Drives (Ssds) for Virtual Block Devices
    Using Solid-State Drives (SSDs) for Virtual Block Devices Sang-Hoon Kim Jin-Soo Kim Seungryoul Maeng KAIST Sungkyunkwan University KAIST [email protected] [email protected] [email protected] Abstract cause of its simplicity, mobility and ease of management. A hy- pervisor provides a VBD to a guest domain, and block requests to In a virtualized environment, the block devices on the I/O do- 1 main can be provided to guest domains by the virtual block de- the VBD are delivered to the I/O domain . The requests are then vice (VBD). As the VBD incurs low latency and no network access translated to a set of file operations to a virtual disk image (VDI) is involved in accessing data, VBD has been used for storing in- file which is stored in the I/O domain filesystem. A number of termediate data of data-intensive applications such as MapReduce. formats for the VDI file have been proposed such as VMware To accelerate the performance further, SSD can be considered as VMDK(Virtual Machine DisK) [36], VirtualBox VDI [33], Mi- a backing device of the VBD because SSD outperforms HDD by crosoft Virtual Server VHD (Virtual Hard Disk) [24], and QEMU several orders of magnitude. However, the TRIM command that QCOW2 [22]. plays an important role in space management of SSD has not been In the meantime, NAND flash memory (or flash for short) be- discussed nor handled properly in the virtualized environment. comes popular storage media. Solid-state drives (SSDs) use the In this paper, we clarify the challenges in supporting the TRIM flash and provide the traditional block I/O interface such as SATA command in the VBD configuration and propose a novel file oper- or SAS.
    [Show full text]
  • Conference Reports
    ConferenceCONFERENCES Reports In this issue: 2011 USENIX Annual Technical Conference (USENIX ATC ‘11) 2011 USENIX Annual Technical Conference (http://www.usenix.org/events/atc11/) 61 Portland, Oregon Summarized by Raluca Ada Popa, Nadav Amit, Muli Ben-Yehuda, June 15–17, 2011 Rik Farrow, Vishakha Gupta, Etienne Le Sueur, Dan Levin, Timothy Merrifield, Muhammad Shahzad, Mark Spear, and Carsten Weinhold Welcome, Awards, and Keynote Address Opening Remarks and Awards Presentation (USENIX 2nd USENIX Conference on Web Application Development Lifetime Achievement Award, Software Tools User (http://www.usenix.org/events/webapps11/) 81 Group [STUG] Award, CRA-W BECA Award, and Best Summarized by Ioannis Papagiannis and Veena Udayabhanu Paper Awards) Jason Nieh and Carl Waldspurger, USENIX ATC ’11 Program Co-Chairs; 3rd USENIX Workshop on Hot Topics in Cloud Computing Clem Cole and Margo Seltzer, USENIX Board of Directors (http://www.usenix.org/events/hotcloud11/) 86 Summarized by Tian Guo, Henrique Rodrigues, Sahil Suneja, and Summarized by Rik Farrow ([email protected]) Byung Chul Tak Jason Nieh and Carl Waldspurger, the co-chairs of ATC, pre- sented the opening remarks with thanks to the program com- 3rd USENIX Workshop on Hot Topics in Storage and File mittee, who performed at least 25 paper reviews each. Out Systems of 180 submitted papers, 38 were accepted. The Best Paper (http://www.usenix.org/events/hotstorage11/) 98 Awards went to “Building a High-performance Deduplica- Summarized by Dutch Meyer, Sejin Park, and Luis Useche tion System,” by Fanglu Guo and Petros Efstathopoulos of Symantec Research Labs, and to “Semantics of Caching with 3rd Workshop on I/O Virtualization SPOCA: A Stateless, Proportional, Optimally-Consistent (http://www.usenix.org/events/wiov11/) 106 Addressing Algorithm,” by Ashish Chawla, Benjamin Reed, Summarized by Sejin Park, Henrique Rodrigues, and Muli Ben- Karl Juhnke, and Ghousuddin Syed of Yahoo! Inc.
    [Show full text]
  • Virtualization for Developers II
    Welcomes you to the session Virtualization for Developers Speaker Michael Fischer Copyright ©2008 Fischer & Consultants GmbH (F&C) Martinstrasse 1 44137 Dortmund Germany www.appfact.de [email protected] 1 Virtualization for Developers Inhalt 1. Creating a New Virtual Machine 6. Virtual Disks 2. More Machines 7. Virtual Networks 3. Basics 8. P2V and V2V 4. Market Overview 5. Scenarios for Developers Slide 2 Abstract: Virtualization for Developers Every good session starts with a sample. In part one of this this series about virtualization, Michael Fischer builds a virtual machine from scratch. Based on this example Michael covers the basics of virtualization: . What’s the difference between virtualization and emulation . What’s the difference between a virtualization layer and hyper visor . How do virtual disks and virtual networks work? And he answers probably the most important question: What do I need this for? Part II is dedicated to real world scenarios for developers: . Converting existing physical machines into virtual machines . Building test machines for developers and QA staff The session will conclude by building a complete team of virtualmachines which emulate a high availability SQL database cluster. 2 Virtualization for Developers 1. Creating a New Virtual Machine Steps: n Get the VMware Eval from www.VMware.com and install it n Create a root directory C:\VirtualMachines n Create a subdirectory \Images n Convert a Windows CD into an ISO image in the \Images directory n Define the virtual machine n Install Windows from the ISO image n Install VMware Tools n Make your first snapshot Slide 3 We will use VMware Workstation 6 for all examples in this presentation.
    [Show full text]
  • Selfie: Co-Locating Metadata and Data to Enable Fast Virtual Block Devices
    Selfie: Co-locating Metadata and Data to Enable Fast Virtual Block Devices Xingbo Wu Zili Shao Song Jiang Wayne State University The Hong Kong Polytechnic Wayne State University [email protected] University [email protected] [email protected] Abstract 1. Introduction Virtual block devices are widely used to provide block inter- Virtualization has been an imperative and widely used tech- face to virtual machines (VMs). A virtual block device man- nique to support isolation and consolidation, and to improve ages an indirection mapping from the virtual address space resource and power efficiency in various computing plat- presented to a VM, to a storage image hosted on file system forms, from cloud systems to personal/mobile computing or storage volume. This indirection is recorded as metadata devices. A virtual storage device, such as a virtual disk, is on the image, also known as a lookup table, which needs to one of the most essential components in a virtual machine be immediately updated upon each space allocation on the (VM) and its efficiency is critical to the VM’s performance, image for data safety (also known as image growth). This especially for I/O-intensive applications. A virtual disk, em- growth is common as VM templates for large-scale deploy- ulating functionalities available in a physical block device, is ments and snapshots for fast migration of VMs are heavily hosted as a disk image on another storage layer, which can used. Though each table update involves only a few bytes of be any file or block abstraction, such as a regular file, a disk data, it demands a random write of an entire block.
    [Show full text]
  • Scalable and Efficient Data Management in Distributed Clouds: Service Provisioning and Data Processing
    Scalable and Efficient Data Management in Distributed Clouds : Service Provisioning and Data Processing Jad Darrous To cite this version: Jad Darrous. Scalable and Efficient Data Management in Distributed Clouds : Service Provisioning and Data Processing. Distributed, Parallel, and Cluster Computing [cs.DC]. Université de Lyon, 2019. English. NNT : 2019LYSEN077. tel-02508592 HAL Id: tel-02508592 https://tel.archives-ouvertes.fr/tel-02508592 Submitted on 15 Mar 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Numéro National de Thèse : 2019LYSEN077 THESE de DOCTORAT DE L’UNIVERSITE DE LYON opérée par l’Ecole Normale Supérieure de Lyon Ecole Doctorale N° 512 École Doctorale en Informatique et Mathématiques de Lyon Discipline : Informatique Soutenue publiquement le 17/12/2019, par : Jad DARROUS Scalable and Efficient Data Management in Distributed Clouds: Service Provisioning and Data Processing Gestion de données efficace et à grande échelle dans les clouds distribués : Déploiement de services et traitement de données Devant le jury composé de :
    [Show full text]
  • Challenges and New Solutions for Live Migration of Virtual Machines in Cloud Computing Environments
    Challenges and New Solutions for Live Migration of Virtual Machines in Cloud Computing Environments Dissertation for the award of the degree “Doctor rerum naturalium” of the Georg-August-Universität Göttingen within the doctoral Program in Computer Science (PCS) of the Georg-August University School of Science (GAUSS) submitted by Fei Zhang from Sichuan, China Göttingen, 2018 Thesis Committee: Prof. Dr. Ramin Yahyapour Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG) Institut für Informatik, Georg-August-Universität Göttingen Prof. Dr. Xiaoming Fu Institut für Informatik, Georg-August-Universität Göttingen Members of the Examination Board/Reviewer: Reviewer: Prof. Dr. Ramin Yahyapour Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG) Institut für Informatik, Georg-August-Universität Göttingen Second Reviewer: Prof. Dr. Xiaoming Fu Institut für Informatik, Georg-August-Universität Göttingen Additional Reviewer: Prof. Dr. Hai Jin School of Computer Science and Technology, Huazhong University of Science and Technology Further members of the Examination Board: Prof. Dr. Jens Grabowski Institut für Informatik, Georg-August-Universität Göttingen Prof. Dr. Dieter Hogrefe Institut für Informatik, Georg-August-Universität Göttingen Jun.-Prof. Dr. Marcus Baum Institut für Informatik, Georg-August-Universität Göttingen Date of the oral examination: 03. May 2018 Acknowledgement During my Ph.D. study, I got a lot of help from so many people. I would say that I could not finish my study without their help. I will express my great thanks and gratitude to my supervisor Prof. Dr. Ramin Yahyapour for his countless advice, the inspiring discussions and his encouragements. His ample knowledge and experiences give me a deep impression. Many thanks are also given to Prof.
    [Show full text]