The Impact of Virtualization on Modern Computing Environments

Total Page:16

File Type:pdf, Size:1020Kb

The Impact of Virtualization on Modern Computing Environments The Impact of Virtualization on Modern Computing Environments Mendel Rosenblum 1 Talk Outline • The Problem: Computers work poorly – Operating Systems get blamed • Virtualization: A level of indirection – Use data center hardware more efficiently – Help improve operating systems • Software distribution and service delivery models 2 2 Modern Computer Environments App1 App2 App3 Apps: Oracle, SAP, Microsoft, ... OS: Microsoft, Linux, … Operating System • Manage hardware • Export better abstractions Hardware: IBM, HP, Dell, .... 3 3 Operating System Market Dynamics • Chicken & egg problem: – Need applications to get users – Need users for applications and drivers • Incentive: Try to be everything to everybody • Results: – Bloated – Unreliable – Insecure – High management cost – Barrier to innovation 4 4 Problem: Failure to multiplex hardware • Common: One service/user per computer – Encoded in best practices • Modular design, security, Windows NT – More services equals more computers • Moore’s law effect: – Cheaper computer – More idle time per computer • Result: Highly inefficient computing 5 5 Virtualization – A level of indirection Application Operating System Operating System Virtualization Compatibility and High Performance 6 6 Virtualization layer attributes • Tractable complexity Application – Interface & Implementation Operating System • Strong Isolation Operating System – High reliability & Virtualization Security • Innovation possible – The Game Multiplex 7 7 Server Consolidation Hypervisor Hypervisor 8 8 Add Live Virtual Machine Migration Hypervisor Hypervisor 9 9 Add Distributed Resource Scheduling Optimize – Utilization – Power – Service Level Agreements Hypervisor Hypervisor CPU MEM CPU MEM 10 10 Data center wide virtualization layer Same Logical View HypervisorVirtualization LayerHypervisor Hardware Pool 11 11 Treat Hardware as a Pool of Resources Virtualization Layer 12 12 Effect of Virtualization on Data Center • Much higher hardware utilization – Scheduler tries to drive utilization up to 100% • Saves much power – Dynamic placement is superior to static • A data center wide distributed system – A foothold for innovation – What more can we do? Monitor software 13 13 Automatic Restart on failures Virtualization Layer 14 14 Site Disaster Recovery Virtualization Layer Virtualization Layer 15 15 Add Record/Replay to the virtualization • Record – Input to the virtual machine – Asynchronous external events (e.g. interrupts) • Relatively compact encoding • Enable logging and replay of execution 16 16 PRIMARY SECONDARY 17 17 Mask Hardware Failures Virtualization Layer 18 18 Discussion • Compelling for enterprise data centers – Less so for HPC and portable devices • Functionality versus assurance – Hopefully we learned from our mistakes • Software runs the same in VMs – Crappy software is still crappy 19 19 Virtualization Impact on Software Virtualization has done a few things: • Monitor and report software behavior • Treat VM images as first class objects – Version control, etc. • Some security enhancements 20 20 Package Software Deployment – Procure hardware App – Install operating App Patches system Patch – Install OS patches Network OS and remove Configuration OS Patches services – Install application – Install application patches – Apply configuration 21 21 Virtual Appliances App App Patches Virtual Appliance OS Configuration Configuration OS Patches 22 22 Virtual Appliances for software deployment Virtual Virtualization Layer Appliance 23 23 Virtual Appliances vs. Package Software • Virtual appliance advantages: – No more user assembly – Better security • Virtual appliances issues: – Difficult to integrate multiple appliances – Heavy weight – Different software licensing model 24 24 Virtual Appliance Operating System Don’t need complex hardware management Application Application Don’t need broad application support Operating System Application-specific operating system Application Support Look at hardware appliance operating VirtualizationHardware Mgmt. Layer systems for examples 25 25 OSes for Virtual Appliances • OS selected by application developer – Criteria: • Match needs of application • Reliability, security, etc. • License fees • Likely features of a virtual appliance OS – Highly customizable – Support appliance infrastructure • Opportunity for new OSes 26 26 Roles in software service delivery • Computing Hardware • Software Development • Software Configuration • Management/maintenance • Users 27 27 Two Extremes: Package Software & SaaS • Package Software – Example: Windows + Exchange + Outlook – Users does all except software development • Software as a Service (SaaS) – Example: Gmail – All roles (hardware, software, management) except users done by service provider • Virtualization lets us access other points in the space 28 28 Cloud Computing with Virtualization ForCRM user, model supports Emaildifferent: Web •Virtual Appliance builder VPN Firewall•Virtual Appliance maintainer Virtualization Layer •Execution platform Cloud Data Center Virtualization Layer 29 29 Local Data Center Virtualization and Cloud Computing • Key advantage of leveraging existing software – Compatible migration vs. new paradigm – Can existing package software convert to a service? • Hardware virtualization vs. PaaS – Advantage: Ultimate software flexibility, Strong isolation – Disadvantage: Need infrastructure, Weight 30 30 Summary Level of indirection trick still works More manageable, more available, more reliable, more secure, … New options for software services Not just better hardware management 31 31.
Recommended publications
  • Understanding Full Virtualization, Paravirtualization, and Hardware Assist
    VMware Understanding Full Virtualization, Paravirtualization, and Hardware Assist Contents Introduction .................................................................................................................1 Overview of x86 Virtualization..................................................................................2 CPU Virtualization .......................................................................................................3 The Challenges of x86 Hardware Virtualization ...........................................................................................................3 Technique 1 - Full Virtualization using Binary Translation......................................................................................4 Technique 2 - OS Assisted Virtualization or Paravirtualization.............................................................................5 Technique 3 - Hardware Assisted Virtualization ..........................................................................................................6 Memory Virtualization................................................................................................6 Device and I/O Virtualization.....................................................................................7 Summarizing the Current State of x86 Virtualization Techniques......................8 Full Virtualization with Binary Translation is the Most Established Technology Today..........................8 Hardware Assist is the Future of Virtualization, but the Real Gains Have
    [Show full text]
  • Enabling Intel® Virtualization Technology Features and Benefits
    WHITE PAPER Intel® Virtualization Technology Enterprise Server Enabling Intel® Virtualization Technology Features and Benefits Maximizing the benefits of virtualization with Intel’s new CPUs and chipsets EXECUTIVE SUMMARY Although virtualization has been accepted in most data centers, some users have not yet taken advantage of all the virtualization features available to them. This white paper describes the features available in Intel® Virtualization Technology (Intel® VT) that work with Intel’s new CPUs and chipsets, showing how they can benefit the end user and how to enable them. Intel® Virtualization Technology Goldberg. Thus, developers found it difficult Feature Brief and Usage Model to implement a virtual machine platform on Intel VT combines with software-based the x86 architecture without significant virtualization solutions to provide maximum overhead on the host machine. system utilization by consolidating multiple environments into a single server or PC. In 2005 and 2006, Intel and AMD, working By abstracting the software away from the independently, each resolved this by creat- underlying hardware, a world of new usage ing new processor extensions to the x86 models opens up that can reduce costs, architecture. Although the actual implemen- increase management efficiency, and tation of processor extensions differs strengthen security—all while making your between AMD and Intel, both achieve the computing infrastructure more resilient in same goal of allowing a virtual machine the event of a disaster. hypervisor to run an unmodified operating system without incurring significant emula- During the last four years, Intel has intro- tion performance penalties. duced several new features to Intel VT. Most of these features are well known, but others Intel VT is Intel’s hardware virtualization for may not be.
    [Show full text]
  • PCI DSS Virtualization Guidelines
    Standard: PCI Data Security Standard (PCI DSS) Version: 2.0 Date: June 2011 Author: Virtualization Special Interest Group PCI Security Standards Council Information Supplement: PCI DSS Virtualization Guidelines Information Supplement • PCI DSS Virtualization Guidelines • June 2011 Table of Contents 1 Introduction ....................................................................................................................... 3 1.1 Audience ................................................................................................................ 3 1.2 Intended Use .......................................................................................................... 4 2 Virtualization Overview .................................................................................................... 5 2.1 Virtualization Concepts and Classes ..................................................................... 5 2.2 Virtual System Components and Scoping Guidance ............................................. 7 3 Risks for Virtualized Environments .............................................................................. 10 3.1 Vulnerabilities in the Physical Environment Apply in a Virtual Environment ....... 10 3.2 Hypervisor Creates New Attack Surface ............................................................. 10 3.3 Increased Complexity of Virtualized Systems and Networks .............................. 11 3.4 More Than One Function per Physical System ................................................... 11 3.5 Mixing VMs of
    [Show full text]
  • Virtualization and Shared Infrastructure Data Storage for IT in Kosovo Institutions Gani Zogaj
    Rochester Institute of Technology RIT Scholar Works Theses Thesis/Dissertation Collections 2012 Virtualization and shared Infrastructure data storage for IT in Kosovo institutions Gani Zogaj Follow this and additional works at: http://scholarworks.rit.edu/theses Recommended Citation Zogaj, Gani, "Virtualization and shared Infrastructure data storage for IT in Kosovo institutions" (2012). Thesis. Rochester Institute of Technology. Accessed from This Master's Project is brought to you for free and open access by the Thesis/Dissertation Collections at RIT Scholar Works. It has been accepted for inclusion in Theses by an authorized administrator of RIT Scholar Works. For more information, please contact [email protected]. AMERICAN UNIVERSITY IN KOSOVO MASTER OF SCIENCE IN PROFESSIONAL STUDIES Virtualization and Shared Infrastructure Data Storage for IT in Kosovo institutions “Submitted as a Capstone Project Report in partial fulfillment of a Master of Science degree in Professional Studies at American University in Kosovo” By Gani ZOGAJ November, 2012 Virtualization and Shared Infrastructure Data Storage for IT in Kosovo institutions ACKNOWLEDGEMENTS First, I would like to thank God for giving me health for completing my Master’s Degree studies. I would like to express my gratitude to my supervisor of capstone proposal, Bryan, for his support and for giving me suggestions and recommendations throughout the Capstone Project work. Finally, I would like to thank my wife, Shkendije, and my lovely daughters, Elisa and Erona, who I love so much, for their understanding while I was preparing the Capstone Project and I couldn’t spend enough time with them. 2 Virtualization and Shared Infrastructure Data Storage for IT in Kosovo institutions Table of Contents Figures and Tables………………………………………………….……………….……….……5 List of Acronyms………………………………………………………………....………….……6 Executive Summary……………………………………………………..………………...………8 Chapter 1…………………………………………………………………………...…………….11 1.
    [Show full text]
  • Oracle® Linux Virtualization Manager Getting Started Guide
    Oracle® Linux Virtualization Manager Getting Started Guide F25124-11 September 2021 Oracle Legal Notices Copyright © 2019, 2021 Oracle and/or its affiliates. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable: U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs) and Oracle computer documentation or other Oracle data delivered to or accessed by U.S. Government end users are "commercial computer software" or "commercial computer software documentation" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, reproduction, duplication, release, display, disclosure, modification, preparation of derivative works, and/or adaptation of i) Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs), ii) Oracle computer documentation and/or iii) other Oracle data, is subject to the rights and limitations specified in the license contained in the applicable contract.
    [Show full text]
  • Firecracker: Lightweight Virtualization for Serverless Applications
    Firecracker: Lightweight Virtualization for Serverless Applications Alexandru Agache, Marc Brooker, Andreea Florescu, Alexandra Iordache, Anthony Liguori, Rolf Neugebauer, Phil Piwonka, and Diana-Maria Popa, Amazon Web Services https://www.usenix.org/conference/nsdi20/presentation/agache This paper is included in the Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI ’20) February 25–27, 2020 • Santa Clara, CA, USA 978-1-939133-13-7 Open access to the Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI ’20) is sponsored by Firecracker: Lightweight Virtualization for Serverless Applications Alexandru Agache Marc Brooker Andreea Florescu Amazon Web Services Amazon Web Services Amazon Web Services Alexandra Iordache Anthony Liguori Rolf Neugebauer Amazon Web Services Amazon Web Services Amazon Web Services Phil Piwonka Diana-Maria Popa Amazon Web Services Amazon Web Services Abstract vantage over traditional server provisioning processes: mul- titenancy allows servers to be shared across a large num- Serverless containers and functions are widely used for de- ber of workloads, and the ability to provision new func- ploying and managing software in the cloud. Their popularity tions and containers in milliseconds allows capacity to be is due to reduced cost of operations, improved utilization of switched between workloads quickly as demand changes. hardware, and faster scaling than traditional deployment meth- Serverless is also attracting the attention of the research com- ods. The economics and scale of serverless applications de- munity [21,26,27,44,47], including work on scaling out video mand that workloads from multiple customers run on the same encoding [13], linear algebra [20, 53] and parallel compila- hardware with minimal overhead, while preserving strong se- tion [12].
    [Show full text]
  • Reference Architecture: Lenovo Client Virtualization (LCV) with Thinksystem Servers
    Reference Architecture: Lenovo Client Virtualization (LCV) with ThinkSystem Servers Last update: 10 June 2019 Version 1.3 Base Reference Architecture Describes Lenovo clients, document for all LCV servers, storage, and networking solutions hardware used in LCV solutions LCV covers both virtual Contains system performance desktops and hosted considerations and performance desktops testing methodology and tools Mike Perks Pawan Sharma Table of Contents 1 Introduction ............................................................................................... 1 2 Business problem and business value ................................................... 2 3 Requirements ............................................................................................ 3 4 Architectural overview ............................................................................. 6 5 Component model .................................................................................... 7 5.1 Management services ............................................................................................ 10 5.2 Support services .................................................................................................... 11 5.2.1 Lenovo Thin Client Manager ...................................................................................................... 11 5.2.2 Chromebook management console ........................................................................................... 12 5.3 Storage .................................................................................................................
    [Show full text]
  • Paravirtualization (PV)
    Full and Para Virtualization Dr. Sanjay P. Ahuja, Ph.D. Fidelity National Financial Distinguished Professor of CIS School of Computing, UNF x86 Hardware Virtualization The x86 architecture offers four levels of privilege known as Ring 0, 1, 2 and 3 to operating systems and applications to manage access to the computer hardware. While user level applications typically run in Ring 3, the operating system needs to have direct access to the memory and hardware and must execute its privileged instructions in Ring 0. x86 privilege level architecture without virtualization Technique 1: Full Virtualization using Binary Translation This approach relies on binary translation to trap (into the VMM) and to virtualize certain sensitive and non-virtualizable instructions with new sequences of instructions that have the intended effect on the virtual hardware. Meanwhile, user level code is directly executed on the processor for high performance virtualization. Binary translation approach to x86 virtualization Full Virtualization using Binary Translation This combination of binary translation and direct execution provides Full Virtualization as the guest OS is completely decoupled from the underlying hardware by the virtualization layer. The guest OS is not aware it is being virtualized and requires no modification. The hypervisor translates all operating system instructions at run-time on the fly and caches the results for future use, while user level instructions run unmodified at native speed. VMware’s virtualization products such as VMWare ESXi and Microsoft Virtual Server are examples of full virtualization. Full Virtualization using Binary Translation The performance of full virtualization may not be ideal because it involves binary translation at run-time which is time consuming and can incur a large performance overhead.
    [Show full text]
  • Red Hat Virtualization 4.3 Planning and Prerequisites Guide
    Red Hat Virtualization 4.3 Planning and Prerequisites Guide Planning for the Installation and Configuration of Red Hat Virtualization 4.3 Last Updated: 2019-05-09 Red Hat Virtualization 4.3 Planning and Prerequisites Guide Planning for the Installation and Configuration of Red Hat Virtualization 4.3 Red Hat Virtualization Documentation Team Red Hat Customer Content Services [email protected] Legal Notice Copyright © 2019 Red Hat, Inc. The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/ . In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version. Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law. Red Hat, Red Hat Enterprise Linux, the Shadowman logo, JBoss, OpenShift, Fedora, the Infinity logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries. Linux ® is the registered trademark of Linus Torvalds in the United States and other countries. Java ® is a registered trademark of Oracle and/or its affiliates. XFS ® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries. MySQL ® is a registered trademark of MySQL AB in the United States, the European Union and other countries.
    [Show full text]
  • IT Modernization with Nutanix – a Cloud-Smart Approach
    SOLUTION BRIEF IT Modernization with Nutanix - A Cloud- Smart Approach Nutanix simplifies legacy IT infrastructure while simultaneously enabling IT-as-a-Service by providing the secure and intelligent automation capabilities cloud-based datacenter architectures require THE BUSINESS VALUE Federal agencies are increasingly being asked to spend less time on infrastructure OF NUTANIX and allocate more time and budget to application services that add business value. Despite a continuous stream of IT hardware and software enhancements, • 60% lower cost of operations the infrastructure challenges and costs faced by agencies continue to rise. • 39% lower IT infrastructure costs Traditional IT infrastructure and virtualization software required to meet agency needs are complex and expensive, and datacenter management has become • 534% 5-year ROI painful. Far too much time, effort, and budget are focused on just keeping the • 61% more IT staff efficiencies lights on and the ability to support an agile continuous development environment with no downtime is not possible today. • 7 month payback Today, IT is distributed. There’s no longer just one cloud. Business applications run • 97% fewer outages in private, public, and distributed clouds. But with many clouds, come many • 73% less staff time to deploy silos–different management tools, infrastructure technologies, and consumption compute resources models – all of which make IT more complex. • 68% less staff time to deploy Legacy infrastructure—with separate silos of proprietary hardware-based servers, storage resources storage, storage networks, and virtualization—is not well suited to meet the growing demand or agility needed to service cloud or numerous enterprise workloads including virtualized, bare metal, container-based, DevSecOps automation use cases, or hybrid cloud architectures.
    [Show full text]
  • Malware Collection and Analysis Via Hardware Virtualization Tamas K
    University of Connecticut OpenCommons@UConn Doctoral Dissertations University of Connecticut Graduate School 12-1-2015 Malware Collection and Analysis via Hardware Virtualization Tamas K. Lengyel [email protected] Follow this and additional works at: https://opencommons.uconn.edu/dissertations Recommended Citation Lengyel, Tamas K., "Malware Collection and Analysis via Hardware Virtualization" (2015). Doctoral Dissertations. 964. https://opencommons.uconn.edu/dissertations/964 Malware Collection and Analysis via Hardware Virtualization Tamas Kristof Lengyel University of Connecticut 2015 Abstract Malware is one of the biggest security threat today and deploying effective defen- sive solutions requires the collection and rapid analysis of a continuously increasing number of samples. The collection and analysis is greatly complicated by the pro- liferation of metamorphic malware as the efficacy of signature-based static analysis systems is greatly reduced. While honeypots and dynamic malware analysis has been effectively deployed to combat the problem, significant challenges remain. The rapidly increasing number of malware samples poses a particular challenge as it greatly inflates the cost of the hardware required to process the influx. As modern malware also deploys anti-debugging and obfuscation techniques, the time it takes to formulate effective solutions is further exacerbated. There is a clear need for effective scalability in automated malware collection and analysis. At the same time, modern malware can both detect the monitoring environment and hide in unmonitored corners of the system. It has also been observed that mal- ware modifies its run-time behavior to lead the analysis system astray when it detects a monitoring environment. Consequently, it is critical to create a stealthy environment to hide the presence of the data collection from the external attacker.
    [Show full text]
  • BEST PRACTICES for DATA CENTRE VIRTUALIZATION (ITSP.70.010) March 2020
    UNCLASSIFIED CYBER CENTRE DATA CENTRE VIRTUALIZATION REPORT: BEST PRACTICES FOR DATA CENTRE VIRTUALIZATION (ITSP.70.010) March 2020 PRACTITIONER TLP:WHITE 1 ITSP.70.010 UNCLASSIFIED FOREWORD ITSP.70.010 Cyber Centre Data Centre Virtualization Report: Best Practices for Data Centre Virtualization is an UNCLASSIFIED publication, issued under the authority of the Head, Canadian Centre for Cyber Security (Cyber Centre). For more information, email or phone our Contact Centre: Cyber Centre Contact Centre [email protected] 613-949-7048 or 1-833-CYBER-88 EFFECTIVE DATE This publication takes effect on (03/27/2020). REVISION HISTORY Revision Amendments Date 1 First release. March 27, 2020 2 ITSP.70.010 UNCLASSIFIED OVERVIEW To improve efficiency and streamline operations, many organizations are virtualizing their data centres. However, some are doing so without a proper understanding of the security implications of their decisions on the overall security posture of the data centre. By increasing their consolidation ratios (i.e. the number of virtual machines that can operate on each physical host machine), many organizations may unintentionally compromise their network security architecture. Moreover, any attempt to replace many of the physical isolation mechanisms with logical equivalents may introduce unacceptable risk into their network architecture. Not only are virtualized data centres (VDCs) susceptible to most of the vulnerabilities inherent in traditional data centres, but they introduce new vulnerabilities specific to this environment. While complex virtualization threats (e.g. System Management Mode (SMM) rootkits, side-channel attacks, and hyperjacking) must be addressed, it is the more practical threats that are of greater risk to the VDC.
    [Show full text]