Introduction to
z/VM and Linux on System z
Malcolm Beattie Linux Technical Consultant, IBM UK From a presentation by Ralf Schiefelbein, IBM Germany
© 2006 IBM Corporation Trademarks
The following are trademarks of the International Business Machines Corporation in the United States and/or other countries.
AIX* ESCON* Multiprise* S/390 Parallel System i5* z/VM CICS* FICON Netfinity Enterprise Server System x zSeries DB2* IBM* OS/390* SecureWay VSE/ESA xSeries DB2Connect IBM logo* PR/SM System/390* Virtualisation Engine* pSeries DB2 Universal Database IMS/ESA RS/6000* System z9* WebSphere BladeCenter ebusiness logo MQSeries* S/390* System p5* z/OS On Demand * Registered trademarks of IBM Corporation The following are trademarks or registered trademarks of other companies. Intel is a trademark of the Intel Corporation in the United States and other countries. Java and all Javarelated trademarks and logos are trademarks or registered trademarks of Sun Microsystems, Inc., in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows and Windows NT are registered trademarks of Microsoft Corporation. SET and Secure Electronic Transaction are trademarks owned by SET Secure Electronic Transaction LLC. UNIX is a registered trademark of The Open Group in the United States and other countries. * All other products may be trademarks or registered trademarks of their respective companies. Notes: Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here. IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply. All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions. This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area. All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Information about nonIBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to nonIBM products. Questions on the capabilities of nonIBM products should be addressed to the suppliers of those products. Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography. This presentation and the claims outlined in it were reviewed for compliance with US law. Adaptations of these claims for use in other geographies must be reviewed by the local country counsel for compliance with local laws.
2 Intro to z/VM & Linux on System z 01/16/07 What is virtualization?
. Logical representation of resources not constrained by physical limitations
► Create many virtual resources within single physical device
► Reach beyond the box – see and manage many virtual resources as one
► Dynamically change and adjust across the infrastructure
3 Intro to z/VM & Linux on System z 01/16/07 What is partitioning? . Partitioning is the division of a single server’s resources* into multiple, independent, isolated systems capable of running their own operating system . Three types of partitioning: ► Hardware – resources are allocated to partitions on a onetoone basis with the underlying physical hardware (no sharing among partitions) ► Logical – resources are managed by hardware firmware and allocated to partitions with a finer granularity than hardware partitioning (resource sharing among partitions) ► Software – resources are managed by a software layer, aggregated into shared resource pools, and apportioned to users as virtual system resources, separating the presentation of the resources from the actual physical entities
* Resources include: processors, memory, I/O adapters and devices, networking interfaces, coprocessors
4 Intro to z/VM & Linux on System z 01/16/07 Server Virtualization Approaches Hardware Partitioning Hypervisor: Type 1 Hypervisor: Type 2
Apps ... Apps Apps ... Apps Apps ... Apps OS OS OS OS OS OS
Adjustable partitions Hypervisor Partition Hypervisor Controller Host OS
SMP Server SMP Server SMP Server
Physical partitioning Hypervisor software/firmware Hypervisor software runs on Sun Domains, HP nPartitions runs directly on server a host operating system System z PR/SM and z/VM VMware Server (GSX) Logical partitioning POWER Hypervisor Xen Hypervisor System p LPAR, HP vPartitions HP Integrity VM Microsoft Virtual Server VMware Infrastructure (ESX) . Hardware partitioning subdivides a server into fractions, each of which can run an OS . Hypervisors use a thin layer of code to achieve finegrained, dynamic resource sharing . Type 1 hypervisors with high efficiency and availability will become dominant for servers . Type 2 hypervisors will be mainly for clients where host OS integration is desirable
5 Intro to z/VM & Linux on System z 01/16/07 What: Virtual Machines
Virtual Machine Virtual Machine … Virtual Machine
Hypervisor (z/VM Control Program)
. A virtual machine is an execution context that obeys the architecture . The purpose of z/VM is to virtualize the real hardware: ► Faithfully replicate the z/Architecture Principles of Operation ► Permit any virtual configuration that could legitimately exist in real hardware ► Let many virtual machines operate simultaneously ► Allow over commitment of the real hardware (processors, for example) ► Your limits will depend on the size of your physical zSeries computer . Virtual machine aka VM user ID, VM logon, VM Guest, Virtual Server
6 Intro to z/VM & Linux on System z 01/16/07 What: Virtual Machines in Practice
Linux Linux z/OS CMS z/VSE z/TPF Others 32bit 64bit Hypervisor (z/VM Control Program)
. Control Program Component – manages virtual machines that adhere to the S/390 architecture and the z/Architecture . Extensions available through CP system services and features . CMS is special single user system and part of z/VM . Control Program interaction via console device
7 Intro to z/VM & Linux on System z 01/16/07 Phrases Associated with Virtual Machines
Linux
Virtual Linux z/OS or z/VSE processor
z/VM Control Program
Virtual Virtual Virtual Virtual processor processor processor processor
z/VM Control Program
Logical Logical Logical Logical Logical Logical Logical processor processor processor processor processor processor processor Logical Partition Logical Partition PR/SM LPAR
8 Intro to z/VM & Linux on System z 01/16/07 Phrases associated with Virtual Machines . In VM ► Guest: a system that is operating in a virtual machine, also known as user or userid ► Running under VM or Running on VM: Running a system as a guest of VM ► Running second level: Running a system as a guest of VM which is itself a guest of another VM ► A virtual machine may have multiple virtual processors ► Sharing is very important . In relationship to LPAR (partitioning) ► Logical Partition: LPAR equivalent of a virtual machine ► Logical Processor: LPAR equivalent of a virtual processor ► Running native or Running in BASIC mode: running without LPAR ● Note: Basic mode is not available on z890, z990 or z9 ► Isolation is very important 9 Intro to z/VM & Linux on System z 01/16/07 System z – A closer look at the ultimate virtualization resource IBM Mainframe . Massive consolidation platform ► 60 logical partitions, hundreds of virtual servers under z/VM ► Virtualization is builtin, not addedon z/VM z/VM z/VM ► HiperSockets for memoryspeed Partitioning Firmware communication
CPU 1 CPU 2 CPU 3 CPU 4 ► Most sophisticated and complete hypervisor function available . Intelligent & autonomic mgmt. of diverse workloads and . Utilization often exceeds 80% system resources based on ► Handles peak workload business policies and workload utilization of 100% without performance objectives service level degradation
10 Intro to z/VM & Linux on System z 01/16/07 System z virtualization / partitioning
System z provides HiperSockets & Virtual Networking and Switching two levels of partitioning Web Sphere WebSphere Traditional ► PR/SM enables SysAdmin Test Apache OLTP and FTP Test scalable virtual Tools Batch server hosting for Linux Linux CMS Linux WLM WLM Linux z/OS LPAR environments z/OS z/OS ► z/VM provides hypervisor function z/VM Control Program z/VM for highly scalable virtualization I/O & Network Memory Memory Memory Memory IFL Processors Processors L P A R L P A R L P A R L P A R
Processor Resource / System Manager (PR/SM)
11 Intro to z/VM & Linux on System z 01/16/07 z/VM – Unlimited Virtualization
. Mature technology ► CP67 introduced in 1967 . Software Hypervisor integrated in hardware ► Sharing of CPU, memory and I/O resources Logical Partitions (LPARs) ► Virtual network – virtual switches/routers ► Virtual I/O (minidisks, virtual cache, …) ► Virtual appliances (SNA/NCP, etc.) . Easy management ► Rapid install of new servers Virtual Servers z/VM ● Cloning or IBM Director task z/VM Center ► Selfoptimizing workload management ► Excellent automation and system management facilities ► Flexible solution for test and development systems
12 Intro to z/VM & Linux on System z 01/16/07 The value of z/VM for Linux
. Enhanced performance, growth and scalability ► Server consolidation enables horizontal growth ► Ntier architecture on two tiers of hardware ► Extensive support for sharing resources ► Virtual networking ► Effective isolation of Linux images, if required
. Increased productivity Linux on System z images ► Development and testing Server farms ► Production support . Improved operations ► Backup and recovery z/VM ► Command and control LPAR
13 Intro to z/VM & Linux on System z 01/16/07 Key points to remember about virtualization
. Virtualization is not about higher performance ► Applications are not going to run faster on servers engaged in application consolidation. It is very important, though, that applications not run perceptibly slower. Increased efficiency and simplified management is the objective. . Higher utilization (virtualization) is directly proportional to available server throughput ► All virtualization technologies must work within resource constraints of server infrastructure. (All servers have a finite throughput capability.) ► Throughput potential can best be identified with “changed data” benchmarks. . Virtualization will not overcome a weak server architecture ► Virtualization introduces mixed / random / unpredictable behavior. Applications have different instruction and data working sets, putting dynamic pressure on the server interconnect. ► Customers cannot afford to consolidate applications on low reliability servers! . A history with virtualization matters ► Virtualization on IBM System z and POWER is an integration of hardware, firmware and software. All other architectures are physical and/or software implementations. ► Security, isolation, fairshare scheduling are not buzzwords. Common criteria certification.
14 Intro to z/VM & Linux on System z 01/16/07 Linux, IBM, and Linux on System z
© 2006 IBM Corporation Why is Linux is important to customers
. Linux is about choice . Drivers to use Linux Today and flexibility ► Attractive hardware acquisition costs . Linux is secure ► Availability of lowcost, Open . Linux is reliable Source software ► Linux runs across all hardware . Linux drives business goals: platforms ► Reduce costs ● x86, x8664, RISC and CISC ► Simplification (including mainframes) ► Improve application service levels ► Interest in alternatives to Windows and UNIX, offering customers ► Promotes innovation choice in software platforms ► Internally change business process ► Expectations of improved and drive contribution to business price/performance ► Generate revenue ► Reuse of existing UNIX skills in enterprise, HPC computing
Source: IDC Directions 2005
16 Intro to z/VM & Linux on System z 01/16/07 What is Linux on System z?
. Standard Linux with ASCII Environment . Uses System z HW, including IEEE floating point, HiperSockets, FCP (Open Fibre Channel), CPACF cryptographic CPU instructions, … . Runs native, within an LPAR, or under z/VM
Linux Applikation GNU GNU GNU Compiler Linux RTL Binutils Delta as Kernel IBM developedr Code low as 5% IBM developedr Code System z Hardware
. Design Principles ► Not a unique version of Linux (Linux is Linux is Linux) ► No change to Look & Feel of Linux on System z ► The IBM commitment to z/OS, z/TPF, and z/VSE is not affected
17 Intro to z/VM & Linux on System z 01/16/07 Integrated Facility for Linux
. Additional engines dedicated to Linux workloads ► Supports z/VM and Linux on System z ► IFLs on “subuni” systems run at “full speed” ● z800, z890, z9 EC, z9 BC
. Traditional mainframe software charges unaffected ► IBM mainframe software ► Independent Software Vendor products
. Linux and z/VM charged only against the IFLs
18 Intro to z/VM & Linux on System z 01/16/07 What System z brings to Linux
. The most reliable hardware platform available ► Redundant processors and memory ► Error detection and correction ► Remote Support Facility (RSF) . Designed to support mixed work loads ► Allows consolidation while maintaining one server per application ► Complete work load isolation . Centralized Linux systems are easier to manage . Scalability ► System z9 scales to 54 application processors ► 2 spare processors and up to 8 dedicated I/O processors ► Hundreds of Linux virtual servers . Access to System z specific hardware ► Cryptographic support – CPACF, Crypto Express2 ► HiperSockets for ultrahigh speed communication
19 Intro to z/VM & Linux on System z 01/16/07 IBM Software for Linux Product Matrix ibm.com/linux/matrix
20 Intro to z/VM & Linux on System z 01/16/07 Application serving with Linux on System z
Outside world Demilitarized Zone (DMZ) Internal network
z/VM z/OS
Collaboration W eb Server Application Server Public Key Application
Infrastructure w L F F C
o / Node i
i r a a H r e e c d T P w D w h
T B r A a i o a o n Commerce
P Directory l a c m l l t g l
I o l
c
/ n a L / a
Server c e Server P
L n t o L
Domain Name i o l e n r o e c a o l o r
a e Server r d a F F n x a d r
d i y i e t B r r B w i B
e e o t S a a w i a w n t l e l h a l a a a a r
n Systems n v l S
l Web n l l c c e c S
i Management e r n Application e
User L r g r Server
Database Shared File Server The best LAN System is one with no wires System z
21 Intro to z/VM & Linux on System z 01/16/07 When should Linux on System z be used?
© 2006 IBM Corporation Typical Server Utilization (absolute)
50000
45000
40000
35000
30000
25000
20000
15000
10000
5000
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 3 5 1 3 5 1 3 0 2 4 0 2 4 0 3 5 1 3 5 1 3 0 2 4 0 2 4 0 3 5 1 3 5 1 3 : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : 0 0 9 9 2 5 2 8 4 3 6 3 6 0 3 3 6 3 6 3 2 5 9 5 9 2 2 8 2 5 8 1 4 1 8 1 0 0 0 1 1 1 2 2 0 0 0 1 1 1 2 0 0 0 1 1 1 2 0 0 0 1 1 1 2 0 0 0 1 1 1 2
23 Intro to z/VM & Linux on System z 01/16/07 Typical Server Utilization (relative)
25 00 00
Installed Capacity
20 00 00
15 00 00
10 00 00
5 00 00 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 4 1 5 2 5 1 3 0 4 5 1 4 0 2 5 0 2 3 5 0 2 4 0 1 3 4 2 4 5 1 3 0 2 3 1 3 4 : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : 0 9 9 4 4 3 3 9 9 4 7 4 3 3 9 8 2 3 6 2 6 2 1 8 1 7 0 6 2 5 2 1 1 7 0 6 2 5 0 0 0 0 1 1 1 2 0 0 0 1 1 1 2 2 0 0 0 1 1 1 2 0 0 0 1 1 1 2 2 0 0 0 1 1 1 2
24 Intro to z/VM & Linux on System z 01/16/07 The Road to IT Simplification
Virtual Server, Windows Server Storage, Network Windows Server
UNIX® Server Network Network Virtualization Management UNIX Server Server Server Storage Linux Server Linux Storage Network Storage Server Logical Complex Physical Consolidation Simplification . Consistent Systems Mgmt. 1 Workload per Server Less Server and License . . . Multiple OS’s per Server Different Mgmt. Tools . Different Mgmt Tools . . Rapid Provisioning Labour-intensive Provisioning . Manual Provisioning . . Automat. Workload Mgmt.
25 Intro to z/VM & Linux on System z 01/16/07 ISV Support for Linux on System z
900
# ISVs 800 # Appl. 700
600
500
400
300
200
100
0 4Q/00 4Q/01 4Q/02 4Q/03 4Q/04 4Q/05 3Q06
For more details please see: http://www.ibm.com/servers/eserver/zseries/os/linux/apps/all.html As of: Sept. 2006
26 Intro to z/VM & Linux on System z 01/16/07 Some Linux on System z References
27 Intro to z/VM & Linux on System z 01/16/07 Redbooks for Linux on System z (www.redbooks.ibm.com)
Actual 141 entries, e.g.: ► IBM System z9 109 Technical Introduction, SG24666900, Redbook, published 26 July 2005 ► z/VM and Linux on zSeries: from LPAR to Virtual Servers in Two Days, SG24669500, Redbook, published 20 June 2005 ► IBM Communication Controller Migration Guide, SG24629801, Redbook, published 14 June 2005 ► Linux on zSeries: Samba3 Performance Observations, REDP398800, Redpaper, published 1 April 2005 ► IBM eServer zSeries Connectivity Handbook, SG24544404, Redbook, published 15 February 2005 ► Experiences with Oracle 10g Database on Linux for zSeries, REDP385900, Redpaper, last update 22 December 2004 ► ...
http://publibb.boulder.ibm.com/cgi bin/searchsite.cgi?query=Linux+and+(System+and+z9+or+zseries+or+S/390)
28 Intro to z/VM & Linux on System z 01/16/07 Some Websites
IBM Linux ibm.com/linux
IBM Software ibm.com/linux/software
IBM Global Services ibm.com/linux/support
IBM Linux on System z ibm.com/systems/z/os/linux
IBM developer works ibm.com/developerworks
IBM z/VM vm.ibm.com
Red Hat europe.redhat.com
Novell/SUSE novell.com External Linux on www.marist.edu/htbin/wlvindex?linux390 System z Mailing List
29 Intro to z/VM & Linux on System z 01/16/07 Many Thanks for your Attention!
Malcolm Beattie IBM UK Europe System z Team eMail: [email protected]
30 Intro to z/VM & Linux on System z 01/16/07