Resource Management
Total Page:16
File Type:pdf, Size:1020Kb
Resource Management Sun Microsystems, Inc. 901 San Antonio Road Palo Alto, CA 94303-4900 USA 650 960-1300 Fax 650 969-9131 Part No. 805-7268-10 July 1999, Revision A Send comments about this document to: [email protected] Copyright 1999 Sun Microsystems, Inc., 901 San Antonio Road • Palo Alto, CA 94303 USA. All rights reserved. This product or document is protected by copyright and distributed under licenses restricting its use, copying, distribution, and decompilation. No part of this product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors, if any. Third-party software, including font technology, is copyrighted and licensed from Sun suppliers. Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is a registered trademark in the U.S. and other countries, exclusively licensed through X/Open Company, Ltd. Sun, Sun Microsystems, the Sun logo, AnswerBook, Java, the Java Coffee Cup, and Solaris are trademarks, registered trademarks, or service marks of Sun Microsystems, Inc. in the U.S. and other countries. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. in the U.S. and other countries. Products bearing SPARC trademarks are based upon an architecture developed by Sun Microsystems, Inc. The OPEN LOOK and Sun™ Graphical User Interface was developed by Sun Microsystems, Inc. for its users and licensees. Sun acknowledges the pioneering efforts of Xerox in researching and developing the concept of visual or graphical user interfaces for the computer industry. Sun holds a non-exclusive license from Xerox to the Xerox Graphical User Interface, which license also covers Sun’s licensees who implement OPEN LOOK GUIs and otherwise comply with Sun’s written license agreements. RESTRICTED RIGHTS: Use, duplication, or disclosure by the U.S. Government is subject to restrictions of FAR 52.227-14(g)(2)(6/87) and FAR 52.227-19(6/87), or DFAR 252.227-7015(b)(6/95) and DFAR 227.7202-3(a). DOCUMENTATION IS PROVIDED “AS IS” AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON- INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID. Copyright 1999 Sun Microsystems, Inc., 901 San Antonio Road • Palo Alto, CA 94303 Etats-Unis. Tous droits réservés. Ce produit ou document est protégé par un copyright et distribué avec des licences qui en restreignent l’utilisation, la copie, la distribution, et la décompilation. Aucune partie de ce produit ou document ne peut être reproduite sous aucune forme, par quelque moyen que ce soit, sans l’autorisation préalable et écrite de Sun et de ses bailleurs de licence, s’il y en a. Le logiciel détenu par des tiers, et qui comprend la technologie relative aux polices de caractères, est protégé par un copyright et licencié par des fournisseurs de Sun. Des parties de ce produit pourront être dérivées des systèmes Berkeley BSD licenciés par l’Université de Californie. UNIX est une marque déposée aux Etats-Unis et dans d’autres pays et licenciée exclusivement par X/Open Company, Ltd. Sun, Sun Microsystems, le logo Sun, AnswerBook, Java, le logo Jave Coffee Cup, et Solaris sont des marques de fabrique ou des marques déposées, ou marques de service, de Sun Microsystems, Inc. aux Etats-Unis et dans d’autres pays. Toutes les marques SPARC sont utilisées sous licence et sont des marques de fabrique ou des marques déposées de SPARC International, Inc. aux Etats-Unis et dans d’autres pays. Les produits portant les marques SPARC sont basés sur une architecture développée par Sun Microsystems, Inc. L’interface d’utilisation graphique OPEN LOOK et Sun™ a été développée par Sun Microsystems, Inc. pour ses utilisateurs et licenciés. Sun reconnaît les efforts de pionniers de Xerox pour la recherche et le développement du concept des interfaces d’utilisation visuelle ou graphique pour l’industrie de l’informatique. Sun détient une licence non exclusive de Xerox sur l’interface d’utilisation graphique Xerox, cette licence couvrant également les licenciés de Sun qui mettent en place l’interface d’utilisation graphique OPEN LOOK et qui en outre se conforment aux licences écrites de Sun. CETTE PUBLICATION EST FOURNIE "EN L’ETAT" ET AUCUNE GARANTIE, EXPRESSE OU IMPLICITE, N’EST ACCORDEE, Y COMPRIS DES GARANTIES CONCERNANT LA VALEUR MARCHANDE, L’APTITUDE DE LA PUBLICATION A REPONDRE A UNE UTILISATION PARTICULIERE, OU LE FAIT QU’ELLE NE SOIT PAS CONTREFAISANTE DE PRODUIT DE TIERS. CE DENI DE GARANTIE NE S’APPLIQUERAIT PAS, DANS LA MESURE OU IL SERAIT TENU JURIDIQUEMENT NUL ET NON AVENU. Please Recycle Contents Acknowledgments xxi Preface xxiii Sun BluePrints Program xxiii Who Should Use This Book xxiv How This Book Is Organized xxiv Related Books xxv What Typographic Changes Mean xxvi Shell Prompts in Command Examples xxvii Part I. Architecture 1. Introduction 1 Business Problems 1 Scope 2 2. Service Level Management 3 Service Level Definitions and Interactions 3 System Level Requirements 4 Sizing Estimates 4 Service Level Agreements 5 iii Real User Experiences 5 Service Level Measurements 5 Policies and Controls 6 Resource Management Control Loop 7 A Simple Approach to Control Theory 8 Viewpoints of Resource Management 9 Diverse Methods 9 The System-Centric Viewpoint 10 The Cluster-Centric Viewpoint 11 The Network-Centric Viewpoint 12 Storage-Centric Viewpoint 13 Database-Centric Viewpoint 15 Application-Centric Viewpoint 15 Integrated Methods 16 The Consolidation Process 17 3. Policies and Controls 19 Policy Types 19 Controls 22 Standardized Policy Definitions 23 Subsystem Policies and Controls 25 User-level Controls 25 Application-level Controls 26 CPU Power-level Controls 26 Disk I/O Policies 27 Disk Space 27 Virtual Memory 27 Relationship Between Virtual Memory and Swap Space 29 iv Resource Management Physical Memory 30 Network Interfaces and Network Services 34 4. Workload Management 35 Workload Analysis Tools 35 Sun Enterprise SyMON 2.0 Software 36 Workload Analysis Products 49 Customized Process Monitors 50 Internet Service Provider Workloads 55 Proxy Web Cache Workload 56 Virtual Web Hosting 60 Managing Web Servers With SRM Software 61 Commercial Workloads 65 Workload Consolidation 65 Database Workloads 71 Database Consolidation 74 Databases in a Resource Managed Environment 77 Database Resource Management Compatibility 78 Resource Manager of the Oracle Database 80 Resource Manager of the Informix Database 85 Batch Workloads 85 Resources Used by Batch Workloads 86 5. Workload Measurements 87 The SE Toolkit 87 Measurement Levels 88 The Application Resource Measurement Standard 89 SAP R/3 Measurements 89 Internet Server Measurements 90 Contents v Configuring and Monitoring a Proxy Cache 90 Internet Servers Summary 93 Process Information 94 Data Access Permissions 97 Microstate Accounting 97 Accounting 100 Solaris Resource Manager Accounting 102 Network Accounting Using NetFlow 103 Storage Measurements 104 Disk Workloads 104 Output Formats and Options for iostat 105 Understanding I/O Measurements 109 Network Measurements 116 Network Throughput 116 Ethernet Statistics 116 Protocol Statistics 118 Part II. Products 6. Solaris Operating Environment 121 When to Use Basic Solaris Features 121 Relationship to Other Resource Control Features 121 Processor Partitioning 122 Processor Sets 123 Published Dual TPC-C and TPC-D Results 126 How Process Partitioning Works 127 Limits 128 Disk Quotas 130 Configurable Kernel Limits 132 vi Resource Management 7. Solaris Resource Manager Software 135 When to Use SRM Software 135 Relationship to Other Solaris Resource Control Features 136 Solaris Resource Manager Functions 138 Solaris Resource Manager Policies 138 Controls Available with SRM Software 140 Measurement 143 System Resource Accounting Information 144 Workload Configuration 145 Mapping the Workload to the lnode Hierarchy 145 A Simple Flat Hierarchy 145 Decay Factors and Parameters 164 Decay Algorithms 165 Setting Decay and Scheduler Parameters 176 Performance and ScalabilityFactors 185 Hierarchy Tree Depth 185 Kernel Memory 185 Monitoring SRM Software 185 System Resource Accounting Information 186 Billing Issues 186 Extracting Accounting Data 187 8. Dynamic System Domains and Dynamic Reconfiguration 193 Dynamic System Domains 193 When to Use Dynamic System Domains 194 DSD Implementation Examples 197 Resource Management Controls 199 Managing Resources with Starfire DR 200 Contents vii Starfire DR-Detach and DR-Attach Timing Reference 201 DR With and Without DSDs 202 Clustered DSDs 206 Starfire Architecture 208 Starfire DR Architecture 211 Starfire DR-Detach Details 212 Starfire DR-Attach Details 216 DR I/O Device Driver Requirements 220 9. Solaris Bandwidth Manager Software 223 The Need for Bandwidth Management 223 Examples of When to Use Bandwidth Management 224 End-to-end Quality of Service 225 How Bandwidth Allocation Works 227 Borrowing Bandwidth 228 Flows 229 Type of Service Packet Marking 230 HTTP Support 232 When to Use Solaris Bandwidth Manager 233 Relationship to Other Resource Management Products 233 Where to Deploy Solaris Bandwidth Manager 234 Server Mode 234 IP-Transparent Mode 235 Solaris Bandwidth Manager Architecture 237 Java Dynamic Management Kit 238 The Administration Tool 239 The Policy Agent 240 LDAP Directory Integration 241 viii Resource Management Directory Enabled Networks 242