Problem Determination for Linux on System Z

Total Page:16

File Type:pdf, Size:1020Kb

Problem Determination for Linux on System Z Front cover Problem Determination for Linux on System z Learn a Linux on System z problem determination methodology Discover problem determination tools for z/VM and Linux on System z Do a case study using what you learn here Lydia Parziale Manoj S Pattabhiraman Masayuki Unno Eravimangalath P. Naveen Klaus Egeler Thiago Patricio de Jesus ibm.com/redbooks International Technical Support Organization Problem Determination for Linux on System z August 2008 SG24-7599-00 Note: Before using this information and the product it supports, read the information in “Notices” on page ix. First Edition (August 2008) This edition applies to Version 5, Release 3, of z/VM (product number 5741-A05), Novel USE Linux Enerprise Server 10 and Red Hat Linux 5. © Copyright International Business Machines Corporation 2008. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . ix Trademarks . x Preface . xi This book The team that wrote this book . xi Become a published author . xiii Comments welcome. xiii Chapter 1. Problem determination methodology . 1 1.1 Proactive approach for minimizing the effects of problems. 3 1.1.1 Design and implementation phases . 3 1.1.2 Test phase . 7 1.2 Problem determination basics . 9 1.2.1 Basic problem determination steps . 9 1.2.2 Gather information and explore the type of problem and its trigger . 11 1.2.3 Analysis of a problem . 13 1.2.4 Collect additional information . 15 1.2.5 Escalate to the support team to analyze . 16 1.2.6 How to approach complex problems. 16 1.3 Problem resolution and follow-up actions . 17 1.3.1 Expanded check for other systems . 18 1.3.2 Update. 18 1.4 Summary . 20 Chapter 2. Problem determination tools for z/VM . 21 2.1 z/VM system tools . 22 2.1.1 Collecting technical setup information. 22 2.1.2 Indicate . 23 2.1.3 query srm . 27 2.1.4 query alloc page . 28 2.1.5 VM trace . 28 2.1.6 vmdump . 33 2.2 IBM z/VM Performance Toolkit . 38 2.2.1 Modes of operation . 39 2.2.2 Selecting performance screens. 43 © Copyright IBM Corp. 2008. All rights reserved. iii 2.3 IBM Tivoli OMEGAMON XE on z/VM and Linux . 52 Chapter 3. Problem determination tools for Linux on System z. 59 3.1 Information-gathering tools . 60 3.1.1 dbginfo.sh . 60 3.1.2 vmstat . 61 3.1.3 System status (sysstat) tool . 62 3.1.4 top . 66 3.1.5 ps . 67 3.1.6 ipcs . 67 3.1.7 iostat . 68 3.1.8 netstat . 68 3.1.9 DASD statistics . 69 3.1.10 OProfile . 73 3.1.11 zFCP statistics . 76 3.1.12 Summary of information-gathering tools . 80 3.2 Dump and trace. 80 3.2.1 When to use dump . 81 3.2.2 When a trace should be run . 82 3.2.3 Stand-alone dump. 83 3.2.4 Verification of the dump . 84 3.2.5 Core dump . 87 3.2.6 Summary of dump techniques . 92 3.3 Debugging tools . 92 3.3.1 gdb . 93 3.3.2 strace . 96 3.3.3 ltrace . 98 3.3.4 SysRq . 100 3.3.5 s390dbf . 104 3.3.6 zFCP/SCSI . 106 Chapter 4. Network problem determination . 109 4.1 Overview of networking options for Linux on System z. 110 4.1.1 Open Systems Adapters . 110 4.1.2 HiperSockets. 112 4.1.3 Guest LAN. 113 4.1.4 Virtual Switch . 113 4.1.5 Summary of networking options for Linux on System z . 114 4.2 Network interface detection and configuration under Linux on System z 115 4.2.1 The Linux hotplug system . 115 4.2.2 Flow of network interface detection and activation under Linux . 116 4.2.3 Network interfaces and their interface names. 119 iv Problem Determination for Linux on System z 4.2.4 Network configuration files overview. 121 4.3 Network problem determination . 123 4.3.1 Problems related to network communication . 123 4.4 Case studies . 159 Chapter 5. Performance problem determination . 163 5.1 What a performance problem is . 164 5.2 General flow of performance problem determination . 165 5.2.1 Data necessary for investigation . 169 5.2.2 CPU bottlenecks . 170 5.2.3 Memory bottlenecks . 183 5.2.4 I/O bottlenecks . 192 5.2.5 Case studies . 205 Chapter 6. Storage problems . 211 6.1 How to determine a storage-related problem . ..
Recommended publications
  • Dell Inspiron 7391 Setup and Specifications
    Inspiron 7391 2n1 Setup and Specifications Regulatory Model: P113G Regulatory Type: P113G001 Notes, cautions, and warnings NOTE: A NOTE indicates important information that helps you make better use of your product. CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid the problem. WARNING: A WARNING indicates a potential for property damage, personal injury, or death. © 2018 - 2019 Dell Inc. or its subsidiaries. All rights reserved. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be trademarks of their respective owners. 2019 - 07 Rev. A00 Contents 1 Set up your Inspiron 7391 2n1.........................................................................................................4 2 Views of Inspiron 7391 2n1............................................................................................................ 6 Right........................................................................................................................................................................................6 Left.......................................................................................................................................................................................... 6 Base......................................................................................................................................................................................... 7 Display....................................................................................................................................................................................
    [Show full text]
  • BEA TUXEDO Reference Manual Section 5 - File Formats and Data Descriptions
    BEA TUXEDO Reference Manual Section 5 - File Formats and Data Descriptions BEA TUXEDO Release 6.5 Document Edition 6.5 February 1999 Copyright Copyright © 1999 BEA Systems, Inc. All Rights Reserved. Restricted Rights Legend This software and documentation is subject to and made available only pursuant to the terms of the BEA Systems License Agreement and may be used or copied only in accordance with the terms of that agreement. It is against the law to copy the software except as specifically allowed in the agreement. This document may not, in whole or in part, be copied photocopied, reproduced, translated, or reduced to any electronic medium or machine readable form without prior consent, in writing, from BEA Systems, Inc. Use, duplication or disclosure by the U.S. Government is subject to restrictions set forth in the BEA Systems License Agreement and in subparagraph (c)(1) of the Commercial Computer Software-Restricted Rights Clause at FAR 52.227-19; subparagraph (c)(1)(ii) of the Rights in Technical Data and Computer Software clause at DFARS 252.227-7013, subparagraph (d) of the Commercial Computer Software--Licensing clause at NASA FAR supplement 16-52.227-86; or their equivalent. Information in this document is subject to change without notice and does not represent a commitment on the part of BEA Systems. THE SOFTWARE AND DOCUMENTATION ARE PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND INCLUDING WITHOUT LIMITATION, ANY WARRANTY OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. FURTHER, BEA Systems DOES NOT WARRANT, GUARANTEE, OR MAKE ANY REPRESENTATIONS REGARDING THE USE, OR THE RESULTS OF THE USE, OF THE SOFTWARE OR WRITTEN MATERIAL IN TERMS OF CORRECTNESS, ACCURACY, RELIABILITY, OR OTHERWISE.
    [Show full text]
  • INT 09H (9) Keyboard
    INT 09h (9) Keyboard The keyboard generates an INT 9 every time a key is pushed or released. Notes: This is a hardware interrupt (IRQ 1) activated by the make or break of every keystroke. The default INT 9 handler in the ROM reads the make and break scan codes from the keyboard and converts them into actions or key codes as follows: ş For ASCII keys, when a make code is encountered, the ASCII code and the scan code for the key are placed in the 32-byte keyboard buffer, which is located at 0:41Eh. The ASCII code and scan code are placed in the buffer at the location addressed by the Keyboard Buffer Tail Pointer (0:041Ch). The Keyboard Buffer Tail Pointer is then incremented by 2, and if it points past the end of the buffer, it is adjusted so that it points to the beginning of the buffer. ş If Ctrl, Alt, or Shift has been pressed, the Shift Status (0:0417h) and Extended Shift Status (0:0418h) bytes are updated. ş If the Ctrl-Alt-Del combination has been pressed, the Reset Flag (0:0472h) is set to 1234h and control is given to the power-on self test (POST). Because the Reset Flag is 1234h, the POST routine bypasses the memory test. ş If the Pause key sequence has been entered, this interrupt enters an indefinite loop. The loop is broken as soon as a valid ASCII keystroke is entered. (The PC Convertible issues an INT 15h, Service 41h (Wait on External Event), to execute its pause loop.) ş If the Print Screen key sequence is entered, an INT 05h (Print Screen) is executed.
    [Show full text]
  • Networking Telnet
    IBM i Version 7.2 Networking Telnet IBM Note Before using this information and the product it supports, read the information in “Notices” on page 99. This edition applies to IBM i 7.2 (product number 5770-SS1) and to all subsequent releases and modifications until otherwise indicated in new editions. This version does not run on all reduced instruction set computer (RISC) models nor does it run on CISC models. This document may contain references to Licensed Internal Code. Licensed Internal Code is Machine Code and is licensed to you under the terms of the IBM License Agreement for Machine Code. © Copyright International Business Machines Corporation 1998, 2013. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Telnet................................................................................................................... 1 What's new for IBM i 7.2..............................................................................................................................1 PDF file for Telnet........................................................................................................................................ 1 Telnet scenarios...........................................................................................................................................2 Telnet scenario: Telnet server configuration.........................................................................................2 Telnet scenario: Cascaded Telnet
    [Show full text]
  • Security in Ordinary Operating Systems
    39 C H A P T E R 4 Security in Ordinary Operating Systems In considering the requirements of a secure operating system,it is worth considering how far ordinary operating systems are from achieving these requirements. In this chapter, we examine the UNIX and Windows operating systems and show why they are fundamentally not secure operating systems. We first examine the history these systems, briefly describe their protection systems, then we show, using the requirements of a secure operating system defined in Chapter 2, why ordinary operating systems are inherently insecure. Finally, we examine common vulnerabilities in these systems to show the need for secure operating systems and the types of threats that they will have to overcome. 4.1 SYSTEM HISTORIES 4.1.1 UNIX HISTORY UNIX is a multiuser operating system developed by Dennis Ritchie and Ken Thompson at AT&T Bell Labs [266]. UNIX started as a small project to build an operating system to play a game on an available PDP-7 computer. However, UNIX grew over the next 10 to 15 years into a system with considerable mindshare, such that a variety of commercial UNIX efforts were launched. The lack of coherence in these efforts may have limited the market penetration of UNIX, but many vendors, even Microsoft, had their own versions. UNIX remains a significant operating system today, embodied in many systems, such as Linux, Sun Solaris, IBM AIX, the various BSD systems, etc. Recall from Chapter 3 that Bell Labs was a member of the Multics consortium. However, Bell Labs dropped out of the Multics project in 1969, primarily due to delays in the project.
    [Show full text]
  • AXEL Platine Terminal Ethernet TCP/IP Models
    AXEL Platine Terminal Ethernet TCP/IP Models User's Guide May 1997 - Ref.: TCPUE105/701-2 The reproduction or the translation of this material, in part or whole, is strictly prohibited. For additional information, please contact: AXEL Zone d'activité d'Orsay-Courtabœuf 16 Avenue du Québec BP 728 91962 LES ULIS Cedex France Tel.: (33) 1 69 28 27 27 Fax: (33) 1 69 28 82 04 The information in this document is subject to change without notice. AXEL assumes no responsibility for any errors that may appear in this document. All trademarks and registered trademarks are the property of their respective holders. © - 1995-1997 - AXEL - All Rights Reserved. 1 - TCP/IP SET-UP ..........................................................................................1 2 - TERMINAL SET-UP ...................................................................................4 2.1 - GENERAL FEATURES.........................................................................5 2.1.1 - Enter Terminal Set-Up Mode ..........................................................5 2.1.2 - Set-Up Screens ..............................................................................6 2.1.3 - Predefined Set-Up..........................................................................6 2.1.4 - Local and Global Parameters .........................................................6 2.1.5 - Exit Set-Up.....................................................................................7 2.2 - SCREEN...............................................................................................8
    [Show full text]
  • The Gold Standard for Patent Brokerage™
    The Gold Standard for Patent Brokerage™ A proven record of success with more than 2500 patents sold. Executive Summary for the Sale of Enterprise Malware Removal & Restoration patent portfolio by Google 29 Assets Total · Full Patent Brokerage · Strategic IP Advisory EXECUTIVE SUMMARY FOR THE SALE OF Enterprise Malware Removal & Restoration Solutions By GOOGLE 29 TOTAL ASSETS EXECUTIVE SUMMARY FOR THE SALE OF Enterprise Malware Removal & Restoration Solutions 12 Families, 13 US Patents & their 16 family members in 8 other Jurisdictions Priority Issue Expiry Bwd/ Fwd Patent Number Patent Title Date Date Date Citations FAMILY 1 Discrete, background determination of the adequacy of Aug 19, Jun 8, Aug 18, US 6748544 10/41 security features of a computer system 1999 2004 2019 FAMILY 2 US 7114184 Oct 27, (This patent has been System and method for restoring computer systems damaged Mar 30, Sep 26, mapped against 2022 15/85 by a malicious computer program 2001 2006 representative (PTA 576) industry offerings) System and method for restoring computer systems damaged Mar 30, Aug 23, EP1374017 by a malicious computer program 2001 2006 System and method for restoring a computer system which has Mar 30, Jul 26, DE60214147 been damaged by a malicious computer program 2001 2007 System and method for restoring a computer system which as Mar 30, ZA 200306411 been damaged by a malicious computer program 2001 System And Method For Restoring Computer Systems Mar 30, Dec 3, IL157542 Damaged By A Malicious Computer Program 2001 2007 System And Method For Restoring Computer Systems Mar 30, IL157542D0 Damaged By A Malicious Computer Program 2001 FAMILY 3 Oct 26, Method and apparatus for multicast delivery of program Aug 25, Jan 4, US 7865723 2028(PTA1 6/17 information 2004 2011 172) Method and apparatus for multicast transmission of program Aug 25, Jan 26, DE102005039361 2/0 information 2004 2017 FAMILY 4 Sep 30, Sep 11, Sep 19, US 8266684 Tokenized resource access 18/35 2008 2012 2030 © 2018 Tangible IP, LLC.
    [Show full text]
  • Lenovo Ideapad 310 Ideapad 310-14ISK Ideapad 310-15ISK Ideapad 310 Touch-15ISK User Guide
    Lenovo ideapad 310 ideapad 310-14ISK ideapad 310-15ISK ideapad 310 Touch-15ISK User Guide lmn ReadRead thethe s safetyafety notice noticess and and important important tip tipss in in the the includedincluded manual manualss before before u usingsing your your computer. computer. Notes • Before using the product, be sure to read Lenovo Safety and General Information Guide first. • The latest electronic compliance and environmental information are available from the Lenovo compliance information Web sites. - To view compliance information go to: http://www.lenovo.com/ compliance - To download environmental information go to: http://www.lenovo.com/ ecodeclaration • Some instructions in this guide may assume that you are using Windows® 10. If you are using another Windows operating system, some operations may be slightly different. If you are using other operating systems, some operations may not apply to you. • The features described in this guide are common to most models. Some features may not be available on your computer or your computer may include features that are not described in this user guide. • The illustrations used in this manual are for Lenovo ideapad 310-14ISK unless otherwise stated. • The illustrations in this manual may differ from the actual product. Please refer to the actual product. Regulatory Notice • For details, refer to Guides & Manuals at http://support.lenovo.com. First Edition (January 2016) © Copyright Lenovo 2016. LIMITED AND RESTRICTED RIGHTS NOTICE: If data or software is delivered pursuant to a General Services Administration “GSA” contract, use, reproduction, or disclosure is subject to restrictions set forth in Contract No. GS-35F-05925. Contents Chapter 1.
    [Show full text]
  • Integrated Dell Remote Access Controller 9 (Idrac9) Version 3.00.00.00 User's Guide Notes, Cautions, and Warnings
    Integrated Dell Remote Access Controller 9 (iDRAC9) Version 3.00.00.00 User's Guide Notes, cautions, and warnings NOTE: A NOTE indicates important information that helps you make better use of your product. CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid the problem. WARNING: A WARNING indicates a potential for property damage, personal injury, or death. Copyright © 2017 Dell Inc. or its subsidiaries. All rights reserved. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be trademarks of their respective owners. 2017-08 Rev. A01 Contents 1 Overview.......................................................................................................................................................17 Benefits of using iDRAC with Lifecycle Controller........................................................................................................18 Key features.......................................................................................................................................................................18 New in this release............................................................................................................................................................21 How to use this user's guide........................................................................................................................................... 21 Supported web browsers................................................................................................................................................22
    [Show full text]
  • Formation Debian GNU/Linux
    Formation Debian GNU/Linux Alexis de Lattre [email protected] Formation Debian GNU/Linux par Alexis de Lattre Copyright © 2002, 2003 par Alexis de Lattre Ce document est disponible aux formats : • HTML en ligne (http://people.via.ecp.fr/~alexis/formation-linux/) ou HTML zippé (http://people.via.ecp.fr/~alexis/formation-linux/formation-linux-html.zip) (3,6 Mo), • PDF zippé (http://people.via.ecp.fr/~alexis/formation-linux/formation-linux-pdf.zip) (4 Mo), • RTF zippé (http://people.via.ecp.fr/~alexis/formation-linux/formation-linux-rtf.zip) (3,5 Mo), • Texte zippé (http://people.via.ecp.fr/~alexis/formation-linux/formation-linux-txt.zip) (215 Ko). La version la plus récente de ce document se trouve à l’adresse http://people.via.ecp.fr/~alexis/formation-linux/. Vous avez le droit de copier, distribuer et/ou modifier ce document selon les termes de la GNU Free Documentation License, version 1.2 ou n’importe quelle version ultérieure, telle que publiée par la Free Software Foundation. Le texte de la licence se trouve dans l’annexe GNU Free Documentation License. Table des matières A propos de ce document ....................................................................................................................................................... i I. Installation de Debian GNU/Linux.................................................................................................................................... i 1. Linux, GNU, logiciels libres,... c’est quoi ?................................................................................................................1
    [Show full text]
  • Lenovo Ideapad
    Lenovo ideapad 320 ideapad 320-17IKB/ideapad 320H-17IKB/ ideapad 320L-17IKB/ideapad 320R-17IKB/ ideapad 320E-17IKB/ideapad 320-17ISK/ ideapad 320H-17ISK/ideapad 320L-17ISK/ ideapad 320R-17ISK/ideapad 320E-17ISK User Guide lmn ReadRead thethe s safetyafety notice noticess and and important important tip tipss in in the the includedincluded manual manualss before before u usingsing your your computer. computer. Notes • Before using the product, be sure to read Lenovo Safety and General Information Guide first. • The latest electronic compliance and environmental information are available from the Lenovo compliance information Web sites. - To view compliance information go to: http://www.lenovo.com/compliance - To download environmental information go to: http://www.lenovo.com/ecodeclaration • Some instructions in this guide may assume that you are using Windows® 10. If you are using another Windows operating system, some operations may be slightly different. If you are using other operating systems, some operations may not apply to you. • The features described in this guide are common to most models. Some features may not be available on your computer or your computer may include features that are not described in this user guide. • The illustrations used in this manual are for Lenovo ideapad 320-17IKB unless otherwise stated. • The illustrations in this manual may differ from the actual product. The screenshots of operating system are for reference only. Please refer to the actual product. Regulatory Notice • For details, refer to Guides & Manuals at http://support.lenovo.com. First Edition (February 2017) © Copyright Lenovo 2017. LIMITED AND RESTRICTED RIGHTS NOTICE: If data or software is delivered pursuant to a General Services Administration “GSA” contract, use, reproduction, or disclosure is subject to restrictions set forth in Contract No.
    [Show full text]
  • The Linux Operating System
    T HE L INUX O PERATING S YSTEM William Stallings Copyright 2008 This document is an extract from Operating Systems: Internals and Design Principles, Sixth Edition William Stallings Prentice Hall 2008 ISBN-10: 0-13-600632-9 ISBN-13: 978-0-13-600632-9 http://williamstallings.com/OS/OS6e.html M02_STAL6329_06_SE_C02.QXD 2/22/08 7:02 PM Page 94 94 CHAPTER 2 / OPERATING SYSTEM OVERVIEW of the System V kernel and produced a clean, if complex, implementation. New fea- tures in the release include real-time processing support, process scheduling classes, dynamically allocated data structures, virtual memory management, virtual file sys- tem, and a preemptive kernel. SVR4 draws on the efforts of both commercial and academic designers and was developed to provide a uniform platform for commercial UNIX deployment. It has succeeded in this objective and is perhaps the most important UNIX variant. It incorporates most of the important features ever developed on any UNIX system and does so in an integrated, commercially viable fashion. SVR4 runs on processors ranging from 32-bit microprocessors up to supercomputers. BSD The Berkeley Software Distribution (BSD) series of UNIX releases have played a key role in the development of OS design theory. 4.xBSD is widely used in academic installations and has served as the basis of a number of commercial UNIX products. It is probably safe to say that BSD is responsible for much of the popularity of UNIX and that most enhancements to UNIX first appeared in BSD versions. 4.4BSD was the final version of BSD to be released by Berkeley, with the de- sign and implementation organization subsequently dissolved.
    [Show full text]