DOCSLIB.ORG

IBM Cluster Systems Management V1.6 Automates Administration of Advanced High Performance Computing Clusters

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
IBM Cluster Systems Management V1.6 Automates Administration of Advanced High Performance Computing Clusters Software Announcement October 10, 2006 IBM Cluster Systems Management V1.6 automates administration of advanced High Performance Computing clusters Overview • Enhanced integration with IBM System Blue Gene Solution At a glance CSM V1.6 is designed to help reduce • Hardware control enhancements the overall cost and complexity of IT Cluster Systems Management management by simplifying the tasks • Deployment enhancements (CSM) V1.6 offers a robust, of installing, configuring, operating, powerful, and centralized way to and maintaining clusters of servers • Assistance for HPC applications manage a large number of clustered or distributed IBM or logical partitions (LPARs). CSM • Enhanced HPC Solution Packs offers a single consistent interface servers from a single point of for managing both AIX 5L and • Install support for diskless Linux control. Linux nodes, with capabilities for nodes remote parallel network installation, New with CSM for AIX 5L, Linux on • remote hardware control, distributed Support for Linux OS upgrades POWER, or Linux Multiplatform V1.6: command execution, file collection • Usability enhancements and distribution, cluster-wide • Support for new IBM monitoring capabilities, and Key prerequisites POWER5+ and System x integration with High Performance servers, and for SUSE Linux Computing (HPC) applications. IBM eServer Cluster 1350, Cluster Enterprise Server (SLES) 10 CSM V1.6 improvements include: 1600, selected IBM System p5, • System x, OpenPower , POWER Hierarchical cluster support, allowing management of • Support for IBM System p5 servers, or BladeCenter running AIX multiple clusters from a single 505Q, 590, and 595 servers with 5L V5.2 or V5.3, SLES 9 or 10, or Red management server CSM for AIX 5L and for Linux Hat Enterprise Linux (RHEL) 4 on POWER operating systems • Collection of POWER5 Hardware Planned availability date Management Console (HMC) • Support for SLES 10 on both diagnostic information on the System p and System x nodes October 27, 2006 management server with CSM for Linux • Support for diskless Linux • Support for System x3455, x3550, nodes x3650, and x3850 servers; xSeries 366 server; AMD • Hardware control, remote Opteron LS21 and LS41 for IBM console, and installation BladeCenter ; and Intel HS21 support for LPARs managed by for IBM BladeCenter, with CSM Integrated Virtualization for Linux Multiplatform Manager New features include: • Enhanced diagnostics for IBM System Blue Gene Solution • Hierarchical Management Server support, which allows a top-level • Support for Linux OS upgrades CSM management server to without node reinstallation manage multiple CSM management servers, creating a second level of control for multiple clusters • Monitoring and logging of all SFP events for POWER5 processors in the cluster to the management server • Support for HMC-less environments This announcement is provided for your information only. For additional information, contact your IBM representative, call 800-IBM-4YOU, or visit the IBM home page at: http://www.ibm.com. IBM United States IBM is a registered trademark of International Business Machines Corporation. 206-249 Enhanced monitoring support for IBM System Blue Gene Description Solution: Support has been added for “rearm” event monitoring to complement the event monitoring CSM V1.6 is designed to offer simple, low-cost capabilities provided in the earlier release. This release management of distributed and clustered System p and also delivers new predefined conditions and sensors for System x servers. For organizations with both AIX 5L and Blue Gene monitoring, and improves the old ones. The Linux applications, a single CSM management console enhanced support allows more flexibility in the data running on the AIX 5L or Linux operating system can delivered within the Blue Gene event and rearm event provide management services to AIX 5L and Linux clients notifications. IBM System Blue Gene can be monitored in distributed and clustered configurations. CSM is also from any type of CSM server. a key element of the Cluster 1600 and Cluster 1350 — platforms that are ideal for workload consolidation or for Hardware control enhancements: achieving high degrees of scalability and performance for • applications that take advantage of clustered systems Changes were made to the rconsole function to architectures. Primary examples are computational perform automatic logging of all console output. This modeling in HPC or multi-terabyte data warehouses in allows catching of critical server failure data, which is large corporations. only written to the console. • Improvements were made to the hwsda and lshwinfo The CSM licensed products include: commands. • CSM for AIX 5L Deployment enhancements: • CSM for Linux on POWER • CSM for Linux Multiplatform (System x, BladeCenter) • The “getadapters” command has been enhanced to support the use of Address Resolution Protocol and New with CSM 1.6 SNMP in obtaining a node′s MAC address. • CSM can now update drivers on PPC64 installations. New hardware support: • • Enhanced support for minimally managed nodes System p servers: p5 505Q, 590, and 595 with CSM for includes use of CSM Configuration File Manager (CFM) AIX 5L and for Linux on POWER and Software Maintenance System (SMS) functions. • System x servers: x3455, x3550, x3650, x3850, and CSM will automatically run these functions when a xSeries 366 MinManaged node is installed. Users can now manually run CFM and SMS commands for • AMD Opteron LS21 and LS41 for BladeCenter MinManaged nodes at any time. • Intel HS21 for BladeCenter Enhanced HPC solution packs: csm.gpfs, csm.ll, csm.pe, csm.essl, and csm.pessl solution packs have been New Linux Distribution support: enhanced to work with later versions of the licensed • SLES 10 support for System p and System x servers products. A csm.pe solution pack has also been added for Linux. Diskless node support: Support has been added for diskless Linux nodes in environments where the Usability improvements: management server and diskless managed nodes are of • Enhanced support for CSM Highly Available the same Linux distribution without the use of installation Management Server (HA MS) to recover the active servers. This support requires Warewulf and associated CSM management server when problems occur open source software (refer to the Software requirements section). • Enhanced Configuration File Manager support to allow the administrator to choose either the rdist or rsync Support for HMC-less environments: Hardware control, remote file distribution client to distribute files to the remote console, and installation support has been added nodes for LPARs managed by Integrated Virtualization Manager (IVM). IVM comes embedded within the optional CSM continues to provide full interoperability of all Advanced POWER Virtualization feature and eliminates CSM-supported combinations of CSM-supported the need for a dedicated HMC. The IVM is included with hardware and CSM-supported operating systems. Any of Virtual I/O Server V1.3. the following can manage or be managed by any of the following: Service Focal Point (SFP) diagnostic support for POWER5: Support has been added for CSM monitoring to be able • CSM-supported System p machines running a to receive events from SFP on POWER5 systems utilizing CSM-supported version of AIX 5L the Problem Analysis framework. • CSM-supported System p machines running a Hierarchical management servers: Support has been CSM-supported version of RHEL added to use CSM in a hierarchical structure. • Hierarchical CSM is a method of using CSM in which CSM-supported System p machines running a multiple CSM management servers (and their clusters) CSM-supported version of SLES can be installed, set up, and monitored by a single • CSM-supported System x machines running a top-level management server. This can be useful to CSM-supported version of RHEL manage more nodes than the current CSM scaling limit or to divide nodes up between different departments or • CSM-supported System x machines running a sets of users. Hierarchical CSM is intended for advanced CSM-supported version of SLES CSM users. Note: CSM V1.6 is the last release that will support a Support for Linux upgrades: Linux OS node upgrades can pause of HA MS. The stop function of HA MS will be able now be done without requiring a full node reinstallation. to be used as an alternative. Support includes only SLES service pack upgrades and RHEL release upgrades. 206-249 -2- Notes Reference information • CSM V1.6 is the last release of CSM that will support the -d flag of the cfmupdatenode command. For additional information on CSM, refer to • CSM V1.6 is the last release of CSM that will support • CSM Home Page, with downloads, FAQs, and related AIX 5L V5.2. resources High Availability Management Server (HA MS): http://www14.software.ibm.com/webapp/set2/sas/f/ csm/home.html On all platforms, the optional CSM HA MS is designed to prevent the management server from being a single point • For documentation of failure in the CSM cluster. CSM HA MS is designed to automate failover in response to failure conditions. You http://publib.boulder.ibm.com/clresctr/windows/ can also define pre- and post-scripts to customize the public/clusterbooks.html failover, allowing you to failover the management server, • For cluster and HPC software information or other subsystems or data, as needed. http://www.ibm.com/servers/eserver/clusters/ A new recovery command is available for the CSM HA software/ MS to help recover the active CSM management server when problems occur. For a complete list of CSM billing and priced features, refer to Software Announcement 205-292, dated November 8, 2005 (CSM for AIX 5L and CSM for Linux on Product positioning POWER, V1.5), or Software Announcement 205-293, dated November 8, 2005 (CSM for Linux Multiplatform, V1.5). CSM offers a way to manage a collection of AIX or Linux servers (nodes), either clustered or distributed, from a Business Partner information single point of control. Why should you use CSM? If you are a Direct Reseller - System Reseller acquiring products from IBM, you may link directly to Business • May help reduce system management costs Partner information for this announcement.
Load more

Recommended publications
  • An Introduction to Security in a CSM 1.3 for AIX 5L Environment
    Front cover An Introduction to Security in a CSM 1.3 for AIX 5L Environment Peek at the latest security mechanisms for pSeries clusters Practical security considerations included Security concepts and components explained Octavian Lascu Rashid Sayed Stuart Carroll Teresa Coleman Maik Haehnel Petr Klabenes Dino Quintero Rogelio Reyes, Jr. Mizuho Tanaka David Duy Truong ibm.com/redbooks International Technical Support Organization An Introduction to Security in a CSM 1.3 for AIX 5L Environment December 2002 SG24-6873-00 Note: Before using this information and the product it supports, read the information in “Notices” on page ix. First Edition (December 2002) This edition applies to Version 1, Release 3, of IBM Cluster Systems Management for use with the AIX operating system Version 5, Release 2. © Copyright International Business Machines Corporation 2002. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Figures . vii Notices . .ix Trademarks . x Preface . .xi The team that wrote this redbook. .xi Become a published author . xiii Comments welcome. xiii Chapter 1. Introduction . 1 1.1 Security overview . 2 1.1.1 System security. 2 1.1.2 Network security basics . 3 1.1.3 Data transmission security . 4 1.2 Cluster Systems Management security basics . 5 1.2.1 Reliable Scalable Cluster Technology (RSCT) . 6 1.2.2 Resource Monitoring and Control (RMC) . 6 1.2.3 Resource managers (RM). 7 1.2.4 Cluster Security Services (CtSec). 7 1.2.5 Group Services and Topology Services . 8 Chapter 2.
    [Show full text]
  • Université De Montréal Low-Impact Operating
    UNIVERSITE´ DE MONTREAL´ LOW-IMPACT OPERATING SYSTEM TRACING MATHIEU DESNOYERS DEPARTEMENT´ DE GENIE´ INFORMATIQUE ET GENIE´ LOGICIEL ECOLE´ POLYTECHNIQUE DE MONTREAL´ THESE` PRESENT´ EE´ EN VUE DE L’OBTENTION DU DIPLOMEˆ DE PHILOSOPHIÆ DOCTOR (Ph.D.) (GENIE´ INFORMATIQUE) DECEMBRE´ 2009 c Mathieu Desnoyers, 2009. UNIVERSITE´ DE MONTREAL´ ECOL´ E POLYTECHNIQUE DE MONTREAL´ Cette th`ese intitul´ee : LOW-IMPACT OPERATING SYSTEM TRACING pr´esent´ee par : DESNOYERS Mathieu en vue de l’obtention du diplˆome de : Philosophiæ Doctor a ´et´edˆument accept´ee par le jury constitu´ede : Mme. BOUCHENEB Hanifa, Doctorat, pr´esidente M. DAGENAIS Michel, Ph.D., membre et directeur de recherche M. BOYER Fran¸cois-Raymond, Ph.D., membre M. STUMM Michael, Ph.D., membre iii I dedicate this thesis to my family, to my friends, who help me keeping balance between the joy of sharing my work, my quest for knowledge and life. Je d´edie cette th`ese `ama famille, `ames amis, qui m’aident `aconserver l’´equilibre entre la joie de partager mon travail, ma quˆete de connaissance et la vie. iv Acknowledgements I would like to thank Michel Dagenais, my advisor, for believing in my poten- tial and letting me explore the field of operating systems since the beginning of my undergraduate studies. I would also like to thank my mentors, Robert Wisniewski from IBM Research and Martin Bligh, from Google, who have been guiding me through the internships I have done in the industry. I keep a good memory of these experiences and am honored to have worked with them. A special thanks to Paul E.
    [Show full text]
  • Installing Conserver
    Installing Conserver version 1.0 David K. Z. Harris [email protected] Bryan Stansell [email protected] http://www.certaintysolutions.com/consoles/LISA2K-2.zip http://www.conserver.com/consoles/LISA2K-2.zip © 2000 Certainty Solutions, Inc. Pg. 1 This presentation is a supplement to my console services web pages located at http://www.certaintysolutions.com/consoles/LISA2K-2.zip. These pages have a substantial amount of information noted below each slide. We do this to help minimize the amount of note-taking that you need to do in class, and this should give you more time to listen to the instructors. If you feel that you learn better by taking notes, please feel free to do so. This presentation is meant to be a follow-up to a Basic Serial presentation. While this presentation can stand on its own, there is only a small amount of review of the earlier topic. During this tutorial, we will be discussing the topic of Console Servers as a generic application, but our technical emphasis will be on the Conserver application, which is freely available from http://www.conserver.com/. For most purposes in this tutorial, “Console Server” and “Conserver” can be used interchangeably. ©2000, David K. Z. Harris Certainty Solutions: Certainty in an uncertain world M12-2 v1.0 1 Pertinent Job History Ø Network Equipment Technologies ² (Comdesign, Bridge Communications) Ø Telebit Corp. Ø Cisco Systems, Inc. Ø Apple Computer, Inc. Ø Synopsys, Inc. Ø Global Networking & Computing ² (We’re now Certainty Solutions.) © 2000 Certainty Solutions, Inc. Pg. 2 Before moving into networking, David Harris was a hardware hacker, working in repair and R&D roles.
    [Show full text]
  • IBM Platform Computing Solutions Reference Architectures and Best Practices
    Front cover IBM Platform Computing Solutions Reference Architectures and Best Practices Helps with the foundation to manage enterprise environments Delivers reference architectures and best practices guides Provides case scenarios Dino Quintero Luis Carlos Cruz Ricardo Machado Picone Dusan Smolej Daniel de Souza Casali Gheorghe Tudor Joanna Wong ibm.com/redbooks International Technical Support Organization IBM Platform Computing Solutions Reference Architectures and Best Practices April 2014 SG24-8169-00 Note: Before using this information and the product it supports, read the information in “Notices” on page v. First Edition (April 2014) This edition applies to RedHat 6.4, IBM Platform Cluster Manager Standard Edition (PCM-SE) 4.1.1, IBM Platform Symphony Advanced Edition 6.1.1, GPFS FPO 3.5.0.13, Hadoop 1.1.1. © Copyright International Business Machines Corporation 2014. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . .v Trademarks . vi Preface . vii Authors. vii Now you can become a published author, too! . ix Comments welcome. ix Stay connected to IBM Redbooks . .x Chapter 1. Introduction. 1 1.1 Why IBM Platform Computing?. 2 1.2 High performance clusters . 2 1.3 IBM Platform HPC implementation scenario. 3 1.4 Big Data implementation on an IBM high performance computing cluster . 3 1.5 IBM Platform Computing solutions and products . 5 Intel . 7 Chapter 2. High performance clusters . 9 2.1 Cluster management. 10 2.1.1 IBM Platform HPC. 12 2.1.2 IBM Platform Cluster Manager Standard Edition . 19 2.1.3 IBM Platform Cluster Manager Advanced Edition.
    [Show full text]
  • An Empirical Study of the Effects of Open Source
    AN EMPIRICAL STUDY OF THE EFFECTS OF OPEN SOURCE ADOPTION ON SOFTWARE DEVELOPMENT ECONOMICS by Di Wu A thesis submitted to the Faculty of Graduate Studies and Research in partial fulfillment of the requirements for the degree of Master of Applied Science in Technology Innovation Management Department of Systems and Computer Engineering, Carleton University Ottawa, Canada, K1S 5B6 March 2007 © Copyright 2007 Di Wu Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. Library and Bibliotheque et Archives Canada Archives Canada Published Heritage Direction du Branch Patrimoine de I'edition 395 Wellington Street 395, rue Wellington Ottawa ON K1A 0N4 Ottawa ON K1A 0N4 Canada Canada Your file Votre reference ISBN: 978-0-494-27005-9 Our file Notre reference ISBN: 978-0-494-27005-9 NOTICE: AVIS: The author has granted a non­ L'auteur a accorde une licence non exclusive exclusive license allowing Library permettant a la Bibliotheque et Archives and Archives Canada to reproduce,Canada de reproduire, publier, archiver, publish, archive, preserve, conserve,sauvegarder, conserver, transmettre au public communicate to the public by par telecommunication ou par I'lnternet, preter, telecommunication or on the Internet,distribuer et vendre des theses partout dans loan, distribute and sell theses le monde, a des fins commerciales ou autres, worldwide, for commercial or non­ sur support microforme, papier, electronique commercial purposes, in microform,et/ou autres formats. paper, electronic and/or any other formats. The author retains copyright L'auteur conserve la propriete du droit d'auteur ownership and moral rights in et des droits moraux qui protege cette these.
    [Show full text]
  • Remote-Serial-Console-HOWTO.Pdf
    Remote Serial Console HOWTO Glen Turner Australian Academic and Research Network <[email protected]> Mark F. Komarinski <mkomarinskiATwayga.org> v2.6 2003−03−31 Revision History Revision 2.6 2003−03−31 Revised by: gdt Correct opposing CTS/RTS explanations. Use <quote> in markup. TLDP PDF is now good, so remove instructions for rendering PostScript to PDF. Typo in GRUB configuration. Revision 2.5 2003−01−20 Revised by: gdt Only one console per technology type. Setting timezone. Use off parameter rather than comments in inittab. Cable lengths. Revision 2.4 2002−10−03 Revised by: gdt Kernel flow control bug, more cabling, Debian, Livingston Portmaster, typos (especially those found during translation to Japanese). Revision 2.3 2002−07−11 Revised by: gdt Updates for Red Hat Linux 7.3, corrections to serial port speeds and UARTs, ioctlsave. Revision 2.2 2002−05−22 Revised by: gdt Minor changes Revision 2.1 2002−05−16 Revised by: gdt Corrections to kernel console syntax. Addition of USB and devfs. Revision 2.0 2002−02−02 Revised by: gdt Second edition. Revision d1.0 2001−03−20 Revised by: mfk First edition. An RS−232 serial console allows Linux to be controlled from a terminal or modem attached to an asynchronous serial port. The monitor, mouse and keyboard are no longer required for system administration. Serial consoles are useful where Linux systems are deployed at remote sites or are deployed in high−density racks. This HOWTO describes how to configure Linux to attach a serial console. Dedication Glen Turner would like to thank his family for allowing him to work on this project for the surprisingly large number of evenings which it took to write this HOWTO.
    [Show full text]
  • Kit Microsoft Dell Software Group
    Kit Microsoft Dell Software Group Kit de terrain Dell Software À propos de Dell Guide des solutions visant à accélérer l’adoption de la plateforme Microsoft Fonctionnalités Dell Software Processus de déploiements Microsoft avec Dell Plateformes technologiques Microsoft prises en charge Optimisation des grands enjeux Microsoft • Plateforme Cloud • Productivité Cloud et enterprise social • Informations métiers et mission critical Accélération de l’adoption de la plateforme Microsoft • Migration Windows Server • Migration de la messagerie électronique • SQL Server® • SharePoint® Notre engagement envers Microsoft Récompenses Contacts Partenaires - Confidentiel À propos de Dell Dell rend la technologie plus accessible et économique, améliorant ainsi la vie des individus, le fonctionnement des entreprises et la marche du monde. Aujourd’hui, nous exploitons la puissance du Cloud, de la technologie mobile, des Big Data et de la sécurité pour permettre à davantage d’individus d’en faire plus. Connexion des Intégration et Simplification Accélération de UTILISATEURS optimisation de et sécurisation via l’innovation via FINAUX l’ENTREPRISE les LOGICIELS les SERVICES Partenaires - Confidentiel Fonctionnalités Dell Software Gestion du Cloud Gestion de Gestion du et des datacenters l’information personnel mobile • Gestion des serveurs et des • Gestion des bases de données • Gestion des appareils mobiles systèmes clients • Business Intelligence / analytique • Virtualisation des postes de • Surveillance des performances • Intégration des données et des
    [Show full text]
  • Linux HPC Cluster Installation
    Front cover Acrobat bookmark Draft Document for Review June 15, 2001 6:30 pm SG24-6041-00 Linux HPC Cluster Installation xCAT - xCluster Administration Tools Developed by Egan Ford IBM ^ xSeries Intel-based Linux® Installing Red Hat® with Kickstart and xCAT Luis Ferreira, Gregory Kettmann Andreas Thomasch, Eillen Silcocks Jacob Chen, Jean-Claude Daunois Jens Ihamo, Makoto Harada Steve Hill and Walter Bernocchi ibm.com/redbooks Draft Document for Review June 15, 2001 6:29 pm 6041edno.fm International Technical Support Organization Linux High Performance Cluster Installation May 2001 SG24-6041-00 6041edno.fm Draft Document for Review June 15, 2001 6:29 pm Take Note! Before using this information and the product it supports, be sure to read the general information in “Special notices” on page 239. First Edition (May 2001) This edition applies to Red Hat® Linux® Version 6.2 for Intel® Architecture. This document created or updated on June 15, 2001. Comments may be addressed to: IBM Corporation, International Technical Support Organization Dept. JN9B Building 003 Internal Zip 2834 11400 Burnet Road Austin, Texas 78758-3493 When you send information to IBM, you grant IBM a non-exclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you. © Copyright International Business Machines Corporation 2001. All rights reserved. Note to U.S Government Users – Documentation related to restricted rights – Use, duplication or disclosure is subject to restrictions set forth in GSA ADP Schedule Contract with IBM Corp. Draft Document for Review June 15, 2001 6:29 pm 6041TOC.fm Contents Figures .
    [Show full text]
  • SGI® Management Centertm (SMC) Administration Guide for Clusters
    SGI® Management CenterTM (SMC) Administration Guide for Clusters 007–6358–001 COPYRIGHT © 2014 SGI. All rights reserved; provided portions may be copyright in third parties, as indicated elsewhere herein. No permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part, without the prior written permission of SGI. The SGI Management Center software stack depends on several open source packages which require attribution. They are as follows: c3: C3 version 3.1.2: Cluster Command & Control Suite Oak Ridge National Laboratory, Oak Ridge, TN, Authors: M.Brim, R.Flanery, G.A.Geist, B.Luethke, S.L.Scott (C) 2001 All Rights Reserved NOTICE Permission to use, copy, modify, and distribute this software and # its documentation for any purpose and without fee is hereby granted provided that the above copyright notice appear in all copies and that both the copyright notice and this permission notice appear in supporting documentation. Neither the Oak Ridge National Laboratory nor the Authors make any # representations about the suitability of this software for any purpose. This software is provided "as is" without express or implied warranty. The C3 tools were funded by the U.S. Department of Energy. conserver: Copyright (c) 2000, conserver.com All rights reserved. Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:- Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer. - Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.
    [Show full text]
  • Setting up and Running a Production Linux Cluster at PNNL
    Case Study: Setting up and running a production Linux cluster at Pacific Northwest National Laboratory Gary Skouson, Molecular Science Computing Facility, William R. Wiley Environmental Molecular Sciences Laboratory, Pacific Northwest National Laboratory Ryan Braby*, Molecular Science Computing Facility, William R. Wiley Environmental Molecular Sciences Laboratory, Pacific Northwest National Laboratory Abstract With the low price and increasing performance of commodity computer hardware, it is important to study the viability of using clusters of relatively inexpensive computers to produce a stable system, capable of the current demands for high performance massively parallel computing. A 192-processor cluster was installed to test and develop methods that would make the PC cluster a workable alternative to using other commercial systems for use in scientific research. By comparing PC clusters with the cluster systems sold commercially, it became apparent that the tools to manage the PC cluster as a single system were not as robust or as well integrated as in many commercial systems. This paper is focused on the problems encountered and solutions used to stabilize this cluster for both production and development use. This included the use of extra hardware such as remote power control units and multi-port adapters to provide remote access to both the system console and system power. A Giganet cLAN fabric was also used to provide a high-speed, low-latency interconnect. Software solutions were used for resource management, job scheduling and accounting, parallel filesystems, remote network installation and system monitoring. Although there are still some tools missing for debugging hardware problems, the PC cluster continues to be very stable and useful for users.
    [Show full text]
  • IBM Spectrum Computing Solutions
    Front cover IBM Spectrum Computing Solutions Dino Quintero Daniel de Souza Casali Eduardo Luis Cerdas Moya Federico Fros Maciej Olejniczak Redbooks International Technical Support Organization IBM Spectrum Computing Solutions May 2017 SG24-8373-00 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. First Edition (May 2017) This edition applies to: Red Hat Linux ppc64 Little Endian version 7.2 IBM Spectrum Scale version 4.2.1 IBM Cluster Foundation version v4.2.2 IBM Spectrum Conductor with Spark version 2.2 IBM Spectrum MPI version 10 © Copyright International Business Machines Corporation 2017. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . vii Trademarks . viii Preface . ix Authors. ix Now you can become a published author, too . .x Comments welcome. xi Stay connected to IBM Redbooks . xi Chapter 1. Introduction to IBM Spectrum Computing . 1 1.1 Overview . 2 1.2 Big data and resource management . 2 1.3 The new era for high-performance computing (HPC) . 2 1.4 Hybrid cloud bursting . 3 1.5 The big data challenge . 4 1.5.1 Hadoop . 4 1.5.2 Apache Spark . 5 1.5.3 Hadoop Distributed File System (HDFS) . 5 1.5.4 Multi-tenancy. 5 1.6 IBM Spectrum Cluster Foundation . 6 1.7 IBM Spectrum Computing . 6 1.7.1 IBM Spectrum Conductor with Spark . 7 1.7.2 IBM Spectrum LSF . 7 1.7.3 IBM Spectrum Symphony . 7 Chapter 2.
    [Show full text]
  • IBM Power Systems 775 HPC Solution
    Front cover IBM Power Systems 775 for AIX and Linux HPC Solution Unleashes computing power for HPC workloads Provides architectural solution overview Contains sample scenarios Dino Quintero Kerry Bosworth Puneet Chaudhary Rodrigo Garcia da Silva ByungUn Ha Jose Higino Marc-Eric Kahle Tsuyoshi Kamenoue James Pearson Mark Perez Fernando Pizzano Robert Simon Kai Sun ibm.com/redbooks International Technical Support Organization IBM Power Systems 775 for AIX and Linux HPC Solution October 2012 SG24-8003-00 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. First Edition (October 2012) This edition applies to IBM AIX 7.1, xCAT 2.6.6, IBM GPFS 3.4, IBM LoadLelever, Parallel Environment Runtime Edition for AIX V1.1. © Copyright International Business Machines Corporation 2012. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Figures . vii Tables . xi Examples . xiii Notices . xvii Trademarks . xviii Preface . xix The team who wrote this book . xix Now you can become a published author, too! . xxi Comments welcome. xxii Stay connected to IBM Redbooks . xxii Chapter 1. Understanding the IBM Power Systems 775 Cluster. 1 1.1 Overview of the IBM Power System 775 Supercomputer . 2 1.2 Advantages and new features of the IBM Power 775 . 3 1.3 Hardware information . 4 1.3.1 POWER7 chip. 4 1.3.2 I/O hub chip. 10 1.3.3 Collective acceleration unit (CAU) . 12 1.3.4 Nest memory management unit (NMMU) .
    [Show full text]