Front cover IBM Platform Computing Solutions Describes the offering portfolio Shows implementation scenarios Delivers add-on value to current implementations Dino Quintero Scott Denham Rodrigo Garcia da Silva Alberto Ortiz Aline Guedes Pinto Atsumori Sasaki Roger Tucker Joanna Wong Elsie Ramos ibm.com/redbooks International Technical Support Organization IBM Platform Computing Solutions December 2012 SG24-8073-00 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. First Edition (December 2012) This edition applies to IBM Platform High Performance Computing (HPC) v3.2, IBM Platform Cluster Manager Advanced Edition v3.2, IBM Platform Symphony v5.2, IBM Platform Load Sharing Facility (LSF) v8.3, RedHat Enterprise Linux v6.2/v6.3, Hadoop v1.0.1, Sun Java Development Kit (JDK) v1.6.0_25, and Oracle Database Express Edition v11.2.0. © Copyright International Business Machines Corporation 2012. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . vii Trademarks . viii Preface . ix The team who wrote this book . ix Now you can become a published author, too! . xi Comments welcome. xi Stay connected to IBM Redbooks . xii Chapter 1. Introduction to IBM Platform Computing . 1 1.1 IBM Platform Computing solutions value proposition . 2 1.1.1 Benefits . 3 1.1.2 Cluster, grids, and clouds . 4 1.2 History . 5 1.2.1 IBM acquisition . 6 Chapter 2. Technical computing software portfolio. 7 2.1 IBM Platform Computing product portfolio . 8 2.1.1 Workload management. 8 2.1.2 Cluster management. 8 2.2 IBM Platform Computing products overview . 10 2.2.1 IBM Platform Load Sharing Facility family . 10 2.2.2 IBM Platform Message Passing Interface. 12 2.2.3 IBM Platform Symphony family. 12 2.2.4 IBM Platform HPC. 13 2.2.5 IBM Platform Cluster Manager . 13 2.3 Current user roadmap . 14 Chapter 3. Planning . 15 3.1 Hardware setup for this residency. 16 3.1.1 Server nodes. 16 3.1.2 Shared storage . 18 3.1.3 Infrastructure planning . 20 3.2 Software packages . 23 Chapter 4. IBM Platform Load Sharing Facility (LSF) product family . 27 4.1 IBM Platform LSF overview. 28 4.2 IBM Platform LSF add-on products. 36 4.2.1 IBM Platform Application Center. 36 4.2.2 IBM Platform RTM. 40 4.2.3 IBM Platform Process Manager . 41 4.2.4 IBM Platform License Scheduler. 44 4.3 Implementation . 49 4.3.1 IBM Platform LSF implementation . 50 4.3.2 IBM Platform Application Center implementation . 54 4.3.3 IBM Platform RTM implementation . 65 4.3.4 IBM Platform Process Manager implementation. 98 4.4 References . 109 © Copyright IBM Corp. 2012. All rights reserved. iii Chapter 5. IBM Platform Symphony . 111 5.1 Overview . 112 5.1.1 Architecture. 117 5.1.2 Target audience . 118 5.1.3 Product versions . 118 5.2 Compute-intensive and data-intensive workloads. 119 5.2.1 Basic concepts . 120 5.2.2 Core components . 121 5.2.3 Application implementation . 124 5.2.4 Application Deployment . 125 5.2.5 Symexec . 126 5.3 Data-intensive workloads . 126 5.3.1 Data affinity . 127 5.3.2 MapReduce. 128 5.4 Reporting. 134 5.5 Getting started. 135 5.5.1 Planning for Symphony. 136 5.5.2 Installation preferred practices . 139 5.6 Sample workload scenarios . 156 5.6.1 Hadoop . 156 5.7 Symphony and IBM Platform LSF multihead environment . 164 5.7.1 Planning a multihead installation . 167 5.7.2 Installation. 167 5.7.3 Configuration. 171 5.8 References . 179 Chapter 6. IBM Platform High Performance Computing . 181 6.1 Overview . ..