Front cover Deploying Oracleacle 9i RAC on IBMBM Eserver Cluster 160000 with GPFS Oracle9i RAC cluster planning and installation on IBM pSeries running AIX Availability and performance considerations GPFS storage and networking considerations Octavian Lascu Vigil Carastanef Lifang (Lillian) Li Michel Passet Norbert Pistoor James Wang ibm.com/redbooks International Technical Support Organization Deploying Oracle 9i RAC on IBM Eserver Cluster 1600 with GPFS October 2003 SG24-6954-00 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. First Edition (October 2003) This edition applies to Version 5, Release 2, Modification 01 of AIX and Version 9.2.0.x of Oracle9i Real Application Clusters. © Copyright International Business Machines Corporation 2003. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . vii Trademarks . viii Preface . ix The team that wrote this redbook. ix Become a published author . .x Comments welcome. .x Chapter 1. Introduction. 1 1.1 Why clusters? . 2 1.1.1 Availability . 2 1.1.2 Scalability . 2 1.1.3 Load sharing . 3 1.1.4 Parallel processing . 3 1.2 Oracle9i RAC overview . 4 1.3 Cluster building blocks . 5 1.3.1 Hardware components . 5 1.3.2 Software components . 6 Chapter 2. Typical Oracle9i RAC configurations . 7 2.1 Basic building blocks. 8 2.2 Oracle9i RAC on RAW devices. 8 2.2.1 Hardware requirements. 8 2.2.2 Software requirements . 10 2.2.3 Application architecture. 10 2.3 Oracle9i RAC on VSD. 12 2.3.1 Hardware requirements. 12 2.3.2 Software requirements . 13 2.3.3 Application architecture. 14 2.4 Oracle9i RAC on GPFS . 15 2.4.1 Hardware requirements. 15 2.4.2 Software requirements . 16 2.4.3 Application architecture. 17 Chapter 3. Planning and implementation . 21 3.1 Configuration objectives . 22 3.2 Hardware architecture. 22 3.3 Software architecture . 23 3.3.1 Oracle9i RAC on an RPD-based GPFS cluster . 23 3.4 Network architecture . 25 3.4.1 Networking design . 26 3.4.2 Client and administrative network . 26 3.4.3 Oracle interconnect networks . 27 3.4.4 GPFS network. 28 3.4.5 Serial (non-IP) network . 28 3.5 Storage subsystem architecture . 28 3.6 Node installation and configuration . 30 3.6.1 AIX 5.2 ML1 . 30 3.6.2 APARs/PTFs. 30 © Copyright IBM Corp. 2003. All rights reserved. iii 3.6.3 AIX 5L 32/64-bit kernel considerations . 31 3.6.4 File system considerations . 32 3.6.5 Memory requirements . 32 3.6.6 Paging space (swap) requirements. 32 3.6.7 Temporary space . 33 3.6.8 Environment and user settings . 34 3.7 Network configuration . 35 3.7.1 Name resolution . 35 3.7.2 Enabling remote command execution. 36 3.7.3 Tuning network options. 38 3.8 ESS Configuration. 40 3.8.1 Configuring host adapter ports . 41 3.8.2 Creating the hosts (on the storage side). 42 3.8.3 Creating the Logical Unit Numbers (LUNs). 44 3.9 Cluster nodes SAN configuration . 45 3.9.1 FC adapter microcode . 45 3.9.2 Configuring logical disks . 46 3.9.3 Enable Fast I/O Failure for FC adapters . 47 3.9.4 Dynamic tracking of Fibre Channel adapters . 47 3.9.5 ESS Subsystem Device Driver setup . 48 3.9.6 Configuring the virtual path devices . 48 3.10 Configuring a clustering infrastructure . 51 3.10.1 RSCT Peer Domain (RPD) cluster . 51 3.10.2 GPFS cluster configuration . 52 3.10.3 HACMP 4.5 installation . ..