Supercomputing made affordable for HPC Departmental users

IBM Departmental Supercomputing Solutions

Now, with the recent introduction of densely packaged rack-optimized servers and blades along with advances in software technology that make it easier to manage and exploit resources, it is possible to extend the benefits of clustered computing to individuals and small departments.

Affordable Supercomputing for HPC Highlights With the IBM Departmental Departmental Users Supercomputing Solutions, barriers to Scientists, engineers and researchers deploying clustered servers—high ■ Complete High Performance have long chosen clustered servers price, complexity, floor-space require- Computing (HPC) solutions with as the preferred solution for large, ments, power consumption levels— pre-tested, densely packaged complex and computational- and have been overcome. Clients with clustered servers deliver high data-intensive problems. Clusters smaller budgets and staff but with performance at a modest price have also proven to be a cost- challenging problems to solve can effective method for managing mixed ■ Includes innovative software tools now leverage the same supercom- HPC workloads. It is common today making cluster systems manage- puting technology used by large for clusters to be used by large cor- ment easy while reducing the time organizations and prestigious labs. porations, universities and govern- it takes to use the solution ment labs to solve problems in life productively IBM Departmental Supercomputing sciences, petroleum exploration, Solutions are offered in a variety of ■ structural design, high-energy Choice to run either or packaged, pre-tested clustered con- physics, finance and securities, Microsoft¨ Windows¨ environ- figurations. Clients have the flexibility ments for enhanced flexibility and more. High Performance Computing

to choose configurations with 1U ● Have you determined that a clus- But despite all the advantages of (1.75 inches high) servers or blades tered solution would be the best clustering, users should be aware in reduced-sized racks and with approach to handle workloads but that clusters can be difficult to con- ® Xeon™ or AMD Opteron™ have not deployed one because of struct from scratch. There are many processors. Clients can choose to run lack of budget, skills or physical technical alternatives to consider, and Linux or operating space? slight mismatches between compo-

systems. Clients have access to infor- ● Are you concerned that your orga- nents in a cluster can result in poor mation about software products from nization’s competitiveness is threat- performance, lowered reliability and IBM vendor partners that can help ened because your HPC system administration nightmares. them choose the right tools to can’t expand with the growth of enhance their productivity and help workloads? IBM Departmental Supercomputing them acquire trial or permanent Solutions are comprehensive cluster license versions of software. And, IBM Departmental Supercomputing packages offered in a variety of con- IBM offers optional implementation Solutions may be the ideal choice. figurations to suit the needs of most and technical support services and smaller organizations. Each cluster attractive leasing and financing Clustering for Performance and consists of compute servers devoted options. Growth to running applications, a manage- Clustering of servers has become a ment server in place for administering ● Do you or your organization have popular approach to solving large, the cluster resources, and a network workloads that have become too complex HPC problems because very interconnect to allow communications complex to solve in a reasonable high levels of sustained performance to and among the compute servers. amount of time or with the required can be delivered in a cost-effective (See table for a list of cluster configu- precision on your current com- manner. Clusters are also popular ration choices.) puting system? because workloads can be partitioned and managed flexibly, resources can be balanced against the available workload, and systems can be expanded incrementally as workload increases. Choosing the right compute servers ● IBM ^ xSeries¨ 335—Dual Single point of control simplifies is the key to successful cluster Intel Xeon processor server in a management deployment. IBM Departmental 1U rack-optimized form-factor These compute servers are combined Supercomputing Solutions offer the with the powerful IBM ^ following choices: With dual high-speed Intel Xeon xSeries 345 management server processors, the x335 delivers max- which is the single point of administra- ● IBM ^¨ BladeCenterª imum xSeries performance density tion for all cluster resources. The x345 HS20—Up to 14 dual Intel Xeon in a flexible server package. The communicates with every compute processor blade servers in a 7U x335 helps deliver the performance server in the cluster over a highly chassis that businesses need to succeed, secure Ethernet virtual LAN the manageability to unburden IT (VLAN). Each IBM Departmental BladeCenter modular design staff, and reliability to provide Supercomputing Solution also gathers computing resources into peace of mind. includes a separate Gigabit Ethernet cost-effective, high-density enclo- VLAN interconnecting all compute sures that support hot-swappable, ● IBM ^325—Dual AMD servers for application internode com- high-performance 2-way Intel Opteron processor server in a 1U munications, and a terminal server processor-based blade servers. rack-optimized form-factor network for remote console capability. The BladeCenter design addresses most serious issues: space con- Designed for HPC, the e325 is The IBM Departmental straints, manageability, scalability, ideal for customers who need Supercomputing Solutions are pack- capacity, performance, cooling and leading 32-bit performance with an aged in economical and space-saving power. BladeCenter servers are easy migration path to 64-bit com- 11U and 25U cabinets along with the designed to take less time to install, puting at an affordable price. The larger 42U cabinet. All configurations fewer people to maintain and cost AMD64™ architecture uses an have been optimized for balanced less than a traditional server solu- integrated memory controller and performance, efficient cabling, proper tion, helping reduce IT infrastruc- innovative HyperTransport™ tech- cooling—and each system is pack- ture costs. BladeCenter technology nology to provide memory access aged and tested as a cluster in the features deliver an effective scale- and substantial I/O bandwidth at factory before being shipped to out architecture that makes adding the speed of the processor. In clients. capacity simple and affordable. addition to delivering outstanding 64-bit price/performance, the e325 enables clients to run both 32- and 64-bit applications simultaneously. This feature gives clients the flexi- bility to run existing applications and operating systems at peak performance today—while also providing a 64-bit migration path for future applications to grow as your business needs grow. High Performance Computing

IBM Departmental Supercomputing Solutions—Cluster Configuration Choices

4-node cluster featuring 1U xSeries 335 compute nodes in 11U rack A small-scale, 4-node, expandable cluster ideal for high availability, infrastructure, or departmental workloads that utilizes dual Intel Xeon processor x335 servers for compute nodes and the powerful dual Intel Xeon processor x345 for cluster management node.

4-node cluster featuring 1U eServer 325 compute nodes in 11U rack A small-scale, 4-node, expandable cluster ideal for high performance 32-bit and/or 64-bit departmental workloads that utilizes dual AMD Opteron processor e325 servers for compute nodes and the powerful dual Intel Xeon processor x345 for cluster management node.

8- and 16-node clusters featuring 1U xSeries 335 compute nodes in 25U rack These 8- and 16-node clusters feature dual Intel Xeon processor x335 1U servers for compute nodes and the powerful dual Intel Xeon processor x345 for the cluster management node.

8- and 16-node clusters featuring 1U eServer 325 compute nodes in 25U rack These 8- and 16-node clusters feature dual AMD Opteron processor e325 1U servers for compute nodes and the powerful dual Intel Xeon processor x345 for the cluster management node.

14- and 28-node clusters featuring IBM ^ BladeCenter in 25U Rack These 14- and 28-node clusters feature our IBM ^ BladeCenter HS20 for compute nodes and the powerful dual Intel Xeon processor x345 for cluster management node. The 14-node cluster utilizes the BladeCenter chassis with 14 dual processor HS20 blade servers sharing redundant resources such as power supplies and cooling fans. The 28-node cluster configuration utilizes two chassis with 14 blade servers installed in each.

32-node clusters featuring xSeries 335 compute nodes in 42U enterprise rack This powerful 32-node Cluster 1350 features dual Intel Xeon processor x335 1U servers for compute nodes and the powerful dual Intel Xeon processor x345 for the cluster management node. The 42U enterprise rack includes all required cabling as well as a 17" flat panel monitor. This design is readily expandable, and can be configured to your individual needs if necessary.

32-node clusters featuring eServer 325 compute nodes in 42U enterprise rack This powerful 32-node Cluster 1350 features dual AMD Opteron processor e325 1U servers for compute nodes and the powerful dual Intel Xeon processor x345 for the cluster management node. The 42U enterprise rack includes all required cabling as well as a 17" flat panel monitor. This design is readily expandable, and can be configured to your individual needs if necessary.

Table 1. Innovative Software Brings the This capability simplifies the man- ● IBM Linux Cluster Install Tool Cluster to Life agement of the cluster and easily (LCIT) Software is what turns a collection scales with the cluster to improve LCIT is a utility and diagnostic tool of interconnected servers into a the efficiency of the person running for Linux users who prefer to have powerful yet manageable cluster for the system. The administrator can more direct involvement in the high performance and scalable monitor hardware and software setup of the cluster. The IBM computing. The IBM Departmental events and CSM can trigger auto- Departmental Supercomputing Supercomputing Solutions are deliv- mated recovery actions when solutions include a unique and ered with cluster management soft- appropriate. Using CSM, the comprehensive application to ware from IBM. Downloadable trial administrator can perform software assist in the deployment and man- versions of software tools from IBM installations and updates on agement of Linux clusters. LCIT partners are available. The Linux or nodes, run distributed commands, provides clients and service per- Microsoft Windows operating system and synchronize files across the sonnel a utility program designed is provided by the client. The collec- cluster. CSM can be used to auto- to assist with the initial setup and tion of software helps derive maximum mate security configuration and information gathering of the cluster. performance and utility from the administration and perform diag- LCIT processes this information cluster as well as ease systems man- nostics. The administrator can into a suitable format for use with agement and enable rapid time-to- learn the status of each server CSM. productivity. in the cluster at any time, and remotely power on and off any The LCIT function results in a more Software components server. By providing a single automated and error-free installa- point of control with robust cluster tion. By using this tool, the admin-

● IBM Cluster Systems management capabilities, CSM istrator will see measurable time Management (CSM) can simplify total systems manage- savings, efficiencies in setup and CSM is advanced systems man- ment and help increase cluster in management capabilities. agement software that allows a availability. cluster of supported Intel and/or AMD Opteron processor-based servers running Linux to be man- aged from a single point of control. High Performance Computing

● IBM Director (ANSI F95, F90, • Thread-safe, OpenMP™ ready IBM Director gives administrators and F77) are source-compatible • Internally multithreaded, no comprehensive remote manage- optimizing compilers which gen- polling ment of individual servers from a erate robust, reliable, high-perform- • Extensive ++ & Fortran com- single graphical console. IBM ance code. The Absoft Fx2 piler support Director automates and simplifies Debugger™ is a Fortran debug- • Remote distributed installation IT tasks, boosting administrator ging tool (and also supports and automatic configuration productivity and reducing skill level C/C++ and assembler), can be requirements. IBM Director tools used in scalar, parallel workstation For more information, visit provide clients with flexible capa- and cluster configurations, and can www.criticalsoftware.com/hpc. bilities to realize maximum system be configured with various graph-

availability and lower IT costs. With ical user interfaces. ● Engineered Intelligence CxC¨ IBM Director, IT administrators can parallel programming tool view and track the hardware con- For more information, visit EI’s CxC language and develop- figuration of remote systems in www.absoft.com. ment environment is a simple par- detail and monitor the usage and allel development system that

performance of critical compo- ● Critical Software WMPI IIª mes- allows customers to prototype par- nents, such as processors, disks, sage passing middleware allel algorithms without system and memory. Critical Software has a worldwide administrator knowledge regarding commercial implementation of the the operating system or cluster

● Absoft¨ compilers and debugger Message Passing Interface (MPI) hardware. Customers can develop Since 1980 Absoft has provided version 2 standard for Windows- parallel programs, or parallelize compilers, debuggers, and devel- based clusters. existing C, C++ or Fortran code, opment tools, and now specializes without spending years and system in Fortran-related products for WMPI II™ is the high-end member time becoming a parallel program- desktops, workstations, and high- of Critical Software’s line of middle- ming specialist - no MPI/OpenMP performance computers and clus- ware products for high perform- knowledge required. EI’s Desktop ters for a wide variety of 32-bit and ance computing clusters providing Supercomputing solution consists 64-bit architectures running Linux, a comprehensive implementation of a parallel development environ- Windows, and Macintosh operating of version 2 of the MPI standard. ment (Paralab™, or Parallel systems. Absoft’s -derived Key features of WMPI II are: Laboratory) and parallel execution

• MPI-2 standard compliant • Heterogeneous cluster support run-time environment. Engineers ● PathScaleª compilers installed. Outstanding single- and scientists can create, proto- The PathScale Suite rep- processor performance, type and run parallel algorithms on resents one of the industry’s uncommon reliability, support for a desktop or laptop computer, highest performance 64-bit com- most common extensions, and then, when ready run the same pilers for the IBM e325 server. This automatic or user-directed paral- unchanged CxC executable on the highly optimized suite consists of lelization for shared-memory par- supercomputing cluster with linear C, C++ and Fortran 77/9x com- allel systems add up to compilers speedup and unlimited scalability. pilers. It is feature rich and has full that “just work” for users migrating compatibility with GNU/gcc tool from RISC/ workstations and For more information, visit chain and debuggers. When per- servers to 32-bit x86 or 64-bit goparallel.com/ibm. formance matters, use PathScale. AMD64 architecture-based systems.

● Etnus TotalView¨ debugger For more information, visit TotalView is an advanced 32- and www.pathscale/IBM- For more information, visit 64-bit graphical debugger that PathScale.html. www.pgroup.com. gives software engineers control

over and insight into threaded and ● PGI compilers ● Scientific Computing Associates parallel applications written in C, The PGI® CDK™ Fortran, C and TCP Lindaª parallelization tool C++ or Fortran. It supports many C++ compilers and tools for Linux TCP Linda gives users without any parallel models, including MPI and clusters allow multiple users to special expertise or training in par- OpenMP. TotalView is equally effec- compile, debug and profile serial, allel programming the ability to tive debugging shared memory or OpenMP-parallel, and MPI-parallel build new parallel applications or distributed programs, on shared science and engineering applica- to “parallelize” existing sequential memory or distributed memory/ tions. The PGI compilers are highly applications easily and intuitively. clustered machines. Some of these optimized for both IA32 and TCP Linda provides a simple, yet advanced features include heap AMD64 architecture-based sys- complete command set which allocation debugging, sophisti- tems. Executables can be enables process creation, synchro- cated data analysis, and STLView deployed on any compatible nization and communication. Every for simplified viewing of C++ stan- system regardless of whether the Linda software system employs dard template code. PGI compilers and tools are powerful application optimization techniques and carefully tuned, For more information, visit www.etnus.com. High Performance Computing

architecture-specific run-time sys- ● Visual Numerics Inc. IMSLª Flexibility of Choosing Linux or tems. Any program written in C, math libraries and PV-WAVE¨ Microsoft Windows C++, or Fortran can be parallelized visual data analysis Selected cluster configurations are using just four simple TCP Linda Visual Numerics’ software products able to run either the Linux or operations. The result is high per- help users understand complex Microsoft Windows operating systems. formance computing through the data from a variety of sources and use of clusters such as an IBM build business-critical applications. This flexibility enhances the value of BladeCenter. TCP Linda tech- Visual Numerics has provided choosing IBM Departmental nology is embedded in versions of technical software solutions for Supercomputing Solutions. The spe- Gaussian ’03, the heavily-used and visualiza- cific operating system versions computational chemistry program, tion for over 30 years. supported are: and is used in diverse other set- tings such as the financial services Visual Numerics has two product For x335 and BladeCenter HS20: and petroleum industries. families: the IMSL Numerical

Libraries and PV-WAVE, Visual ● SUSE® Linux Enterprise Server 8 For more information, visit Data Analysis you can trust. The (SLES 8)

www.lindaspaces.com. IMSL Numerical Libraries, which ● Red Hat® Enterprise Linux (RHEL) are available in C, Fortran and 3.0 ES and WS; RHEL 2.1 AS

● Scali MPI Connectª intercon- Java™, deliver breadth and depth ● Red Hat 9 (32 bit)

nect management of core algorithms allowing for the ● Microsoft Windows 2000 Server for Scali MPI Connect is a fully inte- rapid development of any program Computational Servers

grated message passing interface needed to analyze problems of all ● Microsoft Windows 2003 Standard that allows companies to take sizes. The PV-WAVE Family of Edition for Computational Servers advantage of leading intercon- products can be used in conjunc- nects—Gigabit Ethernet, Myrinet, tion with the IMSL Libraries to For e325: SCI, InfiniBand or a combination render sophisticated visualizations

thereof—through a single MPI of your data. ● SUSE Linux Enterprise Server 8 implementation. Scali’s MPI (SLES 8)/AMD-64 (64-bit)

delivers flexibility, scalability and For more information, visit ● Red Hat Enterprise Linux (RHEL) high bandwidth, low-latency per- www.vni.com. 3.0 AS/AMD-64 and WS/AMD-64

formance for applications designed ● Red Hat 9 (32 bit) for parallelism and portability.

For more information, visit www.scali.com. Software Platform Support

ISV Functional Solution Intel/Linux Intel/Windows AMD Area (x335, BC HS20) (x335, BC HS20) Opteron/Linux (e325)

IBM Cluster Systems CSM X X X Management

IBM Cluster Installation LCIT X X X

IBM Server Management IBM Director X X X

Absoft Compilers Compilers, Fx2 X X X Debugger

Critical Software Message Passing WMPI II X X X

Engineered Parallelization CxC, Paralab X X X Intelligence

Etnus Debugger TotalView X X X

PathScale Compilers Compilers X

PGI Compilers Compilers X X X

SCA Parallelization TCP Linda X X X

Scali Interconnect MPI Connect X X Management

Visual Numerics Math Libraries, Visual IMSL, PV-WAVE X X X Data Analysis High Performance Computing

Backed by IBM Optional Services and Financing planning, interoperability, product IBM Departmental Supercomputing Available documentation, and diagnostic infor- Solutions are backed by worldwide IBM and IBM Business Partners mation. Support Line is available service and support from IBM. When offer optional installation services to either 9 hours per day Mon. through you purchase or lease this solution, clients of the IBM Departmental Fri. or 24 hours per day 7 days per you receive component level warranty Supercomputing Solutions who may week. service with IBM acting as a single need customization assistance or point-of-contact and as the service who may want to integrate them with To further simplify the deployment provider for all components—IBM and other existing systems. effort, IBM can provide project man- Original Equipment Manufacturer agement support to help coordinate (OEM). The warranty period is three IBM Support Line for Linux Clusters is all aspects of delivery and installa- years and standard warranty service an optional fee service staffed by tion, including hardware and software is IBM on-site repair, 9 hours per day experts who understand the entire setup services. Attractive financing Mon. through Fri. excluding holidays, cluster environment, not just the indi- and leasing terms are also available. with next business day response. vidual components. It is available to IBM Global Financing offers competi- Warranty and maintenance services help optimize your staff’s productivity, tive financing to credit-qualified upgrade options are available for an simplify integration and maintenance, clients and Business Partners to additional charge. and reduce problem resolution time. assist them in acquiring IT solutions. With Support Line for Linux Clusters, Offerings include financing for IT Warranty terms and conditions IBM will serve as a single source for acquisition, including hardware, soft- may be different in some countries. comprehensive technical support for ware and services, as well as com- Please consult your local IBM mar- your Linux cluster. Telephone support mercial financing (revolving lines of keting representative or IBM Business includes troubleshooting problems, credit, terms loans, acquisition facili- Partner for country-specific terms and software defect support and ties and inventory financing credit conditions. answering questions regarding instal- lines) for Business Partners. lation, usage, compatibility, upgrade Feature Benefits

Choice of several configurations based on • Yields affordable solutions that can be incrementally expanded as workloads grow server clustering design • Comes with many choices of the number and type of server, offering an ideal solution for smaller organizations • Available in space-saving cabinets, for flexible use within departmental environments

Integrated and tested hardware supported • Provides validated configuration with a single point of contact for continuing support by IBM • Helps speed time-to-productivity

Advanced IBM ^ hardware • Unique IBM Enterprise X-Architecture™ delivers powerful, scalable and reliable Intel processor-based servers • Revolutionary BladeCenter design delivers the optimal combination of performance density and integration • AMD Opteron processor-based systems optimized for both HPC application environ- ments and for clients desiring an affordable, simplified environment for 32-bit to 64-bit migration

Innovative Software • Includes useful cluster system management software tools from IBM to help improve productivity and drive higher levels of utility from the cluster • Includes access to useful software productivity tools from IBM vendor partners to help yield high performance, improve ease-of-use, and drive higher levels of utility from the cluster

Choice of Linux or Microsoft Windows • Allows flexibility to match clients’ preferences

Summary by a cluster have been significant Solutions and can take advantage of Computationally-intensive workloads barriers for departmental level users. clustered supercomputing with can be found within companies and With the introduction of the IBM reduced staffing requirements for organizations of all sizes. Smaller Departmental Supercomputing highly-skilled systems administrators. organizations with limited budgets Solutions, smaller organizations can have been unable to deploy clustered now acquire affordable, pre-tested The benefits of clustered supercom- supercomputing techniques against and integrated clusters based on puting that have provided competitive their most challenging problems. Until high-performance, space-saving advantage for large enterprises and recently, the cost of the system, the technology that is easy to manage research labs are now available to the skills needed to install and manage it, and use. Clients can become produc- smallest organization—even the indi- and the space and power consumed tive more quickly with the IBM vidual scientist or engineer. Departmental Supercomputing For more information? To learn more about IBM Departmental Supercomputing Solutions, contact IBM or an IBM © Copyright IBM Corporation 2004 authorized reseller. IBM Corporation Systems Group Route 100 World Wide Web Somers, NY 10589 .com/servers/deepcomputing Produced in the United States of America February 2004 All Rights Reserved Reseller locator and general Visit ibm.com/pc/safecomputing periodically information for the latest information on safe and effective computing. Warranty Information: For a copy US 1 800 426-4968 of applicable product warranties, write to: Canada 1 800 426-2255 Warranty Information, P.O. Box 12195, RTP, NC 27709, Attn: Dept. JDJA/B203. IBM makes no representation or warranty regarding third- Offering Manager party products or services including those designated as ServerProven or ClusterProven. Herbert Schultz Telephone support may be subject to email: [email protected] TotalView is a registered trademark of Etnus additional charges. For onsite labor, IBM will LLC. attempt to diagnose and resolve the problem PathScale is a trademark of PathScale, Inc. remotely before sending a technician. Marketing Manager PGF90, CDK and Cluster Development Kit are The following terms are registered trademarks Art Wieboldt trademarks, and PGI, PGF77, PGF90, PGCC, of International Business Machines PGDBG and PGPROF are registered Corporation in the United States and/or other email: [email protected] trademarks of STMicroelectronics. countries: ^, xSeries TCP Linda is a trademark of Scientific The following terms are trademarks of Computing Associates, Inc. International Business Machines Corporation Scali MPI Connect is a trademark of Scali. in the United States and/or other countries: BladeCenter, eServer, X-Architecture IMSL is a trademark and PV-WAVE is a registered trademark of Visual Numerics, Inc. For a list of additional IBM trademarks, please see ibm.com/legal/copytrade.shtml References in this publication to IBM products or services do not imply that IBM Microsoft, Windows, and the Windows logo intends to make them available in all are registered trademarks of Microsoft countries in which IBM operates. Corporation in the United States, other countries, or both. IBM hardware products are manufactured from new parts, or new and used parts. In SUSE is a registered trademark of SUSE some cases, the hardware product may not Linux. be new and may have been previously Red Hat is a registered trademark of Red Hat, installed. Regardless, our warranty terms Inc. apply. Intel, Intel Inside (logos), Pentium are All statements regarding IBM's future registered trademarks and Xeon is a direction and intent are subject to change or trademark of Intel Corporation in the United withdrawal without notice, and represent States, other countries, or both. goals and objectives only. AMD Opteron processor, AMD64 architecture All information in these materials is subject to and HyperTransport technology are change without notice. ALL INFORMATION IS trademarks of , Inc. PROVIDED ON AN “AS IS” BASIS, WITHOUT Other company, product and service names ANY WARRANTY OF ANY KIND. may be trademarks or service marks of others. Information in this document concerning non- Absoft is a registered trademark and Pro IBM products was obtained from the Fortran, Fx Debugger, and Fx2 Debugger are suppliers of these products, published trademarks of Absoft Corporation. announcement material or other publicly WMPI II is a trademark of Critical Software SA available sources. IBM has not tested these company. products and cannot confirm the accuracy of performance, compatibility or any other OpenMP is a trademark of the OpenMP claims related to non-IBM products. Architecture Review Board. Questions on the capabilities of non-IBM CxC is a registered trademark and Paralab products should be addressed to the and MPI-XF are trademarks of Engineered suppliers of those products. Intelligence Corporation.

GM13-0612-00