JUGENE: Jülich’s Next Step Computational scientists from many re- No. 160 • Jan. 2008 towards search areas took the chance to apply for significant shares of Blue Gene/L com- When IBM Blue Gene technology became puter time in order to tackle issues that available in 2004/2005, Forschungszen- could not be resolved in the past. Due trum Jülich recognized the potential of this to a large user demand and in line with architecture as a leadership-class system its strategy to strengthen leadership-class for capability computing applications. A key computing, Forschungszentrum Jülich de- feature of this architecture is its scalability cided to procure a powerful next-generation towards petaflop computing based on low Blue Gene system. In October 2007, a 16- power consumption, small footprints and an rack Blue Gene/P system with 65,536 pro- outstanding price-performance ratio. cessors was installed. This system was In early summer 2005, Jülich started test- mainly financed by the Helmholtz Associ- ing a single Blue Gene/L rack with 2,048 ation and the State of North Rhine West- processors. It soon became obvious that phalia. With its peak performance (Rpeak) many more applications than expected of 222.8 TFlop/s and a measured LINPACK could be ported and efficiently run on the computing power (Rmax) of 167.3 TFlop/s, Blue Gene architecture. Due to the fact Jülich’s Blue Gene/P – dubbed JUGENE – that the system is well balanced in terms of was ranked second in the TOP500 list of processor speed, memory latency and net- the fastest computers in the world which work performance, many applications can was released in November 2007 in Reno, be successfully scaled up to large numbers USA. of processors. In January 2006, the system The main differences between Blue Gene/P was therefore upgraded to eight racks with and Blue Gene/L concern the processor 16,384 processors using funding from the and networks. The principal design of Blue Helmholtz Association. Gene/L remained unchanged. The key fea- The eight-rack system has been in opera- tures of Blue Gene/P are: four PowerPC tion successfully for two years now. Today, 450 processors combined in a four-way about 30 research projects, which were SMP (node) chip. This allows a hybrid pro- carefully selected based on their scientific gramming model with MPI and OpenMP quality, run their applications on the system (up to four threads per node). The network using between 1,024 and 16,384 proces- interface is DMA-capable (direct memory sors. During a Blue Gene Scaling Work- access), which increases the performance shop in Jülich, experts from Argonne Na- while reducing the processor load during tional Laboratory, IBM and Jülich helped message handling. The available memory to further optimise some important applica- per processor has been doubled. The ex- tions. It was also shown that all of these ternal I/O network has been upgraded from applications make efficient use of all 16,384 1 to 10 Gigabit Ethernet. processors. JSC News No. 160 • Jan. 2008

These improvements are also reflected in the application Another improvement is the extended validity period of the performance. A code from theoretical elementary parti- new certificates. User certificates are now valid for three cle physics, for example, runs at 36.8 % of the peak per- years and server certificates for five years. Existing "classic" formance on Blue Gene/P compared to 26.3 % on Blue certificates can still be used until they expire. Gene/L. Furthermore, the increased memory of 2 GB per For information about certificates at Forschungszentrum node will allow new applications to be run on Blue Gene/P. Jülich, see http://www.fz-juelich.de/jsc/zertifikate/. JUGENE is part of the dual complex in Contact: Martin Sczimarowsky, ext. 6411 Jülich, embedded in a common storage infrastructure which has also been expanded. A key part of this infrastructure is Institute for Advanced Simulation (IAS) the new Jülich storage cluster (JUST), which was installed Established in the third quarter of 2007. JUST increases the online disk capacity by a factor of ten to around one petabyte. The max- On 1 January 2008, Forschungszentrum Jülich es- imum I/O bandwidth of 20 GB/s is achieved with 29 storage tablished the Institute for Advanced Simulation (IAS). controllers combined with 32 IBM Power 5 servers. JUST is Prof. Dr. Dr. Thomas Lippert was appointed director of the connected to the via a new switch technol- institute. The Jülich Supercomputing Centre (JSC) is now a ogy based on the 10 Gigabit Ethernet. The system takes on division – IAS-1 – of the new institute. Prof. Lippert will con- the fileserver function for GPFS (General Parallel File Sys- tinue to be head of IAS-1. The John von Neumann Institute tem) and is used by clients in Jülich as well as clients within for Computing (NIC) will also be integrated into IAS. the international DEISA infrastructure. With the upgrade of its supercomputer infrastructure, NIC Symposium 2008 Forschungszentrum Jülich has taken the next step towards The 4th NIC Symposium will be held at Forschungszentrum petascale computing and has strengthened Germany’s po- Jülich from 20 - 22 February 2008. The talks will inform a sition in the competition for one of the future European su- broad audience of scientists and interested members of the percomputer centres. public about the activities and results obtained in the last For more detailed information about JUGENE, see two years at the John von Neumann Institute for Computing http://www.fz-juelich.de/jsc/jugene. (NIC). Fifteen invited lectures will cover selected topics in Contact: Klaus Wolkersdorfer, ext. 6579 the fields of astrophysics, biophysics, chemistry, condensed matter, material science, elementary particle physics, poly- Inauguration of the Supercomputer JUGENE mers, environmental research and nuclei, atoms, plasmas, The new supercomputer JUGENE will be officially inaugu- and patterns. rated on 22 February 2008 in the presence of Ministerpräsi- To accompany the conference, an extended proceedings dent Dr. Jürgen Rüttgers of North-Rhine Westphalia in the volume (NIC Series Volume 39) will also be published. It will auditorium at Forschungszentrum Jülich. Several rounds provide an overview of a larger range of projects that have of discussion will highlight the importance of supercomput- used the IBM supercomputers JUMP and JUBL in Jülich and ing with respect to scientific simulations and imbedding the the APE topical computer at DESY-Zeuthen. Jülich supercomputers in a European supercomputer infras- The detailed programme and the registration form are avail- tructure. Participation in the inauguration is by invitation able at: http://www.fz-juelich.de/nic/symposium. only. If you would like to attend, please contact Mrs. Lam- berz de Bayas ([email protected], ext. 3008). Events NIC Symposium 2008 "Global" Certification Authority Operational Date: 20 - 22 February 2008 On 19 December 2007, a new Certification Authority (CA) for Venue: Auditorium, Forschungszentrum Jülich Forschungszentrum Jülich was put into operation. The new Registration: http://www.fz-juelich.de/nic/symposium "global" CA replaces the former "classic" CA and supports Inauguration of JUGENE some important service extensions. Date: 22 February 2008, 11:00 Since the root authority for signing "global" certificates, a Venue: Auditorium, Forschungszentrum Jülich CA of Deutsche Telekom, is included in the certificate stores Request invitation: [email protected] of current versions of MS Internet Explorer, the handling of Further events, talks, and training courses: certificates has become much easier. When using Windows JSC: http://www.fz-juelich.de/jsc/news/calendar products, it is no longer necessary to manually include root NIC: http://www.fz-juelich.de/nic/Aktuelles/ certificates. According to DFN, the Mozilla family of products are to follow this policy in the near future. Editor: Dr. Sabine Höfler-Thierfeldt, ext. 6765