IBM Platform Symphony V5.2 Enables Scalable, High- Performance Grid Services for a Variety of Parallel Compute and Data Intensive Applications

Total Page:16

File Type:pdf, Size:1020Kb

Load more

IBM United States Software Announcement
212-204, dated June 4, 2012

IBM Platform Symphony V5.2 enables scalable, high- performance grid services for a variety of parallel compute and data intensive applications

Table of contents

122246

Overview

78

Publications

Planned availability date Description Product positioning Program number
13 Ordering information 16 Terms and conditions

19 Prices 20 Order now

At a glance

IBM® Platform SymphonyTM V5.2 helps you exceed your performance goals with a fast, efficient grid computing environment.

You can realize: •••••
Faster throughput and performance Higher levels of resource utilization Reduced infrastructure and management costs Reduced application development and maintenance costs The agility to respond instantly to real-time demands

For ordering, contact Your IBM representative or an IBM Business Partner. For more information contact the Americas Call Centers at 800-IBM-CALL (426-2255).

Reference: YE001

Overview

IBM Platform Symphony V5.2 is an enterprise-class grid manager for running distributed application services on a scalable, shared, heterogeneous grid. It accelerates a wide variety of compute and data-intensive applications, quickly computing results while making optimal use of available infrastructure.

Platform Symphony's efficient low-latency middleware and scheduling architecture is designed to provide the performance and agility required to predictably meet and exceed throughput goals for the most demanding analytic workloads.

Designed for reliability and having advanced management features, IBM Platform Symphony helps organizations realize improved application performance at a significantly reduced total cost of ownership.

Platform Symphony can help you: •••
Obtain higher quality business results faster Reduce infrastructure and management costs Combine compute and data intensive applications on a single shared platform

  • IBM United States Software Announcement 212-204
  • IBM is a registered trademark of International Business Machines Corporation

1

Platform Symphony runs on a variety of hardware and operating environments including the latest generation of IBM System x® servers. By pre-qualifying and certifying these platforms in large-scale environments, you take the risk out of deploying mission-critical grid computing applications.

Key features of Platform Symphony : ••••
Ultra-fast, low-latency grid scheduler (less than 1 millisecond overhead) Scalable to 10,000 cores per application and 40,000 cores per cluster Heterogeneous application and platform support Unique resource sharing model that enables lending and borrowing for maximum efficiency
••
Optimized, low latency MapReduce implementation Support of both compute and data intensive problems on a single shared grid of resources

Platform Symphony is available in four different editions tailored to meet your different business requirements.

•••
IBM Platform Symphony Developer Edition - Build and test applications without the need for a full-scale grid. IBM Platform Symphony Express® Edition - The ideal solution for departmental clusters. IBM Platform Symphony Standard Edition - Enterprise class performance and scalability. IBM Platform Symphony Advanced Edition - Use for distributed compute and data intensive applications.

Key prerequisites

  • A physical grid computing environment comprised of IBM System x or similar

servers.
•••
Cluster nodes should be preinstalled with supported operating environments. Cluster nodes should be connected via a fast TCP/IP network infrastructure. Management hosts on the cluster should share a common network file system.

Planned availability date

June 15, 2012

Description

IBM Platform Symphony V5.2 is a high-performance grid middleware and management solution that runs on your choice of hardware and operating environments. You can use Platform Symphony to run preintegrated applications available from a variety of independent software vendor (ISVs), or easily adapt and accelerate their own compute and data intensive parallel workloads on a grid making them agile and flexible.

Performance and scalability

Platform Symphony is one of the industry's fastest and most scalable serviceoriented architecture (SOA) grid management software. IBM Platform Symphony provides organizations with a competitive advantage by solving a wide range of parallelizable compute and data-intensive business problems.

••
Scale to 10,000 cores per application Sub-millisecond latency for grid services

  • IBM United States Software Announcement 212-204
  • IBM is a registered trademark of International Business Machines Corporation

2

••
Throughput to 17,000 tasks per second Reallocate up to 1,000 grid services per second

Platform Symphony environments can scale by linking multiple clusters to environments comprised of hundreds of thousands of cores. For organizations that need a fast service-oriented computing infrastructure, Platform Symphony's performance and scalability provides a clear competitive advantage.

Flexible resource sharing

A key advantage of Platform Symphony is its sophisticated hierarchical resource sharing model. Platform Symphony's ability to lend and borrow resources, based on policy, guarantees users access to owned resources when needed. Departments can also easily share resources not in use with others, and borrow resources dynamically as needed. By avoiding the need for application-specific siloes, users enjoy a better quality of service with reduced infrastructure and management costs. Whether you are deploying on LinuxTM , WindowsTM , Windows HPC Server, UNIXTM , or all of the above, you can manage your environment as a single shared resource pool with IBM Platform Symphony .

Support for compute and data intensive workloads

IBM Platform Symphony is optimized for both compute and data intensive parallel workloads. It provides a rich set of client and server side APIs for a variety of parallel computing problems alongside an optimized Hadoop compatible MapReduce implementation along with other data handling innovations to accelerate the processing of large distributed data sets. Both interfaces take advantage of Platform Symphony's low-latency middleware and resource orchestration capability to deliver dramatic gains for both compute and data intensive applications. By incorporating the function of scheduling both compute and data related tasks into a single smart scheduler, tasks can be dispatched with an awareness of data locality resulting in dramatic gains in performance and efficiency as applications avoid the needless movement of data across congested networks.

Rapid response for business critical workloads

IBM Platform Symphony is able to react instantly to changes in application demand. With the flexibility to adapt when priorities change, IBM Platform Symphony can reallocate over 2,000 compute engines per second to different workloads depending on configurable sharing policies and application priorities. This translates into better application performance, better utilization, and an ability to respond quickly to business critical demands.

Ease of application and data integration

Regardless of your development environment, IBM Platform Symphony has you covered. Well documented APIs enable fast integrations for applications written in the following languages:

•••••
C++ C#, .NET JavaTM Excel COM Native binaries

Extensions provided for MicrosoftTM Visual Studio Professional support compilation free integration of .NET assemblies. Developers can use a step-by-step wizard to integrate and test applications end-to-end without needing to be expert in the Platform Symphony APIs. For Java developers, the Eclipse integrated development environment (IDE) is supported as well.

For data intensive applications, Platform Symphony Developer Edition and Platform Symphony Advanced Edition provide an optimized Hadoop compatible MapReduce implementation enabling most Hadoop applications to run without modification.

  • IBM United States Software Announcement 212-204
  • IBM is a registered trademark of International Business Machines Corporation

3

Plug-ins are also provided for distributed file systems including IBM General Parallel File System ( GPFSTM ), Apache HDFS, and Appistry. Platform Symphony also supports integrations with third-party in-memory data grid solutions.

A free downloadable IBM Platform Symphony Developer Edition makes developers productive immediately, enabling them to develop and test CPU or graphics processing unit (GPU) based applications on their operating system of choice without the need for a production grid. Platform Symphony Developer Edition also enables you to develop and exercise data intensive MapReduce applications with just one or two compute hosts. It is available from developerWorks®

http://www.ibm.com/developerworks/

Accessibility by people with disabilities

A US Section 508 Voluntary Product Accessibility Template (VPAT) containing details on accessibility compliance can be requested at

http://www.ibm.com/able/product_accessibility/index.html

Product positioning

Platform Symphony is part of a family of cluster and grid workload management solutions from IBM .

These products include: ••
IBM LoadLeveler® IBM Platform LSF®

IBM LoadLeveler is a job scheduler that controls the scheduling of batch jobs. LoadLeveler matches job requirements to the best available compute resources for execution and runs on IBM POWER® machines and x86-based Linux systems. LoadLeveler is an excellent choice as a workload management system when you are running applications already integrated with or supported by LoadLeveler on POWER or Linux based systems.

IBM Platform LSF family is comprised of a batch workload scheduler similar to LoadLeveler . A number of other components are also available for Platform LSF including graphical workflow management tools, application-centric portals, monitoring and analysis tools, and tools for scheduling commercial software license features. While there is some intersection in functionality between LoadLeveler and Platform LSF , Platform LSF may be an appropriate choice when you need these specific additional capabilities or when you wish to deploy a Windows , or mixed Windows , Linux , or UNIX (including AIX® ) environment involving hardware or operating systems not supported by IBM LoadLeveler .

Platform Symphony is different from all of the solutions mentioned above. Key differences: •

••
Platform Symphony is most often used with programmatic (API driven) workloads. Whereas a batch scheduler such as Platform LSF can schedule jobs in seconds or minutes, Platform Symphony can schedule tasks in milliseconds. Because of this difference, Platform Symphony is frequently described as supporting online or near real-time requirements. Whereas Platform LSF jobs are typically command line driven or integrated via a C language API, Platform Symphony offers a rich set of client and server side APIs including C++, C#, .NET, Java , Excel COM, and other programming interfaces. Platform Symphony incorporate service-oriented middleware specifically optimized for HPC environments. With a batch workload scheduler, while there are exceptions, the resources assigned to a job are normally static and do not adjust at run time. With Platform

  • IBM United States Software Announcement 212-204
  • IBM is a registered trademark of International Business Machines Corporation

4

Symphony , resource assignments are fluid and service instances can be reallocated very quickly.


Job runtimes in a batch computing context often run for minutes or even hours. Task runtimes in Platform Symphony , by contrast, are often very short and execute in milliseconds. As a point of reference, the largest Platform LSF clusters complete a few million jobs per day while the largest production Platform Symphony clusters run in excess of 400,000,000 tasks per day. Another key differentiator is related to data handling. Batch workload schedulers generally rely on a shared file system to move data between hosts or mechanisms such as pre-execution scripts to move data by other means. Platform Symphony by contrast supports fast in-band data movement and a variety of optimizations for data handling such as direct-data transfer, data compression, and data-aware scheduling.

  • Platform Symphony dynamically provisions services in response to application

demand, however it does not provision the actual cluster nodes or host operating environments. Because of this, Platform Symphony will normally be sold along with cluster management tools or into environments that already have cluster management tools in place.

Because of these key differences, Platform Symphony typically runs different types of analytic workloads than Platform LSF . Workloads that require very fast scheduling, low latency, high throughput and scale, and fast, agile resource sharing are likely to be best served by Platform Symphony .

Some unique characteristics of Platform Symphony relative to other highperformance SOA grid middleware solutions are:

  • Heterogeneity - Platform Symphony is agnostic of operating systems,

programming languages, and software frameworks making it easier to integrate heterogeneous environments. Platform Symphony can run not only multiple compute-oriented workloads, but also data-oriented MapReduce workloads on the same grid sharing resources between them.


Scale and performance - Platform Symphony employs a unique "push" based scheduling model that helps it deliver better scalability and faster response times. Sharing - A unique resource sharing model at the heart of Platform Symphony provides users or lines of business instant access to owned resources when needed, but also facilitates dynamic resource sharing to help ensure that compute hosts are fully utilized at all times.

As mentioned earlier, Platform Symphony is also available to run MapReduce jobs (a component of Apache Hadoop) via an optimized, low-latency MapReduce capability built into the Platform Symphony Advanced Edition.

If you deploy Hadoop clusters, you may want to consider IBM InfoSphere® BigInsights for specific requirements where you want to run service-oriented workloads on the same cluster as Hadoop jobs, or where you have special requirements that demand low-latency scheduling to speed up short duration MapReduce jobs, Platform Symphony may be an appropriate solution.

Customers may choose to deploy Platform LSF and Platform Symphony on the same shared cluster infrastructure but there are some limitations. If deploying mixed Platform Symphony and Platform LSF clusters contact a Platform Symphony product specialist for configuration advice and assistance.

Reference information

Refer to Preview Announcement 212-211, dated June 04, 2012 .

  • IBM United States Software Announcement 212-204
  • IBM is a registered trademark of International Business Machines Corporation

5

Program number

Program number
Program

  • name
  • VRM

  • 5725-G86
  • 5.2.0
  • IBM Platform Symphony

Additional information

Recommended platforms

Platform Symphony is supported on most IBM and third-party x86 and x64 hardware platforms. Platform Symphony installations are typically large and span multiple servers. Because of this, rack-based solutions tend to be the most practical.

Recommended IBM hardware platforms for Platform Symphony include IBM System x racks, blades, and iDataPlex® systems.

For customers running data intensive workloads, such as MapReduce on the Plaform Symphony cluster, the IBM systems noted above, supporting larger numbers of independent disk drives, tend to yield the best application performance. The best system should be selected in consultation with System x and Platform Symphony specialists. The optimal configuration depends on the scale of the cluster and the nature anticipated application workloads.

IBM Power® System servers running AIX V5 are compatible with Platform Symphony but from a client perspective only. This means that client applications running on AIX can call Platform Symphony compute services, but the services themselves are assumed to be running on a grid comprised of System x or compatible systems.

Platform Symphony installations usually involve a predefined number of management hosts and a larger number of compute hosts. Management hosts typically have more robust configurations in terms of CPU, memory, and disk since management hosts run the session management, a key component in the distributed middleware. As requirements changed, the logical set of management hosts can easily be changed without physical reconfiguration of the cluster.

A typical installation might involve half a dozen management hosts and several hundred compute hosts. The number of management hosts is a function of the number of discrete application types that will be run on the grid concurrently. Each application will generally start its own session manager process requiring significant resources on the management host. Part of the reason for separating management functions across multiple hosts is to ensure adequate performance of key system services during periods of high load. For example, services such as the web-based console service and service director typically run on their own nodes so that they are not affected by session managers that can easily consume all of the physical resources of a management host.

Large grids also benefit from running multiple instances of repository services across multiple management hosts and across multiple geographies so that as applications demands change, new services can be rapidly propagated to compute hosts from multiple repository service instances running in parallel.

To facilitate automatic failover between services on these management nodes, a shared filed system is typically implemented. Depending on the scale of the grid and the anticipated network file system I/O, this shared file system may be implemented as a Network File System (NFS) export from one of the compute hosts or as a separate dedicated filer.

Platform Symphony session managers journal their activities as they run so that in the case of a software failure, workloads can be recovered from where they left off without the need to recompute results already obtained. For large simulations

  • IBM United States Software Announcement 212-204
  • IBM is a registered trademark of International Business Machines Corporation

6

involving millions of tasks, this journaling activity can become a performance bottleneck and these types of environments benefit from solid-state drives or other technologies to accelerate synchronous writes.

Education support

The following classes are available:

Course code
Course title

Classroom
H050G H060G H070G H071G H072G
IBM Platform Symphony 5.x Administration IBM Platform Symphony 5.x Application Programming IBM Platform Symphony-MapReduce Administrator IBM Platform Symphony-MapReduce Developer IBM Platform Symphony-MapReduce Data Management

Instructor-led online (ILO)
H150G H160G H170G H171G H172G
IBM Platform Symphony 5.x Administration IBM Platform Symphony 5.x Application Programming IBM Platform Symphony-MapReduce Administrator IBM Platform Symphony-MapReduce Developer IBM Platform Symphony-MapReduce Data Management

IBM training provides education to support many IBM offerings. Descriptions of courses for IT professionals and managers are on the IBM training website

http://www.ibm.com/services/learning/

Call IBM training at 800-IBM-TEACH (426-8322) for catalogs, schedules, and enrollments.

Offering Information

Product information is available via the Offering Information website

http://www.ibm.com/common/ssi

Also, visit the Passport Advantage® website

http://www.ibm.com/software/passportadvantage

Publications

The following publications are shipped with the product and available on the web. The following publications and documentation are provided for Platform Symphony in both web-friendly and PDF formats and are included in the Platform Symphony knowledge center accessible from the Platform Symphony web-based console.

••••••••
Easy Cluster Verification Steps to Get Started Connector for Microsoft Excel User Guide IBM Platform Symphony Foundations GPU Application Development Guide Installing the IBM Platform Symphony Client on UNIX Installing the IBM Platform Symphony Client on Windows Installing your IBM Platform Symphony Cluster Cluster and Application Management Guide

Recommended publications
  • EGO Reference

    EGO Reference

    EGO Reference Platform EGO Version 1.2.3 January 2008 Copyright © 1994-2007 Platform Computing Corporation All rights reserved. Although the information in this document has been carefully reviewed, Platform Computing Corporation (“Platform”) does not warrant it to be free of errors or omissions. Platform reserves the right to make corrections, updates, revisions or changes to the information in this document. UNLESS OTHERWISE EXPRESSLY STATED BY PLATFORM, THE PROGRAM DESCRIBED IN THIS DOCUMENT IS PROVIDED “AS IS” AND WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. IN NO EVENT WILL PLATFORM COMPUTING BE LIABLE TO ANYONE FOR SPECIAL, COLLATERAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES, INCLUDING WITHOUT LIMITATION ANY LOST PROFITS, DATA, OR SAVINGS, ARISING OUT OF THE USE OF OR INABILITY TO USE THIS PROGRAM. We'd like to hear You can help us make this document better by telling us what you think of the content, organization, and usefulness of the information. from you If you find an error, or just want to make a suggestion for improving this document, please address your comments to [email protected]. Your comments should pertain only to Platform documentation. For product support, contact [email protected]. Document This document is protected by copyright and you may not redistribute or translate it into another language, in part or in whole. redistribution and translation Internal You may only redistribute this document internally within your organization (for example, on an intranet) provided that you continue redistribution to check the Platform Web site for updates and update your version of the documentation.
  • SYMPHONY 5.3.4 User's Manual 1

    SYMPHONY 5.3.4 User's Manual 1

    SYMPHONY 5.3.4 User’s Manual 1 T.K. Ralphs2 M. G¨uzelsoy3 A. Mahajan4 May 30, 2011 1This research was partially supported by NSF Grants DMS-9527124, DMI-0534862, and DMI-0522796, as well as Texas ATP Grant 97-3604-010. A revised version of Chapters 4 of this manual now appears in the Springer-Verlag book Computational Combinatorial Optimization edited by M. J¨ungerand D. Naddef, see http://link.springer.de/link/service/series/0558/tocs/t2241.htm 2Department of Industrial and Systems Engineering, Lehigh University, Bethlehem, PA 18017, [email protected], http://www.lehigh.edu/~tkr2 3Department of Industrial and Systems Engineering, Lehigh University, Bethlehem, PA 18017, [email protected], http://coral.ie.lehigh.edu/~menal 4Mathematics and Computer Science Division, Argonne National Lab, Argonne, IL 60439 [email protected], http://www.mcs.anl.gov/~mahajan/ °c 2000-2010 Ted Ralphs Acknowledgments First and foremost, many thanks are due to Laci Lad´anyi who worked with me on the development of a very early precursor of SYMPHONY called COMPSys many years ago now and who taught me much of what I then knew about programming. Thanks are due also to Marta Es¨o,who wrote an early draft of this manual for what was then COMPSys. This release would not have been possible without the help of both Menal G¨uzelsoy, who has been instrumental in the development of SYMPHONY since version 4.0, and Ashutosh Mahajan, who has worked on SYMPHONY since version 5.0. In particular, Ashutosh and Menal did all of the work that went into improving SYMPHONY for release 5.2.
  • Oracle® Java Micro Edition Software Development Kit Developer's Guide Release 3.2 for Windows E24265-04

    Oracle® Java Micro Edition Software Development Kit Developer's Guide Release 3.2 for Windows E24265-04

    Oracle® Java Micro Edition Software Development Kit Developer's Guide Release 3.2 for Windows E24265-04 September 2012 This document describes how to use the Java ME SDK plugin for NetBeans. Oracle Java Micro Edition Software Development Kit, Release 3.2 for Windows E24265-04 Copyright © 2009, 2012, Oracle and/or its affiliates. All rights reserved. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, the following notice is applicable: U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs.
  • Information Library for Solaris 2.6 (Intel Platform Edition)

    Information Library for Solaris 2.6 (Intel Platform Edition)

    Information Library for Solaris 2.6 (Intel Platform Edition) Sun Microsystems, Inc. 2550 Garcia Avenue Mountain View, CA 94043-1100 U.S.A. Part No: 805-0037–10 August 1997 Copyright 1997 Sun Microsystems, Inc. 901 San Antonio Road, Palo Alto, California 94303-4900 U.S.A. All rights reserved. This product or document is protected by copyright and distributed under licenses restricting its use, copying, distribution, and decompilation. No part of this product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors, if any. Third-party software, including font technology, is copyrighted and licensed from Sun suppliers. Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is a registered trademark in the U.S. and other countries, exclusively licensed through X/Open Company, Ltd. Sun, Sun Microsystems, the Sun logo, SunSoft, SunDocs, SunExpress, , JavaSoft, SunOS, Solstice, SunATM, Online: DiskSuite, JumpStart, AnswerBook, AnswerBook2, Java, HotJava, Java Developer Kit, Enterprise Agents, OpenWindows, Power Management, XGL, XIL, SunVideo, SunButtons, SunDial, PEX, NFS, Admintools, AdminSuite, AutoClient, PC Card, ToolTalk, DeskSet, VISUAL, Direct Xlib, CacheFS, WebNFS, Web Start Solaris, and Solstice DiskSuite are trademarks, registered trademarks, or service marks of Sun Microsystems, Inc. in the U.S. and other countries. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. in the U.S. and other countries. Products bearing SPARC trademarks are based upon an architecture developed by Sun Microsystems, Inc. PostScript is a trademark of Adobe Systems, Incorporated, which may be registered in certain juridisdictions.
  • Grid-Enabling and Virtualizing Mission-Critical Financial Services’ Applications

    Grid-Enabling and Virtualizing Mission-Critical Financial Services’ Applications

    TECHNICAL WHITEPAPER Grid-Enabling and Virtualizing Mission-Critical Financial Services’ Applications AUGUST 2006 WWW.PLATFORM.COM 2 Grid-Enabling and Virtualizing Mission-Critical Financial Services Applications Table of Contents Executive Summary............................................................................................3 1. Solution Overview.........................................................................................4 2. Platform Symphony Architecture......................................................................4 3. Grid-Enabling Compute-Intensive Applications with Platform Symphony................5 3.1 High Availability of Symphony-Enabled Applications..........................................................................7 3.2 Performance and Scalability of Symphony-Enabled Applications..........................................................7 3.3 Platform Symphony Grid-Enablement Patterns for Service-Oriented Applications.....................................8 3.4 Platform Symphony for Grid-Enablement APIs....................................................................................9 3.5 Platform Symphony and Application Technology Interoperability..........................................................9 4. Grid Resource Orchestration in Platform Symphony.........................................12 4.1 Ownership and Policy-based Sharing of Resources...........................................................................14 4.2 Guaranteed Service Level Agreement.............................................................................................14
  • IBM Platform Symphony V6.1 Enables Scalable, High- Performance Grid Services for Parallel Compute- and Data-Intensive Analytic Applications

    IBM Platform Symphony V6.1 Enables Scalable, High- Performance Grid Services for Parallel Compute- and Data-Intensive Analytic Applications

    IBM United States Software Announcement 212-426, dated November 13, 2012 IBM Platform Symphony V6.1 enables scalable, high- performance grid services for parallel compute- and data-intensive analytic applications Table of contents 1 Overview 5 Publications 2 Key prerequisites 6 Technical information 2 Planned availability date 12 Ordering information 2 Description 16 Terms and conditions 4 Product positioning 19 Prices 5 Program number 20 Order now At a glance Platform Symphony® V6.1 helps exceed performance goals. With it you can realize: • Faster throughput and performance • Higher levels of resource utilization • Reduced infrastructure and management costs • Reduced application development and maintenance costs • The agility to respond instantly to real-time demands For ordering, contact your IBM® representative, an IBM Business Partner, or IBM Americas Call Centers at 800-IBM-CALL (Reference: YE001). Overview Platform Symphony V6.1 is an enterprise-class grid manager for running distributed application services on a scalable, shared, heterogeneous grid. Platform Symphony can help you: • Obtain higher-quality business results faster • Reduce infrastructure and management costs • Accelerate many types of Hadoop MapReduce workloads • Combine compute- and data-intensive applications on a single shared platform Features include the following: • Ultrafast, low-latency grid scheduler • Redesigned web interface • Multicluster support for scalability to 100,000 cores • Unique resource-sharing model that enables multitenancy with resource lending and borrowing for maximum efficiency • Optimized, low-latency MapReduce implementation compatible with IBM InfoSphere® BigInsightsTM and other big data solutions IBM United States Software Announcement 212-426 IBM is a registered trademark of International Business Machines Corporation 1 Platform Symphony V6.1 now supports IBM Platform Analytics through the use of new data collectors for Symphony .
  • SYMPHONY 5.6.9 User's Manual

    SYMPHONY 5.6.9 User's Manual

    SYMPHONY 5.6.9 User's Manual 1 T.K. Ralphs2 M. Guzelsoy3 A. Mahajan4 March 10, 2015 1This research was partially supported by NSF Grants DMS-9527124, DMI-0534862, DMI-0522796, CMMI-0728011, CMMI-1130914, as well as Texas ATP Grant 97-3604-010. A revised version of Chapters 4 of this manual now appears in the Springer-Verlag book Computational Combinatorial Optimization edited by M. J¨ungerand D. Naddef, see http://link.springer.de/link/service/series/0558/tocs/t2241.htm 2Department of Industrial and Systems Engineering, Lehigh University, Bethlehem, PA 18017, [email protected], http://coral.ielehigh.edu/~ted 3SAS Institute, Cary, NC [email protected] 4Department of Industrial Engineering and Operations Research, IIT Bombay, India [email protected], http://www.ieor.iitb.ac.in/amahajan c 2000-2015 Ted Ralphs Acknowledgments First and foremost, many thanks are due to Laci Lad´anyi who worked with me on the development of a very early precursor of SYMPHONY called COMPSys many years ago now and who taught me much of what I then knew about programming. Thanks are due also to Marta Es¨o,who wrote an early draft of this manual for what was then COMPSys. This release would not have been possible without the help of both Menal G¨uzelsoy, who has been instrumental in the development of SYMPHONY since version 4.0, and Ashutosh Mahajan, who has worked on SYMPHONY since version 5.0. In particular, Ashutosh and Menal did all of the work that went into improving SYMPHONY for release 5.2. I would also like to thank Matthew Galati and Ondrej Medek, who contributed to the development of SYMPHONY over the years.
  • Turbo-Charging Open Source Hadoop for Faster, More Meaningful Insights

    Turbo-Charging Open Source Hadoop for Faster, More Meaningful Insights

    Turbo-Charging Open Source Hadoop for Faster, more Meaningful Insights Gord Sissons Senior Manager, Technical Marketing IBM Platform Computing [email protected] Agenda • Some Context – IBM Platform Computing • Low-latency scheduling meets open-source • Breakthrough performance • Multi-tenancy (for real!) • Cluster-sprawl - The elephant in the room • Side step the looming challenges IBM Platform Computing De facto standard for commercial high- • Acquired by IBM in 2012 performance computing Powers financial • 20 year history in high-performance computing analytics grids for 60% of top investment banks • 2000+ global customers Over 5 million CPUs • 23 of 30 largest enterprises under management • High-performance, mission-critical, extreme scale Breakthrough performance in Big • Comprehensive capability Data analytics Technical Computing - HPC Platform LSF Scalable, comprehensive workload Family management for demanding heterogeneous environments Simplified, integrated HPC management Platform HPC software bundled with systems Analytics Infrastructure Software High-throughput, low-latency compute Platform and data intensive analytics Symphony Family • An SOA infrastructure for analytics • Extreme performance and scale • Complex Computations (i.e., risk) • Big Data Analytics via MapReduce Our worldview – shaped by time critical analytics • Financial firms compete on the their ability to maximize use of capital • Monte-Carlo simulation is a staple technique for simulating market outcomes • Underlying instruments are increasingly complex •
  • IBM Spectrum Computing Solutions

    IBM Spectrum Computing Solutions

    Front cover IBM Spectrum Computing Solutions Dino Quintero Daniel de Souza Casali Eduardo Luis Cerdas Moya Federico Fros Maciej Olejniczak Redbooks International Technical Support Organization IBM Spectrum Computing Solutions May 2017 SG24-8373-00 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. First Edition (May 2017) This edition applies to: Red Hat Linux ppc64 Little Endian version 7.2 IBM Spectrum Scale version 4.2.1 IBM Cluster Foundation version v4.2.2 IBM Spectrum Conductor with Spark version 2.2 IBM Spectrum MPI version 10 © Copyright International Business Machines Corporation 2017. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . vii Trademarks . viii Preface . ix Authors. ix Now you can become a published author, too . .x Comments welcome. xi Stay connected to IBM Redbooks . xi Chapter 1. Introduction to IBM Spectrum Computing . 1 1.1 Overview . 2 1.2 Big data and resource management . 2 1.3 The new era for high-performance computing (HPC) . 2 1.4 Hybrid cloud bursting . 3 1.5 The big data challenge . 4 1.5.1 Hadoop . 4 1.5.2 Apache Spark . 5 1.5.3 Hadoop Distributed File System (HDFS) . 5 1.5.4 Multi-tenancy. 5 1.6 IBM Spectrum Cluster Foundation . 6 1.7 IBM Spectrum Computing . 6 1.7.1 IBM Spectrum Conductor with Spark . 7 1.7.2 IBM Spectrum LSF . 7 1.7.3 IBM Spectrum Symphony . 7 Chapter 2.
  • Oracle Outside in Technology 8.5.4 Supported Formats

    Oracle Outside in Technology 8.5.4 Supported Formats

    ORACLE Data Sheet Oracle Outside In Technology 8.5.4 Supported Formats Archive Version Microsoft Outlook (MSG) 97 –2016 7z split archives not supported) Microsoft Outlook Express (EML) 7z Self Extracting exe (split archives not supported) Microsoft Outlook Forms Template (OFT) 97 –2016 LZA Self Extracting Compress Microsoft Outlook OLM 2011 for Mac LZH Compress Microsoft Outlook OST 97 –2016 Microsoft Office Binder 95 – 97 Microsoft Outlook PST 97 –2016 Microsoft Cabinet (CAB) Microsoft Outlook PST (Mac) 2001 RAR 1.5, 2.0, 2.9, 5.0 MSG with Digital Signature SMIME Self-extracting .exe Multimedia Version UNIX Compress UNIX GZip UNIX tar AVI (Metadata only) Uuencode DICOM (File ID only) Zip Flash (text extraction only) 6.x, 7.x, Lite PKZip Flash (File ID only) 9, 10 Zip WinZip Real Media (File ID only) Zip Zip64 MP3 (ID3 metadata only) MPEG-1 Audio layer 3 V ID3 v1 (Metadata only) Database Version MPEG-1 Audio layer 3 V ID3 v2 (Metadata only) MPEG-1 Video V 2 (File ID only) DataEase 4.x MPEG-1 Video V 3 (File ID only) DBase III, IV, V, X, X1 MPEG-2 Audio (File ID only) First Choice DB Through 3.0 MPEG-4 (Metadata only) MPEG-7 (Metadata only) Framework DB 3.0 QuickTime (Metadata only) Microsoft Access (text only) 1.0, 2.0, 95 –2016 Windows Media ASF (Metadata only) Microsoft Access Report Snapshot (File ID only) 2000 – 2003 Windows Media DVR-MS (Metadata only) Windows Media Audio WMA (Metadata only) Windows Microsoft Works DB for DOS 2.0 Media Playlist (File ID only) Microsoft Works DB for Macintosh 2.0 Windows Media Video WMV (Metadata
  • Running Jobs with Platform LSF®

    Running Jobs with Platform LSF®

    Running Jobs with Platform LSF® Version 6.2 September 2005 Comments to: [email protected] Copyright © 1994-2005 Platform Computing Corporation All rights reserved. We’d like to hear from You can help us make this document better by telling us what you think of the content, you organization, and usefulness of the information. If you find an error, or just want to make a suggestion for improving this document, please address your comments to [email protected]. Your comments should pertain only to Platform documentation. For product support, contact [email protected]. Although the information in this document has been carefully reviewed, Platform Computing Corporation (“Platform”) does not warrant it to be free of errors or omissions. Platform reserves the right to make corrections, updates, revisions or changes to the information in this document. UNLESS OTHERWISE EXPRESSLY STATED BY PLATFORM, THE PROGRAM DESCRIBED IN THIS DOCUMENT IS PROVIDED “AS IS” AND WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. IN NO EVENT WILL PLATFORM COMPUTING BE LIABLE TO ANYONE FOR SPECIAL, COLLATERAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES, INCLUDING WITHOUT LIMITATION ANY LOST PROFITS, DATA, OR SAVINGS, ARISING OUT OF THE USE OF OR INABILITY TO USE THIS PROGRAM. Document redistribution and translation This document is protected by copyright and you may not redistribute or translate it into another language, in part or in whole. Internal redistribution You may only redistribute this document internally within your organization (for example, on an intranet) provided that you continue to check the Platform Web site for updates and update your version of the documentation.
  • Oracle® Java Micro Edition Software Development Kit Developer's Guide Release 3.0.5 for Windows E24265-04

    Oracle® Java Micro Edition Software Development Kit Developer's Guide Release 3.0.5 for Windows E24265-04

    Oracle® Java Micro Edition Software Development Kit Developer's Guide Release 3.0.5 for Windows E24265-04 March 2012 This document describes how to use the Java ME SDK plugin for NetBeans. Java ME SDK Developer's Guide, Release 3.0.5 for Windows E24265-04 Copyright © 2009, 2012, Oracle and/or its affiliates. All rights reserved. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. If this software or related documentation is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are "commercial computer software" or "commercial technical data" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, duplication, disclosure, modification, and adaptation shall be subject to the restrictions and license terms set forth in the applicable Government contract, and, to the extent applicable by the terms of the Government contract, the additional rights set forth in FAR 52.227-19, Commercial Computer Software License (December 2007).