Messaging Solutions in a Linux Environment

Total Page:16

File Type:pdf, Size:1020Kb

Messaging Solutions in a Linux Environment Front cover Messaging Solutions in a Linux Environment Implement WebSphere MQ on Linux for Intel Implement WebSphere BI Message Broker on Linux Learn HA for WebSphere MQ on Linux Geert Van de Putte Geetha Adinarayan Robert Haddon Brian McCarty Mira Peltomaki Oliver Quixchan ibm.com/redbooks International Technical Support Organization Messaging Solutions in a Linux Environment July 2005 SG24-6336-00 Note: Before using this information and the product it supports, read the information in “Notices” on page ix. First Edition (July 2005) This edition applies to IBM WebSphere MQ for Linux for Intel, Version 5.3 and to IBM WebSphere Business Integration Message Broker Version 5.0 (product number 5724-E26). © Copyright International Business Machines Corporation 2005. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . ix Trademarks . x Preface . xi The team that wrote this redbook. xi Become a published author . xiv Comments welcome. xiv Chapter 1. Introduction to Linux and messaging. 1 1.1 Introduction to the world of Linux . 2 1.1.1 Linux . 2 1.1.2 Linux kernel. 3 1.1.3 Linux operating system . 7 1.1.4 Linux distributions . 9 1.2 Concepts of Message Oriented Middleware . 12 1.2.1 Point-to-point messaging . 13 1.2.2 Publish/subscribe . 13 1.2.3 A conceptual paradigm view . 14 1.3 Introducing WebSphere MQ . 14 1.3.1 WebSphere MQ support for Linux. 15 1.3.2 WebSphere MQ objects and security . 15 1.3.3 WebSphere MQ administration and management . 16 1.3.4 WebSphere MQ intercommunication and remote queuing . 17 1.3.5 WebSphere MQ transport types . 17 1.3.6 WebSphere MQ application programming interfaces . 18 1.4 Message broker concepts . 21 1.5 Introducing WebSphere BI Message Broker family. 22 1.5.1 Architecture overview . 23 1.5.2 Runtime environment . 25 1.6 Introducing WebSphere Application Server . 29 Chapter 2. Linux systems and advanced technologies. 33 2.1 Scalability versus high availability . 34 2.1.1 Scalability . 34 2.1.2 High availability . 35 2.2 Linux technologies for scalability. 37 2.2.1 Storage area network . 37 2.2.2 IBM hardware offerings for Linux scalability . 38 2.2.3 IBM software offerings for Linux scalability . 39 © Copyright IBM Corp. 2005. All rights reserved. iii 2.2.4 Open source offerings for Linux scalability . 41 2.3 Linux technologies for high availability . 42 2.3.1 Journaled file systems. 42 2.3.2 IBM software offerings for Linux high availability . 47 2.3.3 Open source offerings for Linux high availability. 47 2.4 Creating a highly available and scalable solution . 48 Chapter 3. Implementing HA queue managers: Part 1. 51 3.1 Scenario one overview . 52 3.1.1 Using WebSphere MQ in bindings mode . 52 3.1.2 Using WebSphere MQ in client mode . 52 3.2 Using Linux-HA . 53 3.2.1 Features of Linux-HA . 53 3.2.2 Planning an implementation . 54 3.2.3 Perform an implementation . 55 3.2.4 Heartbeat configuration. 56 3.2.5 Heartbeat authentication . 56 3.2.6 High availability resource configuration. 57 3.2.7 Network mirror configuration . 58 3.2.8 Validating heartbeat failover and failback . 64 3.2.9 HA configuration summary . 68 3.3 Installing and configuring WebSphere MQ . 68 3.3.1 Preinstallation steps . 69 3.3.2 Installation steps . 70 3.3.3 Postinstallation steps and install verification . 70 3.4 Message generation application . 71 3.4.1 Design of the message generation application . 71 3.4.2 Developing the message generation application . 71 3.4.3 Compiling and running the message generation application . 72 3.5 Message retrieval application . 73 3.5.1 Design of the message retrieval application . 74 3.5.2 Developing the message retrieval application. 74 3.6 WebSphere MQ HA configuration and scripts. 79 3.6.1 Normal scenario . 79 3.6.2 Configuring wmq1 and wmq2 for WebSphere MQ HA . 80 3.6.3 Failover . 82 3.6.4 Failback. 84 3.7 Persistent messages on WebSphere MQ queues . 85 3.8 Bindings versus client tests . 86 3.9 Running the Bindings mode test . 86 3.9.1 Queue Manager configuration. 86 3.9.2 Configuration verification. 91 3.9.3 WebSphere Application Server configuration . 93 iv Messaging Solutions in a Linux Environment 3.9.4 Queue Manager in action . 99 3.9.5 Summary of results . 111 3.10 Running the Client mode test . 112 3.10.1 Queue manager configuration. 112 3.10.2 Configuration of WebSphere Application Server. 114 3.10.3 WebSphere Application Server in action. 115 3.10.4 Summary of results . 118 3.11 Summary . 118 Chapter 4. Implementing HA queue managers: Part 2. 121 4.1 Scenario two overview . 122 4.2 Implementing Linux-HA on SUSE . 122 4.2.1 Planning an implementation . 122 4.2.2 Installing Linux High-Availability . 124 4.2.3 Configuring Linux-HA . 125 4.2.4 Configuring and testing the shared SCSI drives . 128 4.2.5 Validating heartbeat failover and failback . 131 4.2.6 HA configuration summary . 134 4.3 Installing and configuring WebSphere MQ . 134 4.4 Message generation application . 134 4.4.1 Compiling and running the message generation application . 134 4.5 Messaging retrieval application . ..
Recommended publications
  • Oracle RDBMS on AIX, HP-UX, Solaris, Tru64
    QUICK REFERENCE (Color Coding) ---------------------------------------------------- Jump to: AIX HP Sun Tru64 Linux PURPOSE -------------- This bulletin is produced to provide a central source for all the primary installation settings for the various mainstream unix platforms, e.g. IBM AIX, HP-UX, Sun Solaris, Tru64, and Linux. Careful comparison of the Installation Guide and the applicable release note for an OS/Oracle version has been done to ensure that this bulletin provides the most complete source of data in hopes that it will save time for each researching analyst. NOTE: Pre-compilers requirements are no longer addressed in this note, for a single source note that addresses Pre-compiler/Compiler requirements, please refer to: <Note: 43208.1> Certified Compilers SCOPE & APPLICATION ------------------------------------- This focus of this bulletin is on assisting the Oracle Unix installation community in resolving installation issues of the RDBMS. This bulletin places in one document all the pertinent information related to installations that has been extracted from three different documents (Installation Guides, Release Notes, and SRNs) A script to verify that the system has been configured correctly according to the Installation Guide can be found on Metalink <Note: 189256.1> "UNIX: Script to Verify Installation Requirements for Oracle 9.x version of RDBMS" Corrections and updates are REQUESTED and EXPECTED (in the form of REMARKS or Metalink "Feedback" button) to ensure the accuracy and up-to-date status of this bulletin. Oracle
    [Show full text]
  • SCO Authentication Installation and Configuration Guide
    SCO Authentication Installation and Configuration Guide SCO Authentication Installation and Configuration Guide July 18, 2003 COPYRIGHT (c) Copyright 2003 The SCO Group All Rights Reserved. SCO documents (“SCO Documents”) are protected by the copyright laws of the United States and International Treaties. Permission to copy, view and print SCO documents is authorized provided that: It is used for non-commercial and informational purposes. It is not modified. The above copyright notice and this permission notice is contained in each SCO Document. Notwithstanding the above, nothing contained herein shall be construed as conferring any right or license under any copyright of SCO. RESTRICTED RIGHTS LEGEND When licensed to a U.S., State, or Local Government, all Software produced by SCO is commercial computer software as defined in FAR 12.212, and has been developed exclusively at private expense. All technical data, or Caldera commercial computer software/documentation is subject to the provisions of FAR 12.211 - “Technical Data”, and FAR 12.212 - “Computer Software” respectively, or clauses providing SCO equivalent protections in DFARS or other agency specific regulations. Manufacturer: SCO Operations Inc., 355 South 520 West Suite #100, Lindon, Utah 84042. DISCLAIMER THE SCO DOCUMENTS ARE PROVIDED “AS IS” AND MAY INCLUDE TECHNICAL INACCURACIES OR TYPOGRAPHICAL ERRORS. CALDERA INTERNATIONAL, INC. RESERVES THE RIGHT TO ADD, DELETE, CHANGE OR MODIFY THE SCO DOCUMENTS AT ANY TIME WITHOUT NOTICE. THE DOC- UMENTS ARE FOR INFORMATION ONLY. SCO MAKES NO EXPRESS OR IMPLIED REPRESENTA- TIONS OR WARRANTIES OF ANY KIND. TRADEMARKS SCO, the SCO logo, SCO Volution, OpenLinux, SCO OpenServer, AND Skunkware, are trademarks or registered trademarks of Caldera International, Inc.
    [Show full text]
  • Creating Rpms Guide
    CREATING RPMS (Student version) v1.0 Featuring 36 pages of lecture and a 48 page lab exercise This docu m e n t serves two purpose s: 1. Representative sample to allow evaluation of our courseware manuals 2. Make available high quality RPM documentation to Linux administrators A bout this m aterial : The blue background you see simulates the custom paper that all Guru Labs course w are is printed on. This student version does not contain the instructor notes and teaching tips present in the instructor version. For more information on all the features of our unique layout, see: http://ww w . g urulabs.co m /courseware/course w are_layout.php For more freely available Guru Labs content (and the latest version of this file), see: http://www.gurulabs.co m/goodies/ This sample validated on: Red Hat Enterprise Linux 4 & Fedora Core v3 SUSE Linux Enterprise Server 9 & SUSE Linux Professional 9.2 About Guru Labs: Guru Labs is a Linux training company started in 199 9 by Linux experts to produce the best Linux training and course w are available. For a complete list, visit our website at: http://www.gurulabs.co m/ This work is copyrighted Guru Labs, L.C. 2005 and is licensed under the Creative Common s Attribution- NonCom mer cial- NoDerivs License. To view a copy of this license, visit http://creativecom m o n s.org/licenses/by- nc- nd/2.0/ or send a letter to Creative Commons, 559 Nathan Abbott Way, Stanford, California 943 0 5, USA. Guru Labs 801 N 500 W Ste 202 Bountiful, UT 84010 Ph: 801-298-5227 WWW.GURULABS.COM Objectives: • Understand
    [Show full text]
  • CERN R&D on Spack and the Turnkey Stack
    CERN R&D on Spack and the Turnkey Stack HSF Software Workshop - 2020/11/19 Valentin Volkl (CERN), Key4hep Software Group Thanks to Andre Sailer, Pere Mato, Ben Morgan for use of Slides Valentin Volkl: Key4HEP & Spack Table of Contents ● Key4HEP - Introduction and motivation ● The Spack package manager ● Technical considerations ● Deployment to CVMFS ● Workflow -Spack for Development Valentin Volkl: Key4HEP & Spack 2 Dependency Graph of Key4HEP Stack Experiment-specific Packages Valentin Volkl: Key4HEP & Spack 3 Dependency Graph of Key4HEP stack Experiment-specific Packages + HEP-specific packages Valentin Volkl: Key4HEP & Spack 4 Dependency Graph of Key4HEP stack Experiment-specific Packages + HEP-specific Packages + General Purpose Libraries Valentin Volkl: Key4HEP & Spack 5 Requirements for a Build System [ ] Need to be able to scale to a typical experiment software stack [ ] Combinatorics of multiple platforms, versions, Release/Debug ... [ ] Easy deployment to CVMFS [ ] Allow local builds independent of central CVMFS installations [ ] Support software development usecases The KEY4HEP stack contains some 300 packages ● 60 Experiment-specific ● 50 HEP-specific ● 200 System/General Purpose 14 GB install size, some 6h to build on single 4-core machine Valentin Volkl: Key4HEP & Spack 6 Key4HEP ● Future detector studies critically rely on well-maintained software stacks to model detector concepts and to understand a detector’s limitations and physics reach ● We have a scattered landscape of specific software tools on the one hand and integrated
    [Show full text]
  • Linux Standard Base and Debian
    Linux Standard Base and Debian Matt Taggart <[email protected]> debconf2 July 7, 2002 Matt Taggart 06/08/2004 Standards ● 'Standards are great! There are so many to choose from.' ● Show of hands: How many have looked at the LSB? Matt Taggart 06/08/2004 Disclaimer ● Brief introduction targeted at a Debian audience ● Not enough time to cover in depth ● Time for questions, ask as we go Matt Taggart 06/08/2004 Overview ● Standards, Who needs 'em? ● LSB background ● Debian Involvement ● lsb-futures ● questions Matt Taggart 06/08/2004 Standards ● Why should Free Software Developers care? – Limited interest from Debian so far – Most assume it doesn't affect them – Early mistakes upset most Debian people – Free Standards are actually just as important to Debian than other distributions(if not more) Matt Taggart 06/08/2004 The Rest of the World ● Linux has a minority of OS users ● Debian has a minority of Linux users ● We can't abandon the majority of computer users ● We need to be stay in tune with the world around us and do what we can to provide an alternative ● Similar compromise to non-free, LGPL, and GPL not restricting usage on a propriatary system Matt Taggart 06/08/2004 Friend or Foe? ● With commercialization we're starting to see, – traditional propriatary software companies embrace free software – traditional free software companies embrace propriatary software – letter of the law, not spirit – grey areas – "enterprise" editions of software – United Linux - unclear Matt Taggart 06/08/2004 Positive Benefits ● Commercialization not all
    [Show full text]
  • Perspectives on Free and Open Source Software.Pdf
    Perspectives on Free and Open Source Software Perspectives on Free and Open Source Software edited by Joseph Feller, Brian Fitzgerald, Scott A. Hissam, and Karim R. Lakhani The MIT Press Cambridge, Massachusetts London, England © 2005 Massachusetts Institute of Technology All rights reserved. No part of this book may be reproduced in any form by any electronic or mechanical means (including photocopying, recording, or information storage and retrieval) without permission in writing from the publisher. MIT Press books may be purchased at special quantity discounts for business or sales promotional use. For information, please e-mail [email protected] or write to Special Sales Department, The MIT Press, 5 Cambridge Center, Cambridge, MA 02142. This book was set in Stone sans and Stone serif by SNP Best-set Typesetter Ltd., Hong Kong. Printed and bound in the United States of America. Library of Congress Cataloging-in-Publication Data Perspectives on free and open source software / edited by Joseph Feller . [et al.]. p. cm. Includes bibliographical references and index. ISBN 0-262-06246-1 (alk. paper) 1. Shareware (Computer software) 2. Open source software. 3. Computer software—Development. I. Feller, Joseph, 1972– QA76.76.S46P47 2005 005.36—dc22 2004064954 10987654321 My love, thanks and humble apologies go to my very patient and supportive family: Carol, Caelen, Damien, and Dylan. JF Arís as Gaeilge: Buíochas mór le mo chlann, Máire, Pól agus Eimear. Is mór agam an iarracht a rinne sibh ar mo shon. BF With heartfelt warmth, I dedicate this book to my wife, Jacqueline, and my two sons, Derek and Zachery, who bring meaning to everything I do.
    [Show full text]
  • The Progress Company Platform & Product Availability
    The Progress Company Platform & Product Availability Guide Update: May 6, 2003 Introduction The Platform & Product Availability Guide reflects the current commercial releases for the Progress Company’s products. This document does NOT address future product release plans. The information contained in this document is updated on a regular basis and is subject to change without notice. Please note: Edits made since February 17th 2003 have been consolidated with new changes shown in red, bold font. Change Summary • United Linux certification added for Version 9 OpenEdge platforms (Caldera OpenLinux Intel, SuSE Linux Intel & TurboLinux Intel) • SuSe Linux 8.1 Certification added • Table of tested Linux Kernel and glibc versions added • Product Availability sections for V8 and V9 updated to accommodate BI-Reporting Development and Deployment Products • Product Availability sections for Progress V9 updated to include PeerDirect Development and Deployment Products • Minimum patch requirement for Progress version 9 on IBM AIX increased from V9.1C04 to V9.1D04 (grammatical correction) • Certification level of Progress version 9 changed from AIX 5.1 to AIX 5.1L (grammatical correction) • Fathom Clusters certification of Sun Cluster version 3 for Sun Solaris SPARC 9 added • PA-RISC added to HP platforms to clarify that Itanium (IPF) is not supported • Solaris 7 support removed form SUN Solaris SPARC 64-Bit Table of Contents INTRODUCTION.........................................................................................................................................................................................................
    [Show full text]
  • Building Embedded Linux Systems ,Roadmap.18084 Page Ii Wednesday, August 6, 2008 9:05 AM
    Building Embedded Linux Systems ,roadmap.18084 Page ii Wednesday, August 6, 2008 9:05 AM Other Linux resources from O’Reilly Related titles Designing Embedded Programming Embedded Hardware Systems Linux Device Drivers Running Linux Linux in a Nutshell Understanding the Linux Linux Network Adminis- Kernel trator’s Guide Linux Books linux.oreilly.com is a complete catalog of O’Reilly’s books on Resource Center Linux and Unix and related technologies, including sample chapters and code examples. ONLamp.com is the premier site for the open source web plat- form: Linux, Apache, MySQL, and either Perl, Python, or PHP. Conferences O’Reilly brings diverse innovators together to nurture the ideas that spark revolutionary industries. We specialize in document- ing the latest tools and systems, translating the innovator’s knowledge into useful skills for those in the trenches. Visit con- ferences.oreilly.com for our upcoming events. Safari Bookshelf (safari.oreilly.com) is the premier online refer- ence library for programmers and IT professionals. Conduct searches across more than 1,000 books. Subscribers can zero in on answers to time-critical questions in a matter of seconds. Read the books on your Bookshelf from cover to cover or sim- ply flip to the page you need. Try it today for free. main.title Page iii Monday, May 19, 2008 11:21 AM SECOND EDITION Building Embedded Linux SystemsTomcat ™ The Definitive Guide Karim Yaghmour, JonJason Masters, Brittain Gilad and Ben-Yossef, Ian F. Darwin and Philippe Gerum Beijing • Cambridge • Farnham • Köln • Sebastopol • Taipei • Tokyo Building Embedded Linux Systems, Second Edition by Karim Yaghmour, Jon Masters, Gilad Ben-Yossef, and Philippe Gerum Copyright © 2008 Karim Yaghmour and Jon Masters.
    [Show full text]
  • THE TOTAL ENTERPRISE SOLUTION IBM DB2 Universal Database Cluster on Linux and IBM ^ Xseries
    THE TOTAL ENTERPRISE SOLUTION IBM DB2 Universal Database cluster on Linux and IBM ^ xSeries The Total Enterprise Solution The Challenge SMART database Organizations today face the The benefits of Linux clusters, challenging job of integrating including superior performance technologies to pull together a at a low cost, are well known. comprehensive solution that fits When you add to the mix the their business needs and IT built-in clustering capabilities of ® budgets. IBM DB2 Universal Database™ for Linux, you get a rock-solid A complete data center solution foundation for all your enterprise e-business data processing consists of enterprise class applications, databases, needs. management tools, network infrastructure and server Powerful hardware hardware. Until recently such IBM has extensive and proven ® solutions were based on experience with clustered UNIX proprietary systems and involved computers. IBM ^ significant investment in capital, xSeries™ has applied that time and resources to assemble, knowledge to produce servers integrate, test, manage and that are armor-plated for Linux, support. This scenario has optimized for database changed dramatically with Linux® workloads, and deliver clusters and best-of-breed tremendous power at a fraction software, hardware and services of the price. from IBM and its partners. Demanding applications This demonstration is a proof of The combination of DB2 and how even the strictest Linux on xSeries, with the latest ® ® requirements can easily be Intel and AMD processors – satisfied, with the right 32 and 64bit technologies alike, combination of products, to is powerful enough to run highly implement a total data demanding business ® management solution. applications, including SAP R/3, mySAP Customer Relationship Management (CRM), mySAP Business Intelligence (BI) and IBM Websphere Application Server.
    [Show full text]
  • Robust Linux Binaries.Pdf
    Robust Linux Binaries How to use Portage to provide a solid base stack for HEP G. Amadio https://xkcd.com/1987 Why do we fall into this kind of situation? ● We want software that’s not part of the system ● Use pip, conda, homebrew, etc to get it somewhere ● Not compiled with same compiler → incompatible ABI ● Often requires setting LD_LIBRARY_PATH and/or PYTHONPATH ● Problems if a package is both in the system and in add-ons ● Updates to the system do not take add-ons into account 3 Classic example: ROOT, Python, and Anaconda ● User has Anaconda installation with Python, wants ROOT ● User then tries to build ROOT with system compiler and link with Python from Anaconda installation ● libPyROOT.so has to link against system’s libstdc++.so and anaconda’s libpython2.7.so ● Problem: libpython2.7.so from Anaconda is not guaranteed to be ABI-compatible with system libraries ● Solution: install GCC from anaconda that was used to build Python and build ROOT with that compiler instead 4 Why LD_LIBRARY_PATH should be avoided ● LD_LIBRARY_PATH is commonly used to add directories to the linker’s search path ● Problem: LD_LIBRARY_PATH takes precedence, overrides important system libraries ○ See e.g. https://sft.its.cern.ch/jira/browse/SPI-1083 ● Solution: use a wrapper script or even better, don’t use LD_LIBRARY_PATH $ ssh lxplus7 $ lsb_release -d Description: CentOS Linux release 7.5.1804 (Core) $ source /cvmfs/sft.cern.ch/lcg/views/LCG_latest/x86_64-centos7-gcc7-opt/setup.sh $ ldd /usr/bin/git linux-vdso.so.1 => (0x00007ffdb55b3000) libpcre.so.1
    [Show full text]
  • NVIDIA CUDA Installation Guide for Linux
    NVIDIA CUDA Installation Guide for Linux Installation and Verification on Linux Systems DU-05347-001_v11.4 | September 2021 Table of Contents Chapter 1. Introduction........................................................................................................ 1 1.1. System Requirements...............................................................................................................1 1.2. About This Document............................................................................................................... 3 Chapter 2. Pre-installation Actions..................................................................................... 4 2.1. Verify You Have a CUDA-Capable GPU....................................................................................4 2.2. Verify You Have a Supported Version of Linux........................................................................ 5 2.3. Verify the System Has gcc Installed........................................................................................5 2.4. Verify the System has the Correct Kernel Headers and Development Packages Installed........................................................................................................................................5 2.5. Install MLNX_OFED.................................................................................................................. 7 2.6. Choose an Installation Method................................................................................................ 7 2.7. Download
    [Show full text]
  • Intel(R) C++ Compiler 8.0 for Linux Release Notes
    Intel® C++ Compiler 8.0 for Linux Release Notes Contents Overview New Features System Requirements Installation Notes Known Limitations Technical Support Documentation Additional Information Copyright and Legal Information Overview The Intel® Compilers help make your software run at top speeds on all Intel® 32-bit processors and the Intel® Itanium® processors. Optimizations include support for Streaming SIMD Extensions 2 (SSE2) in the Intel® Pentium® 4 and Pentium® M processors, Streaming SIMD Extensions 3 (SSE3) in the Intel® Pentium® Processor 4 with Streaming SIMD Extensions 3 (SSE3) instruction support and software pipelining in the Intel Itanium 2 processor. Inter- procedural optimization (IPO) and profile-guided optimization (PGO) can provide greater application performance. Intel Compilers support multi-threaded code development through autoparallelism and OpenMP* support. The following components are included in the installation package: ● The Intel® C++ Compiler version 8.0 for IA-32 based applications: icc. ● The Intel® C++ Compiler version 8.0 for Itanium-based applications: icc. ● The Intel® Debugger version 7.3 for IA-32 and Itanium-based applications: idb. ● The Intel® Itanium Assembler version 7.0 to produce Itanium-based applications: ias. ● The Intel® Compiler code-coverage tool ● The Intel® Compiler test-prioritization tool ● Documentation and documentation index that can be found at <install-dir>/doc/ ccompindex.htm The paper, Optimizing Applications with the Intel C++ and Fortran Compilers for Windows* and Linux*, explains how to use the Intel compilers to optimize for the Pentium 4 and Itanium processors and is available at http://www.intel.com/software/products/compilers/ . Additional information on the Intel Software Development Products is available at http://www.intel.com/ software/products/ .
    [Show full text]