Patterns of Information Management This Page Intentionally Left Blank Patterns of Information Management

Related Books of Interest

Enterprise Master Data An Introduction to IMS Management Your Complete Guide to IBM Information An SOA Approach to Management Systems, 2nd Edition Managing Core Information By Barbara Klein, et al. By Dreibelbis, Hechler, Milman, Oberhofer, ISBN-13: 978-0-13-288687-1 van Run, Wolfson IBM’s Definitive One-Stop Guide to IMS ISBN-13: 978-0-13-236625-0 Versions 12, 11, and 10: for Every IMS DBA, The Only Complete Technical Primer Developer, and System Programmer for MDM Planners, Architects, Over 90% of the top Fortune® 1000 companies and Implementers rely on IBM’s Information Management System An authoritative, vendor-independent MDM (IMS) for their most critical IBM System z® technical reference for practitioners: architects, data management needs: 50,000,000,000+ technical analysts, consultants, solution design- transactions run through IMS databases every ers, and senior IT decision makers. Written by the day. What’s more, IBM continues to upgrade IMS: IBM® data management innovators who are pio- Versions 12, 11, and 10 meet today’s business neering MDM, this book systematically introduces challenges more flexibly and at a lower cost MDM’s key concepts and technical themes, than ever b efore. In An Introduction to IMS, explains its business case, and illuminates how it Second Edition, leading IBM experts present the interrelates with and enables SOA. definitive technical introduction to these versions of IMS.

The Art of Enterprise Dynamic SOA and BPM Information Architecture Best Practices for Business Process By Godinez, Hechler, Koenig, Lockwood, Management and SOA Agility Oberhofer, Schroeck By Marc Fiammante ISBN-13: 978-0-13-703571-7 ISBN-13: 978-0-13-701891-8 Architecture for the Intelligent Enterprise: Achieve Breakthrough Business Flexibility Powerful New Ways to Maximize the and Agility by Integrating SOA and BPM Real-time Value of Information Thousands of enterprises have adopted Service In this book, a team of IBM’s leading information Oriented Architecture (SOA) based on its promise management experts guide you on a journey that to help them respond more rapidly to chang- will take you from where you are today toward ing business requirements by composing new becoming an “Intelligent Enterprise.” solutions from existing business services. To Drawing on their extensive experience working deliver on this promise, however, companies with enterprise clients, the authors present a need to integrate solid but flexible Business new, information-centric approach to architecture Process Management (BPM) plans into their SOA Dynamic SOA and BPM and powerful new models that will benefit any initiatives. offers a organization. Using these strategies and models, pragmatic, efficient approach for doing so. companies can systematically unlock the business value of information by delivering actionable, real-time information in context to enable better decision-making throughout the enterprise–from the “shop floor” to the “top floor.”

Visit ibmpressbooks.com for all product information Related Books of Interest

A Practical Guide to Distributed Scrum Woodward, Surdeck, Ganis ISBN-13: 978-0-13-704113-8

The Business of IT How to Improve Service and Executing SOA Lower Costs A Practical Guide for the Ryan, Raducha-Grace Service-Oriented Architect ISBN-13: 978-0-13-700061-6 By Bieberstein, Laird, Jones, Mitra ISBN-13: 978-0-13-235374-8 This book follows up where the authors’ best- Viral Data in SOA selling Service-Oriented Architecture Compass left off, showing how to overcome key obstacles An Enterprise Pandemic to successful SOA implementation and identifying Fishman best practices for all facets of execution— ISBN-13: 978-0-13-700180-4 technical, organizational, and human. Among the issues it addresses: introducing a services discipline that supports collaboration and information process sharing; integrating services Disciplined Agile Delivery with preexisting technology assets and strategies; A Practitioner’s Guide to Agile choosing the right roles for new tools; shift- Software Delivery in the Enterprise ing culture, governance, and architecture; and Ambler, Lines bringing greater agility to the entire organizational lifecycle, not just isolated projects. Executing SOA ISBN-13: 978-0-13-281013-5 is an indispensable resource for every enterprise architect, technical manager, and IT leader tasked with driving value from SOA in complex Outside-in Software environments. Development Kessler, Sweitzer ISBN-13: 978-0-13-157551-6

Sign up for the monthly IBM Press newsletter at ibmpressbooks.com/newsletters This page intentionally left blank Patterns of Information Management This page intentionally left blank Patterns of Information Management

Mandy Chessell Harald C. Smith

IBM Press Pearson plc

Upper Saddle River, NJ • Boston • Indianapolis • San Francisco New York • Toronto • Montreal • London • Munich • Paris • Madrid Cape Town • Sydney • Tokyo • Singapore • Mexico City

ibmpressbooks.com The authors and publisher have taken care in the preparation of this book, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein. © Copyright 2013 by International Business Machines Corporation. All rights reserved. Note to U.S. Government Users: Documentation related to restricted right. Use, duplication, or disclosure is subject to restrictions set forth in GSA ADP Schedule Contract with IBM Corporation. IBM Press Program Managers: Steven M. Stansel, Ellice Uffer Cover design: IBM Corporation Editor In Chief: Bernard Goodwin Marketing Manager: Stephane Nakib Publicist: Heather Fox Editorial Assistant: Michelle Housley Managing Editor: Kristy Hart Designer: Alan Clements Project Editor: Andy Beaster Copy Editor: Karen Annett Indexer: Lisa Stumpf Compositor: Gloria Schurick Proofreader: Sarah Kearns Manufacturing Buyer: Dan Uhrig Published by Pearson plc Publishing as IBM Press IBM Press offers excellent discounts on this book when ordered in quantity for bulk purchases or special sales, which may include electronic versions and/or custom covers and content particular to your business, training goals, marketing focus, and branding interests. For more information, please contact U.S. Corporate and Government Sales 1-800-382-3419 [email protected] . For sales outside the U.S., please contact International Sales [email protected] . The following terms are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both: IBM, the IBM Press logo, developerWorks, InfoSphere, Ascential, WebSphere, IBM Redbooks, and IBM Watson. A current list of IBM trademarks is available on the web at “copyright and trademark information” as www.ibm.com/legal/copytrade.shtml. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Other company, product, or service names may be trademarks or service marks of others . Library of Congress Cataloging-in-Publication Data is on file. All rights reserved. This publication is protected by copyright, and permission must be obtained from the publisher prior to any prohibited reproduction, storage in a retrieval system, or transmission in any form or by any means, electronic, mechanical, photocopying, recording, or likewise. For information regarding permissions, write to: Pearson Education, Inc. Rights and Contracts Department 501 Boylston Street, Suite 900 Boston, MA 02116 Fax (617) 671 3447 ISBN-13: 978-0-13-315550-1 ISBN-10: 0-13-315550-1 Text printed in the United States on recycled paper at Courier in Westford, MA. First printing: May 2013 with corrections September 2013 Some day, on the corporate balance sheet, there will be an entry which reads, “Information”; for in most cases, the information is more valuable than the hardware which processes it.

—Rear Admiral Grace Hopper

To my family and friends who have supported and encouraged me over the years, with love: Sarah, Jane, Ray, Terri, Ben, Ella, Ian, Kay, Keith, Dan, and Chris.

—Mandy Chessell

To my family: Mary, Rebecca, Cecilia, and Paul and my parents: Clyde and Ellen For their love and support now and over the years.

—Harald Smith Contents at a Glance

Foreword by Rob High xxi Preface xxiii Acknowledgments xxviii

About the Authors xxix

Chapter 1 Introduction 1

Chapter 2 The MCHS Trading Case Study 25

Chapter 3 People and Organizations 69

Chapter 4 Information Architecture 99

Chapter 5 Information at Rest 235

Chapter 6 Information in Motion 395

Chapter 7 Information Processing 449

Chapter 8 Information Protection 533

Chapter 9 Solutions for Information Management 577

Appendix 1 Glossary 643

Appendix 2 Summary of MCHS Trading’s Systems 649

Appendix 3 Related Pattern Languages 651

Appendix 4 Bibliography 653

Patterns Index 663

Index 669 This page intentionally left blank Table of Contents

Chapter 1 Introduction 1 Islands of Information 1 Introducing MCHS Trading 2 Improving an Organization’s Information Management 4 Patterns and Pattern Languages 7 Basic Components in the Pattern Language 11 Information Integration and Distribution 12 Pattern Language Structure 15 Summary 22

Chapter 2 The MCHS Trading Case Study 25 Introduction 25 Building an Information Strategy 26 Creating Management Reports 28 Creating a Single View of Product Details 30 Creating a Single View of Customer Details 37 Understanding the Status of Orders 44 Delivering Information Quality Improvements 47 Connecting MCHS Trading into a B2B Trading Partnership 51 Exploiting Predictive Analytics 55 Summary of Case Study 67

Chapter 3 People and Organizations 69 Information Centric Organization Patterns 70 Information Centric Organization 73 Information Management Obligation 78 Information Management Strategy 81 Information Management Principle 83 Information Governance Program 88 Information User Patterns 91 Information User 92 Variations of the Information User Pattern 95 Summary 97

Chapter 4 Information Architecture 99 Information Element Patterns 100 Information Element 101 Entity-Level Information Elements 106 Information Asset 107 Information Activity 110 Information Event 113 xiv Contents

Information Processing Variables 114 Information Summary 117 Message-Level Information Elements 119 Information Payload 119 Attribute-Level Information Elements 122 Information Link 123 Information Metric 124 Information Code 126 Summary of Information Elements 129 Information Identification Patterns 129 Information Identification 130 Defining Which Information to Manage and How 133 Subject Area Definition 134 Valid Values Definition 136 Information Configuration 139 Defining How Information Is Structured 141 Information Model 141 Information Schema 143 Locating the Right Information to Use 145 Information Location 146 Semantic Tagging 148 Semantic Mapping 150 Different Reports About Information 153 Information Values Report 154 Information Values Profile 156 Information Lineage 159 Summary of Information Identification 161 Information Provisioning Patterns 161 Information Provisioning 163 Localized Provisioning 166 User Private Provisioning 167 Application Private Provisioning 169 Process-Level Provisioning 171 Daisy Chain Provisioning 172 Service-Level Provisioning 177 User Shared Provisioning 178 Service Oriented Provisioning 179 Linked Information Provisioning 182 Cache Provisioning 184 Collection-Level Provisioning 185 Snap Shot Provisioning 186 Mirroring Provisioning 189 Peer Provisioning 193 Event-Based Provisioning 196 Contents xv

Recovery Provisioning 197 Summary of Information Provisioning 199 Information Supply Chain Patterns 199 Information Supply Chain 200 Variations of the Information Supply Chain Pattern 209 Cascading Information Supply Chain 211 Hub Interchange Information Supply Chain 215 Single View Information Supply Chain 219 Consolidating Information Supply Chain 223 Hierarchical Information Supply Chain 225 Peer Exchange Information Supply Chain 230 Summary of Information Supply Chains 232 Summary 232

Chapter 5 Information at Rest 235 Information Service Patterns 236 Information Service 238 Information Service Implementation Patterns 243 Local Information Service 243 Remote Information Service 246 Triggering Information Service 250 Summary of Information Services 253 Information Collection Patterns 253 Information Collection 254 Location of Information 259 Physical Information Collection 260 Virtual Information Collection 263 Usage of an Information Collection 266 Master Usage 267 Reference Usage 271 Hybrid Usage 274 Sandbox Usage 277 Scope of an Information Collection 279 Complete Scope 280 Local Scope 282 Transient Scope 284 Coverage of an Information Collection 285 Complete Coverage 285 Core Coverage 286 Extended Coverage 286 Local Coverage 287 Summary of Information Collections 287 Information Entry Patterns 288 Information Entry 289 xvi Contents

Identifying Information Using the Information Key 292 Information Key 295 Local Key 297 Recycled Key 300 Natural Key 302 Mirror Key 305 Aggregate Key 307 Caller’s Key 310 Stable Key 312 Structures for an Information Entry 316 Locking for an Information Entry 317 Specialized Operations for an Information Entry 317 Summary of Information Entries 318 Information Node Patterns 319 Information Node 320 Business Information Nodes 324 Application Node 326 Information Content Node 330 Search Node 332 Information Store 334 Information Mart 337 Information Cube 340 Integration Nodes 343 Information Broker 343 Queue Manager 349 Staging Area 353 Look-Up Table Node 356 Event Correlation Node 358 Operational Data Stores and Hubs 360 Information Mirror Store 361 Information Event Store 364 Operational Status Store 366 Information Asset Hub 368 Information Activity Hub 372 Big Data Information Processing Nodes 376 Information Warehouse 377 Streaming Analytics Node 380 Map-Reduce Node 382 Analysis Information Nodes 385 Information Analysis Node 386 Information Mining Store 389 Summary of Information Nodes 393 Summary 394 Contents xvii

Chapter 6 Information in Motion 395 Information Request Patterns 396 Information Request 396 Variations of the Information Request Pattern 398 Summary of Information Requests 401 Information Flow Patterns 401 Information Flow 403 Routing Information Flows 406 Staged Routing 407 Partitioned Routing 410 Buffered Routing 413 Filtered Routing 416 Summarized Routing 418 Consolidating Information Flows 420 Synchronized Consolidation 421 Filtered Consolidation 424 Ordered Consolidation 427 Independent Consolidation 429 Distributing Information Flows 432 Synchronized Distribution 433 Partitioned Distribution 436 Ordered Distribution 439 Independent Distribution 441 Broadcast Distribution 444 Summary of Information Flow Patterns 446 Summary 447

Chapter 7 Information Processing 449 Information Trigger Patterns 450 Information Trigger 450 Variations of the Information Trigger Pattern 453 Manual Information Trigger 453 Scheduled Information Trigger 455 Information Service Trigger 458 Information Change Trigger 460 External Sensor Trigger 462 Summary of Information Triggers 465 Information Process Patterns 465 Information Process 466 Business Processes 469 Bespoke Application Process 471 Packaged Application Process 472 Agile Business Process 474 xviii Contents

State Driven Process 476 Collaborative Editing Process 479 Information Reporting Process 481 Quality Information Processes 483 Information Profile Tracking Process 484 Clerical Review Process 487 Information Remediation Process 489 Information Validation Process 491 Information Matching Process 493 Information Ever-Greening Process 496 Information Archiving Process 497 Provisioning Information Processes 499 Information Replication Process 500 Information Deployment Process 502 Information Relocation Process 505 Information Federation Process 507 Information Queuing Process 509 Information Broadcasting Process 511 Information Summarizing Process 513 Information Scavenging Process 515 Analytics Processes 517 Information Pattern Discovery Process 518 Information Decision Definition Process 521 Information Pattern Detecting Process 523 Search Processes 525 IT Service Management Processes 526 Operational Health Monitoring Process 527 Information Node Management Process 528 Scheduling Process 530 Summary of Information Processes 531 Summary 532

Chapter 8 Information Protection 533 Information Reengineering Step Patterns 534 Information Reengineering Step 534 Specialist Information Reengineering Steps 538 Restructure Data 539 Standardize Data 542 Enrich Data 545 Classify Data 546 Check Data 548 Correct Data 550 Link Entries 553 Contents xix

Merge Entries 556 Separate Entries 558 Derive Value 560 Derive Relationship 562 Smooth Data 563 Sample Data 565 Information Guard Patterns 566 Information Guard 567 Variations of the Information Guard Pattern 570 Information Probe Patterns 572 Information Probe 572 Variations of the Information Probe Pattern 575 Summary 576

Chapter 9 Solutions for Information Management 577 Information Solution Patterns 578 Information Solution 578 Patterns for Changing Information Nodes 582 New Information Node 583 Information Node Upgrade 587 Patterns for Integrating Information Nodes 590 Distributed Activity Status 590 Semantic Integration 593 Partner Collaboration 597 Patterns for Master Data Management 599 Shared Master 601 Centralized Master 604 Information Registry 607 Golden Reference 610 Synchronized Masters 613 Patterns for Big Data and Warehouses 618 Historical System of Record 619 Workload Offload 624 Patterns for Business Intelligence and Analytics 626 Performance Reporting 626 Operational Analytics 628 Next Best Action 630 Patterns for Information Protection 633 Managed Archive 634 Information Access Audit 636 Information Monitoring 638 Summary of Information Solutions 642 Final Thoughts 642 xx Contents

Appendix 1 Glossary 643

Appendix 2 Summary of MCHS Trading’s Systems 649

Appendix 3 Related Pattern Languages 651

Appendix 4 Bibliography 653 Information Centric Organization 653 Enterprise Architecture 653 Enterprise Application Architecture 654 Service-Oriented Architecture and Web Services 655 Information Architecture 655 Data Models 655 Metadata Management 656 Information Warehouse 657 Information Integration 657 Information Quality 658 Master Data Management 659 Big Data 659 Analytics and Reporting 660 Information Security and Privacy 660 Information Life-Cycle Management 661

Patterns Index 663

Index 669 Foreword by Rob High

In the early history of humans—when we were barely distinguishable from other animals—we protected ourselves with the construction of shelters made from branches, leaves, and mud. To suggest that these structures had architecture is being generous. But to the extent that their architectural style could be discerned at all, at best you could argue their architecture was forged from necessity and practicality. Dried mud helped keep the leaves secured and leakproof. Branches provide strength across broad spans. Leaves knitted everything together. Eons of experience and mistakes drove practices—often varying substantially from one region to another based on the available materials and climate conditions of each region. Form strictly followed function. No one, at that time, ever stopped to draw out their shelter design—critiquing it for its style and pro- pitiousness. Likewise, the early years of information systems implementation were driven out of necessity—leveraging the materials and practices that were available to us. Barely discernable architectures were more derived than prescribed. But, as with our ancestral laborers, we found the need to build more sophisticated and ever-larger answers to our problems. And, as before, we discovered that with a little planning, engineering, and standardized construction techniques, we could handle the task more easily. We could adapt to new functions, and we could apply form and aesthetics to the things we constructed. The results are not only more pleasing, but they are more reliable, more efficient, more economical, and more adaptable to changing conditions. There is not only derived architecture, but we can employ architecture to coerce solutions to better meet our needs. At the heart of architecture are patterns that shape and style the materials we work with and the techniques that inform the practices of pattern adoption. Patterns form the building blocks of construction. Techniques tell us how best to select and assemble those building blocks to achieve the results we are seeking. The idea of using patterns and techniques in the construction of information management is exactly what this book is about. Information patterns form the basis of a whole new architectural approach to systems design that, like its analog in the construction industry, is essential to assuring durability, usability, flexibility, and utility of IT solutions. The patterns presented here xxi xxii Foreword

are not hypothetical, but rather have been forged from decades of experience in the field. They capture the bittersweet results of literally thousands of person-years of effort—trying different approaches, abandoning the ones that failed, refining the ones that showed promise, latching on to the ones that proved to work well, and promoting the ones that exceeded expectations. The language of information patterns is a formalism of expression. It standardizes an approach to representing ideas that enables clarity and precision of communication. It allows us to exchange a common understanding of those ideas and to manipulate those ideas to create even bigger, more profound ideas. And although the basic ideas captured in the language are not new, the ability to express those ideas in a formal language is both novel and profoundly innovative. It makes it possible to unleash the value of information patterns, and build even greater value more effectively. As the former chief architect of IBM®’s SOA Foundation, I have long advocated the use of architecture for ensuring the utility of information systems solutions. These information patterns build on the traditions of Service Oriented Architecture (SOA) and, more important, fill a critical gap in SOA by addressing the correlation between services and information in our IT solutions. In keeping with the SOA tradition, these patterns are not just the raw materials of construction for IT developers, but are essential to aligning the objectives of IT and business—driving the form of the system to both enable the business to respond quickly to changing business conditions and to even compel the business to motivate changes that will gain it a competitive advantage in its marketplace. The use of information patterns is imperative for modern information system design. This book is a must-read and I strongly encourage you to apply these techniques in your practices. Rob High IBM Fellow CTO, IBM Watson™ Former chief architect, SOA Foundation Preface

About This Book Information is the heart of any organization’s operation. It defines who is involved, what activities are taking place, and the assets being brought to bear to create its goods and services. Man- aging information takes a multidisciplinary approach because it pervades every aspect of the organization’s life. We must consider where information comes from; consider how it is distributed, protected, governed, and monitored; as well as ensure it is used appropriately at its destina- tion. From a technical point of view, a myriad of technologies have emerged to tackle different aspects of information management. There is the Service Oriented Architecture (SOA) technology that makes information available to remote systems; databases and files systems to store information; messaging technology that sends notifications between systems; extract, transform, load (ETL) technology for moving and transforming large quantities of information; federated queries; big data technologies; replication technology; data quality and metadata tools; distributed security technology; analytics; archiving processes; and many more. For the architect, the choice of technology is overwhelming and there is a strong temptation to just stick with the technology we know well. The result is that our designs can become unbalanced, with too much focus on one dimension of the problem. This book contains architecture patterns that characterize the typical information issues associated with distributed systems. They demonstrate how the seemingly competing technologies for information management, SOA, and business process management can be blended to create an effective, interconnected, and ordered IT landscape, making it both manageable and efficient. The patterns are built around a supply chain metaphor. Information is supplied to the organization, processed, moved around, processed some more, and then output as some form of information product, such as a report or dashboard. Through this analogy, we cover how an organization can manage its information to support its operation effectively, balancing quality, availability, breadth, precision, and timeliness with cost. xxiii xxiv Preface

Information is not a physical asset, of course, so our notion of an “information supply chain” must extend the physical manufacturing and distribution supply chain metaphor with the recognition that information rarely moves from point to point as a discrete, whole unit. It is con- stantly being copied, transformed, renamed, partitioned, merged, updated, and deleted. More subtly, there are multiple versions of the “truth.” People’s interpretation and assumptions around the information they work with are highly contextual, and so when information is shared, it must be transformed to match the expectations and context of the new consumers before they will trust it to support their business. Patterns of Information Management explains how information is transformed, enriched, reconciled, and redistributed along the information supply chain. The aim is to shape the way systems are integrated to create an orderly flow of information that can be reused and synchronized at key points in the processing. A pattern-based approach is powerful because the resulting system behavior is determined by the way technologies are combined; the design choices are heavily affected by nonfunctional requirements, such as the amount of information, the arrival rates of new values, the level of quality that can be assumed, and the processing required to make the information useful. The patterns link together into a pattern language that spans from the holistic system level views for enterprise architects down to the design patterns of integration developers. The resulting pattern language enables the architect to make reasoned decisions about the applicability of each alternative approach and the inherent consequences of the choice.

Intended Audience Patterns of Information Management is intended for enterprise architects, information architects, and solution architects who are responsible for defining how information systems should be linked together in order to synchronize, manage, and share information. Students and practitioners alike will find that the patterns create a framework in which to organize their existing experience and broaden their knowledge.

How to Use This Book This book is principally a reference book. Chapters 1 and 2 , “Introduction” and “The MCHS Trading Case Study,” respectively, set the scene, explaining how the pattern language is structured and walking through some examples. It is recommended that you read both of these chapters before using the patterns. The remaining chapters contain the pattern definitions themselves. These chapters can be used to deepen your knowledge of the topic or as a pattern reference during a particular project. Because there are so many patterns, it is not possible, or necessary, to learn all of the patterns before starting to use them in a project. The patterns are organized into small, related groups that focus on a particular aspect of information management. We suggest that you start with a pattern Preface xxv

group that is particularly relevant to your work. Study the pattern descriptions, paying attention to the differentiating aspects of each pattern, and map them to your project. The content can be used in various ways: • The pattern names define a vocabulary to discuss issues and technology options related to information architecture, governance, and management. The pattern names become the nouns and verbs of your design discussions, enabling you to characterize and choose between the options available. • The pattern icons can be used in whiteboarding sessions and for documenting design decisions in reference architectures and solution specifications. • The pattern descriptions provide design guidance for specific information supply chains and solutions. • The pattern language provides a foundation for setting architectural standards and reference architectures. An organization can select the patterns it wants to support and develop reference implementations for them. • The pattern language provides material for education and training in information architecture. As you become familiar with one group of patterns, you can turn your attention to another—iteratively growing your knowledge. The consistency built into the pattern language will accelerate your learning process and very quickly you will become proficient in a significant working set of patterns.

Structure of the Book Patterns of Information Management is divided into the following chapters:

Chapter 1, “Introduction” Chapter 1 is an introduction to the topic of information management and the challenges that architects face. It explains what a pattern is, the conventions we use in documenting a pattern, and how patterns are linked together to form a pattern language.

Chapter 2, “The MCHS Trading Case Study” Chapter 2 uses a case study involving a fictitious company called MCHS Trading to illustrate how the patterns of information management can be used in a project setting. These projects cover defining an information strategy; introducing a data warehouse and management reporting; introducing master data management hubs for operational master data; improving how information is governed, monitored, and managed; exchanging information with external parties; and using predictive analytics. xxvi Preface

Chapter 3, “People and Organizations” Chapter 3 is the first of the pattern definition chapters. It covers patterns relating to the way an organization is operating because this has a major impact on the way that information is managed. It describes the following pattern groups: • Information centric organizations • Information users These patterns help in the definition of your information strategy and information governance program.

Chapter 4, “Information Architecture” Chapter 4 covers the nature of information and how to think about its structure, meaning, and organization. This includes patterns that describe the different life-cycle patterns of information, models, metadata, information supply chains, and the solutions you may implement to improve the management of information. It includes the following pattern groups: • Information elements • Information identification • Information provisioning • Information supply chains These patterns help you understand and plan the overall flow of information through your organization’s systems.

Chapter 5, “Information at Rest” Chapter 5 contains pattern descriptions describing how information is accessed and stored. This includes descriptions of the different types of servers that support information management. The pattern groups in this chapter are as follows: • Information services • Information collections • Information entries • Information nodes These patterns help to shape your thinking when deploying new capability into the IT environment, such as a new application, master data management hub, data warehouse, analytics, or reporting platform. Preface xxvii

Chapter 6, “Information in Motion” Chapter 6 documents the patterns for moving information between servers, including services, information routing, filtering, consolidation, and distribution. It contains the following pattern groups: • Information requests • Information flows These patterns focus on how information is moved between the information nodes to sat- isfy the needs of their information processes.

Chapter 7, “Information Processing” Chapter 7 describes the different types of processing that is performed on information and how it is triggered. The processes include business, movement, transformation, quality management, search, and analytics processes. It contains these pattern groups: • Information triggers • Information processes These patterns help you categorize and select how information should be processed and maintained.

Chapter 8, “Information Protection” Chapter 8 covers the patterns for protecting information, including validating, transforming, enriching, and correcting information; security; and monitoring. It includes three pattern groups: • Information reengineering steps • Information guards • Information probes Once you have your information supply chains mapped out, these patterns help you design how the information can be protected end to end.

Chapter 9, “Solutions for Information Management” Chapter 9 covers the information solution pattern group. These patterns describe a selection of information projects that improve the information management of an organization’s information systems. Solutions incorporate a set of patterns focused on addressing particular information problems, though always in context with existing information landscapes so they must integrate with, enhance, or incorporate existing systems and information.

Appendices The appendices include a glossary of technical terms and technology types that are mapped to the relevant patterns. xxviii Preface

What Is Not Covered This is a design pattern language and so does not recommend specific technologies and products. It aims to describe classes of technology, where they should be used, and the consequences of using them. This book is also intended to be an overview of the information management landscape. It does not include implementation details, particularly where there is plenty of literature covering these details. Finally, there are references to information governance in the patterns. Information governance is a supporting discipline for information management that involves business controls, procedures, and related technology. It is beyond the scope of this book to cover these aspects properly.

Further Information There is an IBM developerWorks® community for the Patterns of Information Management where additional details, examples, and discussions are being posted. To join, visit: https://www.ibm.com/developerworks/community/groups/community/PoIM This community provides you with an opportunity to ask questions about the patterns and suggest improvements.

Acknowledgments The pattern language has been through many iterations, discussions, and workshops to get it into a state that is suitable for publishing. We would like to thank the following people who have provided help and feedback during the process. From the EuroPLoP 2011 Pattern Writers Conference (where the I NFORMATION N ODE patterns were reviewed), there is our shepherd, Tim Wellhausen, and the members of the writer’s workshop: Klaus Marquardt, Markus Gaertner, Andreas Fiesser, and Joerg Pechau. IBM has provided us with an envirionment where we have been able to develop and share the material with experts from many companies, industries, and software disciplines, drawing on their years of experience delivering complex projects and systems. As a result, we received valuable feedback from many subject matter experts, including Dan Wolfson, Dougal Watt, Steve Lockwood, Kyle Brown, Loretta Mahon Smith, Mike McRoberts, Rob High, Martin Wildberger, Richard Hedges, Stephanie Hazlewood, Patrick Dantressangle, Mukesh Mohania, Ivan Milman, Lena Woolf, David Radley, Larry Yusuf, Susan Visser, Sarah Tee, Herb Berger, Prasad Vempati, Keith Enhagen, Eleomara Goncalves, and Rickey Tang. We would also like to thank the members of Pearsons plc who have expertly guided and supported us in our first publishing effort—in particular, Bernard Goodwin and Michelle Housley. Preface xxix

About the Authors Mandy Chessell FREng CEng FBCS Mandy has worked for IBM since 1987. She is an IBM Distinguished Engineer, IBM Master Inventor, and member of the IBM Academy of Technology Leadership Team. As the chief architect for InfoSphere® Solutions in IBM’s Software Group, Mandy designs common information integration patterns for different industries and solutions. In earlier roles, Mandy’s work has focused on transaction processing, event management, business process management, information management, and model-driven development. This breadth is reflected in her invention portfolio, which to date stands at over 50 issued patents worldwide. Outside of IBM, Mandy is a fellow of the Royal Academy of Engineering and a visiting professor at the University of Sheffield, UK. In 2001, she was the first woman to be awarded a Silver Medal by the Royal Academy of Engineering, and in 2000, she was one of the “TR100” young innovators identified by MIT’s Technology Review magazine. In 2006, she won a British Female Innovators and Inventors Network (BFIIN) “Building Capability” award for her work developing innovative people and the BlackBerry “2006 Best Woman in Technology - Corporate Sector” award. More recently, she was granted an honorary fellowship of the Institution for Engi- neering Designers (IED) and she won the “2012 everywoman Innovator of the Year.” For more information on Mandy’s publications, see http://en.wikipedia.org/wiki/Amanda_ Chessell .

Harald Smith Harald has worked for IBM since 2005. Harald is a software architect in IBM’s Software Group specializing in information quality, integration, and governance products, and is IBM certified in delivering IBM Information Management solutions. In this role, he develops best practices, methodology, and accelerators for common information integration use cases. Harald has 30 years of experience working with data quality products and solutions; product and project management; application development and delivery; system auditing; technical services; and business processes across the software, financial services, healthcare, and education sectors. Harald was the product manager at Ascential® Software and IBM responsible for designing and bringing the IBM InfoSphere Information Analyzer product to market as a key component in IBM’s information quality portfolio. He has been issued three patents in the field of information quality and rule discovery and was recently recognized as an IBM developer- Works Contributing Author. His publications include the IBM developerWorks articles “The information perspective of SOA design” [parts 6, 7, and 8], “Use IBM WebSphere® AuditStage in a federated database environment,” “Using pre-built rule definitions with IBM InfoSphere Information Analyzer,” xxx Preface

“Designing an integration landscape with IBM InfoSphere Foundation Tools and Information Server” [part 1], and “Best practices for IBM InfoSphere Blueprint Director” [parts 1 and 2]. For the IBM InfoSphere Information Server documentation, Harald contributed to the “IBM InfoSphere Information Analyzer Methodology and Best Practices Guide” and “IBM Info- Sphere Information Server Integration Scenario Guide”; he has also contributed to three IBM Redbooks®. CHAPTER 1

Introduction

In software engineering, we are taught that abstraction, modularity, and information hiding are useful approaches when breaking down a set of requirements into manageable chunks for implementation. This book makes use of these principles to tackle the synchronization of information between IT systems.

Islands of Information Most organizations use specialized IT systems called applications to run their operations. Each application supports a particular aspect of the business, either for the whole organization or a group within it. There may be applications for order taking, for billing, for distribution of goods, for management of employee data, and many more. An application will store the information it is processing in a persistent store for later reference. This information store is often a private resource for the application. Over time, this store contains important details about the people with whom the organization is interacting, what assets they use, how, when, and why. A healthy organization will develop and grow—and this change drives changes into its applications, affecting their function and scope. It can also lead to duplication of function: • When two organizations merge, they can end up with at least two applications for each function. • When a new product line or channel to market is introduced, an organization may choose to introduce a new application to support it, to avoid the possibility of disrupting the established business or to implement it faster. • Multinational organizations find they need separate applications for different countries, or trading regions, to handle local customs and regulations. Careful management and constant rationalization may reduce the number of applications so there is little or no overlap in function. However, an application is a complex mix of software and hardware. It takes considerable engineering effort to develop it, and so once the investment is made, an application is expected to have a long life (5–15 years). Ripping it out and replacing it can be expensive and difficult and so an organization may choose to maintain multiple applications for the same function.

1 2 Chapter 1 Introduction

When there are two applications covering the same function, information about that function is split between the two applications and is typically stored in a different format. Even when all applications support unique functions, there is still an overlap in the information that they hold. This is the information that describes the core interests of the organization, such as customers, suppliers, products, contracts, payments, assets, employees, and many more. Over time, the private information stores of an organization’s applications become islands of duplicated and inconsistent information. This affects the efficiency of an organization and its ability to operate in a cost-effective, flexible, and coherent unit. This book seeks to address the challenge of effective information management. How does an organization improve its management of information, working with the applications it already operates, to ensure it knows what its assets are, what it is working on, what commitments it has agreed to, how well it is performing, and how it can improve its operation?

Introducing MCHS Trading MCHS trading is a fictitious trading company used in this book to illustrate different approaches to information management. MCHS Trading sells goods through four channels: on the Internet, via mail order, via a call center, and through physical shops. Due to differences in requirements, orders are taken by three different applications: E-shop for the Internet orders, Mail-shop for mail order and the call center, and the Stores application to support the needs of the physical stores. These applications were introduced incrementally as MCHS Trading opened the new channels to its customers. Orders are fulfilled and money is collected through the Shipping and Invoicing applications, respectively. The E-shop, Mail-shop, and Stores applications send the order details to the Shipping application, which in turn forwards them on to the Invoicing applications as soon as an order is dispatched. This is illustrated in Figure 1.1 .

Figure 1.1 MCHS Trading’s order-processing systems. Introducing MCHS Trading 3

From a functional point of view, this is a rational separation of concerns. Each application has a clearly delineated set of responsibilities and the process works—customers get the goods they ordered and the correct money is collected in exchange for the goods. However, when the information stores are added to the picture (see Figure 1.2 ), you can see that the details about customers, products, and orders are replicated across the systems. Why? Because this information is core to MCHS Trading’s business and so every application needs it in some form or another.

Figure 1.2 Information stores supporting order processing.

Failing to synchronize this information effectively leads to inflexibility and inefficiencies in the organization that can have an impact both internally and externally. Consider an individual customer, Alistair Steiff. He has registered for a loyalty card, which is handled by the Stores application, and he also uses the E-shop and the mail order channel from time to time. The E-shop keeps a record of Alistair in the form of a customer account. This is different from the loyalty card account. The Mail-shop application takes Alistair’s details with each order. It has no capability to maintain his details for the next time he orders something through that channel, which Alistair finds a little annoying. Alistair experienced another issue when he moved to a new address. Although he updated his address in his E-shop account, MCHS Trading kept sending his loyalty card statements to his old address. He tried phoning MCHS Trading’s call center but they could not help because they 4 Chapter 1 Introduction

were only set up to take new orders. He had to write a letter to MCHS Trading to get the loyalty card address updated. Within MCHS Trading, there is also frustration with the current systems. It is difficult to understand the buying patterns of its customers: • To understand which new products would be of interest to an individual • To understand how an individual interacts across each of MCHS Trading’s sales channels There are two issues here. First, the applications only store information that is relevant to their operation—so it is hard to see the complete picture when the details are spread among the applications. Second, applications are designed to reflect the current operational state of their work. They may keep historical data, but not in the form that is conducive to analysis of trends and anomalies. This lack of insight is inhibiting MCHS Trading’s ability to grow and there is a need to introduce new management reporting capability to understand how the business is really performing.

Improving an Organization’s Information Management The problems that MCHS Trading is experiencing are typical for many organizations. Informa- tion is distributed across multiple applications for operational efficiency, leaving the information duplicated, fragmented, and often inconsistent. As a result, the organization cannot act in a coordinated manner: • They find it hard to get an overall picture of how well the organization is performing. This requires a consolidated view of their business activity, showing the current position, along with a historical perspective for comparison. For example, MCHS Trading would want to understand how many customers it has, what types of products its customers are interested in buying, how this is changing over time, how efficient the delivery process is, who its best suppliers are, and much more if it is to maintain its market leadership position. • The quality of information varies from application to application. This means different parts of the organization are operating on different facts that could lead to different decisions being made for the same situation. • The internal fragmentation of the information is often exposed outside of the organization, creating poor customer service or missed opportunities. This was Alistair Steiff’s experience when he tried to change his address—he had to ensure it was updated in each application—using a different process for each one. Improving an Organization’s Information Management 5

• External regulators are skeptical that the organization’s reported results are accurate when ad hoc processes are used to create them because it is difficult to explain where the information came from and how the results were calculated. • Information is not retained for the required amount of time—or too much information is retained for too long. Either case can inhibit the ability to find the right information in a timely manner. • Failures in the mechanisms that move information around can corrupt the integrity of the organization’s information. These failures may be errors in the information itself, which means it cannot be transferred, or errors in the implementation of the mechanism, or a failure to initiate some processing in time, resulting in missing information. These failures may not be detected for some time and can be extremely difficult to resolve. An organization needs to maintain a strong core of information to run the business. This requires a focus on how key information is created, processed, and stored within its IT systems: • They must optimize where information is located relative to the workload that is using it—ensuring copies are taken in a thoughtful way and these copies are supported with mechanisms to maintain or remove them as new information becomes available. • Related information should be correlated together to create a complete picture of the organization’s activities. • Obsolete information must be removed to save storage and reduce the processing effort. Vital historical information needs to be retained. • Information must be protected from inappropriate use, restored after a failure, and, despite the fact that most organizations have their silos and cliques, the right information needs to be exchanged and presented to the right people at the right time . This is hard to achieve. Technology is often focused on providing function to the business rather than managing information. Specialist information management technology helps, but it has to be blended with the existing infrastructure. The blending process creates emergent properties. Emergent properties are those characteristics that “appear” when components are combined together in a particular configuration—rather than being inherent properties of any one of the components. This is similar to the behavior of colors when you mix them together. If you combine blue and yellow, you get the color green. Green is an emergent property because it is not present in either the blue or the yellow—and only emerges when they are combined. When we combine technology together, we also get emergent properties. These emergent properties may be additive, or they may override some of the components’ original capabilities. Consider two applications sited on opposite coasts of the United States. The application on the East Coast needs to regularly send information to the West Coast application. However due to the different time zones in which they operate, there is a 3-hour period of its operation when the 6 Chapter 1 Introduction

West Coast application is not available. It is not possible to extend the period of operation of the West Coast application—and the East Coast application is not capable of buffering the information until the West Coast application comes online. The solution is to provide a new database that is available whenever either application is online (see Figure 1.3 ). The East Coast application writes information into the database. The West Coast application processes the information in the database when it becomes available. This is a common integration approach. The database in the middle is acting as a staging area. Its effect in the integration is to expand the time window that information can be transferred between the two applications. It may also improve the resiliency of the integration because the East Coast application is no longer affected by the occasional outages of the West Coast application. However, the downside is that when both applications are available, the staging area slows down the transfer of information between the two applications because there is a small delay between the East Coast application writing the information and the West Coast application pick- ing it up. The time it takes to transfer information between two systems is called the latency of the information transfer.

Figure 1.3 Using a staging area between two applications.

The increased availability, latency, and resilience are all emergent properties of the integration. In general, the emergent properties relate to non-functional characteristics that may not be evident until the integration is in production. This is why architects like to use tried and tested approaches where the emergent properties are well understood. This book describes how the flow of information between applications and other systems should be designed, calling out the emergent properties as they occur. The aim is to shape the placement of workload and information stores within the IT systems to create an orderly flow of information that guarantees the quality of the results. The material is presented as a set of connected software design patterns, called a pattern language. Patterns and Pattern Languages 7

Patterns and Pattern Languages A software design pattern defines a proven approach to solving a problem. The solution described in the pattern is typically a set of components that are interacting in a particular configuration. The pattern explains why this approach works, its associated trade-offs, and resulting benefits and liabilities. It also links to other patterns that may: • Provide an alternative approach • Provide a complementary capability • Describe an approach to implementing a component that is named in the pattern’s solution This linking together of related patterns creates what we call a pattern language. Every pattern in this pattern language has a name that summarizes the solution it represents in a succinct manner. For example, there is a pattern called I NFORMATION C OLLECTION that describes a collection of related information. Notice that the pattern name is written using the small capitals formatting. This formatting convention is used wherever the pattern is first referenced in a section. The name of a pattern can act as shorthand for the solution during design discussions. Choosing the terminology for the pattern names has been a challenge because the pattern language covers multiple architectural disciplines. Where possible, we have used industry stan- dard names for the concepts and components exposed in the pattern language. However, we have found it necessary to introduce new terminology whenever there is conflicting nomenclature, or no obvious name exists. Every pattern has an icon that can be used as a visual reminder of the pattern, particularly when whiteboarding and documenting solutions. The information collection icon is shown in Figure 1.4 .

Figure 1.4 Icon for the information collection pattern.

The patterns are built on a common component model. This means that a pattern can be used as a component in the solution described by another pattern. When this occurs, the icon of the pattern is used in the solution diagram of the consuming pattern. For example, Figure 1.5 8 Chapter 1 Introduction

shows the solution for the staging area introduced in the previous section. It is built from a variety of pattern icons. The meaning of the icons in the diagram, and the details of the patterns behind them, will become familiar to you as you work with the pattern language. The purpose here is to illustrate how the icon of one pattern, the information collection in this case, can be used in the solutions of other patterns.

Figure 1.5 The solution diagram for a staging area showing the use of the information collection icon.

Each of the patterns of information management can be used independently. However, the real value of a pattern language is the ability to compare and contrast different approaches to resolving a situation. The patterns of information management that are relevant to a particular situation are collected together in a pattern group. Each pattern group has a lead pattern that describes the core principles and capabilities of the group. The pattern group is named after the lead pattern. The other patterns in the pattern group enhance one or more characteristics of the lead pattern to support a more specialized situation. You may have noticed that in Figure 1.5 , the information collection icon appears slightly modified in the solution diagram with five lines coming out of the left side (as shown in Figure 1.6 ). The modification to the information collection icon denotes that the staging area uses specialized information collections described by the T RANSIENT SCOPE pattern. The modified icon visually represents that there is a relationship between the information collection and transient usage patterns. They are, in fact, from the same pattern group along with other patterns called LOCAL SCOPE and COMPLETE SCOPE . Patterns and Pattern Languages 9

Figure 1.6 Icon for the transient scope pattern.

To make it easy to compare and contrast the patterns in a group, each group of patterns begins with a table of pattern summaries, called patlets. A patlet shows a pattern’s icon, name, short problem statement, and summary of the solution. The aim of the patlets is to help you quickly discover and navigate to the pattern you need. Table 1.1 shows the patlet for the I NFOR- MATION COLLECTION pattern, which is the lead pattern in its group.

Table 1.1 Sample Pattern Summary for Information Collection

Icon Pattern Name Problem Solution INFORMATION Information must be organized Group related information COLLECTION so it can be located, accessed, together into a logical collection protected, and maintained at a and implement information ser- level that is consistent with its vices to access and maintain this value to the organization. information.

Table 1.2 shows the related scope patterns from the same group. Notice that the icons are all variations of the information collection icon.

Table 1.2 Patlet Table for the Scope Patterns in the Information Collection Group

Icon Pattern Name Problem Solution COMPLETE An information process needs The information process needs to SCOPE to perform an activity once use an information collection that for each instance of a par- stores a single information entry ticular subject area (such as for each instance of the subject a customer, product, order, area that occurs within the infor- invoice, shipment, etc.) that mation supply chain. Such an occurs within the information information collection is said to supply chain. have a complete scope. 10 Chapter 1 Introduction

Icon Pattern Name Problem Solution LOCAL SCOPE The implementations of the Provide information collections information processes hosted within the information node for within an information node the sole use of its information assume they are in complete processes. These information control of changes to the collections will then only have information they use. information entries that are created by the locally hosted information processes. These types of information collections are said to have a local scope. TRANSIENT An information node needs to Create an information collection SCOPE provide temporary storage for to temporarily store the informa- information entries that are tion entries in the information being continuously added and node. From time to time, the removed by the information information entries stored in processes. this information collection will change, and so we say this collection has transient scope.

The detailed pattern descriptions follow the patlet tables. Many different styles and head- ing structures have been successfully used to describe software patterns. We have chosen to use one of the formats recommended by The Open Group Architecture Framework (TOGAF®)1 with the following subsections: • Context— The situation where it is appropriate to consider using the pattern • Problem— A description of the problem that this pattern solves • Example— An example of the problem • Forces—The factors that make this problem hard to solve • Solution— A description of solution components and how they are assembled together • Consequences—The benefits and liabilities of using the solution • Example Resolved—How the example described is resolved using the pattern • Known Uses— References to well-known technologies and approaches that support the pattern • Related Patterns— Links to other relevant patterns in the pattern language

1. http://www.togaf.info Basic Components in the Pattern Language 11

These sections provide a way to bring together a variety of information into a well-formed structure that summarizes the essence of the pattern. Together, they enable you to make reasoned choices of approach for the solution you are building.

Basic Components in the Pattern Language A good place to start learning about the Patterns of Information Management is a pattern called INFORMATION P ROVISIONING. This describes how five basic components interact to receive, process, and produce information. Figure 1.7 comes from the information provisioning pattern description and shows the components and how they interact. All of these relationships are many-to-many. Notice that the information collection pattern introduced previously is shown as a component in the information provisioning pattern along with some additional patterns: I NFORMA- TION USER , I NFORMATION TRIGGER , INFORMATION PROCESS , and I NFORMATION SERVICE .

Figure 1.7 Five basic components for processing information. 12 Chapter 1 Introduction

The information user is a person working with the organization’s information. This person may be an employee or someone outside the organization such as a customer or a supplier. Each kind of information user has his or her own requirements for the kinds of information needed, where, and when. The information user is both a consumer of existing information and a con- tributor of new information. The information user works with user interfaces that are controlled by information processes. The information processes perform the automated processing of the organization. There are many different kinds of information processes—but, collectively, they are the mechanisms by which information is received, transformed, and produced in some form or another. An information trigger starts an information process. This may be the result of an information user request, a scheduler, an event being detected, or the need for more information. The information trigger passes the information process some context information that describes why it is being started. The information process augments this context information with information from the information users and other information known to the organization. An information process accesses any additional information it needs through well-defined interfaces called information services. An information service provides a specialized view of the information that the information process needs. It is able to locate the requested information from a variety of sources and transform it into a format suitable for the requesting information process. An information service retrieves stored information from information collections. The information collection manages a collection of related information. Typically, the contents of an information collection relate to the same subject area. However, an information collection may contain information that was collected from the same activity, such as the results of an experiment, from the same source, such as readings from a sensor, or from the same time period, such as social media extracted for a specific period of time. The information provisioning pattern is a lead pattern of a pattern group. It recognizes that the information a person sees through a user interface is different from the way it is stored and shows the layering of components used to manage the mapping. The rest of the pattern group describes how information is provisioned when multiple systems are involved.

Information Integration and Distribution As already discussed, an organization will have many applications and other kinds of IT systems. Each of these systems will host their own information processes, information services, and information collections. We use the I NFORMATION NODE pattern to represent the general concept of a system. You may want wish to think of this as a physical computer, or server. However, with the increas- ing use of virtual systems and cloud provisioning, the notion of physical hardware being tied to a particular system is becoming less common. So an information node is simply an identifiable “system” that the organization runs. The information node is the lead pattern in a large information group that describes different types of systems. The application is represented by a pattern from the group called APPLI- CATION N ODE. The STAGING AREA pattern is also in the same group. Information Integration and Distribution 13

The information node provides an execution environment for the information processes, information services, and information collections. Calls between these components can occur totally within the information node. However, it is also possible for information processes to access information from different information nodes. This capability is provided a specialist pattern within the information service pattern group called REMOTE INFORMATION SERVICE . Figure 1.8 illustrates this mechanism. The remote information service uses an I NFOR- MATION REQUEST pattern to retrieve information from an information collection located in another information node. The information request pattern consists of two message flows: one from the remote information service to the information node that hosts the information to request the information, and another flowing in the opposite direction to return the requested information. The information node that receives the request for information routes it to an appropriate information service to extract the information and return a response. In Figure 1.8 , this is shown as a LOCAL INFORMATION SERVICE —that is, one that uses information collections from the same information node—but it could be another remote information service.

Figure 1.8 Accessing information from a different information node. 14 Chapter 1 Introduction

The information request pattern retrieves information from its original location on demand. This means both the calling and the called information node must be available at the same time. When information must be copied from one information collection to another—for example, for performance or availability reasons—the information flow pattern is used instead. This introduces another kind of information node called an INFORMATION BROKER that calls remote information services to extract information from one or more information collections, transform it, and store it in other information collections. The effect is that information flows between the information nodes in what we call an information supply chain. Figure 1.9 illustrates this flow of information. The numbers on the diagram refer to these notes: 1. Here, an information process calls a remote information service to retrieve information from information collection A. Under the covers, the remote information collection uses an information request to contact the information node where information collection A is located. 2. The information process then works with some information users to update the information and store the results in information collection B. 3. Information collection B stores the information in a new entry in the information collection. 4. An information broker now starts an information process to extract the information from information collection B and transform it and save it as a new entry in information collection C. 5. Another information process starts to retrieve the information from information collection C. 6. This process may make changes to the information and update it in information collection C. This example illustrates how multiple copies of information are created—and also how these copies quickly become slightly different from one another. The differences could be as follows: • Superficial— Such as a reformatting • Enriching— Where additional information is added to the original information • Localized—Where updates made are only relevant to the location where they are made • Managed— Where the best source of information (called the authoritative source) is well known at all times • Conflicting— Where it is hard to know which information collection is the best to use or retrieve the latest information from as changes are coming in to each of the copies in an unpredictable way Pattern Language Structure 15

Figure 1.9 Flowing information between systems.

A well-defined information supply chain should avoid having information collections with conflicting differences in them. We aim to minimize the number of copies. Where copies are made, each should have a clear purpose and guidelines on when it should be used. Copies should be synchronized when updates are made, and where differences are unavoidable, there should be at least one copy that is known to have all of the latest information in it. The INFORMATION S UPPLY CHAIN pattern is the lead pattern in a pattern group that describes different patterns of information movement between the information collections and how to synchronize the information to avoid conflicting differences. Designing information supply chains is a key challenge for both information architects and solution architects.

Pattern Language Structure The pattern groups introduced in the previous sections show the breadth of factors an architect needs to consider to achieve a clean, correct, and flexible information design. At the top of the pyramid, you see the organization and the people who work within it. They drive the information strategy. The organization is supported by the information architecture, which is implemented by the information management components. This structure is summarized in Figure 1.10 . 16 Chapter 1 Introduction

Figure 1.10 Structure of the pattern language for information management.

Chapter 2 , “The MCHS Trading Case Study,” contains the case study, introducing the patterns through different projects at MCHS Trading. The remaining chapters contain the pattern descriptions and are organized according to the structure in Figure 1.10 . Chapter 3 , “People and Organizations,” has the patterns for the organization and its people (see Table 1.3 ). These patterns include the information strategy, policy setting, and information governance.

Table 1.3 Pattern Groups in Chapter 3

Lead Pattern Name Lead Pattern Lead Pattern Start Here When... and Icon Problem Statement Solution Summary INFORMATION An organization needs Make the management You are thinking about CENTRIC to make good use of its of information a stra- the holistic approach ORGANIZATION information to achieve tegic priority. Develop that your organization its goals. systems and practices should take to informa- that nurture and exploit tion management. information to maxi- mum effect. Pattern Language Structure 17

Lead Pattern Name Lead Pattern Lead Pattern Start Here When... and Icon Problem Statement Solution Summary INFORMATION Individuals need access Classify the people con- You want to define USER to the organization’s nected with the organi- what types of user roles information to perform zation according to their should be supported their work. information needs and by a new information skills. Then provide user solution. interfaces and reports through which they can access the information as appropriate.

Information architects develop an understanding of the information needs of an organization and propose best practices for how it should be structured, stored, and managed. Solu- tion architects are responsible for developing IT-based solutions to business problems. These solutions are dependent on information and so the solution architect relies on the information architecture created by the information architect when developing a new solution. Both the information architect and the solution architect use information architecture patterns in their work. These are described in the pattern groups shown in Table 1.4 , and are described in more detail in Chapter 4 .

Table 1.4 Pattern Groups in Chapter 4

Lead Pattern Lead Pattern Problem Lead Pattern Solution Start Here When... Name and Icon Statement Summary INFORMATION An organization is looking Group together related You are new to infor- ELEMENT for the best approach to information attributes that mation management manage the many kinds of follow the same life cycle and want to familiarize information it has. and manage them appro- yourself with the types of priately. information an organization has, and how it is managed.

INFORMATION An organization does not Investigate and document You want to catalog the IDENTIFICA- know what types of infor- the information require- information you have and TION mation it has, where it is ments and existing support any new requirements. located, how it is man- available to the organiza- The resulting information aged, and who is respon- tion. is often called metadata. sible for it. 18 Chapter 1 Introduction

Lead Pattern Lead Pattern Problem Lead Pattern Solution Start Here When... Name and Icon Statement Summary INFORMATION An information process Information is supplied to You are considering how PROVISION- needs information to per- the process when it starts, to provide information to ING form its work. through its user interfaces an information process or and through stored infor- information user. mation.

INFORMA- An organization needs Design and manage well- You are designing how TION S UPPLY to process information defined flows of informa- a particular type of CHAIN in order to fulfill its pur- tion that start from the information should flow pose. How is the flow of points where the informa- between your systems. information coordinated tion is collected for the throughout the organiza- organization and links the tion’s people and sys- flows to the places where tems? key consumers receive the information they need.

Chapter 5 , “Information at Rest,” covers the way information is processed within an IT system (see Table 1.5 ). In this pattern language, a system is called an information node and there is a related pattern group devoted to the various types of systems. Stored information is accessed through information services that locate the required information and format for the consumer. Information collections are logical groupings of stored information. Often the information is organized consistently within the collection. Approaches for identifying, structuring, locking, and storing information within an information collection are covered in the information entry pattern group.

Table 1.5 Pattern Groups in Chapter 5

Lead Pattern Lead Pattern Problem Lead Pattern Solution Start Here When... Name and Icon Statement Summary INFORMATION Some information pro- Define well-defined inter- You need to decide how SERVICE cesses need the same faces to the information an information process information, but may that meet the needs of par- will access the informa- require it to be formatted ticular consuming infor- tion it needs. differently. mation processes to enable them to create, retrieve, and maintain just the information they need. Pattern Language Structure 19

Lead Pattern Lead Pattern Problem Lead Pattern Solution Start Here When... Name and Icon Statement Summary INFORMATION Information must be orga- Group related informa- You need to classify how COLLECTION nized so it can be located, tion together into a logical the existing stores of accessed, protected, and collection and implement information are used or maintained at a level that information services to decide how new informa- is consistent with its value access and maintain this tion should be grouped to the organization. information. and stored.

INFORMATION An instance of a type of Structure the informa- You are designing how ENTRY information needs to be tion collection so that information should be stored in an information it is made up of a set of managed within an infor- collection. information entries. Each mation collection. information entry stores a single instance of the subject area. Provide capability to manage and iterate over a collection of these archetypal instances. INFORMATION What is the appropriate Related information You are selecting the NODE IT infrastructure to host processes and informa- type of system to host information collections tion collections should be information and its and information hosted together in a server. related processing. processes?

Chapter 6 , “Information in Motion,” covers the information flow and information request pattern groups for moving information between information nodes (see Table 1.6 ).

Table 1.6 Pattern Groups in Chapter 6

Lead Pattern Lead Pattern Prob- Lead Pattern Solution Start Here When... Name and Icon lem Statement Summary INFORMATION An information pro- Open a communication link with You want to under- REQUEST cess needs to work the remote information node stand the data that with information and synchronously exchange the flows between two located on a remote information and associated com- communicating information node. mands using an agreed protocol. information nodes. 20 Chapter 1 Introduction

Lead Pattern Lead Pattern Prob- Lead Pattern Solution Start Here When... Name and Icon lem Statement Summary INFORMATION How do you imple- Use an information trigger to You are designing FLOW ment the movement of start an information process to information integra- information between control the movement of infor- tion jobs to move two information mation. This information process information between nodes? is responsible for extracting the different systems. required information from the appropriate sources, reengineering it, and delivering it to the des- tination information nodes.

Chapter 7 , “Information Processing,” covers the different kinds of information processes, along with the information triggers that start them, which are found in a typical organization’s IT systems (see Table 1.7 ).

Table 1.7 Pattern Groups in Chapter 7

Lead Pattern Lead Pattern Problem Lead Pattern Solution Start Here When... Name and Icon Statement Summary INFORMATION An information process When the event is detected, You are considering how TRIGGER must be started when a trigger a mechanism that is to start an information particular event occurs. able to request the initia- process. This information of the process on an tion process may be appropriate information providing a new business node. function or moving information between information collections. INFORMATION An organization has to Formally define and You want to understand PROCESS process information to implement the process- existing processing and support one of its activi- ing for that activity in an or design new processing ties. information node. Ensure of information. this information node has access to the information it needs.

Another key concern for organizations with valuable information is how to protect it so it retains its quality and it is not misused or stolen. This is covered in Chapter 8 , “Information Pro- tection,” (see Table 1.8 ). Pattern Language Structure 21

Table 1.8 Pattern Groups in Chapter 8

Lead Pattern Lead Pattern Problem Lead Pattern Solution Start Here When... Name and Icon Statement Summary INFORMATION An information process is Insert capability to trans- You need to under- REENGINEERING not able to consume the form the information so stand how information STEP information it needs, as cur- it is consumable by the can be transformed rently exists. information process. to meet new requirements.

INFORMATION The organization’s informa- Insert mechanisms into You need to consider GUARD tion needs to be protected the information supply the alternatives for the from inappropriate use and chain to verify that the security and privacy theft. right people are only of your information. using information for authorized purposes.

INFORMATION The operation of an infor- Insert probes into key You need to plan how PROBE mation supply chain needs points in the information information manage- to be monitored to ensure it supply chain to gather ment should be moni- is working properly. measurements for further tored. analysis.

The protection of information is something that must be designed holistically, considering the welfare of key information at all stages of its lifetime. It is then implemented through the deployment of small components throughout the systems, where each is responsible for protecting an aspect of the information. The patterns of information management break down the aspects of information protection into three pattern groups: • I NFORMATION R EENGINEERING S TEP —These patterns focus on maintaining the quality and format of information. • I NFORMATION G UARD —These patterns ensure authorized people and processes are using information for authorized purposes. • I NFORMATION P ROBE —These patterns are used to monitor the use and movement of information. With these patterns, it is possible to detect issues in the management of information and correct it. 22 Chapter 1 Introduction

The information protection patterns are used as processing steps in both the information process and information service pattern groups where they transform, protect, or monitor information as it enters the organization; when it is stored; when it is sent between systems; when it is retrieved, updated, and eventually archived and deleted. Individually, they protect a single point in the processing—collectively, they protect the organization’s information throughout its entire life cycle. The final pattern group in Chapter 9 , “Solutions for Information Management,” covers solutions that tackle different aspects of how information management can be improved. They use the pattern groups described previously as components (see Table 1.9 ).

Table 1.9 Pattern Groups in Chapter 9

Lead Pattern Lead Pattern Problem Lead Pattern Solution Start Here When... Name and Icon Statement Summary INFORMATION An organization recognizes Create a project, or series You want to plan changes SOLUTION there is a missing capabil- of projects, to transform to your information sys- ity or a major issue with the way the information tems to improve informa- the way it manages an is managed by the orga- tion management. aspect of its information. nization’s people and information systems.

Summary This chapter introduced some of the information management challenges an organization faces. Their applications provide the information processes that drive the business. These processes need access to a variety of information to perform their function. This information is distributed and duplicated among the applications and the challenge is to keep this information synchronized while ensuring it is available and suitably structured for all of the organization’s needs. This chapter also introduced the patterns of information management. The patterns of information management are a collection of software design patterns that describe best practices for blending software components together to manage the typical information management challenges that organizations face. These patterns each have a succinct name and icon for use in design discussions. Each pattern also has a tabulated short description called a patlet and a full description that explains when to use it, how it works, and the consequences of using it. Throughout the pattern language, this book uses a fictitious company called MCHS Trad- ing to illustrate the use of the patterns. The patterns are also grouped together around particular information management topics called pattern groups. Each pattern group has a lead pattern that describes the basic mechanism at work and the rest of the patterns in the group are variations of this basic pattern. Summary 23

The first lead pattern for a pattern group that was introduced was information provisioning. This explained the layers of components used to provide information to the organization. We then went on to explain how the pattern language is structured and where each of the pattern groups are located in the book. Now that you have seen the pattern groups in the pattern language, you can choose to navigate directly to the patterns of interest. Alternatively, Chapter 2 describes how MCHS Trading used the patterns to transform its information systems through a series of projects. This page intentionally left blank This page intentionally left blank Index

A analytics process patterns, 517 bespoke application process access auditing probe pattern, information pattern discovery pattern, 470 - 472 575 process pattern, 518 - 520 big data and warehouse patterns, accessing stored information, 16 anonymize data pattern, 571 information solution patterns, ACMNM field, information anonymizing, 568 618 values profile pattern, 158 application node, 64 historical system of record ACTID field, information values application node pattern, pattern, 619 - 624 profile pattern, 158 324 - 329 , 599 workload offload pattern, ACXDT field, information application private provisioning 624 - 626 values profile pattern, 158 pattern, 166 , 169 - 171 big data information processing, adding customer details, 41 applications, 1 - 2 376 aggregate key pattern, 294 , archiving process, 193 information warehouse 307 - 309 archiving process pattern, 324 pattern, 377 - 379 agile business process pattern, attribute-level information map-reduce node pattern, 177 , 470 , 474 - 476 elements, 122 382 - 385 agile business processes, 44 information code pattern, streaming analytics node analysis information nodes, 126 - 128 pattern, 380 - 382 385 - 386 information link pattern, broadcast distribution pattern, information analysis node 123 - 124 433 , 444 - 446 pattern, 386 - 389 information metric pattern, buffered routing pattern, 407 , information decision 124 - 126 413 - 415 definition process pattern, authentication, 568 business analyst pattern, 97 521 - 523 authorization, 568 business information nodes, 324 information mining store application node pattern, pattern, 389 326 - 329 information pattern detecting B information content node processes pattern, 523 - 525 B2B trading partnerships, 51 - 55 pattern, 330 - 332 batch information request information cube pattern, pattern, 399 340 - 342

669 670 Index

information mart pattern, check data pattern, 139 , 539 , cascading information supply 337 - 340 548 - 550 chain pattern, 213 information store pattern, classifications, product details, centralized master pattern, 334 - 337 33 - 34 606 search node pattern, 332 - 334 classify data pattern, 539 , check data pattern, 549 business intelligence and 546 - 548 classify data pattern, 547 - 548 analytics patterns, information clerical review process pattern, clerical review process solution patterns, 626 484 , 487 - 489 pattern, 488 next best action pattern, collaborative editing process, 33 collaborative editing process 630 - 633 collaborative editing process pattern, 480 operational analytics pattern, pattern, 372 , 470 , 479 - 481 complete scope pattern, 282 628 - 629 collection control pattern, 571 consolidating information performance reporting collection-level provisioning, supply chain pattern, 224 pattern, 626 - 628 162 , 185 - 186 correct data pattern, 550 business processes pattern, event-based provisioning daisy chain provisioning 469 - 470 pattern, 196 - 197 pattern, 176 agile business process mirroring provisioning derive relationship pattern, pattern, 474 - 476 pattern, 189 - 193 563 bespoke application process peer provisioning pattern, derive value pattern, 561 pattern, 471 - 472 193 - 195 distributed activity status collaborative editing process recovery provisioning pattern, pattern, 591 pattern, 479 - 481 197 - 198 enrich data pattern, 545 - 546 information reporting snapshot provisioning event correlation node processes pattern, 481 - 483 pattern, 186 - 188 pattern, 359 packaged application process complete coverage pattern, 33 , event-based provisioning pattern, 472 - 474 285 pattern, 196 state driven process, 476 - 479 complete scope, 8 , 10 , 32 external sensor trigger complete scope pattern, 279 - 282 pattern, 464 concentrating information supply filtered consolidation pattern, C chain pattern, 209 425 - 426 cache provisioning pattern, 178 , consequences filtered routing pattern, 417 183 - 185 aggregate key pattern, 308 golden reference pattern, 612 caller's key pattern, 294 , 310 - 312 agile business process hierarchical information canonical-based payload pattern, pattern, 475 supply chain pattern, 227 121 application node pattern, historical system of record cascading information supply 328 - 329 pattern, 622 chain pattern, 210 - 215 application private hub interchange information centralized master, 215 provisioning pattern, 170 supply chain pattern, centralized master pattern, 36 , bespoke application process 217 - 218 599 , 604 - 606 pattern, 472 hybrid usage pattern, 276 changing customer details, 42 broadcast distribution pattern, independent consolidation changing information nodes, 445 pattern, 431 information solution patterns, buffered routing pattern, 415 independent distribution 582 - 583 cache provisioning pattern, pattern, 442 - 443 information node upgrade 185 information access audit pattern, 587 - 589 caller's key pattern, 311 pattern, 637 new information node information activity hub pattern, 582 - 587 pattern, 375 Index 671

information activity pattern, information guard pattern, information processing 111 569 variables pattern, 115 information analysis node information identification information profile tracking pattern, 386 - 389 patterns, 132 processes pattern, 486 information archiving process information key pattern, 296 information provisioning pattern, 498 information lineage pattern, patterns, 165 information asset hub pattern, 160 information queueing process 371 information link pattern, pattern, 510 information asset pattern, 109 123 - 124 information reengineering information broadcasting information location pattern, steps pattern, 536 process pattern, 512 147 information registry pattern, information brokers pattern, information management 609 347 obligation pattern, 79 information relocation information centric information management process pattern, 506 organization pattern, 75 principle pattern, 85 information remediation information change trigger information management process pattern, 490 pattern, 462 strategy pattern, 82 - 83 information replication information code pattern, 127 information mart pattern, 339 process pattern, 501 - 502 information collection information matching process information reporting pattern, 257 pattern, 495 processes pattern, 482 information configuration information metric pattern, information request pattern, pattern, 140 125 398 information content node information mining store information scavenging pattern, 332 pattern, 391 process pattern, 516 information cube pattern, information mirror store information schema pattern, 341 - 342 pattern, 363 144 information decision information model pattern, information service patterns, definition process pattern, 142 241 522 information monitoring information service trigger information deployment pattern, 640 - 641 pattern, 460 process pattern, 503 information node information solution patterns, information element patterns, management process 581 104 pattern, 529 information store pattern, information entry patterns, information node patterns, 336 - 337 291 323 information streaming information event pattern, information node upgrade process pattern, 380-382 114 pattern, 588 - 589 information summarizing information event store information pattern detecting process pattern, 514 - 515 pattern, 365 processes pattern, 524 information summary pattern, information ever-greening information pattern discovery 118 process pattern, 497 process pattern, 519 - 520 information supply chain information federation information payload pattern, patterns, 206 process pattern, 508 120 - 121 information trigger patterns, information flow pattern, information probe patterns, 452 404 - 405 573 information user pattern, information governance information process pattern, 93 - 94 program pattern, 90 469 information validation process pattern, 492 - 493 672 Index

information values profile peer provisioning pattern, 194 summarized routing pattern, pattern, 156 - 158 performance reporting 419 information values report pattern, 627 synchronized consolidation pattern, 155 physical information pattern, 423 information warehouse collection pattern, 262 synchronized distribution pattern, 378 - 379 queue manager pattern, pattern, 434 - 435 link entries pattern, 555 351 - 352 synchronized masters pattern, linked information recovery provisioning 616 provisioning pattern, 183 pattern, 198 transient scope pattern, 285 local information service recycled key patterns, 302 triggering information service patterns, 245 reference usage pattern, 272 pattern, 251 - 252 local key patterns, 299 remote information service user private provisioning local scope pattern, 283 patterns, 249 pattern, 168 look-up table node pattern, restructure data pattern, user shared provisioning 357 540 - 541 pattern, 179 managed archive pattern, 635 sample data pattern, 566 valid values definition manual information trigger sandbox usage pattern, 278 pattern, 138 pattern, 455 scheduled information trigger virtual information collection map-reduce node pattern, 384 pattern, 457 pattern, 265 master usage pattern, 270 scheduling process pattern, workload offload pattern, 625 merge entries pattern, 557 531 consolidating information flows, mirroring provisioning search node pattern, 334 66 pattern, 191 semantic integration pattern, consolidating information flows natural key pattern, 304 596 pattern, 420 new information node semantic mapping pattern, filtered consolidation pattern, pattern, 586 152 424 - 427 next best action pattern, 632 semantic tagging pattern, 149 independent consolidation operational analytics pattern, separate entries pattern, 559 pattern, 429 - 432 629 service oriented provisioning ordered consolidation pattern, operational health monitoring pattern, 181 427 - 429 process pattern, 528 shared master pattern, 603 synchronized consolidation operational status store single view information pattern, 421 - 424 pattern, 366 - 367 supply chain pattern, consolidating information supply ordered consolidation pattern, 221 - 222 chain pattern, 223 - 225 428 smooth data pattern, 564 context ordered distribution pattern, snapshot provisioning aggregate key pattern, 307 440 - 441 pattern, 188 agile business process packaged application process stable key pattern, 314 pattern, 474 pattern, 473 staged routing pattern, 408 application node pattern, 326 partitioned distribution staging area pattern, 354 - 355 application private pattern, 437 standardize data pattern, provisioning pattern, 169 partitioned routing pattern, 543 - 544 bespoke application process 411 state driven process, 477 pattern, 471 partner collaboration pattern, streaming analytics node broadcast distribution pattern, 598 pattern, 381 - 382 444 peer exchange information subject area definition buffered routing pattern, 413 supply chain, 231 - 232 pattern, 135 cache provisioning pattern, 184 Index 673

caller's key pattern, 310 information activity pattern, information key pattern, 295 cascading information supply 110 information lineage pattern, chain pattern, 211 information analysis node 159 centralized master pattern, pattern, 386 information link pattern, 123 604 information archiving process information location pattern, check data pattern, 548 pattern, 497 145 classify data pattern, 546 information asset hub pattern, information management clerical review process 368 obligation pattern, 78 pattern, 487 information asset pattern, 106 information management collaborative editing process information broadcasting principle pattern, 83 pattern, 479 process pattern, 511 information management complete scope pattern, 279 information brokers pattern, strategy pattern, 81 consolidating information 343 information mart pattern, 337 supply chain pattern, 223 information change trigger information matching process correct data pattern, 550 pattern, 460 pattern, 493 daisy chain provisioning information code pattern, 126 information metric pattern, pattern, 172 information collection 124 derive relationship pattern, pattern, 254 information mining store 562 information configuration pattern, 389 derive value pattern, 560 pattern, 139 information mirror store distributed activity status information content node pattern, 360 pattern, 590 pattern, 330 information model pattern, enrich data pattern, 545 information cube pattern, 340 141 event correlation node information decision information monitoring pattern, 358 definition process pattern, pattern, 638 event-based provisioning 521 information node pattern, 196 information deployment management process external sensor trigger process pattern, 502 pattern, 528 pattern, 462 information element patterns, information node patterns, filtered consolidation pattern, 101 320 424 information entry patterns, information node upgrade filtered routing pattern, 416 289 pattern, 587 golden reference pattern, 610 information event pattern, information pattern detecting hierarchical information 113 processes pattern, 523 supply chain pattern, 225 information event store information pattern discovery historical system of record pattern, 364 process pattern, 518 pattern, 619 information ever-greening information payload pattern, hub interchange information process pattern, 496 119 supply chain pattern, 215 information federation information probe patterns, hybrid usage pattern, 274 process pattern, 507 572 independent consolidation information flow pattern, 403 information process pattern, pattern, 429 information governance 466 independent distribution program pattern, 88 information processing pattern, 441 information guard pattern, variables pattern, 114 information access audit 567 information profile tracking pattern, 636 information identification processes pattern, 483 information activity hub patterns, 129- 130 pattern, 372 674 Index

information provisioning information warehouse physical information patterns, 163 pattern, 377 collection pattern, 259 information queueing process link entries pattern, 553 queue manager pattern, 349 pattern, 509 linked information recovery provisioning information reengineering provisioning pattern, 182 pattern, 197 steps pattern, 534 local information service recycled key patterns, 300 information registry pattern, patterns, 243 reference usage pattern, 271 607 local key patterns, 297 remote information service information relocation local scope pattern, 282 patterns, 246 process pattern, 505 look-up table node pattern, restructure data pattern, 538 information remediation 356 sample data pattern, 565 process pattern, 489 managed archive pattern, 634 sandbox usage pattern, 277 information replication manual information trigger scheduled information trigger process pattern, 499 pattern, 453 pattern, 455 information reporting map-reduce node pattern, 382 scheduling process pattern, processes pattern, 481 master usage pattern, 267 530 information request pattern, merge entries pattern, 556 search node pattern, 332 396 mirror key pattern, 305- 306 semantic integration pattern, information scavenging mirroring provisioning 593 process pattern, 515 pattern, 189 semantic mapping pattern, information schema pattern, natural key pattern, 302 - 303 150 143 new information node semantic tagging pattern, 148 information service patterns, pattern, 582 separate entries pattern, 558 238 next best action pattern, 630 service oriented provisioning information service trigger operational analytics pattern, pattern, 179 pattern, 458 628 shared master pattern, 601 information solution patterns, operational health monitoring single view information 578 process pattern, 527 supply chain pattern, 219 information store pattern, 334 operational status store smooth data pattern, 563 information streaming pattern, 366 snapshot provisioning process pattern, 380-382 ordered consolidation pattern, pattern, 186 information summarizing 427 stable key pattern, 312 process pattern, 513 ordered distribution pattern, staged routing pattern, 406 information summary pattern, 439 staging area pattern, 353 117 packaged application process standardize data pattern, 542 information supply chain pattern, 472 state driven process, 476 patterns, 200 partitioned distribution streaming analytics node information trigger patterns, pattern, 436 pattern, 380 450 partitioned routing pattern, subject area definition information user pattern, 92 410 pattern, 134 information validation partner collaboration pattern, summarized routing pattern, process pattern, 491 597 418 information values profile peer exchange information synchronized consolidation pattern, 156 supply chain, 230 pattern, 421 information values report peer provisioning pattern, 193 synchronized distribution pattern, 153 performance reporting pattern, 432 pattern, 626 Index 675

synchronized masters pattern, D entity-level information 613 daisy chain provisioning pattern, elements, 106 - 107 transient scope pattern, 284 112 , 172 - 177 , 250 , 253 information activity pattern, triggering information service data dictionaries, subject area 110 - 112 pattern, 250 definition pattern, 136 information asset pattern, user private provisioning data quality analyst pattern, 97 106 - 110 pattern, 167 data scientist pattern, 97 information event pattern, user shared provisioning data stewards, 150 113 - 114 pattern, 177 data-centric access pattern, 571 information processing valid values definition deferred update pattern, 318 variables pattern, 114 - 116 pattern, 136 delete information request information summary pattern, virtual information collection pattern, 398 117 - 119 pattern, 263 deleting customer details, 42 - 43 entry uniqueness probe pattern, workload offload pattern, 624 derive relationship pattern, 539 , 575 copies of information, 562 - 563 entry-level structure pattern, 316 differences, 14 derive value pattern, 539 , environment probe pattern, 575 core coverage, 33 560 - 562 E-Shop core coverage pattern, 286 - 285 differences, copies of customer details, 37 correct data pattern, 50 , 539 , information, 14 information, 50 550 - 552 distributed activity status pattern, event correlation node pattern, coverage patterns 177 , 590 - 593 343 , 358 - 360 , 382 complete coverage pattern, distributed locking pattern, 317 event information request 285 distributing information flows pattern, 399 core coverage pattern, pattern, 432 - 433 event-based provisioning pattern, 285 - 286 broadcast distribution pattern, 185 , 196 - 197 extended coverage pattern, 444 - 446 ever-greening process pattern, 51 285 - 286 independent distribution examples local coverage pattern, 287 pattern, 441 - 444 aggregate key pattern, 307 create information request ordered distribution pattern, agile business process pattern, 398 439 - 441 pattern, 474 customer details, 103 partitioned distribution application node pattern, 326 adding, 41 pattern, 436 - 439 application private changing, 42 synchronized distribution provisioning pattern, 169 creating, 41 pattern, 432 - 435 bespoke application process creating single view of, 37 - 42 dynamic structure pattern, 316 pattern, 471 deleting, 42 - 43 broadcast distribution pattern, E-Shop, 37 444 sources of, 38 E buffered routing pattern, 413 Stores, 37 EDI (Electronic Data cache provisioning pattern, updating, 42 - 43 Interchange), 53 184 customer details, merging into Electronic Data Interchange caller's key pattern, 310 Reporting Hub, 39 (EDI), 53 cascading information supply Customer Hub, 40 - 41 emergent properties, 5 chain pattern, 211 information supply chains, encrypt data pattern, 571 centralized master pattern, 208 encryption, 569 604 Customer-Care application, 44 enrich data pattern, 50 , 539 , check data pattern, 548 - 549 customers, MCHS trading, 3 - 4 545 - 546 classify data pattern, 546 - 547 676 Index

clerical review process information asset hub pattern, information location pattern, pattern, 487 368 145 collaborative editing process information asset pattern, 106 information management pattern, 479 information broadcasting obligation pattern, 78 complete scope pattern, 279 process pattern, 511 information management consolidating information information brokers pattern, principle pattern, 84 supply chain pattern, 223 344 information management correct data pattern, 550 - 551 information centric strategy pattern, 81 daisy chain provisioning organization pattern, 73 information mart pattern, 337 pattern, 173 information change trigger information matching process derive relationship pattern, pattern, 461 pattern, 494 562 information code pattern, 126 information metric pattern, derive value pattern, 560 information collection 125 distributed activity status pattern, 254 information mining store pattern, 590 information configuration pattern, 390 enrich data pattern, 545 pattern, 139 information mirror store event correlation node information content node pattern, 360 - 362 pattern, 359 pattern, 330 information model pattern, event-based provisioning information cube pattern, 340 141 pattern, 196 information decision information monitoring external sensor trigger definition process pattern, pattern, 638 pattern, 463 521 information node filtered consolidation pattern, information deployment management process 424 process pattern, 502 pattern, 529 filtered routing pattern, 416 information element patterns, information node patterns, golden reference pattern, 610 101 321 hierarchical information information entry patterns, information node upgrade supply chain pattern, 226 289 pattern, 587 historical system of record information event pattern, information pattern detecting pattern, 619 113 processes pattern, 523 hub interchange information information event store information pattern discovery supply chain pattern, 215 pattern, 364 process pattern, 518 hybrid usage pattern, 275 information ever-greening information payload pattern, independent consolidation process pattern, 496 120 pattern, 430 information federation information probe patterns, independent distribution process pattern, 507 572 pattern, 442 information flow pattern, 403 information process pattern, information access audit information governance 466 pattern, 636 program pattern, 88 information processing information activity hub information guard pattern, variables pattern, 115 pattern, 373 567 information profile tracking information activity pattern, information identification processes pattern, 485 110 patterns, 130 information provisioning information analysis node information key pattern, 295 patterns, 163 pattern, 387 information lineage pattern, information queueing process information archiving process 159 pattern, 509 pattern, 498 information link pattern, 123 Index 677

information reengineering local information service recycled key patterns, 300 steps pattern, 535 patterns, 244 reference usage pattern, 271 information registry pattern, local key patterns, 297 remote information service 607 local scope pattern, 283 patterns, 247 information relocation look-up table node pattern, restructure data pattern, 540 process pattern, 505 356 sample data pattern, 565 information remediation managed archive pattern, 634 sandbox usage pattern, 277 process pattern, 489 manual information trigger scheduled information trigger information replication pattern, 454 pattern, 456 process pattern, 501 map-reduce node pattern, 383 scheduling process pattern, information reporting master usage pattern, 268 530 processes pattern, 481 merge entries pattern, 556 search node pattern, 333 information request pattern, mirror key pattern, 306 semantic integration pattern, 396 mirroring provisioning 594 information scavenging pattern, 189 semantic mapping pattern, process pattern, 516 natural key pattern, 303 151 information schema pattern, new information node semantic tagging pattern, 148 143 pattern, 582 separate entries pattern, 559 information service patterns, next best action pattern, 630 service oriented provisioning 238 operational analytics pattern, pattern, 180 information service trigger 628 shared master pattern, 601 pattern, 458 operational health monitoring single view information information solution patterns, process pattern, 527 supply chain pattern, 219 579 operational status store smooth data pattern, 564 information store pattern, 335 pattern, 366 snapshot provisioning information streaming ordered consolidation pattern, pattern, 187 process pattern, 380-382 427 stable key pattern, 313 information summarizing ordered distribution pattern, staged routing pattern, 406 process pattern, 514 439 staging area pattern, 353 information summary pattern, packaged application process standardize data pattern, 542 117 pattern, 472 state driven process, 476 information supply chain partitioned distribution streaming analytics node patterns, 200 pattern, 436 pattern, 380 information trigger patterns, partitioned routing pattern, subject area definition 450 410 pattern, 134 information user pattern, 92 partner collaboration pattern, summarized routing pattern, information validation 598 418 process pattern, 492 peer exchange information synchronized consolidation information values profile supply chain, 230 pattern, 421 pattern, 156 peer provisioning pattern, 193 synchronized distribution information values report performance reporting pattern, 432 pattern, 153 pattern, 627 synchronized masters pattern, information warehouse physical information 614 pattern, 377 collection pattern, 259 transient scope pattern, 284 link entries pattern, 553 queue manager pattern, 349 triggering information service linked information recovery provisioning pattern, 250 provisioning pattern, pattern, 197 user private provisioning 182 - 183 pattern, 167 678 Index

user shared provisioning external sensor trigger information deployment pattern, 177 pattern, 464 process pattern, 504 valid values definition filtered consolidation pattern, information element patterns, pattern, 137 426 104 virtual information collection filtered routing pattern, 417 information entry patterns, pattern, 264 golden reference pattern, 612 291 workload offload pattern, 624 hierarchical information information event pattern, examples resolved supply chain pattern, 228 114 aggregate key pattern, 309 historical system of record information event store agile business process pattern, 623 pattern, 365 pattern, 475 - 476 hub interchange information information ever-greening application node pattern, 329 supply chain pattern, 218 process pattern, 497 application private hybrid usage pattern, 276 information federation provisioning pattern, 171 independent distribution process pattern, 508 bespoke application process pattern, 443 information flow pattern, 405 pattern, 472 information access audit information governance broadcast distribution pattern, pattern, 637 program pattern, 90 446 information activity hub information guard pattern, buffered routing pattern, 415 pattern, 375 569 cache provisioning pattern, information activity pattern, information identification 185 112 patterns, 132 - 133 caller's key pattern, 311 information analysis node information key pattern, 296 cascading information supply pattern, 389 information lineage pattern, chain pattern, 213 - 214 information archiving process 160 centralized master pattern, pattern, 498 information link pattern, 124 606 information asset hub pattern, information location pattern, check data pattern, 549 - 550 371 147 classify data pattern, 548 information asset pattern, information management clerical review process 109 - 110 obligation pattern, 80 pattern, 488 - 489 information broadcasting information management collaborative editing process process pattern, 512 principle pattern, 85 - 88 pattern, 480 information brokers pattern, information management complete scope pattern, 281 347 - 348 strategy pattern, 83 consolidating information information centric information mart pattern, 340 supply chain pattern, 224 organization pattern, 75 - 77 information matching process correct data pattern, 552 information change trigger pattern, 495 daisy chain provisioning pattern, 462 information metric pattern, pattern, 176 - 177 information code pattern, 127 126 derive relationship pattern, information collection information mining store 563 pattern, 257 pattern, 392 derive value pattern, 561 information configuration information mirror store distributed activity status pattern, 140 pattern, 363 pattern, 592 information content node information model pattern, enrich data pattern, 546 pattern, 332 142 event correlation node information cube pattern, 342 information monitoring pattern, 359 information decision pattern, 641 event-based provisioning definition process pattern, pattern, 197 522 Index 679

information node information solution patterns, operational health monitoring management process 581 - 582 process pattern, 528 pattern, 529 information store pattern, 337 operational status store information node patterns, information streaming pattern, 367 324 process pattern, 380-382 ordered consolidation pattern, information node upgrade information summarizing 429 pattern, 589 process pattern, 513 -515 ordered distribution pattern, information pattern detecting information summary pattern, 441 processes pattern, 524 118 packaged application process information pattern discovery information supply chain pattern, 473 process pattern, 520 patterns, 207 - 208 partitioned distribution information payload pattern, information trigger patterns, pattern, 438 121 - 122 452 partitioned routing pattern, information probe patterns, information user pattern, 94 411 - 412 573 information validation partner collaboration pattern, information process pattern, process pattern, 493 598 - 599 469 information values profile peer exchange information information processing pattern, 157 - 158 supply chain, 232 variables pattern, 116 information values report peer provisioning pattern, 195 information profile tracking pattern, 155 performance reporting processes pattern, 486 information warehouse pattern, 628 information provisioning pattern, 379 physical information patterns, 165 link entries pattern, 555 collection pattern, 262 information queueing process linked information queue manager pattern, 352 pattern, 510 provisioning pattern, 183 recovery provisioning information reengineering local information service pattern, 198 steps pattern, 536 - 537 patterns, 246 recycled key patterns, 302 information registry pattern, local key patterns, 299 reference usage pattern, 273 609 local scope pattern, 283 remote information service information relocation look-up table node pattern, patterns, 249 process pattern, 506 357 - 358 restructure data pattern, 541 information remediation managed archive pattern, 635 sample data pattern, 566 process pattern, 491 manual information trigger sandbox usage pattern, 278 information replication pattern, 455 scheduled information trigger process pattern, 502 map-reduce node pattern, pattern, 457 information reporting 384 - 385 scheduling process pattern, processes pattern, 482 - 483 master usage pattern, 269 531 information request pattern, merge entries pattern, 557 search node pattern, 334 398 mirror key pattern, 307 semantic integration pattern, information scavenging mirroring provisioning 597 process pattern, 516 pattern, 192 semantic mapping pattern, information schema pattern, natural key pattern, 305 152 - 153 145 new information node semantic tagging pattern, information service patterns, pattern, 586 149 - 150 241 - 242 next best action pattern, 632 separate entries pattern, information service trigger operational analytics pattern, 558 -560 pattern, 460 629 service oriented provisioning pattern, 182 680 Index

shared master pattern, 603 flow of information, information filtered consolidation pattern, single view information nodes, 14 - 15 424 - 425 supply chain pattern, 222 forces filtered routing pattern, 416 smooth data pattern, 564 - 565 aggregate key pattern, golden reference pattern, snapshot provisioning 307 - 308 610 - 611 pattern, 188 agile business process hierarchical information stable key pattern, 314 - 315 pattern, 474 supply chain pattern, 226 staged routing pattern, 409 application node pattern, 326 historical system of record staging area pattern, 355 application private pattern, 620 standardize data pattern, 544 provisioning pattern, 169 hub interchange information state driven process, 478 - 479 bespoke application process supply chain pattern, streaming analytics node pattern, 471 215 - 216 pattern, 382 broadcast distribution pattern, hybrid usage pattern, 275 subject area definition 444 independent consolidation pattern, 135 buffered routing pattern, 413 pattern, 430 summarized routing pattern, cache provisioning pattern, independent distribution 420 184 pattern, 442 synchronized consolidation caller's key pattern, 310 information access audit pattern, 423 cascading information supply pattern, 636 - 637 synchronized distribution chain pattern, 211 information activity hub pattern, 434 centralized master pattern, pattern, 373 synchronized masters pattern, 604 - 605 information activity pattern, 616 check data pattern, 549 110 transient scope pattern, 284 classify data pattern, 547 information analysis node triggering information service clerical review process pattern, 387 pattern, 252 pattern, 487 - 488 information archiving process user private provisioning collaborative editing process pattern, 498 pattern, 168 pattern, 479 - 480 information asset hub pattern, user shared provisioning complete scope pattern, 281 368 - 369 pattern, 179 consolidating information information asset pattern, 108 valid values definition supply chain pattern, 223 information broadcasting pattern, 138 correct data pattern, 551 process pattern, 511 virtual information collection daisy chain provisioning information brokers pattern, pattern, 265 pattern, 173 344 workload offload pattern, 625 derive relationship pattern, information centric extended coverage pattern, 33 , 562 organization pattern, 73 - 74 285 - 286 derive value pattern, 561 information change trigger external sensor trigger pattern, distributed activity status pattern, 461 453 , 462 - 465 pattern, 591 information code pattern, 127 enrich data pattern, 545 information collection event correlation node pattern, 255 F pattern, 359 information configuration filtered consolidation flow, 66 event-based provisioning pattern, 139 filtered consolidation pattern, pattern, 196 information content node 420 , 424 - 427 external sensor trigger pattern, 330 filtered routing flow, 65 pattern, 463 information cube pattern, filtered routing pattern, 407 , 340 - 341 416 - 418 Index 681

information decision information monitoring information service trigger definition process pattern, pattern, 638 - 639 pattern, 458 521 information node information solution patterns, information deployment management process 579 - 580 process pattern, 503 pattern, 529 information store pattern, 335 information element patterns, information node patterns, information streaming 101 321 process pattern, 380-382 information entry patterns, information node upgrade information summarizing 289 - 290 pattern, 587 - 588 process pattern, 514 information event pattern, information pattern detecting information summary pattern, 113 processes pattern, 523 117 information event store information pattern discovery information supply chain pattern, 364 process pattern, 519 patterns, 200 - 202 information ever-greening information payload pattern, information trigger patterns, process pattern, 496 120 450 information federation information probe patterns, information user pattern, process pattern, 507 573 92 - 74 information flow pattern, 403 information process pattern, information validation information governance 466 process pattern, 492 program pattern, 88 - 89 information processing information values profile information guard pattern, variables pattern, 115 pattern, 157 567 - 568 information profile tracking information values report information identification processes pattern, 485 pattern, 153 patterns, 131 information provisioning information warehouse information key pattern, patterns, 163 pattern, 377 - 378 295 - 297 information queueing process link entries pattern, 553 information lineage pattern, pattern, 509 linked information 159 information reengineering provisioning pattern, information link pattern, 123 steps pattern, 535 182 - 183 information location pattern, information registry pattern, local information service 145 607 - 608 patterns, 244 information management information relocation local key patterns, 298 obligation pattern, 78 - 79 process pattern, 505 local scope pattern, 283 information management information remediation look-up table node pattern, principle pattern, 84 process pattern, 490 357 information management information replication managed archive pattern, 634 strategy pattern, 81 - 82 process pattern, 501 manual information trigger information mart pattern, 338 information reporting pattern, 454 information matching process processes pattern, 481 - 482 map-reduce node pattern, 383 pattern, 494 information request pattern, master usage pattern, 268 information metric pattern, 396 - 397 merge entries pattern, 557 125 information scavenging mirror key pattern, 306 information mining store process pattern, 516 mirroring provisioning pattern, 390 information schema pattern, pattern, 189 information mirror store 144 natural key pattern, 303 pattern, 362 information service patterns, new information node information model pattern, 239 pattern, 582 - 584 141 - 142 682 Index

next best action pattern, 630 semantic tagging pattern, 149 G operational analytics pattern, separate entries pattern, 559 glossaries, subject area definition 628 service oriented provisioning pattern, 136 operational health monitoring pattern, 180 golden reference pattern, 40 , process pattern, 527 shared master pattern, 599 , 610 - 613 operational status store 601 - 602 pattern, 366 single view information ordered consolidation pattern, supply chain pattern, 220 H 427 smooth data pattern, 564 hard-coded behavior, ordered distribution pattern, snapshot provisioning information configuration 439 pattern, 187 pattern, 139 packaged application process stable key pattern, 313 hierarchical information supply pattern, 473 staged routing pattern, 406 chain pattern, 209 , 225 - 229 partitioned distribution staging area pattern, 353 historical system of record pattern, 436 standardize data pattern, pattern, 29 , 119 , 618 - 624 partitioned routing pattern, 542 - 543 historical values pattern, 318 410 state driven process, 476 - 477 hub interchange information partner collaboration pattern, streaming analytics node supply chain pattern, 195 , 209 , 598 pattern, 380 215 - 219 peer exchange information subject area definition hybrid usage, 45 , 63 supply chain, 230 pattern, 135 hybrid usage pattern, 198 , 229 , peer provisioning pattern, summarized routing pattern, 266 , 274 - 277 193 - 194 418 performance reporting synchronized consolidation pattern, 627 pattern, 422 I physical information synchronized distribution icons, information collection collection pattern, 259 - 261 pattern, 432 icon, 7 queue manager pattern, 349 synchronized masters pattern, identity propagation pattern, 571 recovery provisioning 614 identity verification pattern, 95 , pattern, 197 transient scope pattern, 284 571 recycled key patterns, triggering information service improving information 300 - 301 pattern, 250 - 251 management, 4 - 6 reference usage pattern, 271 user private provisioning independent consolidation remote information service pattern, 168 pattern, 420 , 429 - 432 patterns, 247 user shared provisioning independent distribution pattern, restructure data pattern, 540 pattern, 177 - 179 433 , 441 - 444 sample data pattern, 565 valid values definition information access audit pattern, sandbox usage pattern, 277 pattern, 137 633 , 636 - 638 scheduled information trigger virtual information collection information activity hub, 46 , 112 pattern, 456 pattern, 264 information activity hub pattern, scheduling process pattern, workload offload pattern, 624 361 , 372 - 376 , 591 530 function-centric access pattern, information activity pattern, 45 , search node pattern, 333 571 102 , 107 , 110 - 112 , 116 , 468 semantic integration pattern, information analysis node, 64 594 - 595 information analysis node semantic mapping pattern, pattern, 386 - 389 , 392 , 626 151 information architecture, 99 Index 683

information archiving process information change trigger, 177 information entry key patterns, pattern, 484 , 497 - 499 information change trigger locking, 317 information asset hub, 40 , 109 pattern, 36 , 453 , 460 - 462 information entry pattern, 19 information asset hub pattern, information code pattern, 103 , information entry patterns, 235 , 219 , 223 , 312 , 315 , 361 , 122 , 126 - 128 259 , 288 - 292 , 316 368 - 372 information codes, 128 specialized operations, information asset pattern, 37 , information collection, 12 , 266 317 - 319 102 , 106 - 110 , 372 , 468 information collection icon, 7 information event pattern, 102 , information assets, 30 information collection pattern, 107 , 113 - 114 information at rest patterns, 235 9 , 19 , 109 , 185 , 188 , 192 , 195 , information event store pattern, coverage patterns, 285 - 287 235 , 253 - 259 114 , 361 , 364 - 366 information collection summary, 287 information ever-greening pattern, 253 - 259 information collection usage process pattern, 484 , 496 - 497 information entry patterns, pattern information federation process 288 - 292 , 316 hybrid usage pattern, 274 - 277 pattern, 223 , 500 , 507 - 509 information key patterns, master usage pattern, 267 - 270 information flow pattern, 20 , 29 , 292 - 297 reference usage pattern, 36 , 112 , 165 , 188 , 192 , 195 , information service 271 - 274 283 , 395 implementation patterns, sandbox usage pattern, routing information flows 243 277 - 279 pattern, 406 - 407 information service patterns, information collections, 62 , 129 , summarized routing pattern, 236 - 243 204 446 location of information, 259 information configuration information flow patterns, scope of information pattern, 133 , 139 - 140 401 - 406 collection, 279 - 280 information content node pattern, information flow probe pattern, usage of information 324 , 330 - 332 575 collection, 266 information crawling process information flows, 29 information auditor pattern, 97 pattern, 525 consolidating, 66 information broadcasting information cube pattern, 324 , information governance program process, 194 340 - 342 pattern, 70 , 88 - 91 , 133 information broadcasting process information decision definition information governor pattern, 97 pattern, 500 , 511 - 513 process pattern, 517 , 521 - 523 information guard pattern, 21 , information broker pattern, 14 , information decision definition 95 , 203 , 566 - 571 36 processes, 62 information guards, 533 information brokers, 53 information decision model, 61 information identification information brokers pattern, 128 , information deployment process, patterns, 18 , 49 , 91 , 99 , 183 , 250 , 343 - 348 , 599 50 129 - 133 , 161 , 165 , 188 , 192 , information centric organization information deployment process 195 , 405 , 582 , 587 pattern, 17 , 70 - 78 , 133 pattern, 500 , 502 - 505 information configuration information governance information editing process pattern, 133 , 139 - 140 program pattern, 70 , 88 - 91 pattern, 470 reports, 154 information management information element pattern, 10 information lineage obligation pattern, 78- 81 information element patterns, pattern, 159 - 161 information management 99 - 106 , 129 , 259 information values profile principle pattern, 70 , 83 - 88 information elements, 62 , 103 pattern, 156 - 158 information management information entries, 109 , 177 , information values report, strategy pattern, 70 , 81 - 83 495 153 - 156 summary, 317 - 319 684 Index

subject area definition information mining store pattern, information mirror store pattern, 133 - 136 389 pattern, 360 - 364 valid values definition information mirror store pattern, operation status store pattern, 133 , 136 - 139 360 - 364 pattern, 366 - 368 information in motion patterns, information model pattern, 106 , summary, 393 395 132 , 136 , 141 - 143 information node upgrade information flow pattern, information monitoring pattern, pattern, 506 , 587 - 589 401 - 406 225 , 633 , 638 - 642 information nodes, 12 - 13 , 109 , information request pattern, information monitoring process, 112 , 195 396 - 398 51 flow of information, 14 - 15 information indexing process information node management information activity hub, 46 pattern, 525 process pattern, 526 , 528 - 530 information owners, 49 , 97 information key pattern, information node patterns, 12 - 13 , information owners pattern, 89 292 - 297 19 , 235 , 259 , 319 - 324 , 587 information pattern detecting aggregate key pattern, analysis information nodes, process pattern, 517 307 - 309 385 - 386 information pattern detecting caller's key pattern, 310 - 312 information analysis node processes pattern, 126 , 523 - 525 local key patterns, 297 - 300 pattern, 386 - 389 information pattern detection mirror key pattern, 305 - 307 information mining store process, 61 - 62 natural key pattern, 302 - 305 pattern, 389 information pattern discovery recycled key patterns, big data information process pattern, 517 - 520 300 - 302 processing, 376 information payload pattern, 103 , stable key pattern, 312 - 315 information warehouse 112 , 119 - 122 , 177 information keys pattern, 124 pattern, 377 - 379 supplementary patterns, 121 information lineage pattern, map-reduce node pattern, information principle pattern, 153- 154 , 158 - 161 382 - 385 158 information link pattern, 103 , streaming analytics node information probe pattern, 21 , 105 , 122 - 124 pattern, 380 - 382 570 information location pattern, integration nodes, 343 information probe patterns, 197 , 136 , 145 - 148 , 158 event correlation node 203 , 533 , 572 - 575 information location resources, pattern, 358 - 360 information probes pattern, 95 132 information brokers information process pattern, 16 , information management, pattern, 343 - 348 93- 95 , 112 , 116 , 465 - 469 improving, 4 - 6 look-up table node business processes pattern, information management pattern, 356 - 358 469 - 470 obligation pattern, 70 , 78 - 81 queue manager pattern, information processes, 12 information management 349 - 353 information processes pattern, principle pattern, 70 , 83 - 89 staging area pattern, 140 , 449 , 531 - 532 information management 353 - 356 information processing patterns, strategy pattern, 70 , 81 - 83 operational data stores and 449 information mart pattern, 324 , hubs, 360 - 361 information trigger patterns, 337 - 340 information activity hub 450 - 452 information matching process pattern, 372 - 376 information processing variables pattern, 484 , 493 - 495 information asset hub pattern, 102 - 103 , 107 , 112 , information metric pattern, 103 , pattern, 368 - 372 114 - 116 122 , 124 - 126 information event store information profile tracking information mining store, 64 , pattern, 364 - 366 process, 49 , 51 , 59 386 Index 685

information profile tracking initiate process information next best action pattern, processes pattern, 483 - 486 request, 399 630 - 633 information protection, 21 , 533 retrieve collection operational analytics information protection patterns, information request pattern, pattern, 628 - 629 633 400 performance reporting information access audit retrieve cursor information pattern, 626 - 628 pattern, 636 - 638 request, 400 changing information nodes, information monitoring retrieve one information 582 - 583 pattern, 638 - 642 request, 400 information node upgrade managed archive pattern, run process information pattern, 587 - 589 634 - 636 request, 399 new information node information provisioning pattern, summary, 401 pattern, 582 - 587 12 , 18 , 64 update information request information protection. See information provisioning pattern, 398 information protection patterns, 99 , 161 - 165 , 199 , 324 , information scavenging process patterns 405 , 468 pattern, 500 , 515 - 517 integrating information information quality processes, 49 information schema pattern, 106 , nodes, 590 information queueing process 141 , 143 - 145 distributed activity status pattern, 356 , 500 , 509 - 511 information search process pattern, 590 - 593 information reengineering, 157 pattern, 525 partner collaboration information reengineering steps, information service pattern, 597 - 599 21 , 50 , 188 implementation patterns, 243 semantic integration information reengineering steps local information service pattern, 593 - 597 pattern, 21 , 533 - 538 patterns, 243 - 246 summary, 642 information registry pattern, 599 , remote information service information solutions, 577 - 578 607 - 609 patterns, 246 - 250 partner collaboration pattern, information relocation process triggering information service 55 pattern, 500 , 505 - 506 pattern, 250 - 253 information stewards, 89 information remediation process information service pattern, 19 information stewards pattern, 97 pattern, 484 , 486 , 489 - 491 information service patterns, information store pattern, 324 , information replication process, 182 , 235 - 243 , 253 334 - 337 406 information service trigger information strategy, 61 information replication process pattern, 453 , 455 , 458 - 460 building an information pattern, 499 - 502 information services, 164 , 217 , strategy, 26 - 28 information reporting processes, 236 - 243 information streaming process 28 , 48 information solution pattern, pattern, 380-382 information reporting processes 22 , 27 information summarizing pattern, 126 , 156 , 481 - 483 information solution patterns, process pattern, 119 , 500 , information request pattern, 13 , 578 - 582 513 - 515 20 , 112 , 122 , 395 - 398 big data and warehouse information summary pattern, batch information request patterns, 618 103 , 107 , 117 - 119 pattern, 399 historical system of record information supply chain pattern, create information request pattern, 619 - 624 15 , 18 , 91 pattern, 398 workload offload pattern, information supply chain delete information request 624 - 626 patterns, 99 , 188 , 199 - 209 , 232 , pattern, 398 business intelligence and 283 event information request analytics patterns, 626 cascading information supply pattern, 399 chain pattern, 211 - 215 686 Index

consolidating information information owners pattern, queue manager pattern, supply chain pattern, 97 349 - 353 223 - 225 information stewards pattern, staging area pattern, 353 - 356 hierarchical information 97 interaction analysis pattern, 571 supply chain pattern, information worker pattern, IT service management 225 - 229 97 processes, 526 hub interchange information infrastructure operator supply chain pattern, pattern, 97 215 - 219 information users, 12 , 48 , 188 K peer exchange information information validation process known uses supply chain, 230 - 232 pattern, 484 , 491 - 493 aggregate key pattern, 309 single view information information values profile agile business process supply chain pattern, pattern, 132 , 139 , 150 , pattern, 476 219 - 223 153- 154 , 156 - 158 application node pattern, 329 information supply chains, 56 information values profiles, 51 application private information collections, information values report, 154 provisioning pattern, 171 204 - 206 information values report bespoke application process parts of, 203 - 204 pattern, 153 - 156 pattern, 472 information trigger pattern, 16 , information warehouse pattern, broadcast distribution pattern, 449 29 , 376 - 379 446 information trigger patterns, 192 , information warehouses, 379 buffered routing pattern, 415 195 , 450 - 453 information warehouses pattern, cache provisioning pattern, external sensor trigger 156 185 pattern, 462 - 465 information worker pattern, 97 caller's key pattern, 312 information change trigger information workers, 325 , 483 cascading information supply pattern, 460 - 462 infrastructure operator pattern, chain pattern, 215 information service trigger 97 centralized master pattern, pattern, 458 - 460 initiate process information 606 manual information trigger request, 399 check data pattern, 550 pattern, 453 - 455 integrating information nodes, classify data pattern, 548 scheduled information trigger information solution patterns, clerical review process pattern, 455 - 457 590 pattern, 489 summary, 465 distributed activity status collaborative editing process information triggers, 12 , 35 , 114 , pattern, 590 - 593 pattern, 481 164 , 177 partner collaboration pattern, complete scope pattern, 282 operational analytics, 59 597 - 599 consolidating information information usage collection semantic integration pattern, supply chain pattern, 225 patterns, 266 593 - 597 correct data pattern, 552 information user pattern, 17 , integration nodes, 343 daisy chain provisioning 91 - 95 event correlation node pattern, 177 business analyst pattern, 97 pattern, 358 - 360 derive relationship pattern, data quality analyst pattern, information brokers pattern, 563 97 343 - 348 derive value pattern, 561 data scientist pattern, 97 information node patterns, distributed activity status information auditor pattern, 343 pattern, 593 97 look-up table node pattern, enrich data pattern, 546 information governor pattern, 356 - 358 event correlation node 97 pattern, 360 Index 687

event-based provisioning information cube pattern, 342 information monitoring pattern, 197 information decision pattern, 641 external sensor trigger definition process pattern, information node pattern, 464 522 management process filtered consolidation pattern, information deployment pattern, 530 426 process pattern, 504 information node patterns, filtered routing pattern, 417 information element patterns, 324 golden reference pattern, 613 105 - 106 information node upgrade hierarchical information information entry patterns, pattern, 589 supply chain pattern, 229 291 information pattern detecting historical system of record information event pattern, processes pattern, 524 pattern, 623 114 information pattern discovery hub interchange information information event store process pattern, 520 supply chain pattern, 219 pattern, 365 - 367 information payload pattern, hybrid usage pattern, 276 information ever-greening 122 independent consolidation process pattern, 497 information probe patterns, pattern, 431 - 437 information fed, 508 574 independent distribution information flow pattern, 405 information process pattern, pattern, 443 information governance 469 information access audit program pattern, 91 information processing pattern, 637 information guard pattern, variables pattern, 116 information activity hub 570 information profile tracking pattern, 376 information identification processes pattern, 486 information activity pattern, patterns, 133 information provisioning 112 information key pattern, 297 patterns, 165 information analysis node information lineage pattern, information queueing process pattern, 389 160 - 161 pattern, 511 information archiving process information link pattern, 124 information reengineering pattern, 499 information location pattern, steps pattern, 537 information asset hub pattern, 147 - 148 information relocation 372 information management process pattern, 506 information asset pattern, 109 obligation pattern, 80 - 81 information remediation information broadcasting information management process pattern, 491 process pattern, 513 principle pattern, 88 information replication information brokers pattern, information management process pattern, 502 348 strategy pattern, 83 information reporting information centric information mart pattern, 340 processes pattern, 483 organization pattern, 77 information matching process information request pattern, information change trigger pattern, 495 398 pattern, 462 information metric pattern, information scavenging information code pattern, 128 126 process pattern, 517 information collection information mining store information schema pattern, pattern, 258 pattern, 392 145 information configuration information mirror store information service patterns, pattern, 140 pattern, 363 242 information content node information model pattern, information service trigger pattern, 332 143 pattern, 460 688 Index

information solution patterns, ordered consolidation pattern, snapshot provisioning 582 429 pattern, 188 information store pattern, 337 ordered distribution pattern, stable key pattern, 315 information streaming 441 staged routing pattern, 409 process pattern, 380-382 packaged application process staging area pattern, 355 information summary pattern, pattern, 474 standardize data pattern, 544 119 partitioned distribution state driven process, 479 information supply chain pattern, 438 streaming analytics node patterns, 209 partitioned routing pattern, pattern, 382 information trigger patterns, 412 subject area definition 452 partner collaboration pattern, pattern, 136 information user pattern, 95 599 summarized routing pattern, information validation peer exchange information 420 process pattern, 493 supply chain, 232 synchronized consolidation information values profile peer provisioning pattern, 195 pattern, 423 pattern, 158 performance reporting synchronized distribution information values report pattern, 628 pattern, 435 pattern, 155 - 156 physical information synchronized masters pattern, information warehouse collection pattern, 262 - 263 618 pattern, 379 queue manager pattern, transient scope pattern, 285 link entries pattern, 556 352 - 353 triggering information service linked information recovery provisioning pattern, 252 provisioning pattern, 183 pattern, 198 user private provisioning local information service recycled key patterns, 302 pattern, 168 patterns, 246 reference usage pattern, 274 user shared provisioning local key patterns, 300 remote information service pattern, 179 local scope pattern, 283 patterns, 249 - 250 valid values definition look-up table node pattern, restructure data pattern, 541 pattern, 138 358 sample data pattern, 566 virtual information collection managed archive pattern, 635 sandbox usage pattern, 279 pattern, 265 manual information trigger scheduled information trigger workload offload pattern, 625 pattern, 455 pattern, 457 map-reduce node pattern, 385 scheduling process pattern, master usage pattern, 270 531 L merge entries pattern, 558 search node pattern, 334 latency of the information mirror key pattern, 307 semantic integration pattern, transfer, 6 mirroring provisioning 597 lifecycle states pattern, 318 pattern, 192 semantic mapping pattern, link entries pattern, 539 , 553 - 556 natural key pattern, 305 153 linked information provisioning new information node semantic tagging pattern, 150 pattern, 178 , 182 - 183 , 332 pattern, 586 separate entries pattern, 560 local coverage pattern, 33 , 287 next best action pattern, 632 service oriented provisioning local information service operational analytics pattern, pattern, 182 patterns, 243 - 246 629 shared master pattern, 603 local key patterns, 293 , 297 - 300 operational health monitoring single view information local locking pattern, 317 process pattern, 528 supply chain pattern, 222 local provisioning pattern, 263 operational status store smooth data pattern, 565 local scope, 8 , 10 , 32 pattern, 367 Index 689

local scope pattern, 280 , 282 - 284 master usage pattern, 198 , O localized provisioning, 162 , 266 - 270 ontologies, subject area 166 - 167 MCHS Trading, 2 - 4 , 26 definition pattern, 136 application private B2B trading partnerships, Open Services for Lifecycle and provisioning pattern, 51 - 55 Collaboration (OSLC), 124 169 - 171 building an information operation status store pattern, user private provisioning strategy, 26 - 28 366 - 368 pattern, 167 - 169 creating a single view of operational analytics, 58 location of information, 259 customer details, 37 - 42 operational analytics pattern, physical information creating a single view of 626 , 628 - 629 collection pattern, 259 - 263 product details, 30 - 37 operational data stores and hubs, virtual information collection creating management reports, 360 - 361 pattern, 263 - 266 28 - 30 information activity hub location of order details, 45 customers, 3 - 4 pattern, 372 - 376 locking information entry key delivering information quality information asset hub pattern, patterns, 317 improvements, 47 - 51 368 - 372 look-up table node pattern, 343 , predictive analytics, 55 - 66 information event store 356 - 358 understanding status of pattern, 364 - 366 lookup tables pattern, 128 orders, 44 - 34 information mirror store merge entries pattern, 539 , pattern, 360 - 364 556 - 558 operation status store pattern, M merging customer details into 366 - 368 Mail-Shop, 41 Reporting Hub, 39 operational health monitoring managed archive pattern, 624 , message-level information process pattern, 324 , 526 - 528 633 - 636 elements, information payload operational health probe pattern, management reports, creating, pattern, 119 - 122 575 28 - 30 metadata collection, 150 operational management manual information trigger mirror key pattern, 293 , 305 - 307 information process patterns, pattern, 453 - 455 mirror provisioning, 217 526 map-reduce node pattern, 376 , mirroring provisioning, 33 - 35 , information node 382 - 385 64 , 190 - 191 management process mask data pattern, 571 mirroring provisioning pattern, pattern, 528 - 530 masking, 568 185 , 189 -193 , 362 operational health monitoring master data, 105 M-Shop, 41 process pattern, 527 - 528 master data management scheduling process pattern, patterns, 599 - 601 530 - 531 centralized master pattern, N operational status store pattern, 604 - 606 naming conventions, patterns, 7 219 , 361 golden reference pattern, natural key pattern, 293 , 302 - 305 optimistic locking pattern, 317 610 - 613 new information node pattern, order details, location of, 45 information registry pattern, 582 - 587 order information, 112 607 - 609 New Order, information ordered consolidation pattern, shared master pattern, processing variables pattern, 420 , 427 - 429 601 - 603 116 ordered distribution pattern, 433 , synchronized masters pattern, next best action pattern, 626 , 439 - 441 613 - 618 630 - 633 orders, status of, 34 - 44 master usage, 31 690 Index

Order-Tracking, 46 - 47 , 375 business intelligence and data-centric access pattern, OSLC (Open Services for analytics patterns, 626 571 Lifecycle and Collaboration), business processes pattern, deferred update pattern, 318 124 469 - 470 delete information request cache provisioning pattern, pattern, 398 178 , 183 - 185 derive relationship pattern, P caller's key pattern, 294 , 539 , 562 - 563 packaged application process, 310 - 312 derive value pattern, 539 , 61 , 64 canonical-based payload 560 - 562 packaged application process pattern, 121 distributed activity status pattern, 470 , 472 - 474 cascading information supply pattern, 177 , 590 - 593 partition distribution, 36 chain pattern, 209 distributed locking pattern, partitioned distribution pattern, centralized master pattern, 36 , 317 433 , 436 - 439 215 , 599 , 604 - 606 distributing information flows partitioned routing pattern, 407 , check data pattern, 139 , 539 , pattern, 432 - 433 410 - 412 548 - 550 dynamic structure pattern, partner collaboration pattern, 55 , classify data pattern, 539 , 316 590 , 597 - 599 546 - 548 encrypt data pattern, 571 pattern groups, 7 clerical review process enrich data pattern, 545 - 546 pattern languages, 7 pattern, 484 , 487 - 489 entry uniqueness probe components of, 11 - 12 collaborative editing process pattern, 575 structure, 15 pattern, 372 , 470 , 479 - 481 entry-level structure pattern, patterns, 7 - 11 collection control pattern, 571 316 access auditing probe pattern, complete coverage pattern, environment probe pattern, 575 33 , 285 575 aggregate key pattern, 294 , complete scope, 10 , 32 event correlation node 307 - 309 complete scope pattern, 280 pattern, 343 , 358 - 360 , 382 agile business process pattern, concentrating information event information request 177 , 470 , 474 - 476 supply chain pattern, 209 pattern, 399 analytics process patterns, consolidating information event-based provisioning 517 flows pattern, 420 pattern, 185 , 196 - 197 anonymize data pattern, 571 consolidating information extended coverage pattern, application node pattern, 324 , supply chain pattern, 33 , 285 - 286 326 - 329 , 599 223 - 225 external sensor trigger application private core coverage pattern, 33 , pattern, 453 , 462 - 465 provisioning pattern, 166 , 285 - 286 filtered consolidation pattern, 169 - 171 correct data pattern, 539 , 420 , 424 - 427 archiving process pattern, 324 550 - 552 filtered routing pattern, batch information request create information request 416 - 418 pattern, 399 pattern, 398 function-centric access bespoke application process daisy chain provisioning pattern, 571 pattern, 470 - 472 pattern, 112 , 172 - 177 , 250 , golden reference pattern, 599 , broadcast distribution pattern, 253 610 - 613 433 , 444 - 446 data quality analyst pattern, hierarchical information buffered routing pattern, 97 supply chain pattern, 209 , 413 - 415 data scientist pattern, 97 225 - 229 business analyst pattern, 97 Index 691

historical system of record information collection information guard pattern, 21 , pattern, 119 , 618 - 624 pattern, 19 , 109 , 192 , 195 , 95 , 203 , 566 - 571 historical values pattern, 318 235 information identification, 99 hub interchange information information configuration information identification supply chain pattern, 195 , pattern, 133 , 139 - 140 patterns, 18 , 49 , 129 - 133 , 209 information content node 316 , 582 , 587 hybrid usage pattern, 198 , pattern, 324 information indexing process 229 , 266 , 274 - 277 information crawling process pattern, 525 identity propagation pattern, pattern, 525 information keys pattern, 124 , 571 information cube pattern, 292 - 297 identity verification pattern, 324 , 340 - 342 information lineage pattern, 95 , 571 information decision 153- 154 , 159 - 161 independent consolidation definition process pattern, information link pattern, 103 , pattern, 420 , 429 - 432 517 , 521 - 523 122 - 124 independent distribution information deployment information location pattern, pattern, 433 , 441 - 444 process pattern, 500 , 136 , 145 - 148 , 158 information access audit 502 - 505 information management pattern, 633 , 636 - 638 information editing process obligation pattern, 70 , 78 - 81 information activity hub, 112 pattern, 470 information management information activity hub information element pattern, principle pattern, 70 , 83 - 88 pattern, 361 , 372 - 376 10 information management information activity pattern, information element patterns, strategy pattern, 70 , 81 - 83 45 , 102 , 107 , 110 - 112 , 116 , 99 , 100 , 101 - 106 , 259 information mart pattern, 324 , 468 information entries, 109 337 - 340 information analysis node information entry pattern, 19 information matching process pattern, 386 - 389 , 626 information entry patterns, pattern, 484 , 493 - 495 information archiving process 235 , 288 - 292 , 317 information metric pattern, pattern, 497 - 499 specialized operations, 103 , 122 , 124 - 126 information asset hub, 109 317 - 319 information mining store, 386 information asset hub pattern, information event pattern, information mining store 219 , 223 , 315 , 361 , 368 - 372 102 , 107 , 113 - 114 pattern, 389 information asset pattern, information event store pattern, information mirror store 102 , 106 - 110 , 468 114 , 361 , 364 - 366 pattern, 360 - 364 information at rest patterns, information ever-greening information model pattern, 235 process pattern, 484 , 106 , 132 , 136 , 141 - 143 information auditor pattern, 496 - 497 information monitoring 97 information federation pattern, 225 , 633 , 638 - 642 information broadcasting process pattern, 223 , 500 , information node, 109 , 112 process pattern, 511 - 513 507 - 509 information node information brokers pattern, information flow pattern, 20 , management process 128 , 183 , 250 , 343 - 348 , 599 112, 192 , 195 , 283 , 395 pattern, 526 , 528 - 530 information centric information flow probe information node patterns, organization pattern, 17 , pattern, 575 12 - 13 , 19 , 235 , 259 , 70 - 78 , 133 information governance 319 - 324 , 587 information change trigger program pattern, 70 , 88 - 91 , information node upgrade pattern, 453 , 460 - 462 133 pattern, 506 , 587 - 589 information code pattern, information governor pattern, information owners pattern, 103 , 122 , 126 - 128 97 97 692 Index

information pattern detecting information request pattern, information warehouses processes pattern, 126 , 517 , 13 , 20 , 112 , 122 , 395 - 398 pattern, 156 523 - 525 information scavenging infrastructure operator information pattern discovery process pattern, 500 , pattern, 97 process pattern, 517 - 520 515 - 517 initiate process information information payload pattern, information schema pattern, request, 399 103 , 112 , 119 - 122 106 , 141 , 143 - 145 interaction analysis pattern, information principle pattern, information search process 571 158 pattern, 525 lifecycle states pattern, 318 information probe pattern, information service patterns, link entries pattern, 539 , 21 , 570 19 , 182 , 235 553 - 556 information probe patterns, information service trigger linked information 197 , 203 , 572 - 575 pattern, 453 , 458 - 460 provisioning pattern, information processes pattern, information solution patterns, 182 - 183 16 , 112 , 116 , 140 , 449 , 22 , 27 , 578 - 582 local coverage pattern, 33 , 465 - 469 , 531 - 532 integrating information 287 information processing nodes, 590 local information service patterns, 449 information stewards pattern, patterns, 243 information processing variables 97 local key patterns, 293 , pattern, 102 - 103 , 107 , 112 , information store pattern, 297 - 300 114 - 116 324 , 334 - 337 local locking pattern, 317 information profile tracking information streaming local provisioning pattern, processes pattern, 483 - 486 process pattern, 380-382 263 information protection information summarizing local scope pattern, 10 , 32 , patterns, 633 process pattern, 119 , 500 , 280 , 282 - 284 information provisioning 513 - 515 look-up table node pattern, patterns, 18 , 99 , 161 - 165 , information summary pattern, 343 , 356 - 358 468 103 , 107 , 117 - 119 lookup tables pattern, 128 information queueing process information supply chain managed archive pattern, 624 , pattern, 356 , 500 , 509 - 511 patterns, 15 , 18 , 99 , 633 - 636 information reengineering 199 -209 , 283 manual information trigger steps pattern, 21 , 534 - 538 information trigger patterns, pattern, 453 - 455 information registry pattern, 16 , 192 , 195 , 449 , 450 - 452 map-reduce node pattern, 599 , 607 - 609 information usage collection 376 , 382 - 385 information relocation patterns, 266 mask data pattern, 571 process pattern, 500 , information user pattern, 17 , master data management 505 - 506 91 - 95 patterns, 599 - 601 information remediation information validation master usage pattern, 198 , process pattern, 486 , process pattern, 484 , 266 - 270 489 - 491 491 - 493 merge entries pattern, 539 , information replication information values profile 556 - 558 process pattern, 499 - 502 pattern, 132 , 139 , 150 , mirror key pattern, 293 , information reporting 153- 154 , 156 - 158 305 - 307 processes pattern, 126 , 156 , information values report mirroring provisioning 481 - 483 pattern, 153 - 156 pattern, 185 , 189 -193 , 362 information warehouse naming conventions, 7 pattern, 376 - 379 natural key pattern, 293 , 302 - 305 Index 693

new information node recovery provisioning pattern, separate entries pattern, 539 , pattern, 582 - 587 185 , 197 - 198 558 - 560 next best action pattern, 626 , recycled key patterns, 293 , separation of duties pattern, 630 - 633 300 - 302 571 operation status store pattern, reengineering information service oriented provisioning 366 - 368 step pattern, 139 pattern, 179 - 182 operational analytics pattern, reference usage pattern, 266 , shared master pattern, 599 , 626 , 628 - 629 271 - 274 601 - 603 operational health monitoring relationships pattern, 318 single view information process pattern, 324 , remote information service supply chain pattern, 209 , 526 - 528 patterns, 243 , 452 219 - 223 , 266 operational health probe restructure data pattern, smooth data pattern, 539 , pattern, 575 538 - 542 563 - 565 operational status store retrieve collection snapshot provisioning, 171 pattern, 219 , 361 information request pattern, snapshot provisioning pattern, optimistic locking pattern, 400 185 - 188 , 279 , 362 317 retrieve cursor information soft delete pattern, 318 ordered consolidation pattern, request, 400 source-specific payload 420 , 427 - 429 retrieve one information pattern, 121 ordered distribution pattern, request, 400 specialist information 433 , 439 - 441 roll up information supply reengineering steps pattern, packaged application process chain pattern, 126 538 - 539 pattern, 470 , 472 - 474 routing information flows stable key pattern, 294 , partitioned distribution pattern, 406 - 407 312 - 315 pattern, 433 run process information staged routing pattern, 407 partitioned routing pattern, request, 399 staging area pattern, 12 , 343 , 407 , 410 - 412 sample data pattern, 539 , 353 - 356 partner collaboration pattern, 565 - 566 standardize data pattern, 539 , 590 , 597 - 599 sample data probe pattern, 542 - 545 peer exchange information 575 state driven process, 114 , supply chain, 209 , 230 - 232 sandbox usage pattern, 266 , 476 - 479 peer provisioning pattern, 277 - 279 state driven process pattern, 185 , 193 - 195 , 217 , 232 scheduled information trigger 470 performance reporting pattern, 453 , 455 - 457 static structure pattern, 316 pattern, 483 , 624 , 626 - 628 scheduling process pattern, streaming analytics node physical information 324 , 526 , 530 - 531 pattern, 376 , 465 collection pattern, 260 search node pattern, 324 , subject area definition physical security zone 332 - 334 pattern, 27 , 106 , 132 - 136 , pattern, 571 search processes pattern, 149 , 156 , 158 profiling rule probe pattern, 525 - 526 subject area probe pattern, 575 semantic integration pattern, 575 provenance pattern, 318 136 , 265 - 266 , 590 , 593 - 597 summarized routing pattern, provisioning information semantic mapping pattern, 418 - 420 process patterns, 499 - 517 122 , 124 , 146 , 150 - 153 , synchronized consolidation proxy pattern, 318 158 , 283 pattern, 420 - 424 queue manager pattern, 343 , semantic tagging pattern, 132 , synchronized distribution 349 - 353 146 , 148 - 150 , 153 , 158 pattern, 432 - 435 694 Index

synchronized masters pattern, buffered routing pattern, 413 information access audit 195 , 599 , 613 - 618 cache provisioning pattern, pattern, 636 tagged media structure, 316 184 information activity hub target-specific payload caller's key pattern, 310 pattern, 373 pattern, 121 cascading information supply information activity pattern, transient scope pattern, 8 - 10 , chain pattern, 211 110 33 , 280 , 284 - 285 centralized master pattern, information analysis node triggered information service 604 pattern, 386 pattern, 266 check data pattern, 548 information archiving process triggering information service classify data pattern, 546 pattern, 497 pattern, 223 , 250 - 253 clerical review process information asset hub pattern, trusted node pattern, 571 pattern, 487 368 unique entries pattern, 318 collaborative editing process information asset pattern, 106 update information request pattern, 479 information broadcasting pattern, 398 complete scope pattern, 279 process pattern, 511 user private provisioning consolidating information information brokers pattern, pattern, 166 - 169 supply chain pattern, 223 344 user shared provisioning correct data pattern, 550 information centric pattern, 169 , 177 - 179 daisy chain provisioning organization pattern, 73 valid values definition pattern, 173 information change trigger pattern, 133 , 136 - 139 derive relationship pattern, pattern, 461 virtual information collection 562 information code pattern, 126 pattern, 253 , 260 , 263 - 266 derive value pattern, 560 information collection workload offload pattern, distributed activity status pattern, 254 460 , 618 , 624 - 626 pattern, 590 information configuration peer exchange information enrich data pattern, 545 pattern, 139 supply chain, 209 , 230 - 232 event correlation node information content node peer provisioning pattern, 185 , pattern, 358 pattern, 330 193 - 195 , 217 , 232 event-based provisioning information cube pattern, 340 performance reporting pattern, pattern, 196 information decision 483 , 624 , 626 - 628 external sensor trigger definition process pattern, physical information collection pattern, 463 521 pattern, 260 , 259 - 263 filtered consolidation pattern, information deployment physical security zone pattern, 424 process pattern, 502 571 filtered routing pattern, 416 information element patterns, predictive analytics, 55 - 66 golden reference pattern, 610 101 problems hierarchical information information entry patterns, aggregate key pattern, 307 supply chain pattern, 226 289 agile business process historical system of record information event pattern, pattern, 474 pattern, 619 113 application node pattern, 326 hub interchange information information event store application private supply chain pattern, 215 pattern, 364 provisioning pattern, 169 hybrid usage pattern, 275 information ever-greening bespoke application process independent consolidation process pattern, 496 pattern, 471 pattern, 430 information federation broadcast distribution pattern, independent distribution process pattern, 507 444 pattern, 441 information flow pattern, 403 Index 695

information governance information processing information values profile program pattern, 88 variables pattern, 114 pattern, 156 information guard pattern, information profile tracking information values report 567 processes pattern, 483 pattern, 153 information identification information provisioning information warehouse patterns, 130 patterns, 163 pattern, 377 information key pattern, 295 information queueing process link entries pattern, 553 information lineage pattern, pattern, 509 linked information 159 information reengineering provisioning pattern, 182 information link pattern, 123 steps pattern, 535 local information service information location pattern, information registry pattern, patterns, 244 145 607 local key patterns, 297 information management information relocation local scope pattern, 282 obligation pattern, 78 process pattern, 505 look-up table node pattern, information management information remediation 356 principle pattern, 84 process pattern, 489 managed archive pattern, 634 information management information replication manual information trigger strategy pattern, 81 process pattern, 499 pattern, 453 information mart pattern, 337 information reporting map-reduce node pattern, 383 information matching process processes pattern, 481 master usage pattern, 268 pattern, 493 information request pattern, merge entries pattern, 556 information metric pattern, 396 mirror key pattern, 305 125 information scavenging mirroring provisioning information mining store process pattern, 515 pattern, 189 pattern, 389 information schema pattern, natural key pattern, 303 information mirror store 143 new information node pattern, 360 information service patterns, pattern, 582 information model pattern, 238 next best action pattern, 630 141 information service trigger operational analytics pattern, information monitoring pattern, 458 628 pattern, 638 information solution patterns, operational health monitoring information node 579 process pattern, 527 management process information store pattern, operational status store pattern, 528 334 - 335 pattern, 366 information node patterns, information streaming ordered consolidation pattern, 320 process pattern, 380-382 427 information node upgrade information summarizing ordered distribution pattern, pattern, 587 process pattern, 514 439 information pattern detecting information summary pattern, packaged application process processes pattern, 523 117 pattern, 472 information pattern discovery information supply chain partitioned distribution process pattern, 518 patterns, 200 pattern, 436 information payload pattern, information trigger patterns, partitioned routing pattern, 119 450 410 information probe patterns, information user pattern, 92 partner collaboration pattern, 572 information validation 598 information process pattern, process pattern, 491 peer exchange information 466 supply chain, 230 696 Index

peer provisioning pattern, 193 synchronized distribution information streaming performance reporting pattern, 432 process pattern, 380-382 pattern, 626 synchronized masters pattern, information summarizing physical information 614 process pattern, 513 - 515 collection pattern, 259 transient scope pattern, 284 proxy pattern, 318 queue manager pattern, 349 triggering information service recovery provisioning pattern, 250 pattern, 197 user private provisioning Q recycled key patterns, 300 pattern, 167 quality improvements, 47 - 51 reference usage pattern, 271 user shared provisioning quality information processes remote information, 246 - 247 pattern, 177 pattern, 483 - 484 restructure data pattern, 540 valid values definition clerical review process sample data pattern, 565 pattern, 137 pattern, 487 - 489 sandbox usage pattern, 277 virtual information collection information archiving process scheduled information trigger pattern, 263 - 264 pattern, 497 - 499 pattern, 455 workload offload pattern, 624 information ever-greening scheduling process pattern, process-level provisioning, 162 , process pattern, 496 - 497 530 171 - 172 information matching process search node pattern, 332 daisy chain provisioning pattern, 493 - 495 semantic integration pattern, pattern, 172 - 177 information profile tracking 593 product details, 30 processes pattern, 483 - 486 semantic mapping pattern, classifications, 33 - 34 information remediation 151 creating a single view, 30 - 37 process pattern, 489 - 491 semantic tagging pattern, 148 Product Hub, 33 , 271 information validation separate entries pattern, 558 product inventory management, process pattern, 491 - 493 service oriented provisioning 55 queue manager pattern, 177 , 194 , pattern, 180 profiling rule probe pattern, 575 343 , 349 - 353 , 511 shared master pattern, 601 properties, emergent properties, single view information 5 supply chain pattern, 219 protecting information, 21 R smooth data pattern, 563 provenance pattern, 318 recovery provisioning pattern, snapshot provisioning provisioning information process 185 , 197 - 198 pattern, 186 patterns, 499 - 517 recycled key patterns, 293 , stable key pattern, 313 information broadcasting 300 - 302 staged routing pattern, 406 process pattern, 511 - 513 reengineering information step staging area pattern, 353 information deployment pattern, 139 standardize data pattern, 542 process pattern, 502 - 505 reference usage, 62 - 63 state driven process, 476 information federation reference usage pattern, 266 , streaming analytics node process pattern, 507 - 509 271 - 274 pattern, 380 information queueing process relationships pattern, 318 subject area definition pattern, 509 - 511 remote information service, 177 pattern, 134 information relocation remote information service summarized routing pattern, process pattern, 505 - 506 pattern, 13 418 information replication remote information service synchronized consolidation process pattern, 499 - 502 patterns, 243 , 246 - 250 , 253 , pattern, 421 information scavenging 452 process pattern, 515 - 517 remote information services, 40 Index 697

remote retrieval S smooth data pattern, 539 , retrieve collection sample data pattern, 539 , 563 - 565 information request pattern, 565 - 566 snapshot provisioning, 171 400 sample data probe pattern, 575 snapshot provisioning pattern, retrieve cursor information sandbox usage, 64 185 - 188 , 279 , 362 request, 400 sandbox usage pattern, 266 , soft delete pattern, 318 retrieve one information 277 - 279 solutions request, 400 scheduled information trigger aggregate key pattern, 308 reordering process, 59 - 60 pattern, 453 , 455 - 457 agile business process reordering stock, 59 - 60 scheduling process pattern, 324 , pattern, 475 Reporting Hub, 271 , 340 526 , 530 - 531 application node pattern, merging customer details, 39 search node pattern, 324 , 326 - 328 reports 332 - 334 application private information identification search processes pattern, provisioning pattern, 169 patterns, 154 525 - 526 bespoke application process information lineage security pattern, 471 - 472 pattern, 159 - 161 authentication, 568 broadcast distribution pattern, information values profile authorization, 568 444 pattern, 156 - 158 semantic integration pattern, 124 , buffered routing pattern, information values report, 136 , 265- 266 , 590 , 593 - 597 413 - 414 153 - 156 semantic mapping pattern, 122 , cache provisioning pattern, management reports, 28 - 30 146 , 150 - 153 , 158 , 283 184 restructure data pattern, 50 , semantic tagging pattern, 132 , caller's key pattern, 310 538 - 542 146 , 148 - 150 , 153 , 158 cascading information supply retrieve collection information separate entries pattern, 50 , 539 , chain pattern, 211 - 212 request pattern, 400 558 - 560 centralized master pattern, retrieve cursor information separation of duties pattern, 571 605 - 606 request, 400 service oriented provisioning, 40 check data pattern, 549 retrieve one information request, service oriented provisioning classify data pattern, 547 400 pattern, 178 - 182 clerical review process roll up information supply chain service-level provisioning , 162, pattern, 488 pattern, 126 177 - 178 collaborative editing process routing information flows cache provisioning pattern, pattern, 480 pattern, 406 - 407 184 - 185 complete scope pattern, 281 buffered routing pattern, linked information consolidating information 413 - 415 provisioning pattern, supply chain pattern, 223 filtered routing pattern, 182 - 183 correct data pattern, 551 416 - 418 service oriented provisioning daisy chain provisioning partitioned routing pattern, pattern, 179 - 182 pattern, 173 - 176 410 - 412 user shared provisioning derive relationship pattern, staged routing pattern, pattern, 177 - 179 562 406 - 409 shared master pattern, 599 , derive value pattern, 561 summarized routing pattern, 601 - 603 distributed activity status 418 - 420 single view information supply pattern, 591 run process information request, chain pattern, 209 , 219 - 223 , enrich data pattern, 545 399 266 event correlation node pattern, 359 698 Index

event-based provisioning information configuration information metric pattern, pattern, 196 pattern, 139 - 140 125 external sensor trigger information content node information mining store pattern, 463 pattern, 330 - 331 pattern, 390 - 391 filtered consolidation pattern, information cube pattern, 341 information mirror store 425 information decision pattern, 362 filtered routing pattern, 416 definition process pattern, information model pattern, golden reference pattern, 521 142 611 - 612 information deployment information monitoring hierarchical information process pattern, 503 pattern, 639 - 640 supply chain pattern, 226 information element patterns, information node historical system of record 102 - 104 management process pattern, 620 - 622 information entry patterns, pattern, 529 hub interchange information 290 information node patterns, supply chain pattern, information event pattern, 321 - 323 216 - 217 113 information node upgrade hybrid usage pattern, 275 information event store pattern, 588 independent consolidation pattern, 364 information pattern detecting pattern, 430 information ever-greening processes pattern, 523 independent distribution process pattern, 496 information pattern discovery pattern, 442 information federation process pattern, 519 information access audit process pattern, 507 - 508 information payload pattern, pattern, 637 information flow pattern, 120 information activity hub 403 - 404 information probe patterns, pattern, 373 - 375 information governance 573 information activity pattern, program pattern, 89 - 90 information process pattern, 111 information guard pattern, 467 - 468 information analysis node 568 - 569 information processing pattern, 387 - 388 information identification variables pattern, 115 information archiving process patterns, 131 - 132 information profile tracking pattern, 498 information key pattern, 295 processes pattern, 485 information asset hub pattern, information lineage pattern, information provisioning 369 - 370 159 patterns, 163 - 165 information asset pattern, information link pattern, 123 information queueing process 108 - 109 information location pattern, pattern, 510 information broadcasting 145 information reengineering process pattern, 511 - 512 information management steps pattern, 535 information brokers pattern, obligation pattern, 79 - 80 information registry pattern, 344 - 347 information management 608 - 609 information centric principle pattern, 84 - 85 information relocation organization pattern, 74 - 75 information management process pattern, 505 - 506 information change trigger strategy pattern, 82 information remediation pattern, 461 information mart pattern, process pattern, 490 information code pattern, 127 338 - 339 information replication information collection information matching process process pattern, 500 pattern, 255 - 257 pattern, 494 information reporting processes pattern, 482 Index 699

information request pattern, map-reduce node pattern, 383 sandbox usage pattern, 397 master usage pattern, 268 277 - 278 information scavenging merge entries pattern, 557 scheduled information trigger process pattern, 516 mirror key pattern, 306 pattern, 456 - 457 information schema pattern, mirroring provisioning scheduling process pattern, 144 pattern, 189 - 191 530 information service patterns, natural key pattern, 303 search node pattern, 333 239 - 241 new information node semantic integration pattern, information service trigger pattern, 584 - 586 595 pattern, 458 - 459 next best action pattern, semantic mapping pattern, information solution patterns, 630 - 632 151 580 - 581 operational analytics pattern, semantic tagging pattern, 149 information store pattern, 629 separate entries pattern, 559 335 - 336 operational health monitoring service oriented provisioning information streaming process pattern, 527 pattern, 180 process pattern, 380-382 operational status store shared master pattern, information summarizing pattern, 366 602 - 603 process pattern, 514 ordered consolidation pattern, single view information information summary pattern, 427 supply chain pattern, 117 ordered distribution pattern, 220 - 221 information supply chain 439 smooth data pattern, 564 patterns, 202 - 206 packaged application process snapshot provisioning information trigger patterns, pattern, 473 pattern, 187 450 partitioned distribution stable key pattern, 313 information user pattern, pattern, 436 staged routing pattern, 93 - 94 partitioned routing pattern, 406 - 408 information validation 410 staging area pattern, 353 - 354 process pattern, 492 partner collaboration pattern, standardize data pattern, 543 information values profile 598 state driven process, 477 pattern, 157 peer exchange information streaming analytics node information values report supply chain, 230 pattern, 380 - 381 pattern, 155 peer provisioning pattern, 194 subject area definition information warehouse performance reporting pattern, 135 pattern, 378 pattern, 627 summarized routing pattern, link entries pattern, 553 - 554 physical information 418 linked information collection pattern, 261 synchronized consolidation provisioning pattern, 183 queue manager pattern, pattern, 422 local information service 349 - 351 synchronized distribution patterns, 244 recovery provisioning pattern, 432 local key patterns, 298 pattern, 198 synchronized masters pattern, local scope pattern, 283 recycled key patterns, 301 615 - 616 look-up table node pattern, reference usage pattern, transient scope pattern, 284 357 271 - 272 triggering information service managed archive pattern, remote information service pattern, 251 634 - 635 patterns, 248 user private provisioning manual information trigger restructure data pattern, 540 pattern, 168 pattern, 454 sample data pattern, 566 700 Index

user shared provisioning stored information, accessing, 16 U pattern, 179 Stores, customer details, 37 unique entries pattern, 318 valid values definition streaming analytics node pattern, update information request pattern, 137 - 138 376 , 380 - 382 , 385 , 465 pattern, 398 virtual information collection subject area definition pattern, updating customer details, 42 - 43 pattern, 264 - 265 27 , 33 , 83 , 106 , 132 - 136 , 149 , user private provisioning pattern, workload offload pattern, 624 153 , 156 , 158 166 - 169 source-specific payload pattern, subject area probe pattern, 575 user shared provisioning pattern, 121 summarized routing pattern, 407 , 169 , 177 - 179 specialist information 418 - 420 reengineering steps pattern, supplementary patterns, 538 - 539 information payload pattern, V check data pattern, 548 - 550 121 valid values definition pattern, classify data pattern, 546 - 548 Supplier-net, 54 - 55 33 , 133 , 136 - 139 correct data pattern, 550 - 552 suppliers, interacting with, 52 - 53 validate data pattern, 50 derive relationship pattern, supply chains, 199 - 209 validation of behavior, 562 - 563 synchronized consolidation information configuration derive value pattern, 560 - 562 pattern, 420 - 424 pattern, 139 enrich data pattern, 545 - 546 synchronized distribution virtual information collection link entries pattern, 553 - 556 pattern, 432 - 435 pattern, 253 , 260 , 263 - 266 merge entries pattern, synchronized master pattern, 42 556 - 558 synchronized masters pattern, restructure data pattern, 195 , 599 , 613 - 618 W-X-Y-Z 538 - 542 workload offload pattern, 460 , sample data pattern, 565 - 566 618 , 624 - 626 separate entries pattern, T 558 - 560 tagged media structure, 179 , 316 smooth data pattern, 563 - 565 target-specific payload pattern, standardize data pattern, 121 542 - 545 taxonomies, subject area specialized operations, definition pattern, 136 information entry patterns, The Open Group Architecture 317 - 319 Framework (TOGAF), 10 stable key pattern, 294 , 312 - 315 TOGAF (The Open Group staged routing flow, 65 Architecture Framework), 10 staged routing pattern, 407 transient scope pattern, 8 - 10 , 33 , staging, 6 280 , 284 - 285 staging area, 183 triggered information service staging area pattern, 12 , 343 , pattern, 266 353 - 356 triggering information service standardize data pattern, 539 , pattern, 223 , 243 , 250 - 253 542 - 545 trusted node pattern, 571 state driven process, 114 , types of information models, 143 476 - 479 state driven process pattern, 470 static structure pattern, 316 status of orders, 34 - 44