St Louis CMG Modernizing and Managing Enterprise Applications in the API Economy Chris Walker – Offering Manager, IBM z Systems Monitoring January 2017
© 2017 IBM Corporation Abstract Businesses are realizing that there is considerable value gained from exposing existing core applications as APIs for developers to rapidly build cloud and mobile apps. This session will explain how hybrid applications that span the enterprise from distributed to the mainframe can benefit from an end to end application performance management view, including a focus on z/OS Connect, Java workloads, as well as traditional workloads such as CICS and IMS on z Systems. The Digital Economy is forcing business to transform
Transaction Processing
Data Serving
Mixed Workloads
ExplosionOperational in Efficiency Analytics is Hybrid cloud is the transactionTrusted and growth Secure Computingmoving to real time new standard A user will simply APIs connect partners A single dissatisfied to core business user experience can deletedrivenReliable, anby mobilityapplication Available, and the Resilientto capture new opportunities for delivering service, applications, but only if result in significant that doesInternet not of deliver Things a at the point of impact agility, trust and efficiency satisfactoryVirtually experience Limitless Scale the APIs perform social impacts
3 User experience is the measure of app performance
A user will simply APIs connect partners A single dissatisfied delete an application to core business user experience can that does not deliver a applications, but only if result in significant satisfactory experience the APIs perform social impacts
4 Enterprises must learn to “Innovate like a Startup”
FROM…….. “The ‘Uber syndrome’ – where a competitor with a completely different business model enters your ……TO industry and flattens you.” Judy Lemke, CIO, A user will simply APIs connect partners Schneider,A single United dissatisfied States delete an application to core business user experience can that does not deliver a applications, but only if result in significant satisfactory experience the APIs perform social impacts “52% of the Fortune 500 firms since 2000 are gone.” – R. Ray Wang http://blog.softwareinsider.org/2014/02/18/research-summary-sneak-peaks-from-constellations-futurist-framework-and- 2014-outlook-on-digital-disruption/
5 What is the API Economy?
The API economy is an enabler for turning a business or organization into a platform. Gartner, Christy Pettey June 2016 1
In the API economy, application programming interfaces (APIs) act as the digital glue that links services, applications and systems. This allows businesses to make the most of their data to create compelling customer experiences and open new revenue channels. IBM 1 http://www.gartner.com/smarterwithgartner/welcome-to-the-api-economy/ 6 What is meant by “API”?
An API is a set of commands, functions, protocols, and objects that programmers can use to create software or interact with an external system. It provides developers with standard commands for performing common operations so they do not have to write the code from scratch. TechTerms.com
7 Where are APIs? Everywhere!
8 The Strategy is Simple…
Unleash Enterprise Investments to Disrupt Competitors
To Develop Innovative Exposed as Apps APIs
Delivering Differentiated Self Service Customer Existing Enterprise Consumed by Experiences IT Investments Developers
…With Hybrid Applications
9 z Systems is the ideal System of Record for Hybrid apps
CRM HR Clients have built and tuned core
DB ERP applications on the mainframe using Systems of CICS, IMS, DB2 over many years Record No other platform provides the reliability, availability and performance
Secure access to mainframe data via Systems of mobile and cloud applications Engagement
30 Billion $6 trillion 80 % 91% business in card payments of the world’s of CIOs said new transactions per day annually corporate data user apps access z
10 Barriers to entering to the API Economy for enterprises • Skills and Development Processes • Technologies • Ease of Access • Security • Costs
• ImpactMobileFirst to Performance Platform • Service(cloud) Management!
11 What does this mean to my development processes? Digital Transformation through Multi-Speed IT
Fast Speed Digital Ecosystem Speed & Agility Core Enterprise Integration & Scale
Steady Speed
12 Challenges with Multi-Speed IT
Fast Speed What businessDigital outcome is expected? How will Ecosystembusiness & IT roles be impacted? How to manageSpeed & Agility the consumption of APIs across the enterprise? How to provide self-service for internal & externalCore developers? Enterprise How to enforce security at runtime? Integration & Scale How to throttle and provide controlled access? How to introduce change with new versions? Steady How do I know who is using my service and how much? Speed How much should I charge for access to my service?
13 What does this mean to my IT environment? Partner App Customer AppPartner App Partner App Internal App Customer App Customer App Internal App Internal App
14
14 What scares the z team about managing hybrid apps?
Controlling Costs! Skills and Agility! Managing Risks!
Too much expert time is Our app dev team How do I know who is wasted in crit-sit war knows Java not COBOL! calling our APIs? rooms! We can’t install new app How can I predict / Additional workload will versions every week! protect the workload? drive up our MIPS! “They” don’t include How do I know if the Training developers is “us” in strategy or user experience is expensive! architecture! impacted by my host performance?
15 The Lifecycle of a Hybrid Application
Application Operational Operational Expose APIs Consume APIs Understanding Monitoring Analytics
16 Application Unlock the value of existing assets Understanding
• Understand the structure of your business critical applications across languages and environments • Challenge for mainframe clients is knowing/understanding the assets already available • Decide what has value to be exposed as an API • Look to reduce risk and time and increase quality of changes through tooling that can identify those dependencies between assets • Result is ability to create or refactor assets to be consumed as API’s Create Microservices and APIs Expose APIs
• From the identified assets, develop microservices that perform a single task to interact with the System of Record • Example: “getCustomerByID” • These microservices can be later integrated, if needed, to form exposable APIs to end users. • Use tooling to create the mapping from existing application endpoints into a RESTful interface • Example: mapping a COBOL copybook into a JSON structure Surely, our clients can do this today?! Expose APIs
CTG or CICS SOAP/JSON Webservices CICS IMS Mobile Feature Pack IMS DB2 JSON DB2 Broker MQ JAX RS WAS Yes, but … Expose APIs
Multiple endpoints for developers to call/maintain access to
CTG or CICS SOAP/JSON Webservices CICS IMS Mobile Feature Pack IMS DB2 JSON DB2 Broker MQ JAX RS WAS
These are typically not RESTful!!! Completely different configuration and management A transformational gateway is required Expose APIs
Discovery using OpenAPI CICS (aka Swagger)
IMS RESTful APIs available from one endpoint DB2
MQ With sophisticated mapping of true RESTful APIs to WAS existing mainframe services and data Managing APIs Consume APIs The challenge: • Who is accessing the APIs? • Is it public? Who has keys? • How can socialize (advertise) the APIs? • What is the quality of service? • Do we have traffic policy enforcement (throttling)? • Can we meter any chargebacks? API management and orchestration Consume APIs
• How do you combine multiple CICS backend services in a single IMS useful API? DB2 MQ
WAS ?
Other Enterprise servers Operational End-to-End monitoring of hybrid applications Monitoring
• Application driven monitoring changes the focus of what is meant by acceptable performance • Need to leverage existing investments in z monitoring and management into overall view of hybrid application • Consistency of data between LOB Application Owner and z Operations teams
Faster problem isolation with visibility into mainframe components
24 Typical hybrid app scenario with a mainframe today
It’s probably the The business Uh-oh! It’s a DB mainframe. application isn’t DB2, MQ and lock on distributed performing like it CICS on z/OS slowing down the should. Where’s that are all performing response time infrastructure contact? ? fine
IT Infrastructure
z SME Line of X Business Application DB Admin Owner
25
25 Evolution of personas that need and use monitoring data
Application Owner z/OS Subject Matter Expert
26 Operational Minimize outages with Analytics Analytics
• Real-time monitoring provides ability to manage effects on performance however there is also a need to observe and react to a bigger picture • The impact of API usage draws in metrics from various sources: • Traditional monitoring resource data • Real-time feeds of SMF data and log data • Client (mobile) connection information • Unstructured data • Creates a feedback loop that identifies the bottlenecks, usage levels and value of the APIs and services
27 Example Scenario: BreadBox Grocery
© 2017 IBM Corporation The Story
• Global footprint. • Family run retail business. • Enterprise operations - 50 states • Optimize and Innovate in IT • Started by 2 brothers in • 3 data centers in the US • New Services Online fast to Ohio. • 500 distribution centers reach new clients. • Rapid Growth via • 45000 trailers & 4000 drivers • Leverage Social & mobile for commitment to clients and • 12000 stores better client engagement Innovation in IT. • Growth through acquisitions. • Maintain Industry Leadership
50 years ago Today Where they want to be
© Copyright IBM Corporation 2015 No milk to cry over
Drive additional sales to the stores of Increased customer satisfaction forgotten items Before
The next morning…
What do I need? Yup, I’ve got everything I need from the Oh no! I forgot the milk! Bread Box Grocery Store I need to run to another store After
What do I need? I’ve got everything I need including I’m glad I got my milk Yes, I do need milk! the milk! at Bread Box! I love this app! Virtual Shopping List Architecture
List Service
IBM Recommendation Cloudant Mobile App Service
DP Cluster
(DMZ)
Z/OS Store Sales App Connec t
Inventory App
Distribution Centers Stores
31 Miki – Application Owner
• Responsible for one or more applications. Most often employee of the business unit
• Needs to ensure that applications are running and meeting SLAS.
• Looking ahead at trending and capacity planning.
Miki • Needs to understand when problems happens if Application Owner those are application or dependent component related (Middleware, Infrastructure)
32 Scenario • Miki is the Application Owner for the Virtual Shopping List at Bread Box Groceries
• Miki uses Application Performance Management to monitor the overall responsiveness of the application using Synthetic Transactions
• Miki has been notified that the response time for the application is slow
Miki • Miki logs onto the APM UI and notices that there Application Owner are warning events in the application dashboard indicating that the CICS transaction used by the VSL are slow
• Miki contacts the CICS SME to let him know that the slow CICS transaction times are impacting her application 33 Virtual Shopping List Architecture
List Service
IBM Recommendation Cloudant Mobile App Service
DP Cluster
(DMZ)
Z/OS Store Sales App Connec t
Inventory App
Distribution Centers Stores
34 What happens when there is a problem?
??? ???
List Service
IBM Recommendation Cloudant Mobile App Service
???
DP Cluster
(DMZ)
??? ???
Z/OS Store Sales App Connec t
Inventory App
Distribution Centers Stores
35 Application Performance Management
APM UI
List Service Node.js IBM Mobile App Recommendation Cloudant Service Node.js
DP Cluster APM 8.1.3 DataPower (DMZ)
Z/OS Connec OMEGAMON t APM Hybrid Monitoring Gateway JVM CICS TEPS TEMS DB2 z/OS Datacenter
36 Conclusions
The API Economy is already here
The investment already made by enterprises in z Systems needs protecting
Application-level monitoring and management is driving change
37 Thank You
© 2017 IBM Corporation Notices and Disclaimers
Copyright © 2016 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM.
U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM.
Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided.
IBM products are manufactured from new parts or new and used parts. In some cases, a product may not be new and may have been previously installed. Regardless, our warranty terms apply.”
Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice.
Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary.
References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business.
Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation.
It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law 39 Notices and Disclaimers Con’t.
Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.
The provision of the information contained h erein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right. IBM, the IBM logo, ibm.com, Aspera®, Bluemix, Blueworks Live, CICS, Clearcase, Cognos®, DOORS®, Emptoris®, Enterprise Document Management System™, FASP®, FileNet®, Global Business Services ®, Global Technology Services ®, IBM ExperienceOne™, IBM SmartCloud®, IBM Social Business®, Information on Demand, ILOG, Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™, PureApplication®, pureCluster™, PureCoverage®, PureData®, PureExperience®, PureFlex®, pureQuery®, pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, Smarter Commerce®, SoDA, SPSS, Sterling Commerce®, StoredIQ, Tealeaf®, Tivoli®, Trusteer®, Unica®, urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.
40