Architecting TIBCO Streambase Applications Unit 2 Use Cases

Architecting TIBCO StreamBase Applications Unit 2 Use Cases

● Fast Insights Use Cases ● Accelerators ● StreamBase Fast Insights Use Case – Oil and Drilling

…prevents pump failure Watch this video “We typically avoid downtime to the tune of $1,000/day/well with proactive, real-time operations. In a typical play, this results in $100M of additional bottom line revenue per year.”

- VP of Operations, major oil company

© Copyright 2000-2015 TIBCO Software Inc. Use Case Examples: Energy and Machines • Production Surveillance Value • Sensor data 1Tb/day/well – ESPs and other equipment • Diagnose/Predict system failure, sensor failure, communications issues • Manage inventory of assets/sensors and topology; maintenance status • Manage NPT = $1K /well/day = $100M+ /field/year Grow Revenue • Manufacturing Process Analysis & Monitoring • Root cause analysis for defects / yield • Real-time intervention • Manage process and intervene = $200K /event/line/day = $20M+ /plant/year Reduce Risk • Transportation, Fleet Management, Maintenance • Railways : Sensors on tracks help diagnose bearing maintenance • Airlines: Sensors data during/post flight used for engine maintenance Increase • Trucking: Telematics for fleet management in oil fields Productivity • Manage Equipment = $X/machine/year = $significant/year

An Accelerator is TIBCO (or partner) supplied code that provides a “template” for a use case or a generic pattern of use of the TIBCO Fast Insights platform.

The Accelerator code includes one or more of: Spotfire analysis files, BPM sample processes, BW plugins and integration processes, R models and PMML model exchange files, Live Datamart configurations, LiveView UI samples, BE concepts and rule sets, and StreamBase EventFlows.

Accelerators are production quality, tested, documented and supported by TIBCO as delivered. But they are not applications. They are provided as source code and are designed to be extended and modified.

Accelerators are released via normal TIBCO product release cycles, in the TIBCO Component Exchange, or as a cloud service. Accelerator code is maintained by a clearly designated group or partner.

Baked-in Best Practices

Free and community-driven

Fully customizable

The most innovative TIBCO community use cases

Enterprise class

The Connected Vehicles FUNCTIONAL COMPONENTS Accelerator (CVA) is a TIBCO 1. BusinessEvents Rules Calculate routes, track resources, manage schedules. engineered, open-source fast-start Provided as Business Events event processing rules and for systems that algorithmically decision tables. manage connected vehicles. 2. StreamBase: Streaming Analytics, IoT StreamBase models for IoT data capture from sensors, a transportation stream data model, and communication with vehicles. 3. Live Datamart: Operational Analytics, UI, Alerts Visualize vehicles in motion in real-time, visualize analytics and rules, control to act on critical business moments. Provided as open source HTML5 / JavaScript code 4. Spotfire: Vehicle Occupancy Analytics Occupancy analytics to discover optimal loading of vehicles, and algorithms to drive optimal offer action.

5. BusinessWorks: Integration A real-time data model that provides a scalable, 360-degree view of vehicle and operational data. Provided as a documented, reusable data model for TIBCO BusinessWorks.

Accelerator for The Connected Vehicles The Foreign Exchange The Intelligent Apache Spark Accelerator Dealing Accelerator Equipment Accelerator

Case Management Financial Fraud Business Activity Real-time Inventory Accelerator Detection Accelerator Monitoring Accelerator Accelerator Baked-in best practices | No-cost and community driven | Production quality and fully customizable © Copyright 2000-2016 TIBCO Software Inc. Use Case Samples Use Case Examples: Logistics Optimization

© Copyright 2000-2016 TIBCO Software Inc. Use Case Examples: Industrial Applications and IoT • Electric Submersible Pump (ESP) Monitoring • Pump health & performance surveillance • Condition-based maintenance • Downhole equipment reliability • Warranty cost recovery • Analysis • Effects of operating conditions on ESP performance • Which suppliers contribute to overall reliability • Which systems should Engineering focus on • Continuous operations improvement from field feedback • Results • Component faults and failure reports • Components removals & related dependencies • Production reports • Prioritization of re-engineering and retrofit programs • Supplier collaboration and involvement in system reliability programs

Capital Markets . Algorithmic trading . Fraud detection . Market data management . Risk management . Smart order routing . Real-time pricing Retail Financial Services . Fraud detection* . Customer support . Activity monitoring . Mobile commerce* . Infrastructure monitoring* Defense & Intelligence . Defense intelligence . Security monitoring . Sentiment analysis . Signal analysis . Geospatial analytics

Telecommunications . Network management . Location-based services . CDR analysis . Fraud detection . Customer support Gaming . Consumer analytics . Consumer trending . Massively parallel gaming . Real-time pricing . Social media integration eCommerce / Web . Clickstream analytics . Security detection . Activity monitoring . Personalization . Fraud detection . Ad placement . Infrastructure monitoring Retail . In store sensors and responsive . In store consumer analysis for advertising displays* cross-sell and up-sell* . Tracking for in store promotions* . Social media tracking* Energy . Smart grid monitoring & control* . Infrastructure monitoring* . Energy trading Health Care . Fraud detection* . Patient data management* . Micropayments / billing* © Copyright 2000-2014 TIBCO Software Inc. 14 Continuous Track and Trace Analytics

• Situation: International Shipment Company Expanding – Firm now delivers to more countries, with more partners • Problem: Track & Trace Systems are Not Event-Driven – No efficient way of detecting if a package missed an expected observation – Looked at database-based solutions, but they are not event- oriented • Solution: TIBCO Continuous Analytics for Track & Trace – Continuous analytics on streaming delivery network events – Continuous visualization and alerting – BusinessEvents, StreamBase, and LiveView • Impact: Increased Rate of On-Time Delivery, Efficiency – Reduced errors – Optimized asset utilization – Real-time customer communication Real-Time Robot Detection

• Situation: Leading Ratings Provider Getting Attacked by Robots Skewing Results – Attacks vary and change in complexity and approach • Problem: Need Custom Real-Time Analytics – Requires the ability to quickly design new algorithms to detect and stop robot attacks • Solution: StreamBase CEP for Rapid Real-Time Analytics – Visual programming for robot detection analytics and visualization via StreamBase LiveView • Impact: Reduced Deployment Architecture by $1M – Algorithms deployed in days, not weeks or months, for rapid reaction to changing robot attacks. – By employing streaming analytics, deployment architecture handles 8 billion messages a day on one server, saving money. TIBCO EP for Telco Network & Call Center Analysis

• Situation: Telcos Must Compete on Services to Differentiate – Leverage the social network, provide better, faster provisioning • Problem: Call Centers Not Integrated with Network Intelligence – Systems don’t talk to each other, require real-time event- driven integration • Solution: TIBCO Event Processing for Real-Time Analytics in Telco Networks and Call Center Action – High-speed network and user event analytics, visualization, alerting, and action to optimize customer call center behavior • Result: Proactive Real-Time Customer Service – Call center system are optimized in real-time by network insights found by StreamBase LiveView and BE rules Trading Asset Management

• Situation: Major Asset Manager Needs Better and Faster Insight for Price Discovery – Which trades are slipping? How close to target are we for participation rates? How can we adjust our trading in the market now? • Problem: How Make Informed Real-Time Decisions? “With StreamBase & Spotfire, we can analyze everything that impacts – Need real-time and historical trading analytics to put intraday trade performance, and adjust to it trading strategy adjustments in the proper context on the fly.” • Solution: TIBCO StreamBase, LiveView, and Spotfire - Head of IT, Asset Management – Firm deployed live visualization and analytics with StreamBase CEP, LiveView, and TIBCO Spotfire for traders & portfolio managers to assess real-time and historical trade performance at once. • Impact: Improved Intraday Adaptability of Trading Strategies – Solution helps allow traders and PM’s understand where their trade performance is going, and adjust trading strategies during the day Event Processing for Telco Network Analytics

• Situation: Telcos Must Compete on Services to Differentiate – Leverage the social network, provide better, faster provisioning • Problem: Balkanized Systems – Systems don’t talk to each other, require real-time event- driven integration • Solution: StreamBase for Real-Time Analytics in Telco Networks – High-speed network and user event analytics, visualization, alerting, and action • Result: Proactive Real-Time Customer Service – Call center system are optimized in real-time by network insights found by StreamBase LiveView and BE rules Oil Futures Trading with StreamBase

• Situation: Seize the Opportunity of Automation – Firm realized that there was lots of low hanging fruit in automating some trading strategies in 2009. • Problem: Batch Sweep Misses Opportunities – Previously, the firm “swept” market data every 15 minutes, assessing opportunities. But with the rise in market data availability, they realized this must turn real- time, and identified CEP as the right platform for the job. • Solution: New Automated Trading Apps Based on “We leapfrogged the trading StreamBase competition with StreamBase, – New applications assess hundreds of thousands of which helps us evaluate and trading opportunities a day, automatically executes “no act on hundreds of thousands brainers,” and alerts trading staff of large opportunities. of trading possibilities a day in • Impact: Best Trading Period Ever; Volumes Up real-time.” – Firm had it’s “best 6-month trading period ever” with the new StreamBase automation system, and overall - CCC head of IT volumes were “also at a historical high” after introducing StreamBase-based systems. Fraud Detection and Monitoring

• Situation: Moving Data Requires Event-Driven Monitoring – Streaming machine-generated data overpowers existing end-of-day analytics and reporting infrastructure • Problem: Existing Commercial Products Not Real-Time – Existing products are designed for ETL-style capture and analytics, not for streaming data • Solution: Event-Driven Monitoring with StreamBase “Event-Drive monitoring and – CEP for event stream aggregation, correlation, and action fraud detection with – StreamBase LiveView for monitoring StreamBase make it easy for us – Integration with Hadoop and streaming machine-generated to whittle 100 million trading data events down to the few that • Impact: Market Disruption, First Mover Advantage matter and ACT in real-time.” – Firms that are first to market with real-time monitoring and fraud detection capture a distinctive advantage in the market - Bruce Ostrover, BNY ConvgeEx and save millions due to electronic-induced outages and fraud. Fraud / Compliance Analytics

• Situation: Real-Time Compliance Requirement for Brokers – VortEx, the BNY ConvergEx dark liquidity agency brokerage, required a new risk and compliance application to comply with SEC Rule 15c3-5 • Problem: Existing Commercial Products Lacking – Most existing products are not designed to provide an effective, intuitive way of filtering and investigating large amounts of real-time events. • Solution: CRSS, Based on StreamBase “CRSS and StreamBase make it – Developed and deployed the Compliance Risk Surveillance easy for our operations staff to System, which provides a simple, intuitive, ad-hoc way to whittle 100 million trading view and investigate real-time events. events down to the hundreds a • Impact: Market Disruption, First Mover Advantage day matter.” – Quadrupled employee productivity by allowing they to process more data in less time. - Bruce Ostrover, BNY ConvgeEx – Due to increased productivity, ConvergEx has expanded business because they can take on – and manage the risk – of more trade flow. Real-Time Big Data “Fast Data”

• Situation: Top 20 Gaming Site – Dynamic virtual world, in-game commerce, 21 million registered accounts • Problem: More Users, More Data, More Attacks – With rapidly increasing usage, site dealing with large volumes of data. More users draw more interest from online commerce fraud, often done in real-time Yellow Submarine in the virtual world • Solution: Real-Time “Coprocessor” for Big Data – Hadoop / Netezza / Microstrategy used for discovery based Real-Time Big Data on history; StreamBase used in parallel to execute • Fraud detection automated decisions based on known patterns of fraud, • Phishing detection phishing, and proactively alert and monitor for operational • Operations monitoring outages. • Real-time ETL • Impact: Millions in Cost Savings and More • Social media analytics Efficient Operations – Site can now stop malicious activity before it impacts the business, and monitor site operations in real-time, increasing client satisfaction, retention, and stickiness. Gift Card Fraud Detection

• Situation: Leading Gift Card Firm Wants to Leverage Big Data in Real-Time – Firm manages a large service bureau for gift card providers. Strategy is to gain cross-network intelligence into transactions as a value-added service for subscribers • Problem: More Users, More Data, Need Real- Time – Problem is: how to deal with big data, but in real-time? “By combining event-based • Solution: Real-Time “Coprocessor” for Big Data data with Hadoop, we can – Hadoop and StreamBase used side-by-side for event- take considered action based based discovery based and big data storage and analytics on historical context, rather • Impact: New Real-Time Fraud Detection Based than being whip-lashed by on Deep Historical Insight looking at ONLY real-time – Real-time fraud action can be taken based on historical events” insight – system not “whiplashed” by real-time events Algorithmic Trading

• Situation: Wall Street Imperative to Deploy Algo Trading – In the last 10 years, automated trade flow has gone from 5% to 80% – Good algo trading technology and time to market are critical to survival • Problem: How to Automate? “In three months we were up – Manual log searching required to understand the business impact and trading, and we were the of system outages: Which clients affected? Should we suggest fastest auto quoter on the they stop trading? market.” • Solution: StreamBase for Algo Trading – Algorithms developed 3-5X faster than if traditional technologies - Head of algorithmic trading, top- were used like databases or application servers tier broker dealer – Requires low latency event processing, aggregation, scale • Business Impact: Algo Trading is Pure Competitive Advantage – Top tier broker: deployed StreamBase in 3 months and went from laggard to leader – Boston hedge fund: built system in 4 months that would have taken 4 years Real-Time Betting

• Situation: Today, 80% of Betting is Done After the Game Starts – It’s not your father’s bookie anymore! • Problem: How to Analyze Big Betting Data? – Thousands of concurrent games, constantly adjusting odds, dozens of betting networks – firms must correlate millions of events a day to find the best betting opportunities in real-time • Solution: TIBCO for Event-Based Betting – TXOdds uses TIBCO to correlate, aggregate, and analyze large volumes of streaming betting data in real-time and publish innovative predictive betting analytics to their customers

“With StreamBase, in two months • Result: TXOdds First to Market with Innovative Zero Latency we had our first betting analytics Betting Analytics feed live, and we continually – Innovative real-time analytics help players who can process electronic data deploy new ideas and evolve our old ones.” in real-time the edge - Alex Kozlenkov, VP of technology, TXOdds Fixed Income Algorithmic Pricing & Execution

• Situation: Broker Targets New Asset Class for Growth – Broker identified fixed income as a market it had unique assets and capabilities to capitalize upon. • Problem: Existing Technology Antiquated – The firms’ existing FI auto quote system was slow, short on function, and traders had no confidence, so they typically shut it off – quoting was 95% manual. “We went from laggard • Solution: New Algo Pricing and Execution System to leader in just months – New team brought in to modernize and leapfrog the competition through innovative algorithmic quoting and with StreamBase.” execution technology. A team was hired, they selected StreamBase, and deployed version 1 in just 4 months. - MD fixed income trading • Impact: Fill Rates Jump from 5% to 35% – In just 6 months of development, and 6 months of deployment, the firm goes from 5% auto quoting fills to 35%, attracting more flow and setting a reputation as the fastest broker on the street (via Tradeweb) Predictive Sensor Analytics

• Situation: Oil Compressor Firm Has Only Historical Insight – Business Objects and database architecture provides insight into what happened in the past; not what’s happening now.

• Problem: How to Gain Real-Time Insight? – Faster refresh on historical data doesn’t provide the temporal analytics needed to understand real-time context

• Solution: StreamBase for Temporal Sensor Data Analysis – Analyze trending on temperature, vibration, voltage data streams in order to proactively detect and address compressor issues before its too late. “Understanding what’s about to happen helps us avoid outages and millions in lost • Business Impact: Increased Reliability Rates revenue from drills in the – Increased quality of service provides competitive advantage field” and increases customer satisfaction – problems fixed before they are detected by the client, avoiding millions in service outage revenue loss on oil rigs - VP, Oil Rig Compressor Company Real-Time Trading System Monitoring Real-time analysis of the impact of trading system outages and congestion

• Situation: Complex Trading Infrastructure – 4,000 trading system instances running per day, millions of trading events per day, complex fan out of trades – One order can spawn as many as 10,000 executions • Problem: Hours to Understand Outages “It used to take hours to – Manual log searching required to understand the figure out which clients were business impact of system outages: Which clients affected? Should we suggest they stop trading? impacted and how by trading system congestion or • Solution: StreamBase Monitoring outages. Now we have that – TradeFlow was developed 3-5X faster than if traditional information at our fingertips, technologies were used like databases or application and it provides exceptional servers, and with those, it would not be real-time client satisfaction to our • Impact: Avoid Trade Outage Cost & Better Service clients who understand their – TradeFlow cuts hours of problem analysis down to < 1 trading goals.” minute, which helps CCC provides superior client services because they understand the business impact - Head of IT of infrastructure outages or congestion in real-time.