Deep Dive into Monitoring with PI

Vince Polsoni Alectra Utilities

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 1

Agenda • Alectra • Maintenance Methodology • Intelligent Transformer Maintenance • Innovation • Leveraging Integrated/ Interfaced Systems • PI AF, Notifications, Analysis, Reporting

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 2

Where is Alectra? 2nd Largest Municipally Owned Local Distribution Co. (LDC) in North America

Ontario 1,068,587 km2

Alectra Service Territory • Located just North and West of Toronto, Ontario, Canada • 1800 km2 • 15 Communities • 1 million Customers • 3.1 million Population • 4750 MW Peak Demand • $3.6 Billion Total Assets

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 3

The Alectra Intelligent Maintenance Plan The Plan RCM3

(Reliability Centered Maintenance) TBM RCM3 CBM

(Time Based Maintenance) (Condition Based Maintenance) 100% of work (PM) • Preventive, Predictive was time based • On Condition Task • Failure Finding • Scheduled Restoration RCM3 - ISO55000 Compliant 'Right Work at • Scheduled Discard RCM3 - ISO31000 Compliant the Right Time, • No Scheduled Maintenance Done the Right Way, The First time'

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 4

Intelligent Station Maintenance at Alectra

• Leverage integration of PI System and CMMS • Risk Based - Condition Based Maintenance • RCM3 methodology incorporated in CMMS • Situational Awareness - Instant Information 24/7 • PI Notifications (Real time) • Alerts from CMMS System • PI System Reports, Dashboards • Automatic Triggered Maintenance Work Orders • Analytics in multiple systems • One source of data • Keeping it Simple

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 5

The Alectra Intelligent Maintenance System 2 Key Components 1. CASCADE CMMS • Tracks assets, Maintenance history, Asset Condition and Costs • Analytics • Trigger maintenance tasks based on condition or events • Interfaces with PI System, test equipment and Oil lab data • Prioritize maintenance work – Criticality, Health and Risk

2. PI System • Data collector, Speed optimized • Real-time analysis and notifications • Easy reporting tools, easy interfacing, enabler of IIOT

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 6

Industrial Development – Industry 1.0 to 4.0

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 7

What is RCM3 definition of RCM: "RCM is a process used to determine what must be done to any physical asset to ensure it continues to do what the user want it to do (fulfill its functions) in the present Operating Context"

• Started in the aviation industry as far as 1978 • Widely adopted by asset-intensive organizations across a variety of industries • RCM3 is an enhanced version of RCM2 • Brings RCM mainstream with the "new" Management Systems ISO 55000 and ISO 31000 • Risk Mitigation is a major focus of RCM3 • Enhanced methodology and process to make the analysis results more robust and defensible

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 8

RCM3 - Understanding Failure Curves

Source: RCM II by John Moubray, Industrial Press Inc, 1992

• Premature random failures • Often after Human Intervention

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 9

RCM3 – On Condition Task Condition Scoring Using Potential Failure “PF” Curve

Alectra Condition Scoring Matrix

1 1 New 2 2 Used

3 3 Potential Failure 4 4 Failed – Schedule Repair 5 Failed – Emergency Repair

3 5 6 Failed – Repaired Onsite

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 10

Embedded Sensors of a Power Transformer at Alectra Over 100 sensors/monitoring points on a typical station power transformer Geomagnetic OLTC Temp, Self Drying Induced Pressure and Breathers Oil Level Current Controls

Tank Oil Dissolved Gas Temperature & Analysis Pressure

Cooling Fans & Winding Pumps Temperature

Bushing Oil Pumps Monitoring

Transformer Protection Protection OLTC Oil MVA, MW, KV Health Filtration and Amps

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 11

Sensors / Equipment Monitoring – Building block for successful Intelligent Maintenance (CBM)

Substation Thermal Camera

Transformer Self Drying Breather Monitoring Systems Oil Filtration

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 12

Sensors / Equipment Monitoring – Key building block for successful Intelligent Maintenance (CBM)

Protection Relay Temperature & Pressure

Transformer Monitoring Relay Hydrogen Gas Monitor 7 Gas Monitoring Unit #OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 13

Fibre Optic - Temperature Sensor Monitoring

Monitors temperature of terminations, locations where InfraRed scanning is not safe or possible.

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 14

Alectra Intelligent Maintenance System Setup

Station Equipment Sensors PI Reports Test Results Analog & Status Data Dashboards (Real-time) Condition Data Firewall Firewall

Algorithm Rules Engine (Daily Scan) PI SCADA PI CARE CMMS Interface System Customer Info System CMMS CIS PI AF Table Query WorkOrder

OMS CMMS Alerts HTML PI Notifications (delayed) Outage Mgmt System Internet (Real-time)

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 15

Sensor Data used to Trigger Transformer Maintenance Tasks

• Transformer: • Dissolved Gas and Moisture (Oil Condition) • Loading, Oil Temperature, Oil Level, Transformer Tank Pressure • Transformer Cooling Status and Cooling Failure • Tap Positions (monthly max and min and if passed through neutral) • Tap Changer Oil temperature vs main Tank Oil Temperature • Bushing Monitoring Power Factor & Capacitance • Geomagnetically Induced Currents (GIC)

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 16

How Alectra configures Intelligent Transformer CBM using PI System and CMMS

Online WIMAX, Fiber, CASCADE SCADA PI System CASCADE CASCADE Monitor Radio CARE

Cascade Define Data sent to SCADA SCADA Points PI Tags Cascade CARE Point Triggers Analogue via available Created Created READS Mapping to PI Alerts from and Digital Communication Mapped to Created Tags CARE RPack State points Network SCADA Points to send to Cascade SCADA Mtce Triggers CARE RPacks Cascade (Algorithms) PI AF Created Triggers Configured Attributes MxOrders from created in Cascade CARE RPack Element Alerts CARE RPacks Template Created mapped to Cascade READ Condition Cascade PI Analysis MxProcedure Based Created Created Maintenance

PI MxProcedure / Notification Trigger Applied Created to Equipment #OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Communication Infrastructure

• Fibre – redundant systems throughout utility territory • Leased and owned • WiMax (Remote stations) to Hubs (Stations) then Fibre to servers throughout utility • Radio System to Hubs (Stations)

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Transformer Monitoring

• Utilize a SEL 2414 Relay • Inputs: • Hydrogen Monitor • High, High High, Monitor status (Form C Contact) • Winding and Oil temperatures from gauges • Oil level • Pressure Relief Status, Rapid Pressure (Oil movement – Protection Trip) • RTD – building temperature (3 wire 100ohm range) • Fan controls, amps • Know running current. If within operating window ‘Normal” if outside operating range “Cooling Failure Alarm” • Once a week for a 15 min interval fans are exercised automatically.

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Example: 7 Gas Monitor

Product: Morgan Schaffer Calisto 9 • Analyses 7 gasses plus water content • Monitored Consumables: Carrier gas, Calibration gas • PI Report and Notifications on consumables (weeks remaining and pressure) • Gas data interfaced to TOA4 • Script run at 3pm daily to upload gas values and have oil analyzed • Synchronized with CMMS twice a day • PI Notifications if gasses exceed IEEE standard thresholds • CMMS triggers alerts and auto generates work order if DGA or Moisture condition codes show oil is in poor condition • Data stored in PI as tags and stored in AF structure

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Integrated Expert Systems – Intelligent Transformer Oil Monitoring

Online Oil Oil Portable Monitor Lab

Data Data

SCADA TOA4

PI System CMMS

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 21

Transformer Dissolved Gas Analysis Monitor Report

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

PI Notification-Transformer DGA Levels Exceeding Thresholds

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Real-Time Transformer Oil Analysis

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 24

Intelligent Maintenance Example Dissolved Gas Analysis in Transformer

TOA4 Analysis PI Processbook

Daily Synch or On Demand Daily synch

CMMS Transformer Problem Identified • (Health and Risk Increase) • PI Notification, CMMS Alert • Auto Generated CM Work Order

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 25

TS Transformer Oil Condition Report

Main Tank - DGA and Moisture Analysis daily Main Tank - Fluid Quality yearly OLTC - DGA yearly

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 26

Transformer Hydrogen Gas Alarm Report

• PI System Notification – Real Time • CMMS System • Alert & Work Order Notification

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 65

Detailed Transformer Report

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Example: Transformer Bushing Monitor

Product: Doble IDD/Doble Prime

• Each unit can monitor up to 12 bushings • Connected to SCADA via DNP3 • Local connection and web page reporting • Raw data from IDD into PI System • Leverage PI Reporting and PI Notifications

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Integrated Expert Systems – Bushing Monitoring Transforming our World

Online Bushing Bushing Bushing Data Monitor Data Portable Tester

Data Data

SCADA DTA PRO

PI System CMMS

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 30

Bushing Monitoring – 1 set Secondary Windings

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Bushing Monitoring – 2 sets Secondary Windings

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

PI AF – Transformer Management

• PI AF Templates • PI AF Transformer Attributes • PI Analysis • PI Notifications • Configuration – Analysis • Configuration - Notification • Email • PI Table • Data extracted from CMMS and OMS systems

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

PI Asset Framework – Transformer Attributes

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Analysis Template – Tap Changer Oil Level

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Notification Rule – Tap Changer Oil Level

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

PI Notification Email Message Template Tap Changer Low Oil

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

PI Notification – Low Tap Changer Oil

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Video Example Table – Transformer and Tap Changer Oil Test Results from CMMS

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

SCADA – PI System – CMMS working as One

PI Report (High Water Alarm) PI Report (High Water Alarm Cleared)

High

PI Notification CMMS Work Order Alert CMMS Work Order

(from SCADA event) (from CMMS) (automatically generated)

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 40

PI Notifications – Transformer Conditions

• Transformer Differential • Transformer Online / Offline • Transformer Main Tank Breather • Primary Switch Operation • Tap Changer Low Oil • Secondary Txmr Breaker Operation • Tap Changer Oil Filtration Alarm • Transformer Oil Temp/Cooling • Dissolved Gas IEEE Threshold • Transformer Bushing Alarm Exceeded • Oil Containment Alarm • Dissolved Gas, Moisture and Fluid • Hydrogen Alarm Quality Condition Code >2 • Transformer High Winding Temp • Calisto 9 Oil Monitor General Alarm

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 41

SubStation Interconnection – Load Transfer Report

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 42

Geomagnetic Induced Current Report

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 43

Feeder Availability Report - Risk

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 44

PI Notification – Transformer De-Energized / Energized

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

PI Notification – Transformer Cooling System On / Off

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

PI Notification - Transformer Cooling Failure

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

PI Notification – Tap Changer Oil Filtration Alarm

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Maintenance Performance Reports

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Maintenance Program and Backlog Performance (by Mtce Task)

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 50

Current Year Transformer 3 Winding Doble Test Maintenance Program Completion Report

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Current Year Transformer Tap Changer Maintenance Completion Report

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Transformer - Annual Oil Samples

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Station Maintenance Program Performance (by Equipment Type) Open WO Status YTD Completed

WO to be Completed

Percent Completed Estimated Effort

Forecasted Historical • Generated Open • Closed

Backlog

Source: CMMS Historical Open #OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 54

Corrective Maintenance Performance

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 55

Visualizing Real-Time Asset Health – CMMS and PI System HRiskth Function of Criticality and Risk CMMS Maintenance Program Performance CMMS and PI / SCADA Data Equipment Condition (DGA, Moisture, Fluid Quality, Health Insulation, Capacitance, Bushings, etc.) Failures, Equipment Status Number of Customers per Feeder/ Transformer / Station Number of Open Work Orders Age No of at Station (1, 2 or more) Transfer Capability Oil Containment Criticality Key Customers Proximity of Station to Water Total No of Customers per Station #OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 58

Transformer - Criticality, Health and Risk

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 59

Various Operations / Equipment Reports - Alectra

• Transformer Availability • Transformer Mtce Completion • Transformer Oil Temperature • Transformer Mtce Forecast • Transformer DGA • Transformer Oil Containment • Transformer Hydrogen • Transformer Monitoring Equipment • Transformer Hydrogen and • Transformer Pressure Relief Vent & Moisture Gas Accumulation • Transformer Health & Risk • Transmission System Supply • Transformer Cooling • Geomagnetic Induced Current • Transformer Loading

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 60

230kV Transmission Supply Status Report

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 62

Station Performance Metrics (Example)

Multi States

Performance Indicators (Performance Equations) Analytics (Performance Equations)

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 63

Station Availability (Risk) Report

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 64

Transformer Fleet Availability

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 65

Station Transformer Oil Temperature/Cooling Report

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 66

Transformer Oil Temperature Report

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Alectra Service Territory Weather Report

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 68

Event Frame Report - Substation Transformer 110% Overloading Events

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 69

PI-ESRI Reports • PI Integrator for ESRI ArcGIS • ArcGIS Online Transformer Loading Number of Customers • Users of ESRI reports: per Station • System Planning • Engineering • Operations

Workers on Site • Other reports: • Outages with Weather Radar Station Load with and Wind Weather radar • Transformer Health • Transformer Loading • Transformer Oil Temperature

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 70

Notable Transformer Saves – Alectra Intelligent Maintenance

#OSIsoftUC #PIWorld ©20187 OSIsoft, LLC 1 Save - 230kV-27.6kV 75/125 MVA

#OSIsoftUC #PIWorld ©2018 OSIsoft72 , LLC

Integrated Expert Systems – Alectra Intelligent Transformer Maintenance

Online Oil Oil Portable Monitor Lab

Data Data

SCADA TOA4

PI System CMMS

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 73

Comparison of Sister Units - DGA Trends (Good Transformer) (Failing Transformer)

7 #OSIsoftUC #PIWorld4 ©2018 OSIsoft, LLC

Increased Gassing - 2 Significant Events Event 1 Event 2

Oct 20, 2012 April 19, 2013 Gas levels increased as load increased Gas levels increased as load increased

75 #OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Intelligent Maintenance CMMS-PI System-TOA4 - Dissolved Gas Analysis in Transformer

TOA4 Analysis PI Processbook

Daily Synch or On Demand Daily synch

Transformer Problem Identified CMMS (Health and Risk Increase) PI Notification, CMMS Alert and Auto Generated CM Work Order (Alert Generated if TOA4 DGA code is >2)

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 76

Findings and Cost Avoidance • It was found that one of the "T" connectors was not crimped during manufacturing to the copper lead. • Transformer was just over 5 years old. • Problem was identified just after warranty period ended.

Cost Avoidance: • Onsite Repair: $100,000 (Potential Failure) • Over $3 million if unit failed catastrophically or with serious internal damage to windings or core.

#OSIsoftUC #PIWorld ©201877 OSIsoft , LLC

Save - 10MVA 44kV-13.8 kV Transformer

PI Notification • High Winding Temperature • High Hydrogen Alarm

Cost Avoidance: $500,000 averted

• Repair Cost: $130,000 • No customer outages Installed a Hydrogen Gas Monitoring Unit • Transformer taken out of service and connected to SCADA (PI and CMMS) before failure, repaired and replaced with spare #OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 78

Increased Visibility – Transformer Maintenance Programs

• Dramatic Increase in Visibility and Awareness of Asset Condition and Program Performance

• Equipment Reliability (Availability/Uptime)

• Decrease Emergency Maintenance Tasks

• Increase Corrective Maintenance Tasks (no missed deficiencies)

• Decrease in Preventive / Predictive Maintenance Tasks

• Detective Maintenance (Failure Finding from RCM3)

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 79

- Intelligent Maintenance

• Failure Avoidance Costs – RCM3 –> CBM • 2 Notable Catastrophic Transformer Failure Avoidances • $3.5 Million Avoided Costs • Many Reliability Improvements through CBM Identified Potential Failures • No missed failures no matter how small • Safer Working Environment / Safer for Public • Improved Risk Management • Better Asset Condition Assessment (Health and Risk)

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 80

Benefits of Leveraging PI System for Transformer Management

• Makes it Easy to turn Real-time Data into Information • Stores Key Information for Asset Management Decision Making • Enabler for Risk Based Condition Based Maintenance • Maintenance Optimizer • Innovation stimulant • PI System is Easy to learn • Keeping it Simple is better

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 81

New – Live Video Streaming PI Report

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

New - ESRI Report in PI Vision Report

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Questions Please remember to…

Please wait for the Complete the Online Survey microphone before asking for this session your questions

State your name & company

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

Leveraging the PI System Station Transformer Intelligent Maintenance

COMPANYCOMPANY and GOAL AND GOAL Alectra Utilities Inc. is a progressive distribution utility company that focuses on Innovation and Technology to achieve operational efficiencies that contribute to maintenance optimization and reduction of equipment failures

CHALLENGE SOLUTION RESULTS

Implement an Intelligent Transformer Used the PI System as a means of Transformer fleet fully Maintenance System that improves worker enabling Prioritized Risk based monitored. Deficiencies are safety, increases asset availability, Condition Based Maintenance on automatically detected early improves reliability, lowers Operational station transformer fleet. Interface and prioritized. Cost avoidance costs, and provides Operations information key systems to allow operational is achieved as a benefit. Life to those who do not have access. data to aid in Optimizing Cycle extension is realized. transformer maintenance. • Configured Intelligent Maintenance • Cost Avoidance achieved with every • Adopt a new approach to transformer system with RCM3 as core deficiency find. maintenance which lowers maintenance utilizing CMMS and PI • Improved System Reliability maintenance costs while extending life Systems to operationalize the system. • Improved Response Time to Equipment Abnormalities of asset and improving worker safety. • Integrated to CMMS system to enable • Increased Equipment Availability due to True Condition Based Maintenance early detection of problems. • Developed PI Notifications to notify on • Savings in Operating Costs equipment conditions. #OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 85

Contact Information Vince Polsoni [email protected] Manager Station Sustainment Alectra Utilities Inc.

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 8686

Merci

Thank You

Grazie

Optional: Click to add a takeaway you wish the audience to leave with.

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC

COMPANY and GOAL

CHALLENGE SOLUTION RESULTS

#OSIsoftUC #PIWorld ©2018 OSIsoft, LLC 88