BRKIOT-2111.Pdf
Total Page:16
File Type:pdf, Size:1020Kb
IoT in Substation and Energy Automation BRKIOT-2111 Paulo Pereira, Consulting Systems Engineer Internet of Things, Europe Agenda • Introduction • Cisco Architectural Approach • IEC 61850 Technical Overview • Fundamental Architectural Design Elements • Security Standards for Energy • Cisco IoT Portfolio for Energy Automation • Conclusion / Key Take Aways BRKIOT-2111 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public 3 Introduction Power Utilities Introduction • Many utilities looked this way in most of the 20th century. Regulation has changed this model considerably in most countries… • Most of World Grid is AC (50Hz Alternating Current in EMEA = 20ms full cycle) • Very Important to maintain frequency within very tight limits as rolling blackout may occur • No significant energy storage in the grid => Power must be kept in balance (generation follows load) BRKIOT-2111 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Power Utilities Infrastructure Primary Power Systems Step-up Transformer 13.8 kV / Transmission voltage level Transmission (220, 345, 500, 765 kV) Generation Station 13.8 kV Sub-transmission Switching Stations/ (161, 115, 69 kV) Transmission Substation Distribution Feeders 3-phase (7, 11, 33 kV) Distribution Substations Sub-transmission voltage level Generation Station 13.8 kV Service Transformers 7 kV to 120/240 V Secondary 120/240 V BRKIOT-2111 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Power Utilities Infrastructure Distribution Grid Detail • Monitor • Measure • Control • Automation • Protection BRKIOT-2111 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Cisco Architectural Approach Industry Drivers and Network Impact Changes in the HV Electrical Grid and Communications Electrical Grid Drivers Potential Network Impact (System Control Tier) Evolution from Centralized Generation to Distributed New locations requiring communications, use cases for Wide Area Generation and Storage Measurement and Control. Machine builders (Wind Towers). Industry and Security Compliance Strong, open standards based physical and cyber security: Video Cameras, Access Control, local storage; as well as Firewall, IPS/IDS, Encryption VPN, SIEM, Security Management. TDM End of Life RFPs for TDM migration to IP/MPLS or MPLS TP with Utility specific requirements (ex. interface module) Aging infrastructure, inefficient assets (some 40+ Use cases for Condition Based Maintenance, substation years). Optimization and more efficient Infrastructures expansion and upgrades to IEC 61850 / Ethernet / IP New Generation Workforce / OPEX reductions Collaboration tools for remote expert support, reduced truck rolls, remote access into / out of the Substation Distributed Intelligence / FOG computing Opportunity to host distributed Utility applications on network (driven by more distributed nature of electrical grid) platforms (Ex: OSI Soft, Substation Gateway, Security) BRKIOT-2111 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Power Utilities Solutions Overview Field Area NG WAN Field Workforce HV Substation Network Enablement Load DMS MDMS Control SCADA DMS DRMS MDM Secondary CC Cisco Connected CG-NMS AMI HES Grid Security and Head-end CG-NMS Network Management Substa on 2G/3G/LTE W GPRS, 3G, WIMAX / Prvt A substa on N LTE LTE T i e r Ethernet, Cisco Connected CGR1000 WiMAX Grid Router 1000 Cisco 1000 Series Connected Grid Router Series r Cisco Connected e IEEE 802.15.4 sub-GHz RF Mesh i T Grid Endpoint N A RF and PLC Mesh Protec on and N Neighborhood Area Network Control Networks Work Force Automa on Residen al Metering AMI Transformer Distribu on EV Charging Direct LoadO utdoor Gas / Water Distributed SCADA Protec on Direct Connect Metering / Monitoring Automa on Infrastructure Control Ligh ng Meters Genera on and Control AMI Meters HAN Gateway Network Business Cost Reduction, Operating Efficiency Workforce Productivity Operating Efficiency Outcome New Business Model . Reduced energy theft . Upgrade legacy . Data Transfers in Seconds . Increase visibility and . Reduced downtime SCADA systems . Handles Multiple Wireless proactive maintenance . Zero touch deployment . Converged, Multi Laptops, Smartphones, Tablets . Scale network to support . Converged Multiservice services network Simultaneously growing number of devices Key Networks (cost) . Integration of TDM . Machine-to-Machine Capabilities . Rapid Fault Isolation and legacy services Communications for Background, . NERC/CIP Security and (uptime) . Follow more recent Next Step Tasks while Field Industry compliance . Scalability, Security and Industry standards Crews are Working . IEC 61850 Interoperability BRKIOT-2111 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public 10 Cisco Substation Automation - System Scope The Cisco SA System covers the Substation Network, Wide Area Network, & relevant components and applications in the Control / Data Center. BRKIOT-2111 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Cisco Substation Automation Example Use Cases Use Case SCADA (DNP3, Modbus, T101) serial tunneling with Raw Sockets SCADA (DNP3, Modbus, T101) transport over E&M LMR SCADA (DNP3-IP, Modbus-TCP & T104) IP transport Wide Area Measurement Systems (WAMS) with C37.118.2 Monitoring, Wide Area Measurement Systems (WAMS) with IEC 61850-90-5 Control, Automation, IEC 61850 GOOSE messaging for Feeder Protection over Station Bus and IEC 61850 SV messaging with Merging Units over Process Bus Protection Traditional Teleprotection (Current Differential) with legacy interfaces IEC 61850 Teleprotection (Current Differential) with Ethernet interfaces System Integrity Protection Schemes (SIPS) Wide Area Measurement Protection and Control (WAMPAC) BRKIOT-2111 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Cisco Architectural Approach GridBlocks Application UseCase Architectures VER Output Management Renewable Generation Wide Area Monitoring Stabilization Actors/ Components Benefits Dynamic Line Rating FISR / FDCL Distribution Level Tele-Protection Actors/ Components Voltage Regulation Benefits Advanced Meter Reading Direct load Control DG – Voltage Ride Actors/ Components Through Benefits BRKIOT-2111 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Cisco Solution Validation Lab and Design • Dedicated solution validation lab for substation automation • Designed to support current and future real-world Power Utilities use cases • Lab consists of complete end-to-end utility SA network: NOC, substations, DMZ, WAN • End-to-end validation with RTU, Relays, IED, PMU etc (ex. Siemens and Alstom). • Test validation results documented in SA Design and Implementation Guide BRKIOT-2111 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Control and Automation Protocol Handling Proprietary protocols Standard protocols over Standards protocols IEC 61850 over Serial Serial over TCP/IP IEC 60870-5-101 MMS Vendor’s dependent DNP3, Modbus, etc IEC 60870-5-104, DNP3/IP, GOOSE/SV Modbus/TCP, etc IEC 60870-5-101 GOOSE/SV over IP/UDP DNP3 future IEC 8-1 and 9-2 profiles IP Interfaces Protocol Translation Ethernet Layer-2 switching Traffic tunneled over IP Raw • IEC 60870-5-101 to IEC 60870- Socket (TCP and UDP) 5-104 Serial L2 over IP WAN • DNP3 to DNP3/IP Ethernet PPP/CHAP (L2TPv3 or EoMPLS) Secure IP infrastructure (Data Integrity, Confidentiality and Privacy) BRKIOT-2111 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Serial SCADA Migration to IP infrastructure SCADA Server RS232 or RS485 PSTN RTUs Infrastructure Application communicates to COM ports SCADA Server Ethernet or Serial connection RS232 or RS485 IP RTUs Infrastructure Raw Socket Scenarios BRKIOT-2111 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Teleprotection Migration to IP E&M, C37.94 E&M, C37.94 Preserving channel-bank E1/T1 E1/T1 CESoPSN or SAToP Pseudowire TPR Relay TPR Relay Migrate from existing Migrate from existing Legacy to ASR-900 Legacy to ASR-900 E1/T1, Serial Direct Attachment from legacy relays E1/T1, Serial CESoPSN or SAToP Pseudowire TPR Relay TPR Relay Direct Attachment from IEC 61850 relays Ethernet Ethernet EoMPLS Pseudowire TPR Relay TPR Relay ESP ESP RTU RTU MPLS/IP MPLS/IP MPLS/IP DC DC CGS-2520 CGS-2520 Transport Transport Transport DFR IED/PMU IED/PMU DFR IE-2000U Substation Substation IE-2000U Router Router Substation Substation Edge Network Core Network Substation Edge Network Substation BRKIOT-2111 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Latency Statistics with Siemens Relays • The primary MPLS label switched 1.82 msec across 1-hop along primary path path traverses a direct link between the two ASR-903s 0.035 msec 1.75 msec 0.035 msec Siemens Siemens • The backup MPLS label switched Siemens Siemens Serial CESoPSN Pseudowire Serial Relay-1 Relay-2 path traverses 10 ASR-903 routers Convert Convert ASR-903 ASR-903 • Latency delta between 1-hop and 512kbps 512kbps 512kbps 512kbps optical 8xDS0 8xDS0 optical 10-hops is only 130usec due to ASR-903 centralized architecture and Cisco low-latency ASIC 1.95 msec across 10-hop along backup path 0.035 msec 1.88 msec 0.035 msec Note: Latency numbers reflected here Siemens Siemens do not account for distances between Siemens Siemens Serial CESoPSN Pseudowire Serial Relay-1 Relay-2 substations. Add 1msec propagation Convert Convert delay (speed of light through fiber optic) ASR-903 ASR-903 for every 200km between substations