Oracle’s High-Availability Vision: What’s New in Oracle Database 11g Release 2 Juan Loaiza Senior Vice President, Oracle System Technology Oracle High Availability Architecture
1. Scale-Out & Low-Cost – High-volume hardware – All components active 2. Application Oriented – Protect and recover application objects – Enable online application changes 3. Integrated & Simple – Availability integrated into all components – Automated 4. Complete & Open – Handles all planned and unplanned downtime – Pluggable components
3 Oracle’s Database HA
Server Unplanned Failures Downtime Data Failures
System Changes
Planned Data Downtime Changes App Changes
4 Best-of-Breed Server Protection At Lowest Cost
Server Real Application Failures Unplanned Clusters (RAC) Downtime Data Failures
System Changes
Planned Data Downtime Changes App Changes
5 Real Application Clusters
HR SALES ERP
• Scale workloads across multiple low cost servers • Consolidate into fewer servers and databases • Runs all Oracle database applications • Built-in HA
6 New in 11.2 RAC One Node Virtualization Benefits for Oracle Databases
• A virtualized single instance database – Omotion - live migration of instances across servers • Move services, then shutdown transactional – Built-in cluster failover for high availability
• Better than OS level virtualization – Rolling database patches – Manage fewer Operating Systems • 10 DBs on a node does not mean 10 Operating Systems to manage – Rolling OS upgrades
7 Best-of-Breed Data Failure Protection At Lowest Cost
Human Server Errors Failures Unplanned Flashback Data Downtime Data Corruptions RMAN Failures Oracle Secure Storage Backup Failures System ASM Changes Site Data Guard Failures Streams Planned Data Downtime Changes App Changes
8 Traditional Flashback Technologies Recovery 80 Error Detection & Correction 60 • Flashback revolutionizes error recovery 40 – View ‘good’ data as of a past point-in-time
Recovery Time Recovery 20 – Simply rewind data changes Flashback – Time to correct error equals time to make error 0
Correction Time = Error Time + f(DB_SIZE)
• Low impact, easy – simple commands, no complex procedure • Flashback Query, Table, Transaction, Database, Drop • SQL> flashback database to
• Enhancements in 11.2: New in 11.2 • Flashback database performance & monitoring optimizations • Flashback archive support for schema evolution
9 Oracle Backup & Recovery Integrated Disk, Tape & Cloud Backup
Oracle Enterprise Manager
• Recovery Manager (RMAN) manages Database Backup & Recovery Oracle Secure Backup • Intrinsic knowledge of database RMAN file formats and recovery procedures • Block validation • Online block-level recovery Tape Drive • Unused block compression • Online, multi-streamed backup • Native encryption Fast Recovery Area Cloud Data Files
10 New in 11.2 Multiple RMAN Compression Levels More Cost Savings
• Backup compression: popular way to save on storage
• Multiple RMAN backup compression levels – Choose between compression levels & backup throughput • [BASIC] | HIGH | MEDIUM | LOW
11 Oracle Secure Backup Enterprise Tape Backup Management
Oracle Enterprise Manager Tape Backup for Oracle Secure Backup Oracle Environment Oracle Database File System Data • Built-in Oracle Integration
RMAN Integration • 25 – 40% faster than leading competition • 4X less expensive than comparable products Tape Virtual Library Tape • Supports Oracle Library (VTL) Database 11g through Oracle9i
12 Oracle Secure Backup Cloud Module Offsite Database Backups in the Cloud
Database Files / Fast Recovery Area
RMAN Oracle Secure Backup Cloud Module Amazon S3 Compression / Encryption
• Oracle Secure Backup Cloud module: Backup databases to Amazon Cloud – Complements local disk and/or tape backup – Eliminates IT management overhead of a disaster recovery site
13 Automatic Storage Management (ASM) Stores & Manages All Data
Database Application 3rd Party FS
ASM Disk Group
• ASM dynamic volume manager supports file systems • ASM directly supports Clusterware files – Cluster Repository, Voting Disk • Built-in mirroring protects from disk failures • Enables auto-repair from corrupt blocks using a valid mirror copy
14 New in 11.2 ASM Cluster File System Oracle Management of File System Data
• Manage both database & file system data – E.g.: Oracle & Application binaries, trace files, alert logs, BFILEs, image files, etc. • Clustered or local file system – Data stored in ASM – Inherits all ASM manageability benefits • Online disk add/drop/rebalance • Integrated mirroring • Cross-platform Shared File System • Read-Only Snapshots – Up to 63 point-in-time space efficient copies of file system • Linux and Windows only in first release
15 Active-Active Availability Minimizing Downtime During Site Failures
Human Server Errors Failures Unplanned Data Downtime Data Corruptions Failures Storage Failures
Site Data Guard Failures GoldenGate Streams
16 Oracle Data Guard
Best Disaster Recovery Open R/O with Dallas Physical Standby Active Data Guard Sync or Async Redo Shipping Production Redo Database Apply Network Backup
DIGITAL DATA STORAGE
DIGITAL DATA STORAGE
Broker Open R/W for Logical peripheral writes Transform Standby Chicago Redo to SQL
SQL Apply Boston
17 New in 11.1 Active Data Guard Offload Queries to Standby
Real-time Queries Concurrent Real-Time Continuous Redo Query Shipment and Apply
Primary Physical Database Standby Database
• Queries on standby database concurrent with apply • Available with Physical Standby in 11.1 – Handles all data types, very fast, operationally simple • Eliminates cost of DR – All hardware used for production load
18 New in 11.2 Oracle Active Data Guard Read Scalability, with DR
Queries Scalable • Up to 30 active Reader standby databases Queries Farm • Flexible options to Updates Queries scale read performance • Add more active Queries standby databases • Scale active standby databases using Production Database Oracle RAC
19 New in 11.2 Oracle Active Data Guard Auto Block Protection
• Automatically repair block corruptions online • Primary repaired from standby and vice-versa
Read/Write Real-time Workload Reporting
Primary Continuous redo shipping validation & apply Active Standby Database Database
20 New in 11.1 Snapshot Standby Test with Production Data Before Deployment
Physical Standby • Use Standby Database for testing Apply Logs and development – Eliminates cost of DR Justify full scale test and DR Open Back out – environments by combining into one Database Changes • Preserves zero data loss while in test/dev mode Snapshot – But no real time query or fast failover Standby Perform • Similar to storage snapshots, but: Testing – Provides DR at the same time Continuous Redo Shipping – Single copy of storage
21 New in 11.2 Oracle Data Guard Better Application Availability
• Automate client failover with role-based services and FAN
FAN Auto-start of enabled primary JDBC database services and OCI clients Wide Area Network (ASYNC) Fast notification of application Primary clients Database NewStandby Primary Database
22 New in 11.2 Oracle Active Data Guard Ensure Service Levels for Query Latency
• Automatically enforce service levels for standby queries
• Query receives error if data delay exceeds SLA • Applications can redirect query to primary
Read/Write Real-time Workload Reporting
Primary Continuous redo shipping validation & apply Active Standby Database Database
23 New in 11.2 Additional Data Type Support Both Data Guard SQL Apply & Streams
• Additional Data Type support: – Basic Table Compression – OLTP Table Compression – SecureFiles • Without deduplication – Online Table Redefinition – Extended data type support for SDO_GEOMETRY (SQL Apply)
24 Comprehensive Data Guard Monitoring Using Enterprise Manager 10g Release 5
• Critical Data Guard metrics reported on HA console
25 Oracle Streams Built-in Oracle Database Replication Solution
Source Target Database Database Propagate
Redo Capture Apply1 Logs Apply2 Transparent • Active-active databases with automatic Gateway conflict detection & optional resolution Non-Oracle • Provides HA for custom apps where Database update conflicts can be avoided or managed
26 New in 11.2 XStream Fast Real-Time Programmatic Access to Data Changes
• Extended Streams - XStream – API for fast real-time access to changes in Oracle database – Client attaches directly to Streams apply process using OCI/Java
– Outbound server (XStream Out) • Stream changes out of the Oracle database
– Inbound server (XStream In) XStream • Stream changes from external sources into an Oracle database
27 New in 11.2 Better Streams Performance
• Performance optimizations of uni-directional Streams extended to one-to-many
• Faster transformations – Statement DML Handlers • Up to 4x faster than procedural DML handlers – New Declarative Transformation - Keep Columns
• Extensive tuning throughout Streams
• Improved JMS integration and faster Streams Advanced Queuing – AQ dequeue is 30%-100% faster than previous releases
28 GoldenGate
• Best-in-class leader in real-time data solutions • Continuous Availability for heterogeneous systems • Real-time data access for Reporting • Real-time data for BI, EPM, Exadata • Zero-downtime migrations / upgrades to Oracle Database and Applications Real-time information • Over 400 customers with 4,000+ implementations across Fortune 500 companies: Financial Services, Communications, Healthcare, Public Sector, Retail & Utilities industries Real-time Access • Top 3 of 5 largest commercial banks • Top 3 of 3 busiest ATM networks • Top 7 of 10 financial data services companies • Top 4 of 5 telecommunications providers • Top 3 of 5 largest food & drug stores
29 GoldenGate for Heterogeneous Platforms
Databases O/S and Platforms Capture: • Windows 2000, 2003, XP . Oracle • Linux . DB2 • Sun Solaris . Microsoft SQL Server • HP NonStop . Sybase ASE • HP-UX . Teradata • HP TRU64 . Enscribe • HP OpenVMS . SQL/MP • IBM AIX . SQL/MX • IBM z/OS Delivery - all listed above, plus: . HP Neoview, Netezza, Greenplum, and any ODBC compatible databases . ETL products . JMS message queues . MySQL . TimesTen
30 GoldenGate and Streams
Oracle GoldenGate Oracle Streams
• GoldenGate is Oracle’s strategic replication solution • Streams continues to be a supported Oracle Database feature • Best Streams technology will be integrated into GoldenGate
31 GoldenGate and Data Guard
Heterogeneous Oracle Distributed Oracle Active Fully-active GoldenGate Data Guard Subset Replicas Oracle DB Primary Oracle DB Standby
• Information Distribution & Consolidation, Application Upgrades & Changes – Use GoldenGate - heterogeneous, active-active, transformations, subsetting • Disaster Recovery / Data Protection / HA – Simple Full Oracle Database Protection • Use Active Data Guard • High-performance, simple, drop-in solution for HA and DR, readable at standby • Works for all apps and data types, including packaged apps that can’t be changed – Application desiring flexible HA, active-active, schema changes, platform changes • Use GoldenGate • Avoid or manage active-active conflicts at application level • Combine the two for full database protection and information distribution
32 Best Online Planned Maintenance At Lowest Cost
Server Failures Unplanned Downtime Data Failures
System Online Reconfiguration Changes Rolling Upgrades Planned Data Online Redefinition Downtime Changes App Edition-based Changes Redefinition
33 Online Reconfiguration Scaling on Demand
• Servers – Add/Remove RAC nodes online – No data movement needed Database • Storage – Add/Remove ASM disks or arrays online – Automatically rebalance after storage change
Storage • Clusterware, ASM – Upgrade Oracle Clusterware and ASM (11g) in an online manner
34 Online Patching and Upgrades
• Most one-off patches can be applied to a running Oracle instance – Linux-x86, Solaris 10, HP-UX 11i – [New in 11.2] Windows 32-bit and Windows 64-bit, AIX v6.1 [TL2 SP1]
• More complex one-off patches can be deployed online using RAC rolling patches (available 10g onwards)
• Database release/patchset upgrades, operating system upgrades, platform migrations can be applied in rolling fashion using Data Guard / GoldenGate / Streams
• Data Center moves / SAN migration / Technology Refresh etc. can be done with minimal downtime using Data Guard / GoldenGate / Streams
35 Online Index & Table Redefinition
• All index changes can be done online – 11gR1 – table is never locked during online index creation • Tables can be Reorganized & Redefined online – Allows changing location, table type, partitioning, columns, column types – Contents can be transformed as they are copied
Copy Transform Source Table Table Result Table
Store Continuous Update Updates Queries & Tracking Transform Updates Updates
36 New in 11.2 Edition-based Redefinition Overview
• Enables online application patches and upgrades
• Allows old and new version of application to co-exist even though schema is changed by new version
• Capabilities primarily used by application developers
37 New in 11.2 Edition-based Redefinition How Does it Work? Post-upgrade Edition
• Maintains logical versions of changed database objects, through: – Edition – Editioning View – Crossedition Trigger Crossedition • PL/SQL code changes and view changes installed Triggers in the privacy of a new edition • New data changes made to new Pre-upgrade Edition columns/tables not seen by old edition • Editioning view exposes a private projection of a table into each edition • Crossedition trigger propagates changes made by old edition into new edition’s columns, or vice-versa
38 End-to-End Availability
39 Sun Oracle Database Machine
• Grid is the architecture of the future • Highest performance, lowest cost, incrementally scalable • Redundant and Fault Tolerant • Sun Oracle Database Machine delivers the first and only complete grid architecture for all data management needs
Oracle Database Server Grid • 8 High-performance compute Exadata Storage Server Grid servers • 14 High-performance storage servers InfiniBand Network • 5TB flash storage • 40 Gb/sec fault-tolerant unified • Data is mirrored across storage server and storage network servers
© 2009 Oracle Corporation - Confidential 40 40 Database Technology Drives Availability
Real Active Application Data Guard Clusters
WAN ASM Oracle Fast Secure Recovery Area Backup • Real-time remote standby open for Protection from • queries – Server Failures • Human error correction – Storage Failures – Database, table, row, transaction level – Network Failures Online indexing and table redefinition – Site Failures • • Online patching and upgrades
41 Database Machine HA Metrics
• Backup & Recovery – Backup shows extreme performance and scalability using Exadata – Full Database Backup to tape demonstrated at 7.8 TB/hr . Limited by tape performance of 14 tape drives used in test – Incremental backup to tape at 10% change rate: 70TB/hr – Single RMAN backup channel runs full backup to disk at 2.5 TB/hr
• Data Guard – Full DR demonstrated with uncompressed loads over 2TB/hour – Compressed tables reduce redo & net traffic enhancing Data Guard • 5 TB/hour load rates with Data Guard into compressed tables – 5 customers have implemented Data Guard on a Database Machine in first year
42 Oracle High Availability Architecture
1. Scale-Out & Low-Cost – High-volume hardware – All components active 2. Application Oriented – Protect and recover application objects – Enable online application changes 3. Integrated & Simple – Availability integrated into all components – Automated 4. Complete & Open – Handles all planned and unplanned downtime – Pluggable components
43 HA Sessions, Labs, & Demos by Oracle Development
Sunday, 11 October – Hilton Hotel Imperial Ballroom B Tuesday, 13 October – Marriott Hotel Golden Gate B1 3:45p Online Application Upgrade 11:30a GoldenGate Zero-Downtime Application Upgrades Monday, 12 October – Marriott Hotel Golden Gate B1 1:00p GoldenGate Deep Dive: Architecture for Real-Time 11:30a Introducing Oracle GoldenGate Products Wednesday, 14 October – Moscone South Monday, 12 October – Moscone South 10:15a Announcing OSB 10.3, Room 300 1:00p Oracle’s HA Vision: What’s New in 11.2, Room 103 11:45a Active Data Guard, Room 103 2:30p Oracle Streams: What's New in 11.2, Room 301 5:00p Exadata Storage & Database Machine, Room 104 4:00p Database 11g: Performance Innovations, Room 103 5:30p Comparing Data Protection Solutions, Room 102 Thursday, 15 October – Moscone South 9:00a Empowering Availability for Apps, Room 300 Tuesday, 13 October – Moscone South 11:30a Oracle Streams: Replication Made Easy, Room 308 12:00p Exadata Technical Deep Dive, Room 307 11:30a Backup & Recovery on the Database Machine, Room 307 1:30p Zero-Downtime DB Maintenance, Room 103 11:30a Next-Generation Database Grid Overview, Room 103 1:00p Oracle Data Guard: What’s New in 11.2, Room 104 Demos Moscone West DEMOGrounds 2:30p GoldenGate and Streams - The Future, Room 270 2:30p Backup & Recovery Best Practices, Room 104 Mon & Tue 10:30a - 6:30p; Wed 9:15a - 5:15p 2:30p Single-Instance RAC, Room 300 Maximum Availability Architecture (MAA), W-045 4:00p Enterprise Manager HA Best Practices, Room 303 Oracle Streams: Replication & Advanced Queuing, W-043 Oracle Active Data Guard, W-048 Hands-on Labs Marriott Hotel Golden Gate B2 Oracle Secure Backup, W-044 Monday 11:30a-2:00p Oracle Active Data Guard, Parts I & II Oracle Recovery Manager & Flashback, W-046 Thursday 9:00a-11:30a Oracle Active Data Guard, Parts I & II Oracle GoldenGate, 3709
44 Complete List of New HA Features Oracle Database 11g Release 2 Oracle Database 11g Release 1
45 Complete List of New HA Features Oracle Database 11g Release 2
Data Guard Data Guard (contd.) RAC • Active Data Guard: • SQL Apply support of OLTP • Server pools • Online block repair Compression, SecureFiles, • RAC One Node • Query SLA XA in RAC, Online • Omotion • Primary with 30 standbys Redefinition & Edition-based Redefinition, • Parallel local & remote SYNC ASM transport SDO_GEOMETRY (EDS) • Cluster File System • Retrieve remaining redo from • Use logical standby as primary before failover Streams source • OCR & Voting Disk in ASM • Improved client failover • Role-based services Streams Flashback • Broker support for ONS • XStream IN & OUT • Flashback Database: better • Support auto-client failover • Statement DML Handlers performance for direct loads for logical standby for JDBC, • Better infrastructure to track • Flashback Database: enable OCI, ODP.Net changes to table data while database is open • No shutdown of RAC instances • New Declarative • Flashback Database: better in old standby for switchover Transformation: keep_columns monitoring of progress • No shutdown moving from Max • Optimized one-to-many • Flashback Transaction: track Availability to Max Protection propagation foreign key dependency • Comprehensive support for • AQ: Improved JMS integration compressed redo transport & performance improvements • Support of OLTP Compression, SecureFiles, Online Redefinition 46 Complete List of New HA Features Oracle Database 11g Release 2
Online Patching & Upgrades OSB 10.3 Grid Control 10.2.0.5 • Edition-based Redefinition • Server-less tape duplication • HA Console using Edition, Editioning View for VTL using NDMP tape • MAA Advisor and Crossedition Trigger copy • Minimal downtime ASM • Online Patching for Windows • Better automation for tape migration & RAC conversion & AIX vaulting • Streams dashboard and • Support for IPv6 as well as improved monitoring of Streams RMAN IPv4 configurations. • Multiple compression levels • Supports LTO-4 tape drive • Database Clone from existing encryption • Target-less DUPLICATE database backups • Manages encryption key • Optimized checks for • Comprehensive OSB seamlessly between native or management DUPLICATE LTO-4 encryption • Expanded DUPLICATE • OSB File System • More comprehensive backup / Backup/Restore and reports options restore monitoring • Enhanced tablespace point-in- • Task based workflow for mining • Verification of tape device redo and archived logs time recovery using configurations transportable tablespace and Data Pump • Improved flexibility of SET NEWNAME • Faster transportable database
47 Complete List of New HA Features Oracle Database 11g Release 1
Clusters Data Guard - Generic Data Guard SQL Apply • Better performance, failover, Ÿ Snapshot standby Ÿ Support XMLType data type management Ÿ Fast-Start Failover in secs (CLOB) • Seamless integration with XA Ÿ Fast-Start Failover for Ÿ Support Transparent Data and Microsoft Transaction asynchronous mode Encryption (TDE) Server Ÿ Fast Redo Transport Ÿ Apply performance improved • Optimized Cache Fusion significantly Ÿ Redo Transport Compression protocols for gaps Ÿ Support Fine Grained Auditing Ÿ SYS user no longer required for Ÿ Support Virtual Private redo shipping Database ASM Ÿ Standby across Linux/Windows • Temporarily freeze I/O to on x86 Data Guard Redo Apply unresponsive storage and Ÿ Active Data Guard replay writes when it returns Flashback Ÿ New parallel media recovery • Rolling Upgrade for ASM Ÿ Flashback Transaction doubles redo apply instances performance Ÿ Flashback Data Archive Ÿ Fast Incremental Backup Ÿ Better RMAN integration
48 Complete List of New HA Features Oracle Database 11g Release 1
Backup & Recovery Upgrades Streams Ÿ Data Recovery Advisor • Online patching Ÿ Support XMLType data type Ÿ Intra-file parallel backup and • Transient logical standby (CLOB) restore Ÿ Support Transparent Data Ÿ Faster backup compression Online Redefinition Encryption (TDE) Ÿ Duplicate database over the • Fast add column with default Ÿ Apply performance improved network value significantly Ÿ Integration with Windows • Invisible Indexes prevent Ÿ Support AWR, ADDM, ASH Volume Shadow Copy premature use of newly Ÿ Streams Performance Advisor Services (VSS) API created indexes Ÿ Synchronous capture Ÿ Integrated protection • Online index build with NO Ÿ Table Data Comparison through ultra safe mode pause to DML Ÿ JMS/AQ performance • No recompilation of dependent improvements objects • Easier to execute table DDL operations online
49 Oracle GoldenGate Key Features in v10
• General – Across the Platforms – Event Marker Infrastructure – Start Delivery as of CSN (Commit Sequence Number) for efficient instantiation – Enhanced Memory Management – Deferred Apply – Array Fetching to increase initial load performance • Oracle – Additional data type support – Spatial, IOTs, Sequences, clustered table, object table – Support of Append hints (Apply only) – Increased Oracle DDL text maximum size to 2MB – Filtering by User for more efficient loop detection and capture task type separation (e.g. batch vs OLTP) – Expanded Support of ALO (Archive Log Only) mode for RAC environments • SQL Server – SQL Server 2008 Delivery – Capture of tables w ithout primary keys (SQL Server 2005) • DB2 LUW – Support for Multi Dimensional Clustered Tables (MDC) – Support for Materialized Query Tables (MQT) • NSK – Support of HP Blades – Support Primary Key Updates from Open Systems (e.g. Oracle to NSK) • Teradata – Integration of Oracle GoldenGate Director w ith TMSM (Teradata Multi-System Manager) – Support of Teradata v13 – DDL replication – Support for additional platforms: Solaris 10, SUSE 9/10 – Full Unicode Support for Linux ODBC
50 Resources
• Oracle.com: http://www.oracle.com/ha
• Oracle HA Customer Success Stories on OTN: http://www.oracle.com/technology/deploy/availability/htdocs/HA_CaseStudies.html
• Maximum Availability Architecture (MAA): http://otn.oracle.com/goto/maa
• MAA Assessment: http://www.oracle.com/goto/hasurvey
51 QQ U E S T I O N S A& N S AW E R S
52 For More Information
search.oracle.com
or oracle.com
53 54