Real-World MAA Best Practices for Siebel Applications on Oracle Database Floyd Manzara Mehdi Gerami Technical Architect Siebel Product Management Kris Trzesicki Richard Exley Senior Database Specialist Siebel MAA and Exadata Disclaimer The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. 2 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Program Agenda . Siebel Maximum Availability Architecture . Siebel and Active Data Guard . Siebel Testing with Oracle Database Replay . WestJet: Siebel on Exadata . Siebel Performance . Siebel Workload Tagging 3 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel Maximum Availability Architecture 4 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel Maximum Availability Architecture Primary Site Secondary Site Web Servers Siebel Servers Siebel Siebel Gateway Gateway Server Server DB Servers Oracle Oracle RAC and RAC and ASM ASM Oracle Data Guard Siebel Oracle File System Replication Oracle Siebel File Database Standby File System Database System 5 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Database Maximum Availability Architecture Real Application Clusters Online Upgrade Data Guard & Clusterware Upgrade Hardware and Software Active Failover Best Practices Fault Tolerant Online Replica Server Scale-Out Primary Site Secondary Site . Oracle RAC and Clusterware . Oracle Data Guard Database Servers Database Servers . Oracle ASM . Oracle Flashback Database Storage Storage . Oracle Recovery Manager Automatic Storage Recovery Manager & Flashback Management Correct Errors by Oracle Secure Backup Low Cost High Performance Fault Tolerant Moving Back in Time Storage Scale-Out Data Protection and Archival 6 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel High Availability Architecture HTTP Load Balancers Best Practices Redundant Configuration . Load Balanced Web Servers Web Servers . Clustered or Load Balanced Web Servers Load Balanced Siebel Servers . Clustered Gateway Server Siebel Servers Clustered Siebel Servers Load Balanced Siebel Servers Typically hosting Gateway Server, Typically hosting Object Managers, Siebel Remote, etc. Workflow, etc. 7 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel MAA on Exalogic and Exadata Case Study Primary Site (Site 1) Secondary Site (Site 2) F5 LTM 4200v F5 LTM 4200v vm36 vm52 Web Servers cn21 cn22 Virtualized Bare Metal Exalogic X3-2 Exalogic X3-2 Siebel Servers Siebel Gateway Siebel Server Gateway and Siebel Server vm02 and vm05 vm47 and vm30 cn23 and cn24 DB Servers Exadata Exadata db07 and db08 db01 and db02 Exadata X3-2 Oracle Data Guard Exadata X3-2 Siebel Siebel Oracle File System Replication Oracle File Database Standby File System (Exadata) Database System (ZFS) (Exadata) (ZFS) 8 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Unplanned Outage Testing Results Outage Error Messages New Login Failover Time Component Outage Type (seconds) (% Users) (% users) (seconds) Siebel Web Instance Failure 0 0.3% 0% Server Node Failure 25 2 (partial) 0.3% 0% Siebel Server Node Failure 0 50% 50% Gateway Instance Failure 0 0% 0% 30 2 Server Node Failure 0 0% 0% 100 2 Database Instance Failure 10 (partial) 2% 1 0% Server Node Failure 45 (complete) 2% 1 0% Primary Site Full Site Failure 77 (complete) 100% 100% 77 1 = Mostly addressed by a Siebel product enhancement in Siebel 8.1.1.11 2 = Can be tuned to a shorter time by configuring more frequent monitoring and shorter timeouts 9 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel MAA Best Practices . See “Siebel MAA on Exalogic and Exadata” New! – http://www.oracle.com/technetwork/database/availability/siebel-maa- exalogic-exadata-2020333.pdf – Detailed steps to establish a Siebel MAA configuration on Exalogic and Exadata – Detailed recovery steps for unplanned outages – Detailed outage test results – 30 best practices to achieve maximum Siebel availability, including several new and improved recommendations 10 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel and Active Data Guard 11 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel and Active Data Guard Active Data Guard Features . Physical standby database open for transactionally consistent read only access . Real-time apply of redo from primary resulting in minimal lag . Real-time block repair in the event of a block corruption on the primary . Incremental database backup support 12 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel and Active Data Guard Query Offload to Standby Query Offload Read/Write from Primary Read Only Siebel Users Siebel Users Primary Site (Read Write) Secondary Site (Read Only) Web Servers Read Only Siebel App Siebel Servers Siebel Siebel Gateway Gateway Server Server Real-time DatabaseRedo ApplyServers Oracle Oracle RAC and RAC and ASM ASM Oracle Data Guard Oracle Active Read Only Siebel File Synchronization Oracle Data Guard Siebel File File Database Standby System Replica System Database 13 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel and Active Data Guard Faster Queries for Remote Users Read/Write Read Only Read/Write Siebel Users Siebel Users Siebel Users Fast Queries for Primary Site (Read/Write) Secondary Site (Read Only) Remote Oracle Data Guard Users Real-time Redo Apply Siebel Siebel Gateway Gateway Server Server San Francisco Oracle RAC and Beijing Oracle ASM RAC and ASM Oracle Active Oracle Data Guard Database Standby Database 14 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel and Active Data Guard Opinion Poll . Would a read only Siebel application be useful for you? Read/Write Read Only Siebel Users Siebel Users Primary Site (Read Write) Secondary Site (Read Only) Web Servers Siebel Servers Siebel Siebel Gateway Gateway Server Server To offload work from the primary? Database Servers Oracle Oracle RAC and RAC and ASM ASM Oracle Data Guard Oracle Active Read Only Siebel File Synchronization Oracle Data Guard Siebel File File Database Standby System Replica System Database Read/Write Read Only Siebel Users Siebel Users Read/Write Siebel Users Primary Site (Read/Write) Secondary Site (Read Only) Siebel Oracle Data Guard Siebel Gateway Gateway Server Server To improve query performance for remote users? Oracle RAC and Oracle ASM RAC and ASM San Francisco Oracle Active Oracle Data Guard Database Standby Beijing Database ? What else? 15 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel and Active Data Guard Experimental and not The Challenge and a Potential Solution currently supported! . Challenge: The S_USER and S_SSA_ID tables are always updated by the Siebel, even when the users are only performing queries . Solution: 1. Create a “dummy” read/write database for S_USER and S_SSA_ID 2. Create a separate “RO” table owner in the Siebel database: . S_SSA_ID and S_USER are database links to “dummy” . All the other tables are synonyms of the real tables 3. When running against the Active Data Guard standby, Siebel configured to connect to the “RO” table owner 16 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel Testing with Oracle Database Replay 17 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel Testing with Oracle Database Replay Oracle Database Replay Capture and Replay Workflow Production Cross Platform Test System Real Production Replay Clients Workload Cross Version Oracle Database Workload Pre- Workload Analysis & Capture processing Replay Reporting 18 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel Testing with Oracle Database Replay Results in Our Lab . Siebel 8.1.1.9 . Oracle Database 11.2.0.3 . 33,000 concurrent simulated Siebel users . 333 GB workload captured over a 4 hour period . 350 million user calls, 19 million transactions . Successfully replayed on test system 19 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Siebel Testing with Oracle Database Replay Best Practices . See “Oracle Database Real Application Testing User's Guide” for more details on Oracle Database Replay: – http://docs.oracle.com/cd/E11882_01/server.112/e41481/toc.htm . See white paper “Siebel on Exadata” for best practice for running Oracle Database Replay with a Siebel workload: – http://www.oracle.com/technetwork/database/features/availability/maa-wp- siebel-exadata-177506.pdf 20 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. WestJet: Siebel on Exadata Floyd Manzara [email protected] Kris Trzesicki [email protected] WestJet: Overview THE AIRLINE INDUSTRY IS TOUGH “If I’d been at Kitty Hawk in 1903 when Orville Wright took off, I would have been farsighted enough, and public-spirited enough – I owed this to future capitalists – to shoot him down.” - Warren Buffet WestJet: Overview Canadian airlines operating today Adler Aviation Aklak Air Cargojet Airways KD Air North-Wright Airways Sunwing Airlines Aeropro Alberta Citylink Central Mountain Air Keewatin Air Orca Airways Superior Airways