1 Copyright © 2011, Oracle And/Or Its Affiliates. All Rights Reserved. Oracle Solaris Cluster

Gia-Khanh Nguyen Oracle Solaris Cluster Engineering

2 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Solaris Solaris Solaris Solaris Solaris Solaris Solaris

DDditdSedicated Servers Virt uali zed S yst ems Missi on C riti cal Cl oud s

SlSolari s 9 Solaris 10 SlSolari s 11

Solaris 11 Solaris 10 Solaris Oracle Oracle Zone Zone Legacy Zone Solaris Enterprise Cluster Oracle Solaris Manager Ops Center Oracle VM

SPARC x86

Virtual Enterprise Cluster-level Ultimate Clusters High Availability Load Balancing Disaster Recovery

• Built-in server, • Instant system • Optimized • Business continuity storage, network failure detection distribution of across unlim ite d virtualization distance • Orchestrated applications load Oracle Solaris Cluster • Multi-tenant policy-based, and priority • One-click, configuration from application- management for automated Web to database specific failover optimized switchover distribution • Secure, isolated • Pre-adapted • One-click, Oracle Solaris fencing and • Soft and hard automated Zone clusters quorum for data resource limits for takeover integrity flexible behavior • Physical and Best HA . • Application fault isolation in zone • Broadest data vitirtua lize d Best Integration. clusters management and environments networking support Oracle Solaris 11 • Failover Zones • Dedicated zone network and data resources

• Monitors health of all cluster components: – Servers, storage, network – OS, virtual machines – Applications • Tol era tes f ail ures b y expl oiti ng har dware redundancy and software algorithms • Recovers cluster infrastructure and applications in in the event of failures • Enables low-impact maintenance

Membership • Establishes consistent Heartbeats inclusion of nodes in cluster • Monitors nodes over a • Coordinates reconfiguration private network • Triggers reconfiguration when a node leaves or joins the cluster Cluster Configuration Repository • PidlProvides loca l copy on eac hdh node • Enables automatic updates • Enables nodes to arbitrarily join or leave the cluster

• Quorum – Prevents partitions (split brain, amnesia) in the cluster 1 1 – Protects against data corruption – Uses a majority voting scheme 1 – 2 node clusters require a quorum device (an external tie-breaker)

• Disk Fencing – Used to pr eserv e data in tegri ty – Non cluster nodes are fenced off from updating any shared data

10 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Application Level Management Resource Group Manager • Rich and extensible framework for plugging applications into Oracle Solaris Cluster – Application is wrapped by an RGM resource, supplying methods for controlling the application: Start, Stop, Monitor, Validate (aka agent) – Closely related resources placed in Resource Groups (RG) • Support rich dependencies between Resources and RGs – Facilitates proper startup/shutdown sequencing – Dependencies can have various flavorflavorss such as strong/weak/restart – Works between RG and across different cluster nodes • Oracle Solaris Service Management Facility (SMF) support • Standard agents provided for popular applications and DB

Install Apache and set up web pages and scripts # clrt register apache using ZFS file systems in a zpool “webpool” on # clrs create -g websrv-rg –t apache \ shared storage and using the webhost hostname -p Bin_dir=/webpool/install/apache/bin \ -p Resource_dependencies=websrv-hasp-rs \ # clrg create websrv-rg -p Port_list=80/tcp websrv-rs # cllhlrslh create -g websrv-rg \ -h webhost websrv-lh-rs Bring the resource group online # clrt register HAStoragePlus # clrg online websrv-rg # clrs create -t HAStoragePlus -g websrv-rg \ Switchover to the other node -p zpools=webpool websrv-hasp-rs # clrg switch –n 2 websrv-rg

App App • GtdiGuest domain as HA resource (black box) – Oracle Solaris Cluster Oracle Solaris Oracle Solaris Cluster Cluster running only in control domain Oracle Oracle Oracle Oracle Oracle Oracle Solaris Solaris Solaris Solaris Solaris Solaris • Domain as cluster node Control Domain Domain Domain Control Domain (control, I/O or guest domain) Domain Domain

Oracle VM for SPARC Oracle VM for SPARC

13 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. High Availability Designed for Virtualization Oracle Solaris Zones HA Deployments Zone Clusters Ideal for multi-tiered workloads and multi-tenants App Zone App Cluster • Application protection: policy based App HR Cloud App management • Ease of use and security: delegated administration extended to virtual cluster Physical Cluster Zone App Cluster App Failover Zone Finance Cloud Ideal for packaged workloads • Zone level protection: resource ddidependencies managemen tttdt, restart and failover Oracle VM Failover for SPARC Zone • Ease of migration: Support for older Oracle Solaris environments in a zone

• Multi-tenant clusters • Combine application, web and database tiers • Application-specific failover for virtualiz ed appli cati on s • Continuous cloud services

15 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Example of Multi-tier consolidation PeopleSoft HCM in Zone Clusters with ZFS SA 7000 # clzc status === Zone Clusters === --- Zone Cluster Status --- Name Node Name Zone HostName Status Zone Status ------appsrv-zc people01-s10 ipseapp1 Online Running people02-s10 ipseapp2 Online Running websrv-zc people01-s10 ipseweb1 Online Running people02-s10 ipseweb2 Online Running dbsrv-zc people01-s10 ipsedb1 Online Running people02-s10 ipsedb2 Online Running

# hostname # clrg list weblh2-rs people01-s10 websrv-lb-rg web-PIA1-rs # clnode list weblh1-rg web-PIA3-rs people01-s10 weblh2-rg web-PIA2-rs people02-s10 websrv1-rg web-PIA6-rs # clrg lis t | wc -l web2bsrv2-rg web-PIA5-rs 0 scalmnt-rg web-PIA4-rs # zlogin websrv-zc # clrs list fs-psftweb-rs # hostname web-lb-rs # clrt list ipseweb1 web-lblh-rs SUNW.LogicalHostname:4 # clnode list weblh1-rs SUNW.SharedAddress:2 ipseweb1 web-admin-rs SUNW.wls:4 ipseweb2 adminlh-rs SUNW.ScalMountPoint:3

Multi-site stretched/campus cluster Multi-site, multiple clusters

Distance dependent on network characteristics Unlimited Distance Separation

Quorum server Room 3

Single Cluster No dist ance lim it

Room 1Public Network Room 2

Private IP Network

Fiber Link FC/AL Switch FC/AL Switch

50 - 200km

Quorum server Room 3

Single Cluster No dist ance lim it

Room 1Public Network Room 2

Private IP Network

Array 1 Array 2 Array-based replication link

50 - 200km

Public IP network Admin. Client

Primary Site subnet 1 subnet 2 Backup Site

Optional Heartbeat Network

Optional Storage Network

Unlimited Distance Separation

21 Copyright © 2011, Oracle and/or its affiliates. All rights 21 reserved. OSCGE Architectural model Layered Extension of Solaris Cluster Built on Solaris Cluster (SPARC, x64) Can be installed/removed with no application downtime MltlitiManages cluster applications and associtdiated rep litilication Builds on same hierarchical concepts with associated admin CLI Partnership of two clusters (ph ysical or zone clusters ) Each cluster has one or more nodes Protection Group contains Resource Groups and Resources Resource Group contains application and storage resources Heartbeat for connection monitoring in partnership Standard TCP/IP heartbeat, opppgtional plug-ins Alerts by email, SNMP trap, custom script

Protection Groups are the managed entities Within a Cluster, Resource Groups fail/switch over Within a Partnership , Protection Groups fail/switch over “Big Red Button” switch-over of Protection Group Synchronized switchover of application and replication Action script is triggered Can be used to fail-over name server entries, etc. “One-click” manual switchover by design Standard Business Continuity practice Enables integration with non-IT parts of BC plan (ppp,eople, buildin g,gs, etc. )

Business Logic Tier Web Tier / Presentation Tier  Oracle Weblogic Server  Oracle Communications Calendar Server Infrastructure Tier  Oracle E-business Suite  Oracle Application Server  Oracle Communications Database Tier  Sun Grid Engine  Instant Messaging Server  Oracle Siebel CRM  Oracle DB and Oracle DNS, NFS, DHCP  Oracle Communications  Oracle Business Intelligence RAC  ZFS, QFS Messaging Exchange Server Enterprise Edition  Sybase ASE  Samba  Oracle iPlanet Web Server  Oracle PeopleSoft Enterprise  Informix IDS  Oracle Solaris Zone  Oracle iPlanet Proxy Server  Sun Java System Message  MySQL  Oracle VM for SPARC Queue, Directory Server  Apache Web/Proxy Server  SAP/MaxDB Database  Agfa IMPAX  Apache Tomcat  PostgreSQL  IBM WebSphere MQ,  TimesTen WebSphere Message Broker

 SAP liveCache, J2EE • No scripting or development required Engine, Enqueue Server  SWIFT Alliance Access/ • GUI to add custom applications GtGateway

Protocol • IPV4 • IPV6

Hardware • SPARC Managed • X86 Private Interconnect Takeover or • Vertical: 1-106 • Infiniband Managed Pre-tested with the most networking,Switchover storage,processors • 2-6 independent • Horizontal: 1- interconnects 16 nodes • Fast Ethernet anddd• Gigabit d aEthernett a management component s • 10 Gigabit Ethernet

Public Network Storage Solutions Replication & Mirroring File System • Infiniband • Sun ZFS Storage Appliance • Oracle Data Guard • Root: ZFS, UFS,VxFS • Fast Ethernet • EMC, Fujitsu, Hitachi, NetApp, • Sun StorageTek Availability Suite • Failover file system: ZFS, UFS, • Gigabit Ethernet and more • MySQL Replicator NFS, QFS, VxFS • 10 Gigabit Ethernet • Hitachi Universal Replicator and • Cluster file system: ACFS, PxFS, • IPMP True Copy shared QFS Storage Technologies • Sun Trunking • EMC SRDF • Fiber Channel, SCSI, iSCSI, • JbFJumbo Frames Volume Manager NAS Storage • VLAN • ZFS, SVM, VxVM, ASM

HA out-of-the box for Oracle applications , middleware Seamless integration with Oracle database and Oracle RAC Built on Oracle Solaris, for Oracle Solaris Secure High Availability for vitirtuali ze d env ironmen ts

Pre-tested, pre-engineered with SPARC, x86, SPARC SuperCluster and Sun storage

• Co-engineered with T4-4 Node 1 T4-4 Node 2

Oracle Web Oracle Web Proxy Server Proxy Server SPARC SuperCluster WebLogic Zone Cluster Oracle Oracle WebLogic WebLogic • Kernel-level Oracle Solaris Server Server

Oracle Application Server Oracle PeopleSoft Zone Cluster PeopleSoft APPS VM+ S10 IO APPS VM + S10 IO integration Application Application Domain Domain Oracle PeopleSoft ServerApplication ServerServer Oracle PeopleSoft – Faster failure detection Application Server Oracle RACZoneOracle Cluster RAC Oracle RAC Application Server – Faster services recovery DB VM + S11 DB VM + S11 InfiniBand internal • Data integrity protection Network with ZFS SA – NFS IO fencing and files lock release ZFS 7320 Storage Appliance • Combines mission-critical HA Cluster and virtualization

Oracle Solaris Cluster 4.0 Built-in Application support Wide range of Oracle applications and Higgyh Availability databases, web-, application and Oracle Solaris 11 Cluster membership, Heartbeat infrastructure solutions Disk fencing, Quorum, • Integrated end-to-end fault healing of Component , Storage Resources, Security hardware, OS and virtualization Quorum, Disk Path Monitoring Role based access control, • Component-Level Dynamic Reconfiguration SMF Integration zones security isolation

le Configuration Checker aa • No software to install • PdProduc tion-safe ob servability bilit Disaster Recovery Stretched Cluster and Multi-site/ Sc • Zero overhead VMware • Dynamic Domains Virtualization Multi-cluster with automated failover virtualization • HA for VMs Oracle Zone cluster, failover zone and replication solution • Secure live migration •Vmotion Oracle VM for SPARC: cluster • Solaris Zones • Virtualization node, failover node • OlVMTltOracle VM Templates mgmt tools • Support for x86 • SPARC / x86 Hypervisors

• Instant provisioning

Availability

31 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Full Integration with Oracle Solaris 11 delivery framework – IPS based delivery • Unified installation experience • Error-free software updates • Automatic patch dependencies resolution – Boot environment • Instant snapshot and rollback • Lower risk updates – Automated Installer • Common provisioning tool Cloud-optimized • Easy full stack, multi-node installation software distribution

Cloud-ready application protection with Oracle Solaris Zone Virtualization cluster for Oracle Solaris 11, Failover Zone for Oracle Solaris 10 and 11, and Oracle VM for SPARC Software Cloud-optimized software distribution with automated Life-cycle dependency analysis through Automated Installer and IPS Management packaging support RliblReliable prot ecti on f rom di sast er throug h au toma ted Disaster application failover and coordination for replication solutions such Recovery as StorageTek Availability Suite 4.0, Oracle Data Guard and script-based ppglug-in. Support peer OSC3.3u1 cluster. Increased application availability, simplified service Built-in deployment and management for Apache, Apache Tomcat, Application DHCP, DNS, NFS, Oracle Database 11.2.0.3 (single instance and Management Oracle Real Application Clusters), WebLogic Server

ptomcat1 ptomcat2 ptomcat3 ptomcat4 Critical

Zone 1 Zone 2 L = 12 L = 12 Important P = 30 P = 30 Solaris 11 Solaris 10 Test Zone 3 Zone 4 L = 8 L = 8 P = 20 P = 20 L = load Solaris 11 Solaris 10 factor P = priority

Zone 5 Zone 6 L = 8 L = 8 1 processor P = 10 P = 10 6 cores / 24 threads Solaris 11 Solaris 10 Load limit = 20 Load factor is the Dedicated CPU count Solaris 11 SlSolar is 11 SlSolar is 11 SlSolar is 11

ptomcat1 ptomcat2 ptomcat3 ptomcat4 Planned outage Zone 1 Zone 2 Maintenance shutdown L = 12 L = 12 ptomcat1 P = 30 P = 30 of Solaris 11 Solaris 10

Zone 3 Zone 4 L = 8 L = 8 P = 20 P = 20 Solaris 11 Solaris 10

Zone 5 Zone 6 L = 8 L = 8 P = 10 P = 10 Solaris 11 Solaris 10