Snap Clone and Data Refresh Solutions Using Oracle Enterprise Manager CON6982
Total Page:16
File Type:pdf, Size:1020Kb
Deep Dive: Snap Clone and Data Refresh Solutions using Oracle Enterprise Manager CON6982 Martin Peña Senior Director, Product Management Subhadeep Sengupta Consulting Product Manager Janardhana Korapala, Database Admin Consultant, Presented with Dell Inc Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Agenda 1 Snap Clone Overview 2 Features and Use Cases 3 Customer Use Case: Dell - Snap Clone with EM13 4 Q & A Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Hurdles to Rapid Development and Deployment Innovation is a key requirement for business growth • Increasing the speed of application development – Fast moving application/database requirements require systematic approach to dev/test – System/application patch/upgrades can introduce risk to dev/test – Custom application/development require deployment in less time • Efficient and up-to-date copies of mission-critical databases for agile application development – Multiple clones of production databases/systems often required to support dev/test activities – Dev/test and cloning of application and databases must be non-disruptive to production database 62% manage more than 5 DB copies, 34% manage more than 20 IOUG Database Storage Survey, 2014 Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Challenges to Development Agility Today Lengthy and complex database provisioning QA Engineer Manager DBA Network Admin Storage Admin DBA QA Engineer Request HW & Setup OS Allocate Configure Request DB Approval Storage & Network Storage Cluster & DB Access DB Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Challenges with Cloning Today Impeding your efforts to innovate • Lack of automation – Scripts are not a viable solution for an agile development process • Traditional cloning techniques are slow – Existing storage vendor solutions are DBA unfriendly • Data explosion often outpaces storage capacity – Inhibits ITs ability to provide clones for development and testing • Archaic processes that require multiple users to share a single clone, or only supports fixed refresh cycles – Different priorities between DBAs and Storage administrators Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Enterprise Manager Snap Clone • Space Efficient • Data Refresh – Over 90% storage savings – Refresh from production • Rapid Cloning • Integrated DB Lifecycle Mgmt. – ~ 2 minutes to provision a 1 TB database – Masking, subsetting, lineage and association • Storage Agnostic • Complete On Premise & Cloud Solutions – Supports NAS and SAN storage Functional Copies User can create Create Test Master Provision Thin Clones additional copies Test Master for functional testing without Production DB Masking & consuming space Sub-setting Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Enterprise Manager Snap Clone Development Agility Powerful Storage Support Storage savings, rapid Supports ALL storage provisioning, Self Service vendors (NAS & SAN) Database Cloning across Data Refresh Clouds Empower the user to make For Compute Services and adhoc clones and restores Database Cloud Services Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Snap Clone Solution Development Agility Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Data Reduction via Thin Clones Traditional Clones Thin Clones Full copy of the original database Only changed blocks in new clone space 3TB for original + clones 1.015TB for original + clones Base Image Base Image 1TB Data Files 1TB Data Files Pointers to Clone A Clone A existing blocks 1TB Data Files 5GB Data Files New data Pointers to Clone B Clone B existing blocks 1TB Data Files 10GB Data Files New data Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Oracle Database as a Service Snap Clone Leverages DBaaS Framework and DB Management Efficiency Consolidated, shared platform maintained with automation Database Accessibility Dedicated Database Pluggable Database Database Schema Automated request channel via self-service Elasticity Agile scale up, scale down, relocation of services OR OR Data Accountability Meter usage, quota, compliance and governance Empty Full Clone Snap clones Integration API integration with 3rd party tools , Infrastructure change requests, dev workflows Physical, Virtual, or Engineered Systems (Hybrid Cloud) On Premise & On Oracle Cloud Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Snap Clone Solution Powerful Storage Support Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Data Cloning Technology Options Leverage your Existing Investments RMAN Restore RMAN Duplicate Data Pump Database Native Hardware Solutions Software Solutions Vendor Specific Vendor Agnostic Storage Agnostic ACFS Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Snap Clone on Exadata Leveraging Sparse Clones • Fast, space-efficient snapshot copies of database • Available for Self-Service consumption. • Integration with pluggable database enables creation of Snap Clone with a “Single Click” • Initiated by using Database snapshot integration • All Exadata features work on features snapshots (smart scans, smart – SNAPSHOT COPY (for pluggable databases) flash cache, resource management – CLONEDB (for non-container databases) …) 10 x Snap Clones created concurrently from 60TB database in 15 minutes. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Hierarchy of Snap Clones on Exadata DEV/TEST T1 T2 T3 EXADATA - ASM CLUSTER P T1-R/O T2-R/O DB6 T3-R/O DB1 DB2 DB3 DB4 DB5 ASM SPARSE DG ASM SPARSE DG DB7 Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Snap Clone with Oracle ZSF Storage Appliance Engineered for optimizing database storage • Oracle ZS Storage Appliance – Optimized Oracle Database efficiency with HCC – Optimized RMAN backup and recovery – Optimized data reuse in development and test – DBAs manage snapshots and clones directly Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Snap Clone using Solaris File System (ZFS) • Uses a single stock Solaris 11.1+ image – physical or virtual [and NOT the Sun ZS3 Appliance ] • Supports any kind storage – NAS or SAN • For SAN, mount luns as raw disk and format with ZFS filesystem • Does NOT require the snapshot/clone licenses from the storage vendor, these features are available for free • Additional features include compression, deduplication, IO caching, etc • HA has to be handled externally either via Solaris Clusters, or by using HA features of the underlying hypervisor Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Snap Clone Solution Agile Data Refresh Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Data Cloning begins from… SNAP SHOTS PRODUCTION DBS TEST MASTER SNAP CLONES Data Guard P S Change Config. (SI/RAC) RMAN Backup Mask,Change Config. (SI/RAC) RMAN Testincremental Master data backup Data RMAN backupSnapshot of archive logs Archive Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Deployment Scenarios Snap Clones using Standby Private backups (snapshots) for SSA user Production Continuous or Discrete Replication Standby / Test Database Master Database Replication Types: Continuous Discrete Technology Data Guard, Golden Gate RMAN, Snap Mirror, import/export … Data Refresh Automatic and instantaneous Manual and at scheduled intervals Masking and Not possible At source (in production), or in place at test master Subsetting Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Agile ‘Data Refresh’ Time Travel – Refresh, Rewind across Snapshots Scheduled or Manual Storage Snapshots or RMAN Backups of the test master database, called Profiles Test Master t0 t1 t2 …. tN • Clones can be created from any profile Test master is • Each user gets a personal read-write database regularly clone refreshed with current data from Clones production Data Refresh Private backups Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Data Cloning & Refresh flow It’s Not Cloudy any more… • Non Self Service (Admin) flows • Scheduled Snapshot/RMAN backup creation • Clone from a library – snapshots / backups / Image copies • Clone from a snapshot to a point-in-time or SCN • 1-click Refresh of clones from source • REST APIs & Emcli verbs Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Snap Clone Solution Coming soon … on Oracle Cloud Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Data Cloning & Refresh for DevOps 49 clones/month 60X faster with 180TB savings over EMC Production Masking 60,000 refreshes per year supporting DevOps for Test Master ClonesSnap 2000+ Developers Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Summary Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Oracle Snap Clone • Scalable – Supports 1 to 1,000s of