Benchware Performance Suite Release 8.6 Release 8.6 Release 8.6
Total Page:16
File Type:pdf, Size:1020Kb
Exadata Evolution - Performance Baseline of X2, X3 and X4 Swiss Technical Exadata Community Meeting 19th of March 2014 Company Confidential Contents 1 Introduction 2 CPU Performance 3 Server Performance 4 Storage Performance 5 Database Load Performance 6 Summary copyright © 2014 by benchware.ch company confidential slide 2 Introduction Unpredictable performance of Oracle platforms – due to complexity Oracle application Oracle Benchware mission Application(s) . Quality assurance: calibrate Middleware efficiency of Oracle platforms . Platform evaluation: quantify price-performance ratio of Oracle Database System Fusion I/O Interconnect I/O Fusion platforms DataGuard File System platform Oracle Volume Manager . Capacity planning: deliver key Network O/S Network Storage Server performance metrics of Oracle platforms for capacity planning Storage System copyright © 2014 by benchware.ch company confidential slide 3 Introduction Holistic approach based on Key Performance Metrics Benchware methodology is based on readily understandable key performance metrics for . CPU performance . Server performance . Storage performance . Database performance for load, scan, OLTP transactions, . Benchware uses a set of representative Oracle benchmark tests to calibrate key performance metrics of all platform components This presentation shows some of these benchmark results copyright © 2014 by benchware.ch company confidential slide 4 Introduction Key Performance Metrics should be self-explanatory Source: www.bmw.de copyright © 2014 by benchware.ch company confidential slide 5 Introduction More information about . Methodology . www.benchware.ch/methodology Benchware Company . www.benchware.ch/company Public Benchmark results . www.benchware.ch/benchmark Discovery Workshop and disclosure of internal benchmark experiences . [email protected] copyright © 2014 by benchware.ch company confidential slide 6 Contents 1 Introduction 2 CPU Performance 3 Server Performance 4 Storage Performance 5 Database Load Performance 6 Summary copyright © 2014 by benchware.ch company confidential slide 7 CPU Performance Why measure CPU performance? . CPU performance has a huge impact on - Oracle license (core factor) and maintenance cost - Performance of most database operations - Performance of compute intensive operations copyright © 2014 by benchware.ch company confidential slide 8 CPU Performance Oracle EE Core Licensing – Price Performance Ratio? Source: Oracle Technology Global Price List; January 30th 2014, Software Investment 35 Guide Oracle Processor Core Factor Table; Last update 25th September 2013 Core factor 0.5: Intel Xeon (x86) Core factor 1.0: IBM zSeries AMD (x86) IBM Power 6, 7, 7+ 30 SPARC T5 Intel Itanium 95xx As an alternative, all these servers can be operated with Oracle Standard Edition! 25 ores C 20 15 HP Proliant Oracle SPARC IBM POWER • 4 sockets • 4 sockets • 4 sockets Number of licensed licensed of Number 10 • 32 cores • 64 cores • 32 cores • 64 threads • 512 threads • 128 threads • 1 TByte RAM • 1 TByte RAM • 1 TByte RAM 5 0 HP DL 560 G8 Oracle SPARC T5-4 IBM P750 copyright © 2014 by benchware.ch company confidential slide 9 CPU Performance What is measured? . CPU performance from the . Speed of single thread Oracle point of view - Elapsed time [s] for algorithms - Pure processor performance - Operations per second [ops] - Including level 1, 2, 3 cache . Maximum throughput of system - No memory access - Operations per second [ops] - No I/O operations - Using Oracle data types and . Scalability Oracle SQL built-in functions - Throughput per process for n = {1, 2, 4, 8, …, n} . Efficiency of - Multi threading - Virtualization - Encryption copyright © 2014 by benchware.ch company confidential slide 10 CPU Performance How is CPU performance measured? . SPEC uses following programming languages - C - C++ - Fortran . Benchware uses Oracle data types in PL/SQL - PLS_INTEGER - NUMBER - VARCHAR2 - DATE copyright © 2014 by benchware.ch company confidential slide 11 CPU Performance CPU architecture CPU X2-2 X3-2 X4-2 CPU type X5675 E5-2690 E5-2697 V2 Intel generation Westmere Sandy Bridge Ivy Bridge Launch date Q1 2011 Q1 2012 Q3 2013 Clock rate [GHz] 3.06 2.9 2.7 Max number of sockets 2 2 2 #cores per socket 6 8 12 Multithreading 2-fold 2-fold 2-fold Performance Numbers from other Benchmarks + 33 % + 62 % SPECint_base2006 (speed) 40.8 54.3 88.1 Oracle CPU speed in sys.aux_stats$ 2’795 1’751 3’074 Remark: . Oracle has an internal estimation about CPU speed in sys.aux_stats$, but none estimation about CPU throughput. This value does not correlate with SPECint_base2006 copyright © 2014 by benchware.ch company confidential slide 13 CPU Performance Server configuration Server X2-2 X3-2 X4-2 CPU type X5675 E5-2690 E5-2697 V2 #sockets 2 2 2 + 50 % #cores 12 16 24 #threads 24 32 48 Memory Capacity [GByte] 96 512 512 Performance Numbers from other Benchmarks SPECint_base_rate_2006 (throughput) 367 630 806 Software Operating System Oracle Lx Oracle Lx Oracle Lx Oracle Database System Release 11.2 Release 11.2 Release 11.2 Benchware Performance Suite Release 8.6 Release 8.6 Release 8.6 copyright © 2014 by benchware.ch company confidential slide 14 CPU Performance Server configuration Server X2-2 X3-2 X4-2 CPU type X5675 E5-2690 E5-2697 V2 #sockets 2 2 2 #cores 12 16 24 #threads 24 32 48 Memory Capacity [GByte] 96 512 512 Performance Numbers from other Benchmarks + 71 % + 28 % SPECint_base_rate_2006 (throughput) 367 630 806 Software Operating System Oracle Lx Oracle Lx Oracle Lx Oracle Database System Release 11.2 Release 11.2 Release 11.2 Benchware Performance Suite Release 8.6 Release 8.6 Release 8.6 copyright © 2014 by benchware.ch company confidential slide 15 CPU Performance Oracle Licensing on Exadata Database Server Oracle Enterprise Edition, 1 Exadata Database Server X2-2 X3-2 X4-2 #cores 12 16 24 Oracle core license factor x 0.5 x 0.5 x 0.5 Oracle license cost (list price 13th of February 2014) . Enterprise Edition (47’500) 285’000 380’000 570’000 . Real Application Cluster (23’000) 138’000 184’000 276’000 . Partition Option (11’500) 69’000 92’000 138’000 . Diagnostic Pack (5’000) 30’000 40’000 60’000 . Tuning Pack (5’000) 30’000 40’000 60’000 Total Oracle license cost for 1 Exadata Database Server 552’000 736’000 1’104’000 Oracle Database Server License X2-2 X3-2 X4-2 Oracle license cost (list price 13th of February 2014) . Eighth Rack - 736’000 1’104’000 . Quarter Rack 1’104’000 1’472’000 2’208’000 . Half Rack 2’208’000 2’944’000 4’416’000 copyright © 2014 by benchware.ch company confidential slide 16 CPU Performance Oracle arithmetic ADD operation, speed of single process 500 Capacity planning: 452 • Similar speed 450 434 423 400 350 ] 300 X2-2 250 X3-2 198 197 189 193 200 175 176 X4-2 Speed in [Mops in Speed 150 100 50 37 36 42 0 SIMPLE_INTEGER SIMPLE_FLOAT PLS_INTEGER NUMBER Single process copyright © 2014 by benchware.ch company confidential slide 17 CPU Performance Oracle arithmetic ADD operation, throughput of 1 DB Server 554 Mops 14'000 per core Capacity planning: • X2 -> X3: + 50% • X3 -> X4: + 50% 12'000 ] 10'000 529 Mops per core 8'000 X2-2 442 Mops X3-2 6'000 per core X4-2 Throughput [Mops in Throughput 4'000 More throughput . • More cores per 41 Mops per core socket 2'000 38 Mops • More throughput per core per core 35 Mops • More efficient per core multi threading 0 SIMPLE_INTEGER SIMPLE_FLOAT PLS_INTEGER NUMBER N processes up to saturation copyright © 2014 by benchware.ch company confidential slide 18 Contents 1 Introduction 2 CPU Performance 3 Server Performance 4 Storage Performance 5 Database Load Performance 6 Summary copyright © 2014 by benchware.ch company confidential slide 19 Server Performance What is measured? . Server performance from the . Maximum throughput of system Oracle point of view - Rows per second [rps] - No I/O operations - Transactions per second [tps] - Oracle SQL transactions on - Service time in [s] objects pinned in KEEP cache - Oracle database block gets per second (logical I/O) in [dbps] . Speed of single thread - Rows per second [rps] . Scalability - Transactions per second [tps] - Throughput per process for - Service time in [s] n = {1, 2, 4, 8, …, n} . Efficiency of - Huge pages and NUMA architectures when using large RAM capacities - Virtualization copyright © 2014 by benchware.ch company confidential slide 20 Server Performance How is Server Performance measured? . Benchmark tables - Pinned in SGA - 24 columns - 300 byte row length . One typical analytic transaction - Selection of all rows via full table scan e.g. searching for specific pattern, grouping, . Two typical OLTP transactions - Selection of one random row via primary key (1 row per SQL), e.g. searching for bank account, product number, order number - Selection of many random rows via secondary key (Ø 25 rows per SQL), e.g. part list of order, last 25 transactions of bank account copyright © 2014 by benchware.ch company confidential slide 21 Server Performance Oracle in-memory full table scan, 1 DB Server 120 Capacity planning speed: 24 cores / 48 threads • X2 -> X3: + 25% • X3 -> X4: + 0% 100 Capacity planning throughput: • X2 -> X3: + 100% ] 80 • X3 -> X4: + 50% Mrps [ 16 cores / 32 threads X2-2 60 X3-2 X4-2 40 Throughput in Throughput 12 cores / 24 threads 20 X4-2 in-memory scan rate for one db server: • ~ 30 GBps • > 100’000’000 rps 0 1 2 4 8 16 32 64 Number of load generators copyright © 2014 by benchware.ch company confidential slide 22 Server Performance Oracle in-memory full table scan, Cluster 900 8 server / 192 cores / 384 threads