Optimized Database Performance Contents Your Customers Need Lots of Data, Fast
Total Page:16
File Type:pdf, Size:1020Kb
Improve customer experience in B2B SaaS with optimized database performance Contents Your customers need lots of data, fast Your customers need lots of data, fast ......................... 2 Business to business applications such as human resources (HR) portals, collaboration tools and customer relationship management (CRM) Memory and storage: completing the pyramid .......... 3 systems must all provide fast access to data. Companies use these tools Traditional tiers of memory and storage ....................... 3 to increase their productivity, so delays will affect their businesses, and A new memory tier .................................................................. 4 ultimately their loyalty to the software provider. Additional benefits of the 2nd generation Intel® As data volumes grow, business to business software as a service (B2B SaaS) providers need to ensure their databases not only have the Xeon® Scalable processor .....................................................4 capacity for lots of data, but can also access it at speed. Improving caching with Memory Mode .......................... 5 Building services that deliver the data customers need at the moment More responsive storage with App Direct Mode ........ 6 they need it can lead to higher levels of customer satisfaction. That, in turn, could lead to improved loyalty, the opportunity to win new Crawl, walk, run ......................................................................... 8 business, and greater revenue for the B2B SaaS provider. The role of SSDs ....................................................................... 8 Acceleration technologies ............................................... 9 Deploying FPGAs ...................................................................... 9 Apache Cassandra* ...........................................................10 Apache Spark* .....................................................................10 MySQL* ...................................................................................10 Intel® Cache Acceleration Technology ..........................10 Boosting connectivity .................................................... 11 Conclusion ........................................................................ 11 Learn more ........................................................................ 12 2 Memory and storage: completing the pyramid Traditional tiers of memory Striking the right balance and storage In this model, B2B SaaS providers face a delicate Building an infrastructure with the right storage balancing act. Unable to get low latency and high solution is the foundation for an efficient and capacity in the same unit, they have to find the right Memory optimized database. Traditionally models of combination of storage and memory to meet their DRAM Hot Tier storage and memory can be thought of as a needs. DRAM is fast but it’s relatively expensive, pyramid, illustrated in Figure 1. The width of the and capacity is low. As you move down the pyramid, you find Intel® OptaneTM DC SSDs, which pyramid represents storage capacity, with HDD/ Persistent memory tape providing the largest capacity; and the can store up to 750GB per drive, and Intel® QLC 3D height of the pyramid represents performance, NAND SSDs, which provide terabytes of storage, with DRAM providing the fastest performance with a latency of hundreds of microseconds. This with a latency of less than 30 nanoseconds. makes them slower than DRAM but faster than Storage hard disks. Speed Now, there is a new option which can be used for workloads that demand both speed and capacity: Intel® OptaneTM DC persistent memory. Intel® LC 3D NAND SSD HDD/TAPE Cold Tier Storage capacities Figure 1: Storage pyramid, showing where the new Intel® Optane™ DC persistent memory sits in the storage hierarchy. 3 A new memory tier Additional benefits of the 2nd generation Intel® Xeon® Scalable The launch of the 2nd generation Intel® Xeon® processor Scalable processor introduced support for Intel Optane DC persistent memory. This has unlocked The 2nd generation Intel Xeon Scalable processor a new tier in the pyramid, which can help B2B SaaS family offers up to 56 cores for high performance providers access the levels of speed and capacity in compute-intensive workloads. It also supports they need to optimize their database performance. integrated Intel® QuickAssist Technology (Intel® QAT), It combines the speed of memory with affordable which can accelerate storage with real-time data large capacities. compression, static data compression, and security features. It can be used to help encrypt network Although Intel Optane DC persistent memory is traffic between servers, for example, to improve slightly slower than DRAM, it offers greater capacity database security. than DRAM at a lower cost per bit; and greater throughput than SSDs, depending on the use case. The 2nd generation Intel Xeon Scalable processor is also equipped with Intel® Advanced Vector Intel Optane DC persistent memory operates in Extensions 512 (Intel® AVX-512), which can process two modes, which can be used in different ways to twice as many floating-point operations per second improve database performance. These are called compared to the previous-generation Intel® Advanced Memory Mode and App Direct Mode. Memory Mode Vector Extensions 2 (Intel® AVX2)1. Databases that can be used to lower the cost of the caching tier, take advantage of Intel AVX-512 can use it to help and App Direct Mode provides high speed bulk accelerate their encryption and compression. data storage. 4 Cost of a Redis* 8TB cache Lower is better $200,000 $150,378 $150,000 $108,221 $100,000 $86, 286 Improving caching with Memory Mode $50,000 $0 Large scale-out databases that run across a lot of As long as you’re running on 2nd generation Intel 12 systems 6 systems nodes, such as Cassandra* or MongoDB*, can get Xeon Scalable processors, you can plug Intel Optane (768GB/system) (1,536GB/system) DRAM so large that access times end up suffering, as it DC persistent memory into the DIMM slots. All Intel® OptaneTM DC persistent memory takes longer to find and access the right data. Using the DRAM in the system is used as cache for the a cache in DRAM can help to accelerate access to persistent memory. Depending on the application Figure 2: To assemble 8TB cache for Redis* requires 12 DRAM systems of the most frequently used data. A few years ago, you you are using, the ratio of DRAM to Intel Optane DC 768GB/system, or 6 DRAM or Intel® OptaneTM DC persistent memory systems might have expected to see systems using 384GB persistent memory will vary. However, a ratio of 1:8 at 1,536GB/system. Compared to either of the DRAM options, Intel Optane DC of DRAM per node. However, it’s now possible to is likely to work well for many applications. persistent memory is more cost effective. Intel Optane DC persistent memory see a cache node measured at 1.5TB. As DRAM is enables these system cost savings with more than 3 million Persistent memory should be used evenly across the operations/second and latency of less than 1ms at the 99th percentile2. expensive, the need for growing cache sizes can platform to make better use of memory bandwidth, eat into the profits of B2B SaaS providers. This is making persistent memory ideal for capacities where the affordability of Intel Optane DC persistent between 512GB and 6TB per two-socket platform. memory can offer a real advantage. Redis* and Memcached* are often used as cache in Cost of a Memcached* 7TB cache In Memory Mode, Intel Optane DC persistent front of databases such as MongoDB and Cassandra. Lower is better memory can be used to provide more capacity to the Redis and Memcached both work well with Intel database cache. In this mode, it works in the same Optane DC persistent memory in Memory Mode $140,000 $125,315 way as DRAM, with a slightly lower performance but $120,000 (see Figures 2 and 3). These results were achieved at a reduced cost per bit. $100,000 $90,184 without code changes. $80,000 $71,905 When it comes to deployment, a key advantage $60,000 of using Intel Optane DC persistent memory in $40,000 Memory Mode is that it doesn’t require changes to $20,000 $0 applications or operating systems. 10 systems 5 systems (768GB/system) (1,536GB/system) DRAM Intel® OptaneTM DC persistent memory Figure 3: Intel® OptaneTM DC persistent memory enables system cost savings with more than 4 million operations/second and latency of less than 1ms at the 99th percentile3. 5 More responsive storage with App Direct Mode Intel Optane DC persistent memory can also be Storage Over App Direct Mode used to enhance data storage to increase the speed You can use Storage Over App Direct Mode to run of persistent reads and writes in the database. applications that haven’t been updated for Intel Accelerating the main storage can reduce the Optane DC persistent memory. In this mode, the need for high capacity caching. There are two operating system has been programmed to treat different ways of deploying Intel Optane DC Intel Optane DC persistent memory as a block persistent memory. storage device. App Direct Mode Storage Over App Direct Mode can accelerate performance for databases that have not yet In App Direct Mode, the database application been updated for App Direct Mode, but the speed talks directly to Intel Optane DC persistent improvements will not be as great as they would memory, mostly bypassing the operating system. have been under App Direct Mode, and results This enables the lowest latency