The Sun Fire X4600 M2 Server and Proven Virtualization Scalability on the Web Sun.Com/X64
Total Page:16
File Type:pdf, Size:1020Kb
THE SUN FIRE™ X4600 M2 SERVER AND PROVEN VIRTUALIZATION SCALABILITY White Paper May 2007 Sun Microsystems, Inc. Table of Contents Introduction . 1 Scalability and Consolidation . 2 Scalability Defined . 2 Measuring Scalability . 2 Experience Delivering Scalable Systems . 3 Virtualization Scalability and the Sun Fire X4600 M2 Server . 4 Pairing Server and Storage Scalability . 4 Scalable Storage to Match . 5 Scalable Platforms, Scalable Performance . 5 Objective Scalability Measures . 6 VMmark Benchmark Design . 6 Derived From Standard Benchmarks. 8 Tiled Workload Design . 8 The VMmark Metric . 8 Test Configuration and Detailed Results . 10 Detailed Results . 11 Memory Locality Measurements. 12 Conclusion . 14 1 Introduction Sun Microsystems, Inc. Chapter 1 Introduction Nearly every Information Technology (IT) organization is using consolidation, or is considering using consolidation, as a way to reduce both capital and operating costs. IT organizations with a number of applications running on older, inefficient, and under- utilized servers can consolidate them onto a smaller number of high-performance, energy-efficient servers that can run at higher utilization levels and reduce overall space, power, and cooling requirements. Reducing the total number of servers can help to reduce both administration and hardware maintenance costs. As a side benefit, IT organizations saddled with legacy applications running on obsolete hardware and operating-system platforms can use consolidation to upgrade to new, more powerful servers. For more information on the role of In most cases, consolidation requires virtualization technology to allow multiple virtualization, please refer to the solution operating system instances and applications to coexist on a single server without brief titled Consolidation through interference. With products supporting virtualization and resource partitioning Virtualization with Sun x64 Servers. reaching back more than a decade, Sun Microsystems offers customers a range of technologies from which to choose. Dynamic System Domains provide electrically isolated partitions of its high-end Sun Fire™ server platforms to support multiple OS and application instances. Logical Domains (LDoms), supported on the latest UltraSPARC® T1 processors, extends hardware virtualization support to servers having as few as a single processor. The Solaris™ Operating System allows multiple, isolated applications to run on a single operating system instance through Solaris Containers technology, and it supports multiple operating system instances through its support for Xen, currently available through the Solaris ExpressSM program. Some of the most powerful virtualization technology that Sun supports is embodied in VMware Virtual Infrastructure 3 software, whose performance on the Sun Fire X4600 M2 server is the topic of this white paper. Consolidation through virtualization requires a combination of server and virtualization technology that delivers sufficient performance to make the move to a smaller number of servers worthwhile. Without the ability to support multiple applications on a single server at desired performance levels, IT organizations cannot achieve the capital and operating cost reductions they desire. The bottom line: a four-socket Sun Fire X4600 Fortunately, the combination of the Sun Fire X4600 M2 server and VMware Virtual M2 server can host twice the number of Infrastructure 3 software provides a powerful, scalable consolidation platform whose virtual machines as a two-socket server, and performance is proven by measurements using a beta version of the VMmark an eight -socket version can host 3.5 times as many as the two-socket server. benchmark. This white paper discusses the importance of scalability in consolidation, the performance of the Sun Fire X4600 M2 server, and the details of how the benchmark was executed. 2 Scalability and Consolidation Sun Microsystems, Inc. Chapter 2 Scalability and Consolidation For consolidation through virtualization to be an effective business strategy, the virtualization technology and server performance must combine to deliver a platform that allows multiple applications to run on the same server at the desired performance levels. If more than one application can’t run effectively on a single server, there’s no point in making the effort to consolidate. Until recently, IT organizations have not been particularly concerned about how well their virtualization platforms scale. This is because most organizations have started with the low-hanging fruit: consolidating applications with very low resource demands such as internal DNS servers, mail servers, and Web servers. As the value of consolidation is proven, IT organizations begin to look at consolidating more resource- intensive applications, and scalability becomes a more important topic. Scalability Defined Scalability is the property that adding more resources to a server — such as more CPUs and memory — result in the server handling a commensurate increase in work. Linear scalability describes an ideal situation where every increase in server resources results in the same increase in capacity. Doubling the number of CPUs and memory, for example, result in a doubling of the server’s throughput. Linear scalability is a goal, but it is rarely achieved beyond more than just a few processors because the greater the workload, the greater the amount of overhead in the operating system (or virtualization software) and the greater amount of interaction between processes detracts from the software’s ability to scale. In servers with large numbers of processors, issues such as memory bus contention and cache coherency come into play, reducing the ability of a server to scale. Sun has been a leader in delivering highly scalable server platforms, from the symmetric multiprocessing supported by the Sun Fire E25K server (with up to 72 processors) to the Sun Fire X4600 M2 server that its the topic of this paper. Measuring Scalability Scalability is often measured by increasing a server’s workload until one or more of its resources become saturated, then adding more resources and measuring again. The result is a plot of performance (often measured by throughput) versus the resource characteristics of the system. Figure 1 is an example of such a graph. The abscissa represents the number of processors, and the ordinate represents the maximum observed throughput. The set of orange bars illustrate an ideal situation with linear 3 Scalability and Consolidation Sun Microsystems, Inc. scalability. The set of green bars illustrate a more realistic situation where the server’s throughput begins to level off while the amount of resources continue to increase. 5 4 3 Throughput 2 1 12345 Amount of Dedicated Resources Linear Scalability Typical Scalability Figure 1. Linear scalability is a goal, but real-world applications typically scale less than linearly. In the x86-architecture server market, the inability of many Microsoft Windows operating system-based applications to scale beyond four processors has limited the demand for servers that scale beyond four processors or four processor sockets. Indeed, some processors are architecturally limited to no more than four sockets per server. Experience Delivering Scalable Systems Sun Microsystems, with its UltraSPARC processor-based server product line offering options with as many as 72 processors in a single server, sees the market differently. Many commercial applications ranging from application servers to enterprise databases easily utilize more than four processors, so Sun has not constrained either its UltraSPARC or its x64 server product line to the four-socket maximum often seen in x86- architecture servers. Indeed, the Sun Fire X4600 M2 server is one of the few eight-socket x64 servers on the market today, and its performance running VMware is one illustration of the benefits of having a more scalable platform. 4 Virtualization Scalability and the Sun Fire X4600 M2 Server Sun Microsystems, Inc. Chapter 3 Virtualization Scalability and the Sun Fire X4600 M2 Server Sun built the Sun Fire X4600 M2 server to meet the needs of organizations that need more raw compute power than typical four-socket servers are capable of providing. It is an ideal consolidation platform because of its raw processing capacity and its ability to accommodate additional processors, memory, and I/O resources as workloads demand them. Sun paired the Sun Fire X4600 M2 server with the highly scalable Sun StorageTek™ 6540 Array to create a highly scalable virtualization platform that demonstrates near linear scalability on the VMmark virtualization benchmark. Pairing Server and Storage Scalability The Sun Fire X4600 M2 server is a modular, scalable system that can pack up to eight CPU sockets and up to 64 GB of memory in a mere four rack units, putting roughly twice the resources in the same space as other 4 RU servers on the market today (Figure 2). The server’s performance per cubic volume helps IT organizations alleviate their space crunch, while the server’s excellent performance per watt helps them to reduce power consumption and cooling requirements. Figure 2. The Sun Fire X4600 M2 server is an ideal virtualization platform. The Sun Fire X4600 M2 server is a modular system that supports up to eight internal CPU/memory modules. Each module holds a single dual-core AMD Opteron™ processor and from 1-8 GB of memory. The CPU modules are distributed across the server’s I/O subsystem so that adding modules increases CPU, memory,