Using Test Beds to Probe Non- Volatile Memories' Dark

Total Page:16

File Type:pdf, Size:1020Kb

Using Test Beds to Probe Non- Volatile Memories' Dark Beyond the Datasheet: Using Test Beds to Probe Non- Volatile Memories’ Dark Secrets Laura M. Grupp*, Adrian M. Caulfield*, Joel Coburn*, John D. Davis†, and Steven Swanson* *University of California, San Diego †Microsoft Research, Silicon Valley Lab [lgrupp, acaulfie, jdcoburn, swanson]@cs.ucsd.edu [email protected] latency, bandwidth, bit error rate, and energy efficiency will all combine to determine which designs are viable Abstract and which are not. Second, they must understand how Non-volatile memories (such as NAND flash and phase the non-volatile memory array will affect the rest of the change memories) have the potential to revolutionize system. If a new storage technology significantly computer systems. However, these technologies have increases performance, it may expose bottlenecks in complex behavior in terms of performance, reliability, other parts of the system. and energy consumption that make fully exploiting Addressing the first challenge requires a their potential a complicated task. As device engineers comprehensive understanding of non-volatile memory push bit densities higher, this complexity will only performance, failure modes, and energy consumption. increase. Managing and exploiting the complex and at This information is difficult to come by. Device times surprising behavior of these memories requires a manufacturers hide the details of their devices behind deep understanding of the devices grounded in non-disclosure agreements, and even when datasheets experimental results. Our research groups have are freely available, they provide scant details: average developed several hardware test beds for flash and performance characteristics, vague recommendations other memories that allow us to both characterize these about error correction requirements, and inexact memories and experimentally evaluate their bounds on energy consumption. The datasheets make performance on full-scale computer systems. We no mention of many “warts” that these devices possess. describe several of these test bed systems, outline some It is not that datasheets are inaccurate; it is that they are of the research findings they have enabled, and discuss woefully inadequate if our goal is to fully exploit the some of the methodological challenges they raise. capabilities of these memories. To address the second challenge and fully evaluate a 1. Introduction new non-volatile storage array, it is easiest to measure and observe the array in situ, in a working system, Non-volatile memory has recently emerged as a running real applications. The benefits of this approach possible replacement for main memory and hard disk – versus, for example analytical model or simulation – drives (HDDs). While these devices have some is that it reveals unexpected hardware and/or software limitations, the potential benefits that the components bottlenecks and reveals the actual benefit of this promise more than outweigh them. In current systems, application. non-volatile memories usually appear as solid state disks (SSDs) that use NAND flash to build “black box” The only way to address either of these challenges is replacements for conventional HDDs. to construct working hardware test beds – custom-built hardware systems that incorporate non-volatile Constructing SSDs or other components built from memories or can emulate them at very high fidelity. non-volatile memories presents two problems that These test beds can provide “ground truth” data on the researchers and designers must confront. First, how to behavior of both memory devices and systems that best construct a system to exploit the strengths and incorporate them. mitigate the weaknesses of the technology. The This paper describes the non-volatile test beds that PowerPC FPGA we have built and provides some results from them. Flash Memory We describe some of the insights we have gleaned Processor Testing Socket from them and discuss some of the challenges that building and using these test beds presents. Our Flash Flash Bus experiences with these systems demonstrate that they Controller can provide a wealth of useful data and raise Flash Memory unexpected and important questions that motivate and Other Peripherals Testing Socket inform research into applying non-volatile memories. Figure 1. The Ming/Zarkov system uses a PowerPC processor and a custom flash controller built into an 2. Hardware Test beds FPGA to provide direct access to flash devices for either Hardware test beds come in two flavors: characterization (in Ming) or FTL prototyping (in Zarkov). characterization platforms and application platforms. Characterization platforms allow researchers to observe for the flash controller. The driver is unique in that it the behavior of the device under test at a finer provides user-level access to low-level flash operations granularity than the information provided in the device (read, program, and erase, etc.). The result is that datasheet. Application platforms allow researchers to developing test code for Ming is very easy. For evaluate the impact of a memory technology at the instance, to test a new error correction or data encoding application level, in a working system, and in the technique, it is sufficient to implement it in C. presence of real-world software and hardware The combination of the Ming hardware and software overheads. In some cases, the same platform can be provides a wealth of information about each flash used for both characterization and applications. memory access. The driver returns the operation Characterization platforms latency at 10ns resolution and allows straight forward A device’s datasheet provides some information about measurement of the energy consumed by each chip. how it will behave, but it does not provide the level of Application platforms detail that a characterization platform can extract. Application platforms offer insight in how a new Whereas a datasheet may provide a latency range for a technology will affect application-level behavior. They device operation, the characterization platform can offer insight into how storage devices will interact with observe the distribution of latencies for that operation other hardware and software components. This can, for across the chip or a collection of chips. In general, instance, reveal bottlenecks in the system that the new these platforms may be able to observe characteristics technology exposes. Below we describe the application of the device that are not reported in the datasheet. platforms our groups have developed and used. We have used a platform called Ming to characterize The first is Zarkov. Zarkov relies on the same many NAND flash devices. Ming is composed of an FPGA-based controller and FPGA prototyping board off-the-shelf Xilinx FPGA-based development board as as Ming but holds up to 32, non-removable flash chips. well as a custom-built flash testing board, enabling Zarkov is a key component of the BlueSSD project [5]. detailed measurements of almost all aspects of flash BlueSSD aims to provide an open platform for memory devices. The test board holds two “burn in” experimenting with SSD optimizations. sockets that accept standard TSOP flash devices. Each The second application platform is the Flash socket has a separate power plane to support per-chip Research Platform (FRP). The FRP hardware is a power measurement. Figure 1 provides a block combination of the BEE3 multi-FPGA research diagram of the Ming hardware platform. platform [1] and a custom printed circuit board, a Flash In addition to the hardware, Ming also includes Dual Inline Memory Module (FDIMM). The several software components that make it useful as a combination of an FPGA and DIMM slot provide the characterization system. The Xilinx FPGA contains a ability to interface to other non-volatile memories, like microprocessor and we configure it with a custom-built PCM, for future research, leveraging the same BEE3 flash memory controller. We run a full-fledged version hardware and software. Each FDIMM exposes 8 of Linux on the processor, and provide a custom driver independent flash channels and up to four FDIMMs execution of these commands on the actual hardware. Host PC Host PC The FRP management software can be executed on an PCI-E x8, embedded CPU in the FPGA, or on the host CPU in the 1 GbE, PCI-E x8, 10 GbE 8 GB 64 GB 1 GbE, device driver or even as a user-level application. 10 GbE FF 8 GB 64 GB LL F Currently, we organize the management layer as a user- M Controller F A AA L R L FPGA S M Controller D S A AA level application on a PC running Windows XP, A R HH FPGA S D S A HH trading off performance for ease of implementation. (A) Ring A2D Ring A2B Co-development of the user-level application and the FF FF FF FF FPGA flash controller enable implementing and C LL Flash LL 2 LL Flash LL A AA A A A FPGA A H A FPGA A instrumenting all flash operations. Like the SS D SS S SS B SS Q HH HH HH HH Ming/Zarkov platform, the FRP can be a 64 GB 64 GB 64 GB 64 GB characterization or application platform. The main FF FF LL Flash LL difference is that the FRP platform does not have AA FPGA AA SS C SS HH HH separate power planes per flash package on the 64 GB (B) 64 GB FDIMM, enabling only module power measurement Figure 2. FRP configuration ranges from (A) a single FPGA and not individual package power measurement. and associated DIMM cards to (B) a multiple FPGA system with up to 16 DIMM cards. These configurations assume 4 The final application platform is a prototyping GB DRAM DIMMs and 32 GB FDIMMs. system for developing PCIe-attached storage devices based on next-generation non-volatile memories. The can be connected to an FPGA. The BEE3 has 16 platform is called Moneta and it targets memories such DIMM slots that we can populate with DRAM, as phase change memory, the memristor, or scalable FDIMMs, or other special-purpose modules.
Recommended publications
  • Advanced NAND Flash Memory Single-Chip Storage Solution
    SOLUTION SHEET: ADVANCED SOLID STATE MEMORY CONTROLLER Advanced NAND Flash Memory Single-Chip Storage Solution ? The growing complexity of flash memory management algorithms has made controller designs complex and has impacted the performance and the diversity of NAND devices that a single controller can support. As the complexity of the controller design increases, there comes a point where hardware acceleration is necessary. We see this trend for partial FTL (Flash Translation Layer) layers, addressing and wear leveling, and command queuing. At the same time, algorithms and flash device characteristics constantly change through the life of the controller. But data center managers expect the controller to constantly make design tradeoffs in order to improve in-system performance. These changes are also impacted by the traffic patterns of the application. The challenge is to provide hardware-accelerated algorithms that can change frequently in the field. The Context Solid-state storage based on NAND flash technology has become an important new lever for improving data-center performance and predictability. But the solid-state drives also present cost and predictability issues of their own. Surprisingly, these issues can be addressed through design of the flash memory controller. The NAND array has become the dominating factor for the cost of the drive. Increasing the life expectancy of the NAND array obviously reduces the total cost of ownership of the system. Also, the ability to reconfigure the controller to implement improved algorithms or to adapt to a new generation of flash chips extends the system life. Performance predictability and throughput are key concerns for data-center managers.
    [Show full text]
  • Using Data Postcompensation and Predistortion to Tolerate Cell-To-Cell
    2718 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: REGULAR PAPERS, VOL. 57, NO. 10, OCTOBER 2010 Using Data Postcompensation and Predistortion to Tolerate Cell-to-Cell Interference in MLC NAND Flash Memory Guiqiang Dong, Student Member, IEEE, Shu Li, and Tong Zhang, Senior Member, IEEE Abstract—With the appealing storage-density advantage, mul- than 1 bit in each memory cell (or floating-gate MOS tran- tilevel-per-cell (MLC) NAND Flash memory that stores more than sistor) by programming the cell threshold voltage into one 1 bit in each memory cell now largely dominates the global Flash of voltage windows, has been widely used to further memory market. However, due to the inherent smaller noise NAND margin, the MLC NAND Flash memory is more subject to various improve the Flash memory storage density. Because of device/circuit variability and noise, particularly as the industry is its obvious advantages in terms of storage density and, hence, pushing the limit of technology scaling and a more aggressive use cost, MLC NAND Flash memory now largely dominates the of MLC storage. Cell-to-cell interference has been well recognized global Flash memory market. In current design practice, most as a major noise source responsible for raw-memory-storage MLC NAND Flash memories store 2 bits per cell, while 3- and reliability degradation. Leveraging the fact that cell-to-cell in- terference is a deterministic data-dependent process and can even 4-bit-per-cell NAND Flash memories have been recently be mathematically described with a simple formula, we present reported in the open literature [2]–[6].
    [Show full text]
  • Speeding Data Access with the Sun Flash Accelerator F20 Pcie Card
    An Oracle White Paper June 2010 Speeding Data Access with the Sun Flash Accelerator F20 PCIe Card Speeding Data Access with the Sun Flash Accelerator F20 PCIe Card Introduction..........................................................................................1 Accelerating Application Performance with Enterprise-Quality Sun FlashFire Technology ..........................................................................................3 Sun Flash Accelerator F20 PCIe Card Highlights ...........................4 Sun Flash Accelerator F20 PCIe Card Architecture ............................5 Sun Flash Accelerator F20 PCIe Card Components...........................5 Disk on Module Design....................................................................6 Enterprise-Quality NAND Flash for Reliability........................................ 8 Serial-Attached SCSI Controller ......................................................8 Twelve-Port Serial-Attached SCSI Expander ..................................8 Supercapacitor Module....................................................................8 Supercapacitors versus Batteries .......................................................... 8 Reliability, Availability, and Serviceability Features.............................9 Deploying the Sun Flash Accelerator F20 PCIe Card .......................11 Flash Technology Considerations .................................................11 Aligning Data Transfers and Block Size............................................... 12 Database Acceleration
    [Show full text]
  • Flash Memory Guide
    Flash Memory Guide Portable Flash memory for computers, digital cameras, mobile phones and other devices Flash Memory Guide Kingston®, the world’s leading independent manufacturer of memory products, offers a broad range of Flash cards, USB Flash drives and Solid-State Drives (SSD) (collectively called Flash storage devices) that employ Flash memory chips for storage. The purpose of this guide is to explain the various technologies and Flash memory offerings that are available. Note: Due to Flash technology changes, specifications listed in this document are subject to change without notice 1.0 Flash Memory: Empowering A New Generation of Flash Storage Devices Toshiba invented Flash memory in the 1980s as a new memory technology that allowed stored data to be saved even when the memory device was disconnected from its power source. Since then, Flash memory technology has evolved into the preferred storage media for a variety of consumer and industrial devices. In consumer devices, Flash memory is widely used in: • Notebook computers • Personal computers • Tablets • Digital cameras • Global Positioning Systems (GPS) • Mobile phones • Solid-state music players such as • Electronic musical instruments MP3 players • Television set-top boxes • Portable and Home Video game consoles Flash memory is also used in many industrial applications where reliability and data retention in power-off situations are key requirements, such as in: • Security systems/IP Cameras • Military systems • Embedded computers • Set-top boxes • Networking and communication products • Wireless communication devices • Retail management products • Point of Sale Devices (e.g., handheld scanners) Please Note: Most Kingston Flash memory is designed and tested for compatibility with consumer devices.
    [Show full text]
  • Flash Memory Controller 1TB SSD Controller Gbdriver RS4 Series with 3 Gbps Serial ATA
    Flash Memory Controller 1TB SSD Controller GBDriver RS4 Series with 3 Gbps Serial ATA • Supports latest 16 kB/page structure as well as 8 kB/page and 4 kB/page NAND type flash memory, latest 1 TB SSD • Highly reliable high-speed SATA SSD controller with Enhanced ECC and read retry functions November 6, 2012 TDK Corporation has developed the GBDriver RS4 series of NAND type flash memory controllers with support for 3 Gbps serial ATA. Sales will begin in January 2013. With an effective access speed of 180 MB/sec, the GBDriver RS4 is an advanced high- speed SATA controller chip. It is fully compatible not only with the latest 1xnm generation and 2xnm generation 16 kB/page SLC (single level cell) and MLC (multi level cell) NAND type flash memory, but also with 8 kB/page and 4 kB/page structures. This allows the customer to select the optimal flash memory for the respective application, providing the flexibility to configure high-speed SATA storage with a capacity ranging from 512 MB to 1 TB. Along with high-speed control, a read retry function has been added which is essential for ensuring data reliability when using the latest MLC type NAND flash memory. Together with the auto-recovery, data randomizer, and auto-refresh functions of the existing GBDriver series, this design accommodates also future developments in the flash memory format. Data reliability is significantly enhanced by the highly acclaimed GBDriver power interruption tolerance algorithm. For customers requiring an even higher level of data reliability, the Enhanced ECC function makes it possible to expand ECC to 71 bits per 512 byte block.
    [Show full text]
  • 88ALP01 PCI to NAND, SD and Camera Host Controller Datasheet
    Cover 88ALP01 PCI to NAND, SD and Camera Host Controller Datasheet Doc. No. MV-S103921-00, Rev. – July 17, 2007 Marvell. Moving Forward Faster Document Classification: Proprietary Information 88ALP01 Datasheet Document Conventions Note: Provides related information or information of special importance. Caution: Indicates potential damage to hardware or software, or loss of data. Warning: Indicates a risk of personal injury. Document Status Doc Status: Preliminary Technical Publication: x.xx For more information, visit our website at: www.marvell.com Disclaimer No part of this document may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording, for any purpose, without the express written permission of Marvell. Marvell retains the right to make changes to this document at any time, without notice. Marvell makes no warranty of any kind, expressed or implied, with regard to any information contained in this document, including, but not limited to, the implied warranties of merchantability or fitness for any particular purpose. Further, Marvell does not warrant the accuracy or completeness of the information, text, graphics, or other items contained within this document. Marvell products are not designed for use in life-support equipment or applications that would cause a life-threatening situation if any such products failed. Do not use Marvell products in these types of equipment or applications. With respect to the products described herein, the user or recipient, in the absence of appropriate U.S. government authorization, agrees: 1) Not to re-export or release any such information consisting of technology, software or source code controlled for national security reasons by the U.S.
    [Show full text]
  • NAND Flash Controller 13 2014.08.18
    NAND Flash Controller 13 2014.08.18 a10_54010 Subscribe Send Feedback The hard processor system (HPS) provides a NAND flash controller to interface with external NAND flash memory in Altera® system-on-a-chip (SoC) FPGA systems. You can use external flash memory to store a processor boot image, software, or as extra storage capacity for large applications or user data. The HPS NAND flash controller is based on the Cadence® Design IP® NAND Flash Memory Controller. NAND Flash Controller Features The NAND flash controller provides the following functionality and features: • Supports one x8 or x16 NAND flash device Note: The HPS supports booting only from a x8 NAND flash device. • Supports Open NAND Flash Interface (ONFI) 1.0 • Supports NAND flash memories from Hynix, Samsung, Toshiba, Micron, and STMicroelectronics • Supports programmable 512 byte (4-, 8-, or 16-bit correction) or 1024 byte (24-bit correction) error correction code (ECC) sector size • Supports pipeline read-ahead and write commands for enhanced read/write throughput • Supports devices with 32, 64, 128, 256, 384, or 512 pages per block • Supports multiplane devices • Supports page sizes of 512 bytes, 2 kilobytes (KB), 4 KB, or 8 KB • Supports single-level cell (SLC) and multi-level cell (MLC) devices with programmable correction capabilities • Provides internal direct memory access (DMA) • Provides programmable access timing • Provides three NAND FIFOs—ECC buffer, Write FIFO, and Read FIFO, using single-error detection/correction and double-error detection NAND Flash Controller Block Diagram and System Integration The flash controller receives commands and data from the host through the command and data slave interface.
    [Show full text]
  • 2013 Annual Report
    SILICON MOTION TECHNOLOGY CORPORATION Annual Report 2013 Financial Highlights Product Mix % of Net Sales (2013) Mobile Storage 82 % Mobile Communications 14 % Others 4 % Net Sales US$ million 2009 89 2010 133 2011 224 2012 281 2013 225 Contents Financial Highlights 01 Letter to Shareholders 02 About Silicon Motion 04 Form 20-F Directors and Executives Gross Margin % of Net Sales 2009 41% 2010 47% 2011 48% 2012 47% 2013 47% Diluted Earnings per ADS US$ 2009 - 2.54 2010 - 0.18 2011 1.28 2012 1.40 2013 0.81 01 Letter to Shareholders Dear Shareholders, 2013 was a transitional year for Silicon Motion as sales of removable storage controllers for mature card and USB flash drive markets declined while sales of SSD plus embedded storage controllers, especially for eMMC growth markets, grew rapidly. 2013 was also a transitional year for our LTE transceiver products as the market quickly moved to the significantly enhanced LTE-Advanced standard. While the negative effects of the transitions were dramatic from the perspective of revenue and profitability, we believe we have built a strong foundation for renewed, long-term growth by focusing on eMMC, SSD, and other embedded storage applications and are confident this will lead to strong growth in upcoming years. In 2013, sales of our SSD plus embedded products grew almost 100% year-over-year to account for almost half of our Mobile Storage sales. Sales of eMMC controllers, our largest SSD plus embedded product, are now already larger than our card and USB flash drive controllers sales, and account for roughly a third of our total revenue.
    [Show full text]
  • Flash Memory Guide
    Flash Memory Guide Portable Flash memory for computers, digital cameras, mobile phones and other devices Flash Memory Guide Kingston®, the world’s leading independent manufacturer of memory products, offers a broad range of Flash cards, USB Flash drives and Solid-State Drives (SSD) (collectively called Flash storage devices) that employ Flash memory chips for storage. The purpose of this guide is to explain the various technologies and Flash memory offerings that are available. Note: Due to Flash technology changes, specifications listed in this document are subject to change without notice 1.0 Flash Memory: Empowering A New Generation of Flash Storage Devices Toshiba invented Flash memory in the 1980s as a new memory technology that allowed stored data to be saved even when the memory device was disconnected from its power source. Since then, Flash memory technology has evolved into the preferred storage media for a variety of consumer and industrial devices. In consumer devices, Flash memory is widely used in: • Notebook computers • Personal computers • Tablets • Digital cameras • Global Positioning Systems (GPS) • Mobile phones • Solid-state music players such as • Electronic musical instruments MP3 players • Television set-top boxes Flash memory is also used in many industrial applications where reliability and data retention in power-off situations are key requirements, such as in: • Security systems • Military systems • Embedded computers • Solid-state drives • Networking and communication products • Wireless communication devices • Retail management products • Point of Sale Devices (e.g., handheld scanners) 2.0 SSD, Flash Card and USB Flash Drive Capacity Some of a Flash storage device’s listed capacity is used for formatting and other functions and thus is not available for data storage.
    [Show full text]
  • X1 SSD Flash Memory Controller
    X1 SSD Flash Memory Controller Hyperstone GmbH Hyperstone Inc. - USA Hyperstone Asia Pacific - Taiwan Line-Eid-Strasse 3 486 N Patterson Ave Suite 301 3F., No. 501, Sec.2, Tiding Blvd. 78467 Konstanz Winston-Salem, NC 27101 Neihu District, Taipei City 114 Germany USA Taiwan, R.O.C. Phone: +49 7531 980 30 Phone: +1 336 744 0724 Phone: +886 2 8751 0203 Email: [email protected] Email: [email protected] Email: [email protected] X1 www.hyperstone.com Content is subject to change without prior notice. X1, hyReliability and hyMap are trademarks of Hyperstone GmbH. Other brand, product, or company names are property of the respective holder. Warranties, implied or expressed as well as liabilities for any damage resulting from using provided information in this document are excluded until part of a separate written contract. HS-Mkt-LH-19-01-25 X1 SSD Flash Memory Controller ■ The Hyperstone X1 family of SATA SSD NAND flash controllers together with provided firmware, reference designs and tools offers an X1 Block Diagram Controller & CPU easy-to-use turnkey solution for industrial, high endurance and robust Solid State Drives, or modules compatible to host systems with ■■High performance dual-core microprocessor based on the ■■Flash memory power down logic and write protect control SATA interface. The X1 family enables SATA storage systems with the latest flash memory, advanced security and highest reliability. Hyperstone architecture ■■Firmware storage in flash, loaded into controller by boot ROM ■■16 GPIO pins provide flexibility
    [Show full text]
  • Scalable Parallel Flash Firmware for Many-Core
    Scalable Parallel Flash Firmware for Many-core Architectures Jie Zhang and Miryeong Kwon, KAIST; Michael Swift, University of Wisconsin-Madison; Myoungsoo Jung, KAIST https://www.usenix.org/conference/fast20/presentation/zhang-jie This paper is included in the Proceedings of the 18th USENIX Conference on File and Storage Technologies (FAST ’20) February 25–27, 2020 • Santa Clara, CA, USA 978-1-939133-12-0 Open access to the Proceedings of the 18th USENIX Conference on File and Storage Technologies (FAST ’20) is sponsored by Scalable Parallel Flash Firmware for Many-core Architectures Jie Zhang1, Miryeong Kwon1, Michael Swift2, Myoungsoo Jung1 Computer Architecture and Memory Systems Laboratory, Korea Advanced Institute of Science and Technology (KAIST)1, University of Wisconsin at Madison2 http://camelab.org Abstract requests are sent to tens or hundreds of flash packages. This enables assigning queues to different applications; multiple NVMe is designed to unshackle flash from a traditional stor- deep NVMe queues allow the host to employ many threads age bus by allowing hosts to employ many threads to achieve thereby maximizing the storage utilization. higher bandwidth. While NVMe enables users to fully exploit An SSD should handle many concurrent requests with its all levels of parallelism offered by modern SSDs, current massive internal parallelism [12,31,33,34,61]. However, it firmware designs are not scalable and have difficulty in han- is difficult for a single storage device to manage the tremen- dling a large number of I/O requests in parallel due to its dous number of I/O requests arriving in parallel over many limited computation power and many hardware contentions.
    [Show full text]
  • THE ROLE of FLASH MEMORY in DATABASE MANAGEMENT SYSTEMS by Jaeyoung Do a Dissertation Submitted in Partial Fulfillment of the Re
    THE ROLE OF FLASH MEMORY IN DATABASE MANAGEMENT SYSTEMS by Jaeyoung Do A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy (Computer Sciences) at the UNIVERSITY OF WISCONSIN–MADISON 2012 Date of final oral examination: 11/30/12 The dissertation is approved by the following members of the Final Oral Committee: Jignesh M. Patel, Professor, Computer Sciences David J. DeWitt, John P. Morgridge Professor, Emeritus, Computer Sciences Jeffrey F. Naughton, Professor, Computer Sciences Michael Swift, Assistant Professor, Computer Sciences Rafael Lazimy, Associate Professor, Operations and Information Management © Copyright by Jaeyoung Do 2012 All Rights Reserved i To my family. ii Acknowledgments Throughout this intellectual journey, I have learned a lot of lessons and experiences from dozens of remarkable individuals whom I wish to acknowledge. First and foremost, I wish to thank my wonderful advisor, Professor Jignesh M. Patel. He has been supportive since the day I began working on the first class project taught by him. It has truly been a pleasure to work with him, and I will never forget the enthusiasm, sincerity, and encouragement that he showed me. Along with Jignesh, David J. DeWitt has been very helpful and encouraging during my time at Wisconsin. It is an honor to have had opportunities to write very successful papers with him. I would also like to thank Colin Dewey for taking a keen interest in guiding my master thesis. Jeffrey F. Naughton and Michael Swift deserve special thanks for the many useful discussions to point out various improvements on my thesis. I am also very thankful to Rafael Lazimy for taking the time to be on my defense committee.
    [Show full text]