DOCSLIB.ORG

Flash-Aware Database Management Systems Hardock, Sergej (2020)

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Flash-Aware Database Management Systems Hardock, Sergej (2020) Flash-aware Database Management Systems Hardock, Sergej (2020) DOI (TUprints): https://doi.org/10.25534/tuprints-00014476 License: CC-BY-SA 4.0 International - Creative Commons, Attribution Share-alike Publication type: Ph.D. Thesis Division: 20 Department of Computer Science Original source: https://tuprints.ulb.tu-darmstadt.de/14476 Flash-aware Database Management Systems Zur Erlangung des akademischen Grades Doktor-Ingenieur (Dr.-Ing.) Genehmigte Dissertation von Sergej Hardock aus Kiew, Ukraine Tag der Einreichung: 30.7.2020, Tag der Prüfung: 4.11.2020 1. Gutachten: Prof. Dr. Carsten Binnig 2. Gutachten: Prof. Dr.-Ing. Ilia Petrov 3. Gutachten: Alejandro Buchmann, Ph.D. Darmstadt Computer Science Department Technical University of Darmstadt Data Management Lab Flash-aware Database Management Systems Accepted doctoral thesis by Sergej Hardock 1. Review: Prof. Dr. Carsten Binnig 2. Review: Prof. Dr.-Ing. Ilia Petrov 3. Review: Alejandro Buchmann, Ph.D. Date of submission: 30.7.2020 Date of thesis defense: 4.11.2020 Darmstadt Bitte zitieren Sie dieses Dokument als: URN: urn:nbn:de:tuda-tuprints-144769 URL: http://tuprints.ulb.tu-darmstadt.de/id/eprint/14476 Dieses Dokument wird bereitgestellt von tuprints, E-Publishing-Service der TU Darmstadt http://tuprints.ulb.tu-darmstadt.de [email protected] Die Veröffentlichung steht unter folgender Creative Commons Lizenz: Namensnennung - Weitergabe unter gleichen Bedingungen 4.0 International https://creativecommons.org/licenses/by-sa/4.0 This dissertation is dedicated to my parents who encouraged me to follow my dreams. Erklärungen laut Promotionsordnung §8 Abs. 1 lit. c PromO Ich versichere hiermit, dass die elektronische Version meiner Dissertation mit der schriftli- chen Version übereinstimmt. §8 Abs. 1 lit. d PromO Ich versichere hiermit, dass zu einem vorherigen Zeitpunkt noch keine Promotion versucht wurde. In diesem Fall sind nähere Angaben über Zeitpunkt, Hochschule, Dissertationsthe- ma und Ergebnis dieses Versuchs mitzuteilen. §9 Abs. 1 PromO Ich versichere hiermit, dass die vorliegende Dissertation selbstständig und nur unter Verwendung der angegebenen Quellen verfasst wurde. §9 Abs. 2 PromO Die Arbeit hat bisher noch nicht zu Prüfungszwecken gedient. Darmstadt, 30.7.2020 S. Hardock v Acknowledgments First, I would like to thank my supervisors Ilia Petrov and Alejandro Buchmann. My interest in database management systems, which continuously evolved over the years, began back in year 2010 with your exciting lectures. After different projects and Master thesis done under your supervision, it was a great pleasure to get an offer to work as PhD student in your team. Without your support, help and guidance I would not be able to finish this dissertation. I wish to thank all other members of defense committee Carsten Binnig, Andreas Koch, Christian Bischof and Max Mühlhäuser for meaningful and fruitful discussions, comments and suggestions. Many thanks to my former colleagues Robert Gottstein, Daniel Bausch, Dejan Petkov, Alexander Frömmgen and Robert Rehner. Your support has helped me a lot during the research. I really appreciate the work and spare time we spent together at university and on conferences. I like to express my gratitude to Maria Tiedemann for the help in lots of organisational topics. I had great pleasure of working with undergraduate students Sruthi Parvathy Subra- manian, Mohan Kanth Dayanandan and Elena-Madalina Cososchi. Thank you for your contribution to this project. Special thanks to my family, especially to my dear parents. Your support and belief in me helped me in various difficult moments over these 6 years. You did not let me giveup at the final, most difficult steps. vii Abstract Flash SSDs are becoming the primary storage technology for single servers and large data centers. In contrast to conventional magnetic disks, which were dominating the storage market for more than 40 years, Flash offers significantly more performance, consumes less energy and has lower cost per IOPS (I/O Operations Per Second). Besides these advantages, an important role in establishment and quick proliferation of Flash storage was played by the black-box design of SSDs, which guaranteed their backwards compatibility with the traditional hard disk drives. This makes the replacement of HDDs seamless as the software stack, including the application, does not require any adjustment. However, such design of SSDs has multiple disadvantages, which become especially critical for database management systems. The backwards compatibility of SSDs is encapsulated in the so-called Flash translation layer (FTL). FTL is a set of Flash management tasks that typically run on device and mask the native behavior of Flash memory. In other words, FTL creates a black-box over Flash memory and emulates the behavior of HDDs. The fact that the database system has no knowledge about FTL, and has no control over the physical data placement on Flash, results in high I/O overhead, which is caused by suboptimal realization of Flash management tasks and functional redundancy along the critical I/O path. Thus, write-amplification of conventional SSDs used in traditional ’cooked’ storage architecture (i.e., with file system indirection) can be as high as 15x, i.e., a single 4KB write request submitted by the DBMS can turn into 60KB being physically written on Flash storage. As a result, the effective I/O throughput and longevity expectations of SSDs are significantly lower than those of Flash memory encapsulated in these SSDs. In this work we describe our approach - the NoFTL storage architecture - that aims to solve the aforementioned disadvantages of modern Flash SSDs. The basic idea behind the NoFTL is to give the full control over the underlying Flash storage to the database management system, which in turn assumes elimination of all intermediate abstraction layers (file system, block device layer and FTL) between the DBMS and physical storage. NoFTL consists of three main elements - (i) native Flash interface; (ii) integration of Flash management into subsystems of the DBMS; and (iii) the concept of configurable Flash storage. The interplay of them allows us to realize the whole performance potential of ix Flash memory. Native Flash interface allows the DBMS to control physical data placement on Flash storage, and to utilize the computational power of the SSD to perform near- data processing. Integration of typical Flash management tasks (address translation, garbage collection and wear leveling) into different subsystems of the DBMS leads toan optimization of these tasks and of native DBMS algorithms. The concept of configurable Flash storage is a unique approach to organize and manage data on Flash SSDs. With the help of novel storage abstractions, the database system can perform intelligent data placement by clustering objects into different regions. Moreover, for each such region the DBMS can apply a separate set of Flash management algorithms, which would be optimal for data assigned to that region. All this reduces the write-amplification of SSDs to a minimum (up to 15x reduction for OLTP workloads), improves the overall system performance, and significantly increases the lifetime of Flash SSDs (up to 30x improvement). We have realized the NoFTL prototype on an open-source database engine and evaluated it under various scenarios and on different testbeds. x Zusammenfassung Flash-SSDs werden zur primären Speichertechnologie für einzelne Server und große Rechenzentren. Im Gegensatz zu herkömmlichen Festplatten, die mehr als 40 Jahre lang den Speichermarkt dominierten, bietet Flash deutlich mehr Leistung, verbraucht weniger Energie und hat geringere Kosten pro IOPS (I/O-Operationen pro Sekunde). Eine wichtige Rolle bei der Etablierung und schnellen Verbreitung von Flash-Speichern spielte neben diesen Vorteilen auch das Black-Box-Design von SSDs, wodurch deren Abwärtskompatibi- lität mit den herkömmlichen Festplatten garantiert wurde. Dies macht den Austausch von Festplatten nahtlos, da der Software-Stack einschließlich der Anwendung keine Anpassung erfordert. Ein solches Design von SSDs weist jedoch mehrere Nachteile auf, die für die Datenbankverwaltungssysteme besonders kritisch werden. Die Abwärtskompatibilität von SSDs ist in der sogenannten Flash Translation Layer (FTL) eingekapselt. FTL ist eine Reihe von Flash-Verwaltungsaufgaben, die normalerweise auf dem Gerät ausgeführt werden und das native Verhalten des Flash-Speichers mas- kieren. Mit anderen Worten, FTL erstellt eine Blackbox über dem Flash-Speicher und emuliert das Verhalten von Festplatten. Die Tatsache, dass das Datenbanksystem keine Kenntnisse über FTL und auch keine Kontrolle über die physische Datenplatzierung auf dem Flash hat, führt zu einem hohen I/O-Overhead, der durch die suboptimale Realisie- rung von Flash-Verwaltungsaufgaben und funktionale Redundanz entlang des kritischen I/O-Pfades verursacht wird. Somit kann der Schreibfaktor (write amplification) herkömm- licher SSDs, die in der üblichen "cookedSSpeicherarchitektur verwendet werden (d.h. mit Dateisystem-Indirektion), bis zu 15x sein. So kann eine einzelne 4KB Schreibanforderung, die vom DBMS gesendet wird, bis zu 60KB werden, die physisch auf dem Flash-Speicher geschrieben sind. Infolgedessen sind der effektive I/O-Durchsatz und die Langlebigkeits- erwartungen von SSDs erheblich niedriger als die von in diesen SSDs eingekapselten Flash-Speichern. In dieser Arbeit beschreiben wir unseren Ansatz - die NoFTL-Speicherarchitektur, der darauf abzielt, die
Load more

Recommended publications
  • PC Gamers Win Big
    CASE STUDY Intel® Solid-State Drives Performance, Storage and the Customer Experience PC Gamers Win Big Intel® Solid-State Drives (SSDs) deliver the ultimate gaming experience, providing dramatic visual and runtime improvements Intel® Solid-State Drives (SSDs) represent a revolutionary breakthrough, delivering a giant leap in storage performance. Designed to satisfy the most demanding gamers, media creators, and technology enthusiasts, Intel® SSDs bring a high level of performance and reliability to notebook and desktop PC storage. Faster load times and improved graphics performance such as increased detail in textures, higher resolution geometry, smoother animation, and more characters on the screen make for a better gaming experience. Developers are now taking advantage of these features in their new game designs. SCREAMING LOAD TiMES AND SMOOTH GRAPHICS With no moving parts, high reliability, and a longer life span than traditional hard drives, Intel Solid-State Drives (SSDs) dramatically improve the computer gaming experience. Load times are substantially faster. When compared with Western Digital VelociRaptor* 10K hard disk drives (HDDs), gamers experienced up to 78 percent load time improvements using Intel SSDs. Graphics are smooth and uninterrupted, even at the highest graphics settings. To see the performance difference in a head-to- head video comparing the Intel® X25-M SATA SSD with a 10,000 RPM HDD, go to www.intelssdgaming.com. When comparing frame-to-frame coherency with the Western Digital VelociRaptor 10K HDD, the Intel X25-M responds with zero hitching while the WD VelociRaptor shows hitching seven percent of the time. This means gamers experience smoother visual transitions with Intel SSDs.
    [Show full text]
  • SPDK FTL & Marvell OCSSD for Noisy Neighbor Problem
    SPDK FTL & Marvell OCSSD for Noisy Neighbor Problem David Recker Marketing VP Circuit Blvd., Inc. April 2019 4/17/2019 © 2019 Circuit Blvd., Inc. 1 Industry Who We Are Enterprise/Cloud Database and Storage Year Founded Sunnyvale, CA, U.S.A. 2017 Mission We develop next gen database/storage systems leveraging expertise in memory semiconductor, solid-state storage system, and operating systems Open Source Contributions • Linux LightNVM, OCSSD 2.0 specification, OpenSSD FPGA platform • SPDK (since SPDK v17.10) • RocksDB 4/17/2019 © 2019 Circuit Blvd., Inc. 2 OCSSD with SPDK FTL • SPDK FTL on Marvell’s OCSSD Platform • We have been evaluating SPDK FTL on Marvell's SSD SoC platform since Jan ’19 • SPDK (Flash Translation Layer) FTL: The Flash Translation Layer library provides block device access on top of non-block SSDs implementing Open Channel interface. It handles the logical to physical address mapping, responds to the asynchronous media management events, and manages the defragmentation process* • Measured various performance metrics of initial prototype and demonstrate how SPDK OCSSDs can solve the noisy neighbor problem in multi-tenant environments • Share experimental data based on our current implementation (both SPDK FTL and Marvell’s controller being continuously improved) • (Demo) SPDK Driven OCSSD Comparison (Isolation vs Non-Isolation) • Demo table outside (please feel free to drop by for further questions) * SPDK FTL definition: https://spdk.io/doc/ftl.html 4/17/2019 © 2019 Circuit Blvd., Inc. 3 Hardware Setup • SuperMicro X11DPG • 2 * Xeon Scalable Gold 6126 2.6 Ghz (12 cores) • hyperthreading disabled OCSSD1 • 8 * 32 GB DIMM 2666 MT/s • 2 * OCSSD 2.0 OCSSD2 • Marvell 88SS1098 controller • PCIe Gen3x4 slot to each CPU package • nvme id-ns • LBADS=12 (4KiB), MS=0 • ocssd geometry • 8 grp (3), 8 pu (3), 1478 chk (11), 6144 lbk (13) • () means bit length in LBAF • ws_opt=24 (96KiB) CPU1 • 3D TLC NAND CPU2 • write unit: 96KiB (one shot program) • read unit: 32KiB 4/17/2019 © 2019 Circuit Blvd., Inc.
    [Show full text]
  • Information Hiding at SSD NAND Flash Memory Physical Layer
    SECURWARE 2014 : The Eighth International Conference on Emerging Security Information, Systems and Technologies DeadDrop-in-a-Flash: Information Hiding at SSD NAND Flash Memory Physical Layer Avinash Srinivasan and Jie Wu Panneer Santhalingam and Jeffrey Zamanski Temple University George Mason University Computer and Information Sciences Volgenau School of Engineering Philadelphia, USA Fairfax, USA Email: [avinash, jiewu]@temple.edu Email: [psanthal, jzamansk]@gmu.edu Abstract—The research presented in this paper, to of logical blocks to physical flash memory is controlled by the best of our knowledge, is the first attempt at the FTL on SSDs, this cannot be used for IH on SSDs. Our information hiding (IH) at the physical layer of a Solid proposed solution is 100% filesystem and OS-independent, State Drive (SSD) NAND flash memory. SSDs, like providing a lot of flexibility in implementation. Note that HDDs, require a mapping between the Logical Block throughout this paper, the term “physical layer” refers Addressing (LB) and physical media. However, the to the physical NAND flash memory of the SSD, and mapping on SSDs is significantly more complex and is handled by the Flash Translation Layer (FTL). FTL readers should not confuse it with the Open Systems is implemented via a proprietary firmware and serves Interconnection (OSI) model physical layer. to both protect the NAND chips from physical access Traditional HDDs, since their advent more than 50 as well as mediate the data exchange between the years ago, have had the least advancement among storage logical and the physical disk. On the other hand, the hardware, excluding their storage densities.
    [Show full text]
  • Micron: NAND Flash Architecture and Specification Trends
    NAND Flash Architecture and Specification Trends Michael Abraham ([email protected]) Applications Engineering Manager Micron Technology, Inc. Santa Clara, CA USA August 2009 1 Abstract As NAND Flash continues to shrink, page sizes, block sizes, and ECC requirements are increasing while data retention, endurance, and performance are decreasing. These changes impact systems including random write performance and more. Learn how to prepare for these changes and counteract some of them through improved block management techniques and system design. This presentation also discusses some of the tradeoff myths – for example, the myth that you can directly trade ECC for endurance Santa Clara, CA USA August 2009 2 NAND Flash: Shrinking Faster Than Moore’s Law 200 100 Logic 80 DRAM on (nm) ii 60 NAND Resolut 40 Micron 32Gb NAND (34nm) 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 Semiconductor International, 1/1/2007 Santa Clara, CA USA August 2009 3 Memory Organization Trends Over time, NAND block size is increasing. • Larger page sizes increase sequential throughput. • More pages per block reduce die size. 4,194,304 1,048,576 262,144 65,536 16,384 4,096 1, 024 256 64 16 Block size (B) Data Bytes per Page Pages per Block Santa Clara, CA USA August 2009 4 Consumer-grade NAND Flash: Endurance and ECC Trends Process shrinks lead to less electrons ppgger floating gate. ECC used to improve data retention and endurance. To adjust for increasing RBERs, ECC is increasing exponentially to achieve equivalent UBERs. For consumer applications, endurance becomes less important as density increases.
    [Show full text]
  • SSD ABC Guide – OCZ Forum Ii © 2014 OCZ Storage Solutions
    SSD ABC Guide – OCZ Forum ii © 2014 OCZ Storage Solutions SSD ABC Guide – OCZ Forum Contents 1 - 8 .......................................................................................... Identifying your SSD ..................................................................................................................................................... 1 Products ........................................................................................................................................................................ 2 Unpacking and Handling your SSD .............................................................................................................................. 3 Fitting your SSD ............................................................................................................................................................ 4 Desktop ...................................................................................................................................................................................... 4 Laptop/Notebook ........................................................................................................................................................................ 4 Powering On and Self Testing (POST) your SSD ......................................................................................................... 4 Detecting your SSD ......................................................................................................................................................
    [Show full text]
  • Intelligent Controllers Key to Solid State Storage Systems
    Intelligent Controllers Key to Solid State Storage Systems Anil Vasudeva President & Chief Analyst IMEX Research.com (408) 268-0800 (408) 489-0800 cell [email protected] 2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. Agenda • Industry Trends • SSD Adoption Challenges & Solutions • Workload Characterization & Impact on Controller Designs • Server and Storage Attach SSDs - Product Segments • Key Take-aways © 2010-12 IMEX Research, Copying prohibited. All rights reserved. 2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. IT Industry Journey - Roadmap Analytics – BI IT Industry Predictive Analytics - Unstructured Data Roadmap From Dashboards Visualization to Prediction Engines using Big Data. Cloudization On-Premises > Private Clouds > Public Clouds DC to Cloud-Aware Infrast. & Apps. Cascade migration to SPs/Public Clouds. Automation Automatically Maintains Application SLAs (Self-Configuration, Self-Healing©IMEX, Self-Acctg. Charges etc.) Virtualization Pools Resources. Provisions, Optimizes, Monitors Shuffles Resources to optimize Delivery of various Business Services Integration/Consolidation Integrate Physical Infrast./Blades to meet CAPSIMS ®IMEX Cost, Availability, Performance, Scalability, Inter-operability, Manageability & Security Standardization Standard IT Infrastructure- Volume Economics HW/Syst SW (Servers, Storage, Networking Devices, System Software (OS, MW & Data Mgmt. SW) 2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
    [Show full text]
  • Arc 100 Series Product Highlights
    Arc 100 Series Product Highlights SATA 3.0 2.5” SSD • Cutting-edge A19nm process geometry NAND offers excellent value for consumer desktops and laptops • Emphasis on endurance, rated for 20GB/day of host writes for 3 years (typical client workloads) • Proprietary Barefoot 3 M10 controller technology delivers superior sustained speeds over the long term • Excels in both incompressible and compressible data types such as multimedia, encrypted data,. ZIP files and software • Advanced suite of NAND flash management to analyze and dynamically adapt as flash cells wear Solid Performance for Notebooks and PCs • Superior reliability with in-house technology and high quality Think an SSD upgrade is out of your reach? Think again. With OCZ’s Arc 100 components based on the latest Series, get lasting SSD performance and an exceptional computing experience, all technology while delivering an excellent value for flash storage thrill seekers. • Sleek alloy housing offers ultra-slim Putting Hard Drives to Shame sub-7mm z-height for use in the latest thinner form factor notebooks Imagine faster boot-ups, snappier file transfers, improved energy efficiency, and system responsiveness that make you wonder why you put up with that hard drive for so long. If you’re ready to make the leap to a more durable alternative to spinning discs, the Arc 100 Series is ready to take on your storage challenges at an upgrade-friendly price point. OCZ may make changes to specifications and product descriptions at any time, without notice. Product Brief | Arc 100 Series | V1.1 | ©2014 OCZ Storage Solutions, Inc. – A Toshiba Group Company 1 Performance 120GB 240GB 480GB Sequential Read Speed1 490 MB/s 490 MB/s 490 MB/s Sequential Write Speed1 400 MB/s 430 MB/s 430 MB/s Random Read (4K QD32)2 70,000 IOPS 70,000 IOPS 80,000 IOPS Random Write (4K QD32)2 80,000 IOPS 80,000 IOPS 80,000 IOPS Steady State Random Write (4K QD32) 12,000 IOPS 18,000 IOPS 20,000 IOPS 1.
    [Show full text]
  • Radeon™ R7 Series Solid State Drives
    RADEON™ R7 SERIES SOLID STATE DRIVES The Ultimate Storage for your Gaming Desktop or Notebook PC Prepare yourself for a new level of performance and revel in a storage experience second to none with superior gaming, system responsiveness, and application performance. Using cutting-edge SSD technology designed with enthusiasts in mind, the Radeon™ R7 Series SSDs meets the demands of gamers and graphics- hungry power users for fast system boot-ups, insane speeds, and scorching fast load times. Now there is finally a storage solution to match the rest of your high-end system components for an unmatched gaming and multimedia experience. Product Highlights Designed to deliver the ultimate storage solution Excels in both incompressible and compressible for gamers and graphics-hungry power users. data types such as multimedia, encrypted data,. ZIP files and software Proprietary OCZ Barefoot 3 controller technology delivers superior performance and endurance Bundled with a 3.5-inch desktop adapter bracket and Acronis® True Image™ HD cloning software to easily transfer games, programs, and data from Latest generation A19nm flash delivers a high your old hard drive performance yet cost-effective upgrade Sleek alloy housing offers slimmer 7mm z-height Advanced suite of NAND flash management for compatibility with the ultra-thin notebooks keeps your drive at higher sustained performance over the long term Putting emphasis on client workload endurance, rated at 30GB/day of host writes for 4 years* PERFORMANCE 120GB 240GB 480GB Max Read (MB/sec)1 550
    [Show full text]
  • The SSD Relapse: Understanding and Choosing the Best SSD
    12/31/2020 A Wear Leveling Refresher: How Long Will My SSD Last? - The SSD Relapse: Understanding and Choosing the Best SSD Login Register ABOUT BENCH FORUMS PODCAST PC COMPONENTS ▼ SMARTPHONES & TABLETS ▼ SYSTEMS ▼ ENTERPRISE & IT GUIDES ▼ DEALS TRENDING TOPICS AMD CPUS INTEL MOBILE GPUS SMARTPHONES MOTHERBOARDS STORAGE Follow 72.5K followers Home > Storage The SSD Relapse: Understanding and Choosing 295 the Best SSD Comments by Anand Lal Shimpi on August 30, 2009 12:00 AM EST + Add A Comment Posted in Storage A WEAR LEVELING REFRESHER: HOW LONG WILL MY SSD LAST? A Wear Leveling Refresher: How Long Will My SSD Last? As if everything I’ve talked about thus far wasn’t enough to deal with, there’s one more major issue that directly impacts the performance of these drives: wear leveling. PIPELINE STORIES + SUBMIT NEWS Each MLC NAND cell can be erased ~10,000 times before it stops reliably holding charge. You can switch to SLC flash and up that figure to 100,000, but your cost just went up 2x. For these drives to succeed in the Xiaomi Announces the consumer space and do it quickly, it must be using MLC flash. Mi 11: First Snapdragon 888 Device AT Deals: SK Hynix Gold S31 1 TB is $84 at Amazon Intel's Maple Ridge (JHL8540) SLC (left) vs. MLC (right) flash Thunderbolt 4 Controller Now Shipping Ten thousand erase/write cycles isn’t much, yet SSD makers are guaranteeing their drives for anywhere from 1 - 10 years. On top of that, SSD makers across the board are calling their drives more reliable than AT Deals: Seagate 12TB Exos HDD Drops conventional hard drives.
    [Show full text]
  • Manual 417045 OCZ VTX3-25SAT3-480G
    OCZ Solid State Drive Breakdown Delivering performance, versatility, and reliability that other SSD lines cannot offer 2.5 inch SATA III Capacity Max Read Max Write Random 4K Write Technology NAND Vector Series – groundbreaking storage performance Product Page VTR1-25SAT3-128G 128GB 550MB/s 400MB/s 90,000 IOPS Indilinx Barefoot 3 VTR1-25SAT3-256G 256GB 550MB/s 530MB/s 95,000 IOPS Advanced suite of NAND flash Sync VTR1-25SAT3-512G 512GB 550MB/s 530MB/s 95,000 IOPS management for reliability MLC Idle time garbage collection Vertex 4 Series - Rethinking storage performance and endurance with a cutting-edge new architecture Product Page VTX4-25SATA3-64G 64GB 460MB/s 220MB/s 70,000 IOPS Indilinx Everest 2 VTX4-25SATA3-128G 128GB 560MB/s 430MB/s 90,000 IOPS Ndurance™ 2.01 Sync VTX4-25SATA3-256G 256GB 560MB/s 510MB/s 90,000 IOPS Latency reduction MLC VTX4-25SATA3-512G 512GB 560MB/s 510MB/s 95,000 IOPS Up to 1GB cache Vertex 3 Max IOPS Series - Maximizes data throughput with increased random IOPS performance Product Page VTX3MI-25SAT3-120G 120GB 550MB/s 500MB/s 75,000 IOPS SandForce 2200 Toggle VTX3MI-25SAT3-240G 240GB 550MB/s 500MB/s 65,000 IOPS MLC Vertex 3 Series - Excellent performance & endurance for write-intensive applications Product Page 7mm Product Page VTX3-25SAT3-60G 60GB 535MB/s 480MB/s 60,000 IOPS VTX3-25SAT3-90G 90GB 550MB/s 500MB/s 60,000 IOPS VTX3-25SAT3-120G 120GB 550MB/s 500MB/s 60,000 IOPS VTX3-25SAT3-128G 128GB 550MB/s 500MB/s 60,000 IOPS SandForce 2200 Sync VTX3-25SAT3-240G 240GB 550MB/s 500MB/s 60,000 IOPS MLC VTX3-25SAT3-256G
    [Show full text]
  • Onfi: Achieving Breakthrough NAND Performance
    ONFi: Achieving Breakthrough NAND Performance Amber Huffman Principal Engineer Intel Corporation Agenda ONFi Workgroup Update – Mission and membership – ONFi 2.0 specification completed – NAND connector specification completed – JEDEC collaboration established High-speed NAND interface details Extending the high-speed interface 2 Agenda ONFi Workgroup Update – Mission and membership – ONFi 2.0 specification completed – NAND connector specification completed – JEDEC collaboration established High-speed NAND interface details Extending the high-speed Interface 3 Mission… Possible. NAND has been the only commodity memory with no standard interface – Command set, timings, and pin-out are similar among vendors NAND has been ripe for standardization due to a few inflection points: – 1) Explosion in use of NAND for MP3 players, phones, caches, and SSDs – 2) Increase in number of NAND vendors serving the market (2 to 6+) ONFi Workgroup was formed in May 2006 to address “gap” – ONFI = Open NAND Flash Interface ONFi revision 1.0 delivered in December 2006, defines: – Uniform NAND electrical and protocol interface • Raw NAND component interface for embedded use • Includes timings, electrical, protocol • Standardized base command set – Uniform mechanism for device to report its capabilities to the host ONFI 1.0 sets a solid foundation for NAND (r)evolution. 4 A-Data Afa Technologies Alcor Micro Aleph One Anobit Tech. Apacer Arasan Chip Systems ASMedia Technology ATI Avid Electronics BitMicro Biwin Technology Chipsbank Cypress DataFab Systems DataIO Datalight Denali Software Entorian FCI FormFactor Foxconn Fusion Media Tech Genesys Logic Hagiwara Sys-Com HiperSem Hitachi GST Hyperstone InCOMM Indilinx Inphi Intelliprop ITE Tech Jinvani Systech Kingston Technology Lauron Technologies Lotes LSI Macronix Marvell Mentor Graphics Metaram Members Moai Electronics Molex NVidia Orient Semiconductor P.A.
    [Show full text]
  • Lessons in Transitioning Research Simulations Into Hardware Systems
    Getting Real: Lessons in Transitioning Research Simulations into Hardware Systems Mohit Saxena, Yiying Zhang Michael M. Swift, Andrea C. Arpaci-Dusseau and Remzi H. Arpaci-Dusseau University of Wisconsin-Madison msaxena,yyzhang,swift,dusseau,remzi @cs.wisc.edu { } Abstract of changing their command interface. Most such knowl- Flash-based solid-state drives have revolutionized stor- edge has remained the intellectual property of SSD man- age with their high performance. Their sophisticated in- ufacturers [18, 26, 11, 12], who release little about the ternal mechanisms have led to a plethora of research on internal workings of their devices. This limits the oppor- how to optimize applications, file systems, and internal tunities for research innovation on new flash interfaces, SSD designs. Due to the closed nature of commercial de- on OS designs to better integrate flash in the storage hi- vices though, most research on the internals of an SSD, erarchy, and on adapting the SSD internal block manage- such as enhanced flash-translation layers, is performed ment for application requirements. using simulation or emulation. Without implementation Simulators and emulators suffer from two major in real devices, it can be difficult to judge the true benefit sources of inaccuracy. First, they are limited by the of the proposed designs. quality of performance models, which may miss impor- In this paper, we describe our efforts to implement two tant real-world effects. Second, simulators often simplify new SSD designs that change both the internal workings systems and may leave out important components, such of the device and its interface to the host operating sys- as the software stack used to access an SSD.
    [Show full text]