Tiered-Latency DRAM: a Low Latency and Low Cost DRAM Architecture

Total Page:16

File Type:pdf, Size:1020Kb

Tiered-Latency DRAM: a Low Latency and Low Cost DRAM Architecture Tiered-Latency DRAM: A Low Latency and Low Cost DRAM Architecture Donghyuk Lee Yoongu Kim Vivek Seshadri Jamie Liu Lavanya Subramanian Onur Mutlu Carnegie Mellon University 2.5 100 Abstract Capacity Latency (tRCD) Latency (tRC) The capacity and cost-per-bit of DRAM have historically 2.0 80 scaled to satisfy the needs of increasingly large and complex 1.5 60 computer systems. However, DRAM latency has remained al- 1.0 40 most constant, making memory latency the performance bottle- Latency (ns) Latency neck in today’s systems. We observe that the high access la- (Gb) Capacity 0.5 20 tency is not intrinsic to DRAM, but a trade-oU made to decrease 0.0 0 cost-per-bit. To mitigate the high area overhead of DRAM sens- SDR-200 DDR-400 DDR2-800 DDR3-1066 DDR3-1333 ing structures, commodity DRAMs connect many DRAM cells to 20002000 20032003 20062006 20082008 20112011 each sense-ampliVer through a wire called a bitline. These bit- y We refer to the dominant DRAM chips during the period of time [5, 19]. lines have a high parasitic capacitance due to their long length, Figure 1. DRAM Capacity & Latency Over Time [5, 19, 35, 43] and this bitline capacitance is the dominant source of DRAM la- cialized applications such as high-end networking equipment tency. Specialized low-latency DRAMs use shorter bitlines with that require very low latency even at a very high cost [6]. fewer cells, but have a higher cost-per-bit due to greater sense- ampliVer area overhead. In this work, we introduce Tiered- In DRAM, each bit is represented by electrical charge on a capacitor-based cell. The small size of this capacitor necessi- Latency DRAM (TL-DRAM), which achieves both low latency tates the use of an auxiliary structure, called a sense-ampliVer, and low cost-per-bit. In TL-DRAM, each long bitline is split into to sense the small amount of charge held by the cell and am- two shorter segments by an isolation transistor, allowing one plify it to a full digital logic value. A sense-ampliVer is up to segment to be accessed with the latency of a short-bitline DRAM three orders of magnitude larger than a cell [39]. To mitigate without incurring high cost-per-bit. We propose mechanisms the large size of sense-ampliVers, each sense-ampliVer is con- that use the low-latency segment as a hardware-managed or nected to many DRAM cells through a wire called a bitline. software-managed cache. Evaluations show that our proposed mechanisms improve both performance and energy-eXciency DRAM manufacturers trade latency for cost-per-bit by ad- for both single-core and multi-programmed workloads. justing the length of these bitlines. Shorter bitlines (fewer cells connected to the bitline) constitute a smaller electrical load on the bitline, resulting in decreased latency, but require a larger 1 Introduction number of sense-ampliVers for a given DRAM capacity (Fig 2a), Primarily due to its low cost-per-bit, DRAM has long been resulting in higher cost-per-bit. Longer bitlines (more cells con- the choice substrate for architecting main memory subsystems. nected to the bitline) require fewer sense-ampliVers for a given In fact, DRAM’s cost-per-bit has been decreasing at a rapid DRAM capacity (Fig 2b), reducing cost-per-bit, but impose a rate as DRAM process technology scales to integrate ever more higher electrical load on the bitline, increasing latency. As a DRAM cells into the same die area. As a result, each successive result, neither of these two approaches can optimize for both generation of DRAM has enabled increasingly large-capacity cost-per-bit and latency. main memory subsystems at low cost. ) e t r In stark contrast to the continued scaling of cost-per-bit, the n i o l t h i latency of DRAM has remained almost constant. During the s b ( cells same 11-year interval in which DRAM’s cost-per-bit decreased e n i by a factor of 16, DRAM latency (as measured by the t and sense-amps l RCD t 1 i timing constraints ) decreased by only 30.5% and 26.3%, as b t ) RC e g n i Isolation TR. n shown in Fig 1. From the perspective of the processor, an access l ) t e o t e i l r n ( n b to DRAM takes hundreds of cycles – time during which the i i o l l t t h i i processor may be stalled, waiting for DRAM. Such wasted time s b cells ( cells cells b leads to large performance degradations commonly referred to as the “memory wall” [58] or the “memory gap” [56]. sense-amps sense-amps sense-amps However, the high latency of commodity DRAM chips is in fact a deliberate trade-oU made by DRAM manufactur- (a) Latency Opt. (b) Cost Opt. (c) Our Proposal ers. While process technology scaling has enabled DRAM Figure 2. DRAM: Latency vs. Cost Optimized, Our Proposal designs with both lower cost-per-bit and lower latency [16], Our goal is to design a new DRAM architecture that pro- DRAM manufacturers have usually sacriVced the latency ben- vides low latency for the common case while still retaining a eVts of scaling in order to achieve even lower cost-per-bit, as low cost-per-bit overall. Our proposal, which we call Tiered- we explain below. Hence, while low-latency DRAM chips ex- Latency DRAM, is based on the key observation that long bit- ist [25, 27, 45], their higher cost-per-bit relegates them to spe- lines are the dominant source of DRAM latency [47]. 1The overall DRAM access latency can be decomposed into individual Our key idea is to adopt long bitlines to achieve low cost- DRAM timing constraints (Sec 2.2). Two of the most important timing con- per-bit, while allowing their lengths to appear shorter in or- der to achieve low latency. In our mechanism (Tiered-Latency straints are tRCD (row-to-column delay) and tRC (“row-conWict” latency). When DRAM is lightly loaded, tRCD is often the bottleneck, whereas when DRAM), each long bitline is split into two shorter segments us- DRAM is heavily loaded, tRC is often the bottleneck (Secs 2.2 and 2.3). ing an isolation transistor, as shown in Fig 2c: the segment that 1 is connected directly to the sense-ampliVer is called the near This paper makes the following contributions. segment, whereas the other is called the far segment. • Based on the observation that long internal wires (bitlines) Table 1 summarizes the latency and die-size (i.e., cost- 2 are the dominant source of DRAM latency, we propose a per-bit ) characteristics of Tiered-Latency DRAM and other new DRAM architecture, Tiered-Latency DRAM. To our DRAMs (refer to Sec 3 for details). Compared to commodity knowledge, this is the Vrst work that enables low-latency DRAM (long bitlines) which incurs high access latency for all DRAM without signiVcantly increasing cost-per-bit. cells, Tiered-Latency DRAM oUers signiVcantly reduced access • We quantitatively evaluate the latency, area, and power latency for cells in the near segment, while not always increas- characteristics of Tiered-Latency DRAM through circuit ing the access latency for cells in the far segment. In fact, for simulations based on a publicly available 55nm DRAM cells in the far segment, although tRC is increased, tRCD is process technology [39]. actually decreased. • We describe two major ways of leveraging TL-DRAM: Table 1. Latency & Die-Size Comparison of DRAMs (Sec 3) 1) by not exposing the near segment capacity to the OS and using it as a hardware-managed cache, and 2) by ex- Short Bitline Long Bitline Segmented Bitline posing the near segment capacity to the OS and using (Fig 2a) (Fig 2b) (Fig 2c) hardware/software to map frequently accessed pages to Unsegmented Unsegmented Near Far the near segment. We propose two new policies to manage Length (Cells) 32 512 32 480 the near segment cache that speciVcally exploit the asym- metric latency characteristics of TL-DRAM. Lowest High Lowest Low We evaluate our proposed memory management policies tRCD (8.2ns) (15ns) (8.2ns) (12.1ns) • Latency on top of the Tiered-Latency DRAM substrate and show Lowest High Lowest Higher t that they improve both system performance and energy RC (23.1ns) (52.5ns) (23.1ns) (65.8ns) eXciency for both single-program and multi-programmed Normalized Highest Lowest Low workloads. Die-Size (Cost) (3.76) (1.00) (1.03) 2 DRAM Background To access a cell in the near segment, the isolation transistor 3 A DRAM chip consists of numerous cells that are grouped is turned oU, so that the cell and the sense-ampliVer see only at diUerent granularities to form a hierarchical organization as the portion of the bitline corresponding to the near segment shown in Fig 3. First, a DRAM chip is the set of all cells on (i.e., reduced electrical load). Therefore, the near segment can the same silicon die, along with the I/O circuitry which allows be accessed quickly. On the other hand, to access a cell in the the cells to be accessed from outside the chip. Second, a DRAM far segment, the isolation transistor is turned on to connect the chip is divided into multiple banks (e.g., eight for DDR3), where entire length of the bitline to the sense-ampliVer. In this case, a bank is a set of cells that share peripheral circuitry such as the however, the cell and the sense-ampliVer see the full electrical address decoders (row and column).
Recommended publications
  • Zynq-7000 All Programmable Soc and 7 Series Devices Memory Interface Solutions User Guide (UG586) [Ref 2]
    Zynq-7000 AP SoC and 7 Series Devices Memory Interface Solutions (v4.1) DS176 April 4, 2018 Advance Product Specification • I/O Power Reduction option reduces average I/O Introduction power by automatically disabling DQ/DQS IBUFs and The Xilinx® Zynq®-7000 All Programmable SoC and internal terminations during writes and periods of 7 series FPGAs memory interface solutions cores provide inactivity high-performance connections to DDR3 and DDR2 • Internal VREF support SDRAMs, QDR II+ SRAM, RLDRAM II/RLDRAM 3, and • LPDDR2 SDRAM. Multicontroller support for up to eight controllers • Two controller request processing modes: DDR3 and DDR2 SDRAMs o Normal: reorder requests to optimize system throughput and latency This section discusses the features, applications, and functional description of Xilinx 7 series FPGAs memory o Strict: memory requests are processed in the order interface solutions in DDR3 and DDR2 SDRAMs. These received solutions are available with an optional AXI4 slave interface. LogiCORE™ IP Facts Table Core Specifics DDR3 SDRAM Features Supported Zynq®-7000 All Programmable SoC (1) • Component support for interface widths up to 72 bits Device Family 7series(2) FPGAs • Supported DDR3 Component and DIMM, DDR2 Single and dual rank UDIMM, RDIMM, and SODIMM Memory support Component and DIMM, QDR II+, RLDRAM II, RLDRAM 3, and LPDDR2 SDRAM Components • DDR3 (1.5V) and DDR3L (1.35V) Resources See Table 1. • 1, 2, 4, and 8 Gb density device support Provided with Core • 8-bank support Documentation Product Specification • x8 and x16 device
    [Show full text]
  • Micron Technology Inc
    MICRON TECHNOLOGY INC FORM 10-K (Annual Report) Filed 10/26/10 for the Period Ending 09/02/10 Address 8000 S FEDERAL WAY PO BOX 6 BOISE, ID 83716-9632 Telephone 2083684000 CIK 0000723125 Symbol MU SIC Code 3674 - Semiconductors and Related Devices Industry Semiconductors Sector Technology Fiscal Year 03/10 http://www.edgar-online.com © Copyright 2010, EDGAR Online, Inc. All Rights Reserved. Distribution and use of this document restricted under EDGAR Online, Inc. Terms of Use. UNITED STATES SECURITIES AND EXCHANGE COMMISSION Washington, D.C. 20549 FORM 10-K (Mark One) ANNUAL REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE SECURITIES EXCHANGE ACT OF 1934 For the fiscal year ended September 2, 2010 OR TRANSITION REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE SECURITIES EXCHANGE ACT OF 1934 For the transition period from to Commission file number 1-10658 Micron Technology, Inc. (Exact name of registrant as specified in its charter) Delaware 75 -1618004 (State or other jurisdiction of (IRS Employer incorporation or organization) Identification No.) 8000 S. Federal Way, Boise, Idaho 83716 -9632 (Address of principal executive offices) (Zip Code) Registrant ’s telephone number, including area code (208) 368 -4000 Securities registered pursuant to Section 12(b) of the Act: Title of each class Name of each exchange on which registered Common Stock, par value $.10 per share NASDAQ Global Select Market Securities registered pursuant to Section 12(g) of the Act: None (Title of Class) Indicate by check mark if the registrant is a well-known seasoned issuer, as defined in Rule 405 of the Securities Act.
    [Show full text]
  • Understanding and Exploiting Design-Induced Latency Variation in Modern DRAM Chips
    Understanding and Exploiting Design-Induced Latency Variation in Modern DRAM Chips Donghyuk Leeyz Samira Khan@ Lavanya Subramaniany Saugata Ghosey Rachata Ausavarungniruny Gennady Pekhimenkoy{ Vivek Seshadriy{ Onur Mutluyx yCarnegie Mellon University zNVIDIA @University of Virginia {Microsoft Research xETH Zürich ABSTRACT 40.0%/60.5%, which translates to an overall system perfor- Variation has been shown to exist across the cells within mance improvement of 14.7%/13.7%/13.8% (in 2-/4-/8-core a modern DRAM chip. Prior work has studied and exploited systems) across a variety of workloads, while ensuring reli- several forms of variation, such as manufacturing-process- able operation. or temperature-induced variation. We empirically demon- strate a new form of variation that exists within a real DRAM 1 INTRODUCTION chip, induced by the design and placement of different compo- In modern systems, DRAM-based main memory is sig- nents in the DRAM chip: different regions in DRAM, based nificantly slower than the processor. Consequently, pro- on their relative distances from the peripheral structures, cessors spend a long time waiting to access data from require different minimum access latencies for reliable oper- main memory [5, 66], making the long main memory ac- ation. In particular, we show that in most real DRAM chips, cess latency one of the most critical bottlenecks in achiev- cells closer to the peripheral structures can be accessed much ing high performance [48, 64, 67]. Unfortunately, the la- faster than cells that are farther. We call this phenomenon tency of DRAM has remained almost constant in the past design-induced variation in DRAM.
    [Show full text]
  • Leveraging Heterogeneity in DRAM Main Memories to Accelerate Critical Word Access ∗
    Leveraging Heterogeneity in DRAM Main Memories to Accelerate Critical Word Access ∗ Niladrish Chatterjee‡ Manjunath Shevgoor‡ Rajeev Balasubramonian‡ Al Davis‡ Zhen Fang§† Ramesh Illikkal∞ Ravi Iyer∞ ‡University of Utah §Nvidia Corporation ∞Intel Labs {nil,shevgoor,rajeev,ald}@cs.utah.edu [email protected] {ramesh.g.illikkal,ravishankar.iyer}@intel.com Abstract of DRAM chips to build and exploit a heterogeneous memory sys- tem. This paper takes an important step in uncovering the potential The DRAM main memory system in modern servers is largely ho- of such a heterogeneous DRAM memory system. mogeneous. In recent years, DRAM manufacturers have produced The DRAM industry already produces chips with varying proper- chips with vastly differing latency and energy characteristics. This ties. Micron offers a Reduced Latency DRAM (RLDRAM) product provides the opportunity to build a heterogeneous main memory sys- that offers lower latency and lower capacity, and is targeted at high tem where different parts of the address space can yield different performance routers, switches, and network processing [7]. Mi- latencies and energy per access. The limited prior work in this area cron also offers a Low Power DRAM (LPDRAM) product that of- has explored smart placement of pages with high activities. In this fers lower energy and longer latencies and that has typically been paper, we propose a novel alternative to exploit DRAM heterogene- employed in the mobile market segment [6]. Our work explores ity. We observe that the critical word in a cache line can be easily innovations that can exploit a main memory that includes regular recognized beforehand and placed in a low-latency region of the DDR chips as well as RLDRAM and LPDRAM chips.
    [Show full text]
  • Dynamic Rams from Asynchrounos to DDR4
    Dynamic RAMs From Asynchrounos to DDR4 PDF generated using the open source mwlib toolkit. See http://code.pediapress.com/ for more information. PDF generated at: Sun, 10 Feb 2013 17:59:42 UTC Contents Articles Dynamic random-access memory 1 Synchronous dynamic random-access memory 14 DDR SDRAM 27 DDR2 SDRAM 33 DDR3 SDRAM 37 DDR4 SDRAM 43 References Article Sources and Contributors 48 Image Sources, Licenses and Contributors 49 Article Licenses License 50 Dynamic random-access memory 1 Dynamic random-access memory Dynamic random-access memory (DRAM) is a type of random-access memory that stores each bit of data in a separate capacitor within an integrated circuit. The capacitor can be either charged or discharged; these two states are taken to represent the two values of a bit, conventionally called 0 and 1. Since capacitors leak charge, the information eventually fades unless the capacitor charge is refreshed periodically. Because of this refresh requirement, it is a dynamic memory as opposed to SRAM and other static memory. The main memory (the "RAM") in personal computers is dynamic RAM (DRAM). It is the RAM in laptop and workstation computers as well as some of the RAM of video game consoles. The advantage of DRAM is its structural simplicity: only one transistor and a capacitor are required per bit, compared to four or six transistors in SRAM. This allows DRAM to reach very high densities. Unlike flash memory, DRAM is volatile memory (cf. non-volatile memory), since it loses its data quickly when power is removed. The transistors and capacitors used are extremely small; billions can fit on a single memory chip.
    [Show full text]
  • Memory Systems Cache, DRAM, Disk
    Memory Systems Cache, DRAM, Disk Bruce Jacob University of Maryland at College Park Spencer W. Ng Hitachi Global Storage Technologies David T. Wang MetaRAM With Contributions By Samuel Rodriguez Advanced Micro Devices Xmmmk JÜOBSK'1'"'" AMSTERDAM • BOSTON • HEIDELBERG LONDON NEW YORK • OXFORD • PARIS • SAN DIEGO SAN FRANCISCO • SINGAPORE • SYDNEY • TOKYO :<* ELSEVIER Morgan Kaufmann is an imprint of Elsevier MORGAN KAUFMANN PUBLISHERS Preface "It's the Memory, Stupid!" xxxi Overview On Memory Systems and Their Design 1 Ov.l Memory Systems 2 Ov.1.1 Locality ofReference Breeds the Memory Hierarchy 2 Ov.1.2 ImportantFigures ofMerit 7 Ov.1.3 The Goal ofa Memory Hierarchy 10 Ov.2 Four Anecdotes on Modular Design 14 Ov.2.1 Anecdote I: Systemic Behaviors Exist 15 Ov.2.2 Anecdote II: The DLL in DDR SDRAM 17 Ov.2.3 Anecdote III: A Catch-22 in the Search for Bandwidth 18 Ov.2.4 Anecdote IV: Proposais to Exploit Variability in CellLeakage 19 Ov.2.5 Perspective 19 Ov.3 Cross-Cutting Issues 20 Ov.3.1 Cost/Performance Analysis 20 Ov.3.2 Power and Energy 26 Ov.3.3 Reliability 32 Ov.3.4 Virtual Memory 34 Ov.4 An Example Holistic Analysis 41 Ov.4.1 Fully-Buffered DIMM vs. the Disk Cache 41 Ov.4.2 FullyBufferedDIMM: Basics 43 Ov.4.3 Disk Caches: Basics 46 Ov.4.4 Experimental Results 47 Ov.4.5 Conclusions 52 Ov.5 What to Expect 54 IX - X Contents Part I Cache 55 Chapter 1 An Overview of Cache Principles 57 1.1 Caches, 'Caches/ and "Caches" 59 1.2 Locality Principles 62 1.2.1 Temporal Locality 63 1.2.2 Spatial Locality 63 1.2.3 Algorithmic Locality 64 1.2.4
    [Show full text]
  • MOCA: Memory Object Classification and Allocation in Heterogeneous Memory Systems
    MOCA: Memory Object Classification and Allocation in Heterogeneous Memory Systems Aditya Narayan∗, Tiansheng Zhang∗, Shaizeen Agay, Satish Narayanasamyy and Ayse K. Coskun∗ ∗Boston University, Boston, MA 02215, USA; Email: fadityan, tszhang, [email protected] yUniversity of Michigan, Ann Arbor, MI 48109, USA; Email: fshaizeen, [email protected] Abstract—In the era of abundant-data computing, main mem- Traditionally, the main memory (e.g., DRAM) of a com- ory’s latency and power significantly impact overall system puting system is composed of a set of homogeneous memory performance and power. Today’s computing systems are typically modules. The key attributes that determine the efficiency of a composed of homogeneous memory modules, which are optimized to provide either low latency, high bandwidth, or low power. Such memory system are latency, bandwidth, and power. An ideal memory modules do not cater to a wide range of applications with memory system should provide the highest data bandwidth diverse memory access behavior. Thus, heterogeneous memory at the lowest latency with minimum power consumption. systems, which include several memory modules with distinct However, there is no such perfect memory system as a memory performance and power characteristics, are becoming promising module with high performance generally has a high power alternatives. In such a system, allocating applications to their best-fitting memory modules improves system performance and density. Hence, memory modules come in different flavors, energy efficiency. However, such an approach still leaves the optimized to either improve system performance or reduce full potential of heterogeneous memory systems under-utilized power consumption. because not only applications, but also the memory objects within Due to diverse memory access behavior across workloads, a that application differ in their memory access behavior.
    [Show full text]
  • Techniquesfor
    TECHNIQUESFOR Design Examples, Signaling and Memory Technologies, Fiber Optics, Modeling and Simulation to Ensure Signal Zntegrity Tom Granberg, P1i.D. PRENTICEHALL PTR UPPER SADDLERIVER, NJ 07458 WWW.PHiTRCOM PTR Preface xxxvii How This Book 1s Organized xxxvii This Textbook Was Written with Educational Institutions in Mind xxxix University Courses for Which This Book 1s Suitable xl Solutions Manual 1s Available xl Cash for Identifying Textbook Errors xl How This Book Was Prepared xli Personal Acknowledgments xli Technical Acknowledgments xliii Part 1 Introduction 1 Chapter 1 Trends in High-Speed Design 1.1 Everything Keeps Getting Faster and Faster! 1.2 Emerging Technologies and Industry Trends 1.2.1 Major Drivers of Printed Circuit Board (PCB) Technology 1.2.2 Drivers of Innovation 1.2.3 110 Signaling Standards 1.2.4 Web Site as Retailer 1.2.5 Memories 1.2.6 On-Die Terminations 1.3 Trends in Bus Architecture 1.3.1 Moving from Parallel to Serial 1.3.2 The Power of Tools 1.3.3 ASSPs and ASMs 1.4 High-Speed Design as an Offshoot from Microwave Theory 1.5 Background Disciplines Needed for High-Speed Design 1.5.1 High-Speed Conferences and Forums 1.6 Book Organization 1.7 Exercises X Contents cha&er 2 ASICs, Backplane Configurations, and SerDes Technology 2.1 Application-Specific Integrated Circuits (ASICs) 2.2 Bus Configurations 2.2.1 Single-Termination Multidrop 2.2.2 Double-Termination Multidrop 2.2.3 Data Distribution with Point-to-Point Links 2.2.4 Multipoint 2.2.5 Switch Matrix Mesh und Fahric Point-to-Point Bus Architectures 2.3 SerDes Devices 2.3.1 SerDes Device Fundamentals 2.3.2 SerDes at 5 Gbps 2.3.3 SerDes Multibit Signal Encoding 2.4 Electrical Interconnects vs.
    [Show full text]
  • Zynq-7000 All Programmable Soc and 7 Series Devices Memory Interface Solutions User Guide (UG586) [Ref 2]
    Zynq-7000 AP SoC and 7 Series Devices Memory Interface Solutions (v2.3) DS176 June 24, 2015 Advance Product Specification Introduction • Strict: memory requests are processed in the order received The Xilinx® Zynq®-7000 All Programmable SoC and 7 series FPGAs memory interface solutions cores provide LogiCORE™ IP Facts Table high-performance connections to DDR3 and DDR2 Core Specifics SDRAMs, QDR II+ SRAM, RLDRAM II/RLDRAM 3, Supported Zynq®-7000All Programmable SoC, Virtex®-7(2), Kintex®-7(2), and LPDDR2 SDRAM. Device ® Family(1) Artix -7 Supported DDR3 Component and DIMM, DDR2 Component and DIMM, DDR3 and DDR2 SDRAMs Memory QDR II+, RLDRAM II, RLDRAM 3, and LPDDR2 SDRAM Components This section discusses the features, applications, and Resources See Table 1. functional description of Xilinx 7 series FPGAs memory interface solutions in DDR3 and DDR2 SDRAMs. These Provided with Core solutions are available with an optional AXI4 slave Documentation Product Specification User Guide interface. Design Files Verilog, VHDL (top-level files only) Example DDR3 SDRAM Features Design Verilog, VHDL (top-level files only) • Component support for interface widths up to 72 bits Test Bench Not Provided • Single and dual rank UDIMM, RDIMM, and Constraints XDC SODIMM support File • DDR3 (1.5V) and DDR3L (1.35V) Supported N/A • 1, 2, 4, and 8 Gb density device support S/W Driver • 8-bank support Tested Design Flows(3) • x8 and x16 device support Design Entry Vivado® Design Suite • 8:1 DQ:DQS ratio support Simulation For supported simulators, see the • Configurable data bus widths (multiples of 8, up to Xilinx Design Tools: Release Notes Guide.
    [Show full text]
  • External Memory Interface Handbook Volume 2: Design Guidelines
    External Memory Interface Handbook Volume 2: Design Guidelines Last updated for Altera Complete Design Suite: 15.0 Subscribe EMI_DG 101 Innovation Drive 2015.05.04 San Jose, CA 95134 Send Feedback www.altera.com TOC-2 Selecting Your Memory Contents Selecting Your Memory.......................................................................................1-1 DDR SDRAM Features............................................................................................................................... 1-2 DDR2 SDRAM Features............................................................................................................................. 1-3 DDR3 SDRAM Features............................................................................................................................. 1-3 QDR, QDR II, and QDR II+ SRAM Features..........................................................................................1-4 RLDRAM II and RLDRAM 3 Features.....................................................................................................1-4 LPDDR2 Features........................................................................................................................................ 1-6 Memory Selection........................................................................................................................................ 1-6 Example of High-Speed Memory in Embedded Processor....................................................................1-9 Example of High-Speed Memory in Telecom......................................................................................
    [Show full text]
  • I/O: a Detailed Example
    ECE 485/585 Microprocessor System Design Lecture 5: DRAM Basics DRAM Evolution SDRAM-based Memory Systems Zeshan Chishti Electrical and Computer Engineering Dept. Maseeh College of Engineering and Computer Science Sources: Lecture based on materials provided by Mark F. Jacob’s DRAM Systems article Memory component datasheets Outline Taxonomy of Memories Memory Hierarchy SRAM ◼ Basic Cell, Devices, Timing DRAM ◼ Basic Cell, Timing Memory Organization ◼ Multiple banks, interleaving DRAM Evolution DDR3 SDRAM DRAM modules Error Correction Memory Controllers ECE 485/585 Dynamic RAM (DRAM) ECE 485/585 DRAM Technology DRAM Cell • Write – Drive bit line word line – Select desired word (“row”) • Read – Pre-charge bit line Bit state (1 or 0) stored as – Select desired word (“row”) charge on a tiny capacitor – Sense charge bit line – Write value back (restore) 1 transistor • Refresh! – Periodically read each cell • (forcing write-back) Read is destructive → must restore value Charge leaks out over time → refresh ECE 485/585 Volatile Memory Comparison SRAM Cell DRAM Cell word line word line bit line bit line bit line Larger cell Smaller cell ◼ lower density, higher cost/bit ◼ higher density, lower cost/bit Non-destructive Read Destructive Read No refresh required Needs periodic refresh Simple read faster access Complex read longer access time Standard IC process natural for Special IC process difficult to integration with logic integrate with logic circuits Non-multiplexed address lines Multiplexed address lines ◼ Density
    [Show full text]
  • CROW: a Low-Cost Substrate for Improving DRAM Performance, Energy Efficiency, and Reliability Hasan Hassan† Minesh Patel† Jeremie S
    CROW: A Low-Cost Substrate for Improving DRAM Performance, Energy Efficiency, and Reliability Hasan Hassany Minesh Pately Jeremie S. Kimy§ A. Giray Yaglikciy Nandita Vijaykumary§ Nika Mansouri Ghiasiy Saugata Ghose§ Onur Mutluy§ yETH Zürich §Carnegie Mellon University ABSTRACT instruction and data cache miss rates, and 3) have low memory-level DRAM has been the dominant technology for architecting main parallelism. While manufacturers offer latency-optimized DRAM memory for decades. Recent trends in multi-core system design and modules [72, 98], these modules have significantly lower capac- large-dataset applications have amplified the role of DRAM asa ity and higher cost compared to commodity DRAM [8, 53, 58]. critical system bottleneck. We propose Copy-Row DRAM (CROW), Thus, reducing the high DRAM access latency without trading off a flexible substrate that enables new mechanisms for improving capacity and cost in commodity DRAM remains an important chal- DRAM performance, energy efficiency, and reliability. We use the lenge [17, 18, 58, 78]. CROW substrate to implement 1) a low-cost in-DRAM caching Second, the high DRAM refresh overhead is a challenge to im- mechanism that lowers DRAM activation latency to frequently- proving system performance and energy consumption. A DRAM accessed rows by 38% and 2) a mechanism that avoids the use of cell stores data in a capacitor that leaks charge over time. To main- short-retention-time rows to mitigate the performance and energy tain correctness, every DRAM cell requires periodic refresh opera- overhead of DRAM refresh operations. CROW’s flexibility allows tions that restore the charge level in a cell.
    [Show full text]