FAST: Quick Application Launch on Solid-State Drives
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Advanced Programming for the Java(TM) 2 Platform
Advanced Programming for the Java(TM) 2 Platform Training Index Advanced Programming for the JavaTM 2 Platform By Calvin Austin and Monica Pawlan November 1999 [CONTENTS] [NEXT>>] [DOWNLOAD] Requires login As an experienced developer on the JavaTM platform, you undoubtedly know how fast moving and comprehensive the Early Access platform is. Its many application programming interfaces (APIs) Downloads provide a wealth of functionality for all aspects of application and system-level programming. Real-world developers never use one Bug Database or two APIs to solve a problem, but bring together key Submit a Bug functionality spanning a number of APIs. Knowing which APIs you View Database need, which parts of which APIs you need, and how the APIs work together to create the best solution can be a daunting task. Newsletters Back Issues To help you navigate the Java APIs and fast-track your project Subscribe development time, this book includes the design, development, test, and deployment phases for an enterprise-worthy auction Learning Centers application. While the example application does not cover every Articles possible programming scenario, it explores many common Bookshelf situations and the discussions leave you with a solid methodology Code Samples for designing and building your own solutions. New to Java Question of the Week This book is for developers with more than a beginning level of Quizzes understanding of writing programs in the Java programming Tech Tips language. The example application is written with the Java® 2 Tutorials platform APIs and explained in terms of functional hows and whys, so if you need help installing the Java platform, setting up your Forums environment, or getting your first application to work, you should first read a more introductory book such as Essentials of the Java Programming Language: A Hands-On Guide or The Java Tutorial. -
Fragmentation in Large Object Repositories
Fragmentation in Large Object Repositories Experience Paper Russell Sears Catharine van Ingen University of California, Berkeley Microsoft Research [email protected] [email protected] ABSTRACT 1. INTRODUCTION Fragmentation leads to unpredictable and degraded application Application data objects continue to increase in size. performance. While these problems have been studied in detail Furthermore, the increasing popularity of web services and other for desktop filesystem workloads, this study examines newer network applications means that systems that once managed static systems such as scalable object stores and multimedia archives of “finished” objects now manage frequently modified repositories. Such systems use a get/put interface to store objects. versions of application data. Rather than updating these objects in In principle, databases and filesystems can support such place, typical archives either store multiple versions of the objects applications efficiently, allowing system designers to focus on (the V of WebDAV stands for “versioning” [25]), or simply do complexity, deployment cost and manageability. wholesale replacement (as in SharePoint Team Services [19]). Similarly, applications such as personal video recorders and Although theoretical work proves that certain storage policies media subscription servers continuously allocate and delete large, behave optimally for some workloads, these policies often behave transient objects. poorly in practice. Most storage benchmarks focus on short-term behavior or do not measure fragmentation. We compare SQL Applications store large objects as some combination of files in Server to NTFS and find that fragmentation dominates the filesystem and as BLOBs (binary large objects) in a database. performance when object sizes exceed 256KB-1MB. NTFS Only folklore is available regarding the tradeoffs. -
ECE 598 – Advanced Operating Systems Lecture 19
ECE 598 { Advanced Operating Systems Lecture 19 Vince Weaver http://web.eece.maine.edu/~vweaver [email protected] 7 April 2016 Announcements • Homework #7 was due • Homework #8 will be posted 1 Why use FAT over ext2? • FAT simpler, easy to code • FAT supported on all major OSes • ext2 faster, more robust filename and permissions 2 btrfs • B-tree fs (similar to a binary tree, but with pages full of leaves) • overwrite filesystem (overwite on modify) vs CoW • Copy on write. When write to a file, old data not overwritten. Since old data not over-written, crash recovery better Eventually old data garbage collected • Data in extents 3 • Copy-on-write • Forest of trees: { sub-volumes { extent-allocation { checksum tree { chunk device { reloc • On-line defragmentation • On-line volume growth 4 • Built-in RAID • Transparent compression • Snapshots • Checksums on data and meta-data • De-duplication • Cloning { can make an exact snapshot of file, copy-on- write different than link, different inodles but same blocks 5 Embedded • Designed to be small, simple, read-only? • romfs { 32 byte header (magic, size, checksum,name) { Repeating files (pointer to next [0 if none]), info, size, checksum, file name, file data • cramfs 6 ZFS Advanced OS from Sun/Oracle. Similar in idea to btrfs indirect still, not extent based? 7 ReFS Resilient FS, Microsoft's answer to brtfs and zfs 8 Networked File Systems • Allow a centralized file server to export a filesystem to multiple clients. • Provide file level access, not just raw blocks (NBD) • Clustered filesystems also exist, where multiple servers work in conjunction. -
Ext4 File System and Crash Consistency
1 Ext4 file system and crash consistency Changwoo Min 2 Summary of last lectures • Tools: building, exploring, and debugging Linux kernel • Core kernel infrastructure • Process management & scheduling • Interrupt & interrupt handler • Kernel synchronization • Memory management • Virtual file system • Page cache and page fault 3 Today: ext4 file system and crash consistency • File system in Linux kernel • Design considerations of a file system • History of file system • On-disk structure of Ext4 • File operations • Crash consistency 4 File system in Linux kernel User space application (ex: cp) User-space Syscalls: open, read, write, etc. Kernel-space VFS: Virtual File System Filesystems ext4 FAT32 JFFS2 Block layer Hardware Embedded Hard disk USB drive flash 5 What is a file system fundamentally? int main(int argc, char *argv[]) { int fd; char buffer[4096]; struct stat_buf; DIR *dir; struct dirent *entry; /* 1. Path name -> inode mapping */ fd = open("/home/lkp/hello.c" , O_RDONLY); /* 2. File offset -> disk block address mapping */ pread(fd, buffer, sizeof(buffer), 0); /* 3. File meta data operation */ fstat(fd, &stat_buf); printf("file size = %d\n", stat_buf.st_size); /* 4. Directory operation */ dir = opendir("/home"); entry = readdir(dir); printf("dir = %s\n", entry->d_name); return 0; } 6 Why do we care EXT4 file system? • Most widely-deployed file system • Default file system of major Linux distributions • File system used in Google data center • Default file system of Android kernel • Follows the traditional file system design 7 History of file system design 8 UFS (Unix File System) • The original UNIX file system • Design by Dennis Ritche and Ken Thompson (1974) • The first Linux file system (ext) and Minix FS has a similar layout 9 UFS (Unix File System) • Performance problem of UFS (and the first Linux file system) • Especially, long seek time between an inode and data block 10 FFS (Fast File System) • The file system of BSD UNIX • Designed by Marshall Kirk McKusick, et al. -
Partitioner Och Filsystem 2
Partitioner och filsystem 2 File systems FAT Unix-like NTFS Vad är ett filsystem? • Datorer behöver en metod för att lagra och hämta data… • Referensmodell för filsystem (Carrier) – Filsystem kategori • Layout och storleksinformation – Innehålls kategori • Kluster och block – data enheter – Metadata kategori • Tidsinformation, storlek, access kontroll • Adresser till allokerade data enheter – Filnamn kategori • Oftast ihop-kopplad med metadata – Applikations kategori • Quota • Journaler • De modernaste påminner mycket om relations databaser Windows • NTFS (New Technology File System) – 6 versioner finns, de nyaste är v3.0 (Windows 2000) och v3.1 (XP, 2003, Vista, 2008, 7), kallas även 5.0, 5.1, 5.2, 6.0 och 6.1 (efter OS version) – Stöd för unicode, säkerhet, mm. - är mycket mer komplext än FAT! – http://en.wikipedia.org/wiki/Ntfs • FAT 12/16/32, VFAT (långa filnamn i Win95) – Används fortfarande men är inte effektivt för större lagringskapaciteter (klusterstorleken) – Långsammare access än NTFS • Windows Future Storage (WinFS) inställt projekt, enligt rykten var det en SQL-databas som ligger ovanpå ett NTFS filsystem – Läs mer på: http://www.ntfs.com/ – Och: http://en.wikipedia.org/wiki/WinFS FAT12, 16 och 32 • FAT12, finns på floppy diskar – Begränsad lagringskapacitet – Designat för MS-DOS 1.0 • FAT16, var designat för större diskar – Äldre OS använde detta • MS-DOS 3.0, Win95 OSR1, NT 3.5 och NT 4.0 – Max diskstorlek 2 GB • FAT32 kom när diskar större än 2GB kom – Vissa äldre och alla nya OS kan använda FAT32 • Windows 98/Me/2000/XP/2003/Vista/7 och 2008 • Begränsningar med FAT32 – Största formaterabara volymen är 32GB (större volymer kan dock användas, < 16 TiB) – Begränsade features vad gäller komprimering, kryptering, säkerhet och hastighet jämfört mot NTFS • http://en.wikipedia.org/wiki/FAT_file_system exFAT • exFAT (Extended File Allocation Table, a.k.a. -
Enhance Your Customer's Vista System with Datatraveler Readyflash
kingston.com/windowsvista Enhance your customer’s Vista system with DataTraveler ReadyFlash For more information, Complement your Vista™ sales with a Kingston® for Windows ReadyBoost with at least 512 MB of please contact your dedicated DataTraveler® ReadyFlash USB Flash drive enhanced available space. Kingston representative: for Windows® ReadyBoost™. Craig McQueenie – Central Can I enable ReadyBoost with any USB (416) 315-9097 Ideal for systems with limited memory expansion Flash drive? [email protected] capabilities, Windows ReadyBoost allows a user to No, Vista will only offer the option of using Daniel Ouimet – Quebec utilize memory outside of system memory module ReadyBoost on USB Flash drives that have met both (514) 244-4901 upgrades. For instance, if a notebook has a maximum a specific performance and a capacity threshold. [email protected] memory capacity of 1 GB installed, Windows Patrick Jan – West ReadyBoost allows for usage of a Flash memory Will Kingston offer additional Flash memory (604) 961-8038 device, such as DataTraveler ReadyFlash as a more devices for ReadyBoost? [email protected] responsive storage medium for ReadyBoost cache. Yes, Kingston will offer additional Flash products that Royal Taylor – Central (416) 617-6714 Kingston Part Number: DTR/1GB are enhanced for Windows ReadyBoost. Please contact [email protected] your Kingston representative for further details. Description: 1-GB USB Flash drive enhanced for Windows ReadyBoost. Can I use more than one ReadyBoost enabled device at a time? Windows Vista allows for only one device enabled FAQ: for ReadyBoost at a time. What is ReadyBoost? ReadyBoost is a Microsoft Windows Vista feature How much memory should I allocate for which may improve system performance by ReadyBoost? allowing a compatible USB drive to be configured If you have selected to use ReadyBoost, you can with a ReadyBoost cache. -
Filesystem Considerations for Embedded Devices ELC2015 03/25/15
Filesystem considerations for embedded devices ELC2015 03/25/15 Tristan Lelong Senior embedded software engineer Filesystem considerations ABSTRACT The goal of this presentation is to answer a question asked by several customers: which filesystem should you use within your embedded design’s eMMC/SDCard? These storage devices use a standard block interface, compatible with traditional filesystems, but constraints are not those of desktop PC environments. EXT2/3/4, BTRFS, F2FS are the first of many solutions which come to mind, but how do they all compare? Typical queries include performance, longevity, tools availability, support, and power loss robustness. This presentation will not dive into implementation details but will instead summarize provided answers with the help of various figures and meaningful test results. 2 TABLE OF CONTENTS 1. Introduction 2. Block devices 3. Available filesystems 4. Performances 5. Tools 6. Reliability 7. Conclusion Filesystem considerations ABOUT THE AUTHOR • Tristan Lelong • Embedded software engineer @ Adeneo Embedded • French, living in the Pacific northwest • Embedded software, free software, and Linux kernel enthusiast. 4 Introduction Filesystem considerations Introduction INTRODUCTION More and more embedded designs rely on smart memory chips rather than bare NAND or NOR. This presentation will start by describing: • Some context to help understand the differences between NAND and MMC • Some typical requirements found in embedded devices designs • Potential filesystems to use on MMC devices 6 Filesystem considerations Introduction INTRODUCTION Focus will then move to block filesystems. How they are supported, what feature do they advertise. To help understand how they compare, we will present some benchmarks and comparisons regarding: • Tools • Reliability • Performances 7 Block devices Filesystem considerations Block devices MMC, EMMC, SD CARD Vocabulary: • MMC: MultiMediaCard is a memory card unveiled in 1997 by SanDisk and Siemens based on NAND flash memory. -
Implementing Nfsv4 in the Enterprise: Planning and Migration Strategies
Front cover Implementing NFSv4 in the Enterprise: Planning and Migration Strategies Planning and implementation examples for AFS and DFS migrations NFSv3 to NFSv4 migration examples NFSv4 updates in AIX 5L Version 5.3 with 5300-03 Recommended Maintenance Package Gene Curylo Richard Joltes Trishali Nayar Bob Oesterlin Aniket Patel ibm.com/redbooks International Technical Support Organization Implementing NFSv4 in the Enterprise: Planning and Migration Strategies December 2005 SG24-6657-00 Note: Before using this information and the product it supports, read the information in “Notices” on page xi. First Edition (December 2005) This edition applies to Version 5, Release 3, of IBM AIX 5L (product number 5765-G03). © Copyright International Business Machines Corporation 2005. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . xi Trademarks . xii Preface . xiii The team that wrote this redbook. xiv Acknowledgments . xv Become a published author . xvi Comments welcome. xvii Part 1. Introduction . 1 Chapter 1. Introduction. 3 1.1 Overview of enterprise file systems. 4 1.2 The migration landscape today . 5 1.3 Strategic and business context . 6 1.4 Why NFSv4? . 7 1.5 The rest of this book . 8 Chapter 2. Shared file system concepts and history. 11 2.1 Characteristics of enterprise file systems . 12 2.1.1 Replication . 12 2.1.2 Migration . 12 2.1.3 Federated namespace . 13 2.1.4 Caching . 13 2.2 Enterprise file system technologies. 13 2.2.1 Sun Network File System (NFS) . 13 2.2.2 Andrew File System (AFS) . -
External Flash Filesystem for Sensor Nodes with Sparse Resources
External Flash Filesystem for Sensor Nodes with sparse Resources Stephan Lehmann Stephan Rein Clemens Gühmann stephan.lehmann@tu- stephan.rein@tu- clemens.guehmann@tu- berlin.de berlin.de berlin.de Wavelet Application Group Department of Energy and Automation Technology Chair of Electronic Measurement and Diagnostic Technology Technische Universität Berlin ABSTRACT for using just a few kilobytes of RAM, the source data must This paper describes a free filesystem for external flash mem- be accessible. Another memory intensive task concerns long- ory to be employed with low-complexity sensor nodes. The term sensor logs. system uses a standard secure digital (SD) card that can be easily connected to the serial port interface (SPI) or any A cost effective solution of this memory problem could be general input/output port of the sensor’s processor. The external flash memory. Flash memory is non-volatile and filesystem is evaluated with SD- cards used in SPI mode and therefore power failure safe. Flash memory can be obtained achieves an average random write throughput of about 40 either as raw flash or as standard flash devices such as USB- kByte/sec. For random write access throughputs larger than sticks or SD- cards. Raw flashes are pure flash chips which 400 kByte/sec are achieved. The filesystem allows for stor- do not provide a controller unit for wear levelling- that is, age of large amounts of sensor or program data and can assist a technique for prolonging the service life of the erasable more memory expensive algorithms. It requires 7 kByte of storage media - or garbage collection. -
Azor: Using Two-Level Block Selection to Improve SSD-Based I/O Caches
Azor: Using Two-level Block Selection to Improve SSD-based I/O caches Yannis Klonatos∗†, Thanos Makatos∗, Manolis Marazakis∗, Michail D. Flouris∗, and Angelos Bilas∗† ∗Foundation for Research and Technology - Hellas (FORTH), Institute of Computer Science (ICS) 100 N. Plastira Ave., Vassilika Vouton, Heraklion, GR-70013, Greece †Department of Computer Science, University of Crete, P.O. Box 2208, Heraklion, GR 71409, Greece. {klonatos, mcatos, maraz, flouris, bilas}@ics.forth.gr Abstract—Flash-based solid state drives (SSDs) exhibit poten- approaches that are application-specific and require application tial for solving I/O bottlenecks by offering superior performance knowledge, intervention, and tuning, Azor transparently and over hard disks for several workloads. In this work we design dynamically places data blocks in the SSD cache as they flow Azor, an SSD-based I/O cache that operates at the block-level and is transparent to existing applications, such as databases. Our in the I/O path between main memory and HDDs. In this work, design provides various choices for associativity, write policies we investigate the following problems: and cache line size, while maintaining a high degree of I/O concurrency. Our main contribution is that we explore differ- TABLE I entiation of HDD blocks according to their expected importance HDD AND SSD PERFORMANCE METRICS. on system performance. We design and analyze a two-level block selection scheme that dynamically differentiates HDD blocks, and SSD HDD selectively places them in the limited space of the SSD cache. Price/capacity ($/GB) $3 $0.3 We implement Azor in the Linux kernel and evaluate its Response time (ms) 0.17 12.6 effectiveness experimentally using a server-type platform and Throughput (R/W) (MB/s) 277/202 100/90 large problem sizes with three I/O intensive workloads: TPC-H, IOPS (R/W) 30,000/3,500 150/150 SPECsfs2008, and Hammerora. -
Tzworks Prefetch Parser (Pf) Users Guide
TZWorks® Prefetch Parser (pf) Users Guide Abstract pf is a standalone, command-line tool that can parse Windows prefetch files. From a forensics perspective, the prefetch file offers the analyst information about the applications that were executed, their location and the frequency. pf runs on Windows, Linux and Mac OS-X. Copyright © TZWorks LLC www.tzworks.com Contact Info: [email protected] Document applies to v1.33 of pf Updated: Aug 5, 2021 Table of Contents 1 Introduction .......................................................................................................................................... 2 2 How to Use pf........................................................................................................................................ 2 2.1 Handling Volume Shadow Copies ................................................................................................. 5 2.2 Other Output Options ................................................................................................................... 6 3 Known Issues ......................................................................................................................................... 7 4 Available Options .................................................................................................................................. 8 5 Authentication and the License File .................................................................................................... 10 5.1 Limited versus Demo versus Full in the tool’s Output -
Practical-Electronic
EVERYDAY DECEMBER 1997 ELECTRON http://www.epemag.wimborne.co.uk £2.65 pa; cinE, GIANT PULL•OUT , • • «Mr am, - DettgeR:)t tam 4"- ACTIVE , •• MICROPHONE • A simple circuit to increase sensitivity P. rs .• • • - - MINI - •• - • L. tr. ORGAN 1:7 \ An unusual, inexpensive •P 7 " • e design t Ort 9. SA 11 '7 • SOUND rtr1 1 Alarm deterrent for P1R securit hts TEACH-IN 98 ........ Part 2: Capacitors and Inductors Index for Volume 26 THE Noil MAGAZINE FO. ELL TECHNOLOGY- r ra spedal ALTERNATIVE _.•ii 9 770262 361089 Feat and FUTURE TECHNOLOGIES ELECTRIC MAN PLANS, SHOCK PEOPLE WITH THE TOUCH OF YOUR HAND! E5/set Ref F/EMA1 PARABOLIC DISH MICROPHONE PLANS Listen to distant sounds and voices open windows sound sources in 'hard to ger or hostile premises Uses Satellite technology to gather distant sounds and focus them to our ultra sensitive electronics Plans also Sn0,11 xn optional wireless link system £8/set ref F/PM5 2 FOR 1 MULTIFUNCTIONAL HIGH FREQUENCY AND HIGH DC VOLTAGE, SOLID STATE TESLA COIL A AND VARIABLE 100,000 VDC OUTPUT GENERATOR PLANS Operates on 9-12v0c, many possible experiments £10 Ref WIND GENERATORS 380 WATT 1 14 metre rta cades aaroon riatri cades .a year warranty vdc output 24v version available control electronics included brushless neodymium cubic curve alternator only two moving pans maintenance free simple roof top installation start up speed 7mph max output (30mph) 380w £499 ref AIR1 PLANS PORTABLE X RAY MACHINE PLANS Easy to construct e e- plans on a simple and cheap way to build a home X-ray rnachinei Effective device X-ray sealed assemblies can beused for experimental purposes Not a toy or for minors' £6,/set Ref F/XP I TELEKINETIC ENHÀNCER PLANS Mystrfy and amaze your COLOUR CCTV friends by creating motion with no known apparent means or cause Uses no electnca Ior mechanical connections no special gimmicks yet produces positive motion and effect Excellent for science projects.