An Analysis of Data Storage and Retrieval of File Format System

Total Page:16

File Type:pdf, Size:1020Kb

An Analysis of Data Storage and Retrieval of File Format System 38 Indian Journal of Science and Technology Vol.2 No. 9 (Sep 2009) ISSN: 0974- 6846 An analysis of data storage and retrieval of file format system R. Mariappan and B. Parthasarathy Dept. of Master of Computer Appl., Mailam Engg. College, Mailam-604 304, Villupuram Dt., Tamil Nadu, India [email protected] Abstract: The present work focuses on the analysis and results. The digital entities are images of reality, stored as examination of different types of file format system, data (bits) that must be interpreted for display by applying storage devices and storage & retrieval systems which information and knowledge. The preservation of digital are most frequently used in the various applications. It is entities requires the ability to characterize data, focused on the file format to identify the right file to right information, and knowledge (Regan W. Moore, 2000). applications for the fast storing and accessing speed with Data integrity is a fundamental aspect of storage less memory space along with the suitable file format on security and reliability. The reliable access to data is specific storage devices, RAM and processors. The prerequisite for most computer system and applications. analysis evolves based on different types of file format on File system consistency is one of the common ones. different storage devices taking into account different Data storage patterns are being employed for efficient research perspectives. The outcome of the work retrieval of data from secondary storage devices motivates multimedia applications users and developers (Gopalan Sivathanu et al., 2005). for choosing appropriate file format, storage devices, It is meant to operate in a COMOHO (commercial RAM and processors to undertake their applications in a office, mobile office, and home office) environment, i.e. successful manner. computing anywhere, anytime. The main desktop office machine (CO) holds all files. Since Cyber All will store all Keywords: Data storage, RAM, file format systm personal information, e.g. documents, photos, and Introduction videos, this data needs to be valid and hence understood Data is a major aspect of the computer field in both in an indeterminate future (Cyber All, 2006. A Personal hardware and software. The data storage in the system store for everything). can store data for easy and fast access at any time and For many years, when we used a word-processing anywhere. Data is organized for storage in a hierarchy in application, files were stored in a format that was fully the form such as bits, bytes / characters, fields, records, understood only by the application we used. WordPerfect files and databases and data warehouse. The storage stored WordPerfect files, Microsoft Word stored Word media and file formats are all vital importance in order for files, and so on. computer systems to store and organize the various kinds The Chemical Abstracts Service (CAS) has built files of data in effectively and efficiently. which require hundreds of millions of bytes of storage. To In the past decade the traditional users and cope with this size and variability, CAS has developed an developer’s applications that supported with only text and internal standardized storage format and has image file formats. These files could be handled by disk implemented it on the IBM System/360. This format, operating systems. In the modern GUI world the software which is called Standard File Format Implementation of and hardware developers are facing a challenging trouble standardized files, has permitted the CAS system to to use different types of file formats and storage devices. operate with greater generality and flexibility (Anzelmo, ,Storage media are of vital importance in order for 1971). computer systems to store and organize information Data must be stored and documented in a meaningful effectively and efficiently (Papadopoulos & Zhang, 2007). way that is absolutely clear (Joseph C. Slater, 2007). Storage media compose a hierarchy with primary storage Regarding graphics, use EPS or PDF for all graphics that (registers, cache and main memory) tertiary storage are not a pure photographs. Converting a photograph to a (tapes, optical disks and flash memory) and secondary JPEG or TIFF is a simple task on a Mac R. On other storage (hard disks). platforms there is free software available, or Adobe Several types of data storage exist in most computer Acrobat R can be used. Magnetic – based media such as systems (Abrahma Silberschatz et al., 2002). They are floppy disks and hard drives have a half life of between classified by the speed with which they can access data, five and seven years depending on the storage by their cost per unit of data to buy the memory, and by conditions. their reliability. Among the media available are cache, Need of the Study main memory, flash memory, magnetic disks , optical disk In the fast emergent world, we need a good storage and magnetic tapes. media and storage software. In the earlier days, the data It is clear that the upload time increases for files were stored and retrieved in various methods. Those stored in data base as file size increases. But download methods needed many storage spaces in both permanent time of files whether stored in database or file system is (Floppy, Hard Disk etc.,) and temporary (RAM, VRAM almost same since it is faster retrieving the search Research article “Data storage & retrieval” Mariappan & Parthasarathy Indian Society for Education and Environment (iSee) http://www.indjst.org Indian J.Sci.Technol. 39 Indian Journal of Science and Technology Vol.2 No. 9 (Sep 2009) ISSN: 0974- 6846 etc.,) storage and be also took more time to store and constructed by Bits and Bytes. But, after the introduction retrieve on the devices. of GUI, the computer world has come to the peak. In the recent and emerging trends in information Generally, the computer software professionals need to technology has been totally changed for the users needs know the apt technology of store and access of the data. and requirements of choices are large capacity of storage Objectives of the study devices and file format to meet and challenges in their The following are the objectives of this research. many applications. Computer data storage and retrieval • To study and analyze the various file format such as system helps as per the need of the consumers and the image, text, audio, video and others. users. • To understand the suitable file format with less In the middle of twentieth century, after invention of memory space occupied. electrical, electronic and computer instrument, the Methodology requirement of data and database usage also In the present study and analysis the descriptive tremendously increased. Then they needed huge amount research design has been followed. This research of data storage media and fastest data store and access proposed to collect the following details about the data, method. data collection, file format storage device/ media and supporting software and hardware for the Fig.1 Fig.2. Analysis of image file format and file size 50 File Size 44 40 38.8 30 24.8 25.4 20 10 7.71 File size 4.86 2.48 0 GIF JPEG PNG BMP PSD TIFF PCX File Type Fig.3. Analysis of audio file format and file size 60 File Size 50 48 40 30 File size 20 10 10 . 3 6.49 5.73 6.11 0 AUD M ID MP3 WAV WMA File Type purpose of the analysis of the study. The following different types of file format, storage devices media are to be considered in the analysis of the researches data storage and retrieval Statement of the problem systems Data is a major aspect of the computer field in both • Image file formats - GIF, JPEG, PNG, BMP, EPS, hardware and software. The computer peripherals are PSD,TIFF designed based on certain kind of data. Since 1946, in • Audio File formats - WAV,MID,AUD, WMA, MP3 the computer field the data storage media is a major • Video File format - AVI, DAT, MP3, MPEG, WMV component of hardware in order to store and access the • Text File format - DOC,XLS, PDF, HTML, RTF,TIFF data. Only in 1980's the computer Hardware • Source File format and Database file format etc., Manufacturers introduced many kinds of technologies to Fig.1-5 shows the analysis of Data storage and retrieval store huge amount of data in same size of floppy disk and system (Flow chart is given). Hard disk etc. Results and discussion Before the introduction of the windows operating Based on the analysis of the study, the following system the data were processed based on Disk comparison analysis table has been made. The following Operating System only. In the DOS era, the Data were Research article “Data storage & retrieval” Mariappan & Parthasarathy Indian Society for Education and Environment (iSee) http://www.indjst.org Indian J.Sci.Technol. 40 Indian Journal of Science and Technology Vol.2 No. 9 (Sep 2009) ISSN: 0974- 6846 table and figures show the result Fig.4. Analysis of video file format & file size fast and efficiently and effectively in of various types of file format Comprision of File t ype and File size the selective storage and retrieval stored in different types of 62 of data for multimedia applications. storage devices. File Size In future there might be storage 61 60.8 60.4 Table 1: Image File format 60 devices, file format which will have 59.4 Table 2: Audio File format 59 58.9 a large storage capacity and also Table 3: Video File format 58 with quick access time. Let us File size 57.8 Table 4: Text File format 57 firmly believe that the evaluation of From this analysis of the Tables 56 invention shall take us there.
Recommended publications
  • The LAS File Format Contains a Header Block, Variable Length
    LAS Specification Version 1.2 Approved by ASPRS Board 09/02/2008 LAS 1.2 1 LAS FORMAT VERSION 1.2: This document reflects the second revision of the LAS format specification since its initial version 1.0 release. Version 1.2 retains the same structure as version 1.1 including identical field alignment. LAS 1.1 file Input/Output (I/O) libraries will require slight modifications in order to be compliant with this revision. A LAS 1.1 Reader will read LAS 1.2 (without the new enhancements) with no modifications. A detailed change document that provides both an overview of the changes in the specification as well as the motivation behind each change is available from the ASPRS website in the LIDAR committee section. The additions of LAS 1.2 include: • GPS Absolute Time (as well as GPS Week Time) – LAS 1.0 and LAS 1.1 specified GPS “Week Time” only. This meant that GPS time stamps “rolled over” at midnight on Saturday. This makes processing of LIDAR flight lines that span the time reset difficult. LAS 1.2 allows both GPS Week Time and Absolute GPS Time (POSIX) stamps to be used. • Support for ancillary image data on a per point basis. You can now specify Red, Green, Blue image data on a point by point basis. This is encapsulated in two new point record types (type 2 and type 3). LAS FORMAT DEFINITION: The LAS file is intended to contain LIDAR point data records. The data will generally be put into this format from software (e.g.
    [Show full text]
  • Key Aspects in 3D File Format Conversions
    Key Aspects in 3D File Format Conversions Kenton McHenry and Peter Bajcsy Image Spatial Data Analysis Group, NCSA Presented by: Peter Bajcsy National Center for Supercomputing Applications University of Illinois at Urbana-Champaign Outline • Introduction • What do we know about 3D file formats? • Basic Archival Questions • Is there an optimal format to convert to? • Can we quantify 3D noise introduced during conversions? • NCSA Polyglot to Support Archival Processes • Automation of File Format Conversions • Quality of File Format Conversions • Scalability with Volume • Conclusions • Live demonstration Introduction Introduction to 3D File Format Reality *.k3d *.pdf (*.prc, *.u3d) *.ma, *.mb, *.mp *.w3d *.lwo *.c4d *.dwg *.blend *.iam *.max, *.3ds Introduction: Our Survey about 3D Content • Q: How Many 3D File Formats Exist? • A: We have found more than 140 3D file formats. Many are proprietary file formats. Many are extremely complex (1,200 and more pages of specifications). • Q: How Many Software Packages Support 3D File Format Import, Export and Display? • A: We have documented about 16 software packages. There are many more. Most of them are proprietary/closed source code. Many contain incomplete support of file specifications. Examples of Formats and Stored Content Format Geometry Appearance Scene Animation Faceted Parametric CSG B-Rep Color Material Texture Bump Lights Views Trans. Groups 3ds √ √ √ √ √ √ √ √ √ igs √ √ √ √ √ √ √ lwo √ √ √ √ √ √ obj √ √ √ √ √ √ √ ply √ √ √ √ √ stp √ √ √ √ √ √ wrl √ √ √ √ √ √ √ √ √ √ √ u3d √ √ √ √ √
    [Show full text]
  • Fileweaver: Flexible File Management with Automatic Dependency Tracking Julien Gori Han L
    FileWeaver: Flexible File Management with Automatic Dependency Tracking Julien Gori Han L. Han Michel Beaudouin-Lafon Université Paris-Saclay, CNRS, Inria, Laboratoire de Recherche en Informatique F-91400 Orsay, France {jgori, han.han, mbl}@lri.fr ABSTRACT Specialized tools typically load and save information in pro- Knowledge management and sharing involves a variety of spe- prietary and/or binary data formats, such as Matlab1 .mat cialized but isolated software tools, tied together by the files files or SPSS2 .sav files. Knowledge workers have to rely on that these tools use and produce. We interviewed 23 scientists standardized exchange file formats and file format converters and found that they all had difficulties using the file system to communicate information from one application to the other, to keep track of, re-find and maintain consistency among re- leading to a multiplication of files. lated but distributed information. We introduce FileWeaver, a system that automatically detects dependencies among files Moreover, as exemplified by Guo’s “typical” workflow of a without explicit user action, tracks their history, and lets users data scientist [8, Fig. 2.1], knowledge workers’ practices often interact directly with the graphs representing these dependen- consist of several iterations of exploratory, production and cies and version history. Changes to a file can trigger recipes, dissemination phases, in which workers create copies of files either automatically or under user control, to keep the file con- to save their work, file revisions, e.g. to revise the logic of sistent with its dependants. Users can merge variants of a file, their code, and file variants, e.g.
    [Show full text]
  • Common Object File Format (COFF)
    Application Report SPRAAO8–April 2009 Common Object File Format ..................................................................................................................................................... ABSTRACT The assembler and link step create object files in common object file format (COFF). COFF is an implementation of an object file format of the same name that was developed by AT&T for use on UNIX-based systems. This format encourages modular programming and provides powerful and flexible methods for managing code segments and target system memory. This appendix contains technical details about the Texas Instruments COFF object file structure. Much of this information pertains to the symbolic debugging information that is produced by the C compiler. The purpose of this application note is to provide supplementary information on the internal format of COFF object files. Topic .................................................................................................. Page 1 COFF File Structure .................................................................... 2 2 File Header Structure .................................................................. 4 3 Optional File Header Format ........................................................ 5 4 Section Header Structure............................................................. 5 5 Structuring Relocation Information ............................................... 7 6 Symbol Table Structure and Content........................................... 11 SPRAAO8–April 2009
    [Show full text]
  • Image Formats
    Image Formats Ioannis Rekleitis Many different file formats • JPEG/JFIF • Exif • JPEG 2000 • BMP • GIF • WebP • PNG • HDR raster formats • TIFF • HEIF • PPM, PGM, PBM, • BAT and PNM • BPG CSCE 590: Introduction to Image Processing https://en.wikipedia.org/wiki/Image_file_formats 2 Many different file formats • JPEG/JFIF (Joint Photographic Experts Group) is a lossy compression method; JPEG- compressed images are usually stored in the JFIF (JPEG File Interchange Format) >ile format. The JPEG/JFIF >ilename extension is JPG or JPEG. Nearly every digital camera can save images in the JPEG/JFIF format, which supports eight-bit grayscale images and 24-bit color images (eight bits each for red, green, and blue). JPEG applies lossy compression to images, which can result in a signi>icant reduction of the >ile size. Applications can determine the degree of compression to apply, and the amount of compression affects the visual quality of the result. When not too great, the compression does not noticeably affect or detract from the image's quality, but JPEG iles suffer generational degradation when repeatedly edited and saved. (JPEG also provides lossless image storage, but the lossless version is not widely supported.) • JPEG 2000 is a compression standard enabling both lossless and lossy storage. The compression methods used are different from the ones in standard JFIF/JPEG; they improve quality and compression ratios, but also require more computational power to process. JPEG 2000 also adds features that are missing in JPEG. It is not nearly as common as JPEG, but it is used currently in professional movie editing and distribution (some digital cinemas, for example, use JPEG 2000 for individual movie frames).
    [Show full text]
  • File Format Guidelines for Management and Long-Term Retention of Electronic Records
    FILE FORMAT GUIDELINES FOR MANAGEMENT AND LONG-TERM RETENTION OF ELECTRONIC RECORDS 9/10/2012 State Archives of North Carolina File Format Guidelines for Management and Long-Term Retention of Electronic records Table of Contents 1. GUIDELINES AND RECOMMENDATIONS .................................................................................. 3 2. DESCRIPTION OF FORMATS RECOMMENDED FOR LONG-TERM RETENTION ......................... 7 2.1 Word Processing Documents ...................................................................................................................... 7 2.1.1 PDF/A-1a (.pdf) (ISO 19005-1 compliant PDF/A) ........................................................................ 7 2.1.2 OpenDocument Text (.odt) ................................................................................................................... 3 2.1.3 Special Note on Google Docs™ .......................................................................................................... 4 2.2 Plain Text Documents ................................................................................................................................... 5 2.2.1 Plain Text (.txt) US-ASCII or UTF-8 encoding ................................................................................... 6 2.2.2 Comma-separated file (.csv) US-ASCII or UTF-8 encoding ........................................................... 7 2.2.3 Tab-delimited file (.txt) US-ASCII or UTF-8 encoding .................................................................... 8 2.3
    [Show full text]
  • File Format Identification and Validation Tools Roy Lechich 2/2007 Integrated Library & Technology Systems Yale University Library
    File Format Identification and Validation Tools Roy Lechich 2/2007 Integrated Library & Technology Systems Yale University Library File Types and Formats With the increasing uses for software, many of them involving storage of different kinds of data, numerous types of computer files have emerged. In fact , it is virtually impossible to list every type of computer file, because: • some file types are general while others are very specific • some file types are widely used while others may exist only for the use of one organization or individual • the specfications for some file types are proprietary while others are open • new types are always being created. A file type often has an associated explicit format specification -- a formal declaration of how information is to be encoded in a file to qualify as being of that "type". The more widely used and specific a file type is, the more likely that it will have a corresponding format specification, with its formal declaration existing as a "reference implementation" and usually maintained by a standards organization. Key file use concepts: • different types are typically created, accessed and modified by some set of programs or tools – this can range from very general (e.g. text files able to be read and written by operating system tools) to very specific (e.g. a jpeg 2000 requiring a very specific program to create or view the image). • users of a specific file will do so using these appropriate programs/tools File Type Identification vs. File Format Validation Most people typically are not overly concerned about file formats and related issues, because a) they are happily able to create and use their data with their sets of applications and tools, and b) they do not need to think about the implications of the passage of time upon their data and their ability to continue to use it.
    [Show full text]
  • Atlantis Core File
    Available for CEREC SW, inLab CAD SW, 3Shape, Dental Wings, DWOS Lava Edition, exocad, Open design software Atlantis® Atlantis® Core File – User guide Atlantis® CONTENTS This user guide for the Atlantis Core File is valid for: • CEREC SW 4.4.4 or higher • inLab CAD SW 1 6.0 or higher • exocad DentalCAD • 3Shape DS 2014/2015 • Dental Wings DWOS 4.0 • DWOS Lava Edition • Design software that accepts open STL file format Description of Atlantis Core File 4 Creating a new Atlantis order 5 Downloading Atlantis Core File 6 Importing Atlantis Core File into CEREC SW 7 Importing Atlantis Core File into inLab CAD SW 1 1 Adding the screw access channel 1 6 Importing Atlantis Core File into exocad DentalCAD 1 8 Adding the screw access channel 2 1 Importing Atlantis Core File into 3Shape 24 Adding the screw access channel 26 Importing Atlantis Core File into Dental Wings or DWOS Lava Edition 28 Adding the screw access channel 30 Importing Atlantis Core File into open design software 35 Appendix A: Adding more restorations – CEREC SW 36 Appendix B: Failed to process your Atlantis Core File order 38 Appendix C: Designing pontic on Atlantis Core File 39 Appendix D: Designing pontic with 3Shape 4 1 Appendix E: Later order 42 All trademarks and company names are the property of their respective owners. All products may not be regulatory released in all markets. Please contact the local Dentsply Sirona Implants sales office for current product assortment and availability. To improve readability for our customers, Dentsply Sirona does not use ® or ™ in body copy.
    [Show full text]
  • Wing Helper 1.1 Tutorial Document Version 1.1
    Wing Helper 1.1 Tutorial Document Version 1.1 (c) 2015, 2016 by Wing Helper e.U., all rights reserved Wing Helper 1.1 Table of Contents 1 Introduction......................................................................................................................................5 2 New Functions and Improvements in Version 1.1............................................................................6 3 Features.............................................................................................................................................7 4 Usage................................................................................................................................................9 4.1 Registering Wing Helper...........................................................................................................9 4.2 Main Window.........................................................................................................................10 4.3 Panel Edit Mode......................................................................................................................11 4.3.1 Base Data........................................................................................................................12 4.3.2 Ribs.................................................................................................................................14 4.4 Spars........................................................................................................................................15 4.4.1
    [Show full text]
  • Apple File System Reference
    Apple File System Reference Developer Contents About Apple File System 7 General-Purpose Types 9 paddr_t .................................................. 9 prange_t ................................................. 9 uuid_t ................................................... 9 Objects 10 obj_phys_t ................................................ 10 Supporting Data Types ........................................... 11 Object Identifier Constants ......................................... 12 Object Type Masks ............................................. 13 Object Types ................................................ 14 Object Type Flags .............................................. 20 EFI Jumpstart 22 Booting from an Apple File System Partition ................................. 22 nx_efi_jumpstart_t ........................................... 24 Partition UUIDs ............................................... 25 Container 26 Mounting an Apple File System Partition ................................... 26 nx_superblock_t ............................................. 27 Container Flags ............................................... 36 Optional Container Feature Flags ...................................... 37 Read-Only Compatible Container Feature Flags ............................... 38 Incompatible Container Feature Flags .................................... 38 Block and Container Sizes .......................................... 39 nx_counter_id_t ............................................. 39 checkpoint_mapping_t ........................................
    [Show full text]
  • Best Practices for File Naming and Organizing
    Smithsonian Data Management Best Practices Naming and Organizing Files Name and organize your files in a way that indicates their contents and specifies any relationships to other files. The five precepts of file naming and organization: Have a distinctive, human-readable name that gives an indication of the content. Follow a consistent pattern that is machine-friendly. Organize files into directories (when necessary) that follow a consistent pattern. Avoid repetition of semantic elements among file and directory names. Have a file extension that matches the file format (no changing extensions!) FILE NAMING A file name should enable disambiguation among similar files and, for large numbers of files that make up a dataset, facilitate sorting and reviewing. Ideally, file names should be unique. Keep in mind that files can be moved and, without the inherited folder structure, important descriptive information about the contents could be lost. Consider whether a filename would be meaningful outside of your chosen directory structure, and if not, how important the loss of that context would be, e.g., if the date a file was created is important, include it in the filename rather than just the directory name. To provide a description of the file contents in the name itself, you should include elements such as: a date, or at least the year, the contents of the file were created, in the YYYYMMDD format (four digit year, two digit month, two digit day.) o start the filename with the date if it is important to store or sort files in chronological order. the project name, or documented abbreviation for the project.
    [Show full text]
  • Tinkertool System 6 Reference Manual Ii
    Documentation 0632-1969/2 TinkerTool System 6 Reference Manual ii Version 6.99, July 21, 2021. US-English edition. MBS Documentation 0632-1969/2 © Copyright 2003 – 2021 by Marcel Bresink Software-Systeme Marcel Bresink Software-Systeme Ringstr. 21 56630 Kretz Germany All rights reserved. No part of this publication may be redistributed, translated in other languages, or transmitted, in any form or by any means, electronic, mechanical, recording, or otherwise, without the prior written permission of the publisher. This publication may contain examples of data used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental. This publication could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. The publisher may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice. Make sure that you are using the correct edition of the publication for the level of the product. The version number can be found at the top of this page. Apple, macOS, iCloud, and FireWire are registered trademarks of Apple Inc. Intel is a registered trademark of Intel Corporation. UNIX is a registered trademark of The Open Group. Broadcom is a registered trademark of Broadcom, Inc. Trademarks or service marks are used for identification purposes only.
    [Show full text]