DOCSLIB.ORG

Importing and Exporting Data

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Importing and Exporting Data Chapter II-9 II-9Importing and Exporting Data Importing Data................................................................................................................................................ 117 Load Waves Submenu ............................................................................................................................ 119 Line Terminators...................................................................................................................................... 120 LoadWave Text Encodings..................................................................................................................... 120 Loading Delimited Text Files ........................................................................................................................ 120 Determining Column Formats............................................................................................................... 120 Date/Time Formats .................................................................................................................................. 121 Custom Date Formats ...................................................................................................................... 122 Column Labels ......................................................................................................................................... 122 Examples of Delimited Text ................................................................................................................... 123 The Load Waves Dialog for Delimited Text — 1D ............................................................................. 123 Editing Wave Names............................................................................................................................... 124 Set Scaling After Loading Delimited Text Data .................................................................................. 124 The Load Waves Dialog for Delimited Text — 2D ............................................................................. 124 2D Label and Position Details................................................................................................................ 125 Loading Text Waves from Delimited Text Files.................................................................................. 125 Delimited Text Tweaks ........................................................................................................................... 126 Troubleshooting Delimited Text Files .................................................................................................. 127 Loading Fixed Field Text Files ...................................................................................................................... 127 The Load Waves Dialog for Fixed Field Text ...................................................................................... 127 Loading General Text Files............................................................................................................................ 128 Examples of General Text....................................................................................................................... 128 Comparison of General Text, Fixed Field and Delimited Text ......................................................... 129 The Load Waves Dialog for General Text — 1D................................................................................. 129 Editing Wave Names for a Block........................................................................................................... 130 The Load Waves Dialog for General Text — 2D................................................................................. 130 Set Scaling After Loading General Text Data ...................................................................................... 130 General Text Tweaks............................................................................................................................... 130 Troubleshooting General Text Files ...................................................................................................... 131 Loading Igor Text Files .................................................................................................................................. 131 Examples of Igor Text ............................................................................................................................. 131 Igor Text File Format............................................................................................................................... 132 Setting Scaling in an Igor Text File........................................................................................................ 133 The Load Waves Dialog for Igor Text................................................................................................... 133 Loading MultiDimensional Waves from Igor Text Files ................................................................... 134 Loading Text Waves from Igor Text Files ............................................................................................ 135 Loading Igor Binary Data .............................................................................................................................. 135 The Igor Binary File ................................................................................................................................. 136 The Load Waves Dialog for Igor Binary............................................................................................... 136 The LoadData Operation ........................................................................................................................ 137 Sharing Versus Copying Igor Binary Files........................................................................................... 137 Loading Image Files........................................................................................................................................ 138 The Load Image Dialog........................................................................................................................... 138 Chapter II-9 — Importing and Exporting Data Loading PNG Files................................................................................................................................... 138 Loading JPEG File.................................................................................................................................... 138 Loading BMP Files................................................................................................................................... 138 Loading TIFF Files ................................................................................................................................... 138 Loading Sun Raster Files ........................................................................................................................ 139 Loading Row-Oriented Text Data ................................................................................................................ 139 Loading HDF Files.......................................................................................................................................... 140 Loading Excel Files ......................................................................................................................................... 140 What XLLoadWave Loads...................................................................................................................... 140 Column and Wave Types................................................................................................................ 140 Treat all columns as numeric.......................................................................................................... 140 Treat all columns as date ................................................................................................................. 141 Treat all columns as text .................................................................................................................. 141 Deduce from row.............................................................................................................................. 141 Use column type string.................................................................................................................... 141 XLLoadWave and Wave Names............................................................................................................ 142 XLLoadWave Output Variables ............................................................................................................ 142 Excel Date/Time Versus Igor Date/Time .............................................................................................. 142 Loading Excel Data Into a 2D Wave ..................................................................................................... 143 Loading Matlab MAT Files............................................................................................................................ 144 Finding Matlab Dynamic Libraries ....................................................................................................... 144 Matlab Dynamic Library Issues............................................................................................................. 144 Matlab Dynamic Library Issues on Macintosh...................................................................................
Load more

Recommended publications
  • Current Trends in Vector-Based Internet Mapping: a Technical Review
    Chapter 3 Current Trends in Vector-Based Internet Mapping: A Technical Review Christophe Lienert, Bernhard Jenny, Olaf Schnabel, and Lorenz Hurni Abstract Possibilities and limitations of Internet cartography software largely depend on the pace set by the software industry. The variety of commercial and non-commercial software caters for the needs of a continuously growing mapping community, including both professional and amateur cartographers. This chapter provides an overview of state-of-the-art technologies for vector-based Web- mapping as of the beginning of 2011. Both proprietary and open format technologies are discussed for vector data rendering in browsers, highlighting their advantages and disadvantages. The discussed technologies are Adobe Flash, Microsoft Silverlight, Scalable Vector Graphics (SVG), JavaFX, Canvas, and WebGL. The chapter also discusses client and server side frameworks which provide Application Programming Interfaces (APIs) for creating custom interactive maps, mainly by overlaying raster images with vector data. 3.1 Introduction Internet maps are the major form of spatial information delivery, as the Internet is today the primary medium for the transmission and dissemination of maps (Peterson 2008). For map authors, the maze of available techniques for creating and distributing Web maps is overwhelming, while authoring tools for Web-maps meeting the demands of high-quality cartography are difficult to find. Map authors may choose between GIS and graphics software products to create maps for the Internet, but these off-the-shelve maps oftentimes fall short of effectively convey- ing information. There are three main reasons for this shortcoming: (a) the design of these maps sometimes does not take into account the specific limitations of digital displays (Jenny et al., 2008); (b) the maps are often restricted in using standard C.
    [Show full text]
  • Parallel Data Analysis Directly on Scientific File Formats
    Parallel Data Analysis Directly on Scientific File Formats Spyros Blanas 1 Kesheng Wu 2 Surendra Byna 2 Bin Dong 2 Arie Shoshani 2 1 The Ohio State University 2 Lawrence Berkeley National Laboratory [email protected] {kwu, sbyna, dbin, ashosani}@lbl.gov ABSTRACT and physics, produce massive amounts of data. The size of Scientific experiments and large-scale simulations produce these datasets typically ranges from hundreds of gigabytes massive amounts of data. Many of these scientific datasets to tens of petabytes. For example, the Intergovernmen- are arrays, and are stored in file formats such as HDF5 tal Panel on Climate Change (IPCC) multi-model CMIP-5 and NetCDF. Although scientific data management systems, archive, which is used for the AR-5 report [22], contains over petabytes such as SciDB, are designed to manipulate arrays, there are 10 of climate model data. Scientific experiments, challenges in integrating these systems into existing analy- such as the LHC experiment routinely store many gigabytes sis workflows. Major barriers include the expensive task of of data per second for future analysis. As the resolution of preparing and loading data before querying, and convert- scientific data is increasing rapidly due to novel measure- ing the final results to a format that is understood by the ment techniques for experimental data and computational existing post-processing and visualization tools. As a con- advances for simulation data, the data volume is expected sequence, integrating a data management system into an to grow even further in the near future. existing scientific data analysis workflow is time-consuming Scientific data are often stored in data formats that sup- and requires extensive user involvement.
    [Show full text]
  • Supported Formats (August 2020)
    Oracle Outside In Technology 8.5.5 Supported Formats (August 2020) Archive Version Multimedia Version 7z split archives not supported) AVI (Metadata only) 7z Self Extracting exe (split archives not DICOM (File ID only) supported) LZA Self Extracting Compres Flash (text extraction only) 6.x, 7.x, Lite LZH Compress Flash (File ID only) 9,10 Microsoft Office Binder Real Media (File ID only) Microsoft Cabinet (CAB) 95 – 97 MP3 (ID3 metadata only) RAR 1.5, 2.0, 2.9, MPEG-1 Audio layer 3 V ID3 v1 5.0 (Metadata only) Self-extracting .exe MPEG-1 Audio layer 3 V ID3 v2 (Metadata only) UNIX Compress MPEG-1 Video V 2 (File ID only) UNIX GZip MPEG-1 Video V 3 (File ID only) UNIX tar MPEG-2 Audio (File ID only) Uuencode MPEG-4 (Metadata only) ZIP PKZip MPEG-7 (Metadata only) ZIP WinZip QuickTime (Metadata only) ZIP ZIP64 Windows Media ASF (Metadata only) Database Version Windows Media DVR-MS (Metadata only) DataEase 4.x Windows Media Audio WMA (Metadata only) DBase III, IV, V, X, X1 Windows Media Playlist (File ID only) First Choice DB Through 3.0 Windows Media Video WMV (Metadata only) Framework DB 3.0 WAV (Metadata only) Microsoft Access (text only) 1.0, 2.0, 95 … Other Version 2019 Microsoft Access Report Snapshot (File ID 2000 – 2003 AOL Messenger (File ID only) 7.3 only) Microsoft Works DB for DOS 2.0 Microsoft InfoPath (File ID only) 2007 Microsoft Works DB for Macintosh 2.0 Microsoft Live Messenger (via XML filter) 10.0 Microsoft Works DB for Windows 3.0, 4.0 Microsoft Office Theme files (File ID only) 2007 … 2019 Microsoft Works DB for DOS
    [Show full text]
  • No. 25 a Secret Index—
    a secret index— division leap no. 25 a secret index— Booksellers, publishers and researchers of the history of print culture. Collections purchased. Books found. Appraisals performed. Libraries built. divisionleap.com no. 25 83. 35. 59. 39. 39. 27. 30. 25. 21. 65. 48. 72. 6. contents a. Walter Benjamin—German Expressionism—Raubdrucke 17 b. Reproduction—Computing—Classification—Architecture 23 c. The Body—Tattooing—Incarceration—Crime—Sexuality 33 d. Social Movements—1968—Feminism—The SI & After 47 e. Music 57 f. Literature—Poetry—Periodicals 63 g. Film—Chris Marker 77 h. Art 85 i. Punk Zines 91 Additional images of all items available at divisionleap.com or by request. a. Walter Benjamin—German Expressionism—Raubdrucke 17 2. 1. 18 a. The Birth of Walter Benjamin’s Theory Heuber so messianically feels is near … ” of the Messianic McCole, analyzing this same letter, notes that this appears to be Benjamin’s first use of the term 1. [Victor Hueber] Die Organisierung der “Messianic” in his writings [McCole, p. 61]. The Intelligenz. Ein Aufruf. Zweite, erweiterte Auflage. idea would haunt Benjamin’s subsequent works Als Manuskript gedruckt. on history, and reach its conclusion in the second [Prague]: Druck H. Mercy, [1910]. 8vo, thesis in On the Concept of History, written just 107 pp, stab-stapled and glue bound into violet before his march into the mountains. “The past printed wraps. Front and back panels of wraps carries with it a secret index, by which it is referred detached but present, with the paper covering to its resurrection. There is an agreement and an the spine mostly perished.
    [Show full text]
  • A Metadata Based Approach for Supporting Subsetting Queries Over Parallel HDF5 Datasets
    A Metadata Based Approach For Supporting Subsetting Queries Over Parallel HDF5 Datasets Thesis Presented in Partial Fulfillment of the Requirements for the Degree Master of Science in the Graduate School of The Ohio State University By Vignesh Santhanagopalan, B.S. Graduate Program in Computer Science and Engineering The Ohio State University 2011 Thesis Committee: Dr. Gagan Agrawal, Advisor Dr. Radu Teodorescu ABSTRACT A key challenge in scientific data management is to manage the data as the data sizes are growing at a very rapid speed. Scientific datasets are typically stored using low-level formats which store the data as binary. This makes specification of the data and processing very hard. Also, as the volume of data is huge, parallel configurations must be used to process the data to enable efficient access. We have developed a data virtualization approach for supporting subsetting queries on scientific datasets stored in native format. The data is stored in Hierarchical Data Format (HDF5) which is one of the popular formats for storing scientific data. Our system supports SQL queries using the Select, From and Where clauses. We support queries based on the dimensions of the dataset and also queries which are based on the dimensions and attributes (which provide extra information about the dataset) of the dataset. In order to support the different types of queries, we have the pre-processing and post-processing modules. We also parallelize the selection queries involving the dimensions and the attributes. Our system offers the following advantages. We provide SQL like abstraction for specifying subsets of interest which is a powerful mechanism.
    [Show full text]
  • HUDDL for Description and Archive of Hydrographic Binary Data
    University of New Hampshire University of New Hampshire Scholars' Repository Center for Coastal and Ocean Mapping Center for Coastal and Ocean Mapping 4-2014 HUDDL for description and archive of hydrographic binary data Giuseppe Masetti University of New Hampshire, Durham, [email protected] Brian R. Calder University of New Hampshire, Durham, [email protected] Follow this and additional works at: https://scholars.unh.edu/ccom Recommended Citation G. Masetti and Calder, Brian R., “Huddl for description and archive of hydrographic binary data”, Canadian Hydrographic Conference 2014. St. John's, NL, Canada, 2014. This Conference Proceeding is brought to you for free and open access by the Center for Coastal and Ocean Mapping at University of New Hampshire Scholars' Repository. It has been accepted for inclusion in Center for Coastal and Ocean Mapping by an authorized administrator of University of New Hampshire Scholars' Repository. For more information, please contact [email protected]. Canadian Hydrographic Conference April 14-17, 2014 St. John's N&L HUDDL for description and archive of hydrographic binary data Giuseppe Masetti and Brian Calder Center for Coastal and Ocean Mapping & Joint Hydrographic Center – University of New Hampshire (USA) Abstract Many of the attempts to introduce a universal hydrographic binary data format have failed or have been only partially successful. In essence, this is because such formats either have to simplify the data to such an extent that they only support the lowest common subset of all the formats covered, or they attempt to be a superset of all formats and quickly become cumbersome. Neither choice works well in practice.
    [Show full text]
  • Towards Interactive, Reproducible Analytics at Scale on HPC Systems
    Towards Interactive, Reproducible Analytics at Scale on HPC Systems Shreyas Cholia Lindsey Heagy Matthew Henderson Lawrence Berkeley National Laboratory University Of California, Berkeley Lawrence Berkeley National Laboratory Berkeley, USA Berkeley, USA Berkeley, USA [email protected] [email protected] [email protected] Drew Paine Jon Hays Ludovico Bianchi Lawrence Berkeley National Laboratory University Of California, Berkeley Lawrence Berkeley National Laboratory Berkeley, USA Berkeley, USA Berkeley, USA [email protected] [email protected] [email protected] Devarshi Ghoshal Fernando Perez´ Lavanya Ramakrishnan Lawrence Berkeley National Laboratory University Of California, Berkeley Lawrence Berkeley National Laboratory Berkeley, USA Berkeley, USA Berkeley, USA [email protected] [email protected] [email protected] Abstract—The growth in scientific data volumes has resulted analytics at scale. Our work addresses these gaps. There are in a need to scale up processing and analysis pipelines using High three key components driving our work: Performance Computing (HPC) systems. These workflows need interactive, reproducible analytics at scale. The Jupyter platform • Reproducible Analytics: Reproducibility is a key com- provides core capabilities for interactivity but was not designed ponent of the scientific workflow. We wish to to capture for HPC systems. In this paper, we outline our efforts that the entire software stack that goes into a scientific analy- bring together core technologies based on the Jupyter Platform to create interactive, reproducible analytics at scale on HPC sis, along with the code for the analysis itself, so that this systems. Our work is grounded in a real world science use case can then be re-run anywhere. In particular it is important - applying geophysical simulations and inversions for imaging to be able reproduce workflows on HPC systems, against the subsurface.
    [Show full text]
  • Parsing Hierarchical Data Format (HDF) Files Karl Nyberg Grebyn Corporation P
    Parsing Hierarchical Data Format (HDF) Files Karl Nyberg Grebyn Corporation P. O. Box 47 Sterling, VA 20167-0047 703-406-4161 [email protected] ABSTRACT This paper presents a description of the creation of a library to parse Hierarchical Data Format (HDF) Files in Ada. It describes a “work in progress” with discussion of current performance, limitations and future plans. Categories and Subject Descriptors D.2.2 [Design Tools and Techniques]: Software Libraries; E.2 [Data Storage Representations]: Object Representation; I.2.10 [Vision and Scene Understanding]: Representations, data structures, and transforms. General Terms Algorithms, Performance, Experimentation, Data Formats. Keywords Ada, HDF. 1. INTRODUCTION Large quantities of scientific data are published each year by NASA. These data are often accompanied by metadata files that describe the contents of individual files of the data. One example of this data is the ASTER (Advanced Spaceborne Thermal Emission and Reflection Radiometer) [1]. Each file of data (consisting of satellite imagery) in HDF (Hierarchical Data Format) [2] is accompanied by a metadata file in XML (Extensible Markup Language) [3], encoded according to a published DTD (Document Type Description) that indicates the components and types of data in the metadata file. Each ASTER data file consists of an image of the satellite as it passes over the earth [4]. Information on the location of the data collected as the satellite passes is contained in the metadata file. Over time, multiple images of the same location on earth are obtained. For many purposes of analysis (erosion, building patterns, deforestation, glacier movement, etc.), these images of the same location are compared over time.
    [Show full text]
  • A New Data Model, Programming Interface, and Format Using HDF5
    NetCDF-4: A New Data Model, Programming Interface, and Format Using HDF5 Russ Rew, Ed Hartnett, John Caron UCAR Unidata Program Center Mike Folk, Robert McGrath, Quincey Kozial NCSA and The HDF Group, Inc. Final Project Review, August 9, 2005 THG, Inc. 1 Motivation: Why is this area of work important? While the commercial world has standardized on the relational data model and SQL, no single standard or tool has critical mass in the scientific community. There are many parallel and competing efforts to build these tool suites – at least one per discipline. Data interchange outside each group is problematic. In the next decade, as data interchange among scientific disciplines becomes increasingly important, a common HDF-like format and package for all the sciences will likely emerge. Jim Gray, Distinguished “Scientific Data Management in the Coming Decade,” Jim Gray, David Engineer at T. Liu, Maria A. Nieto-Santisteban, Alexander S. Szalay, Gerd Heber, Microsoft, David DeWitt, Cyberinfrastructure Technology Watch Quarterly, 1998 Turing Award Volume 1, Number 2, February 2005 winner 2 Preservation of scientific data … the ephemeral nature of both data formats and storage media threatens our very ability to maintain scientific, legal, and cultural continuity, not on the scale of centuries, but considering the unrelenting pace of technological change, from one decade to the next. … And that's true not just for the obvious items like images, documents, and audio files, but also for scientific images, … and MacKenzie Smith, simulations. In the scientific research community, Associate Director standards are emerging here and there—HDF for Technology at (Hierarchical Data Format), NetCDF (network the MIT Libraries, Common Data Form), FITS (Flexible Image Project director at Transport System)—but much work remains to be MIT for DSpace, a groundbreaking done to define a common cyberinfrastructure.
    [Show full text]
  • Data Format Guide
    Data Format Guide Tecplot, Inc. Bellevue, WA 2006 COPYRIGHT NOTICE Tecplot 360TMData Format Guide is for use with Tecplot 360TM 2006. Copyright © 1988-2006 Tecplot, Inc. All rights reserved worldwide. Except for personal use, this manual may not be reproduced, trans- mitted, transcribed, stored in a retrieval system, or translated in any form, in whole or in part, without the express written permission of Tecplot, Inc., 3535 Factoria Blvd., Ste 550, Bellevue, Washington, 98006, U.S.A. The software discussed in this documentation and the documentation itself are furnished under license for utilization and duplication only according to the license terms. The copyright for the software is held by Tecplot, Inc. Documentation is provided for information only. It is subject to change without notice. It should not be interpreted as a commitment by Tecplot, Inc. Tecplot, Inc. assumes no liabil- ity or responsibility for documentation errors or inaccuracies. Tecplot, Inc PO Box 52708 Bellevue, WA 98015-2708 U.S.A. Tel: 1.800.763.7005 (within the U.S. or Canada), 00 1 (425)653-1200 (internationally) email: [email protected], [email protected] Questions, comments or concerns regarding this documentation: [email protected] For more information, visit http://www.tecplot.com THIRD PARTY SOFTWARE COPYRIGHT NOTICES ENCSA Hierarchical Data Format (HDF) Software Library and Utilities © 1988-1998 The Board of Trustees of the University of Illi- nois. All rights reserved. Contributors include National Center for Supercomputing Applications (NCSA) at the University of Illinois, Fortner Software (Windows and Mac), Unidata Program Center (netCDF), The Independent JPEG Group (JPEG), Jean-loup Gailly and Mark Adler (gzip).
    [Show full text]
  • Designing and Implementing a Geographical Information System
    DESIGNING AND IMPLEMENTING A GEOGRAPHICAL INFORMATION SYSTEM A Guide for Managers of Area-wide Pest Management Programmes DESIGNING AND IMPLEMENTING A GEOGRAPHICAL INFORMATION SYSTEM A Guide for Managers of Area-wide Pest Management Programmes IAEA, VIENNA, 2006 IAEA/FAO-GIS © IAEA, 2006 Printed by the IAEA in Austria April 2006 FOREWORD Over the past two decades, the use of computer software and mapping methods known as geographical information systems (GIS) has been adopted by an ever growing variety of professionals. Every activity that deals with location dependent information can use GIS, and agriculture is no exception. The potential of GIS and remote sensing (RS) to facilitate the planning and implementation of area- wide integrated pest management (AW-IPM) programmes is enormous but unfortunately, these methods are still much underused. AW-IPM programmes, especially those that integrate the sterile insect technique (SIT) with other surveillance and control methods, would benefit considerably by drawing on GIS/RS. These programmes are often implemented over large areas of even tens of thousands of square kilometres, where surveillance methods are deployed and large data sets are systematically generated on a daily basis. The acquisition of geo-referenced data sets on pest presence/absence, relative abundance, disease prevalence, crop damage, etc., that will allow accurate spatial and temporal analysis is important for proper and timely decision making to efficiently plan and implement any operational pest management programme. Animal health and plant protection officials and pest control programme managers might be intuitively aware of the importance of employing GIS as an analytical tool. However, they often lack a deeper understanding of its capabilities.
    [Show full text]
  • Revisiting the So-Called “Legibility Wars” of the '80S and '
    58 PRINT 70.3 FALL 2016 PRINTMAG.COM 59 HAT DID YOU DO during the Legibility Wars?” asked one of my more inquisitive design history students. “Well, it wasn’t actually a war,” I said, recalling the period during the mid-’80s through the mid- to late-’90s when there were stark divisions “Wbetween new and old design generations—the young anti- Modernists, and the established followers of Modernism. “It was rather a skirmish between a bunch of young designers, like your age now, who were called New Wave, Postmodern, Swiss Punk, whatever, and believed it necessary to reject the status quo for something freer and more contemporary. Doing that meant criticizing old-guard designers, who believed design should be simple—clean on tight grids and Helveticized.” “Do you mean bland?” he quizzed further. “Maybe some of it was bland!” I conceded. “But it was more like a new generation was feeling its oats and it was inevitable.” New technology was making unprecedented options possible. Aesthetic standards were changing because young designers wanted to try everything, while the older, especially the devout Modern ones, believed everything had already been tried. “I read that Massimo Vignelli called a lot of the new digital and retro stuff ‘garbage,’” he said. “What did you say or do about it back then?” “I was more or less on the Modernist side and wrote about it in a 1993 Eye magazine essay called ‘Cult of the Ugly.’” I wasn’t against illegibility per se, just the stuff that seemed to be done badly. I justified biased distinctions not between beauty and ugly, but between good ugly and bad ugly, or what was done with an experimental rationale and with merely style and fashion as the motive.
    [Show full text]