Preserving Transactional Data and the Accompanying Challenges Facing Companies and Institutions That Aim to Re-Use These Data for Analysis Or Research
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Solutions for the Chora of Metaponto Publication Series
Preserving an Evolving Collection: “On-The-Fly” Solutions for The Chora of Metaponto Publication Series Jessica Trelogan Maria Esteva Lauren M. Jackson Institute of Classical Archaeology Texas Advanced Computing Center Institute of Classical Archaeology University of Texas at Austin University of Texas at Austin University of Texas at Austin 3925 W. Braker Lane J.J. Pickle Research Campus 3925 W. Braker Lane +1 (512) 232-9317 +1 (512) 475-9411 +1 (512) 232-9322 [email protected] [email protected] [email protected] ABSTRACT research in this way, complex technical infrastructures and As digital scholarship continues to transform research, so it services are needed to support and provide fail-safes for data and changes the way we present and publish it. In archaeology, this multiple, simultaneous functions throughout a project’s lifecycle. has meant a transition from the traditional print monograph, Storage, access, analysis, presentation, and preservation must be representing the “definitive” interpretation of a site or landscape, managed in a non-static, non-linear fashion within which data to an online, open, and interactive model in which data collections evolve into a collection as research progresses. In this context, have become central. Online representations of archaeological data curation happens while research is ongoing, rather than at the research must achieve transparency, exposing the connections tail end of the project, as is often the case. Such data curation may between fieldwork and research methods, data objects, metadata, be accomplished within a distributed computational environment, and derived conclusions. Accomplishing this often requires as researchers use storage, networking, database, and web multiple platforms that can be burdensome to integrate and publication services available across one or multiple institutions. -
Combined Documents V2
Outline: Combining Brainstorming Deliverables Table of Contents 1. Introduction and Definition 2. Reference Architecture and Taxonomy 3. Requirements, Gap Analysis, and Suggested Best Practices 4. Future Directions and Roadmap 5. Security and Privacy - 10 Top Challenges 6. Conclusions and General Advice Appendix A. Terminology Glossary Appendix B. Solutions Glossary Appendix C. Use Case Examples Appendix D. Actors and Roles 1. Introduction and Definition The purpose of this outline is to illustrate how some initial brainstorming documents might be pulled together into an integrated deliverable. The outline will follow the diagram below. Section 1 introduces a definition of Big Data. An extended terminology Glossary is found in Appendix A. In section 2, a Reference Architecture diagram is presented followed by a taxonomy describing and extending the elements of the Reference Architecture. Section 3 maps requirements from use case building blocks to the Reference Architecture. A description of the requirement, a gap analysis, and suggested best practice is included with each mapping. In Section 4 future improvements in Big Data technology are mapped to the Reference Architecture. An initial Technology Roadmap is created on the requirements and gap analysis in Section 3 and the expected future improvements from Section 4. Section 5 is a placeholder for an extended discussion of Security and Privacy. Section 6 gives an example of some general advice. The Appendices provide Big Data terminology and solutions glossaries, Use Case Examples, and some possible Actors and Roles. Big Data Definition - “Big Data refers to the new technologies and applications introduced to handle increasing Volumes of data while enhancing data utilization capabilities such as Variety, Velocity, Variability, Veracity, and Value.” The key attribute is the large Volume of data available that forces horizontal scalability of storage and processing and has implications for all the other V-attributes. -
Digital Data Archive and Preservation in the Cloud – What to Do and What Not to Do 2 © 2013 Storage Networking Industry Association
DigitalPRESENTATION Data Archive TITLE and GOES PreservationHERE in the Cloud - What To Do and What Not To Do Chad Thibodeau / Cleversafe Sebastian Zangaro / HP SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA unless otherwise noted. Member companies and individual members may use this material in presentations and literature under the following conditions: Any slide or slides used must be reproduced in their entirety without modification The SNIA must be acknowledged as the source of any material used in the body of any document containing material from these presentations. This presentation is a project of the SNIA Education Committee. Neither the author nor the presenter is an attorney and nothing in this presentation is intended to be, or should be construed as legal advice or an opinion of counsel. If you need legal advice or a legal opinion please contact your attorney. The information presented herein represents the author's personal opinion and current understanding of the relevant issues involved. The author, the presenter, and the SNIA do not assume any responsibility or liability for damages arising out of any reliance on or use of this information. NO WARRANTIES, EXPRESS OR IMPLIED. USE AT YOUR OWN RISK. Digital Data Archive and Preservation in the Cloud – What to do and What Not to Do 2 © 2013 Storage Networking Industry Association. All Rights Reserved. 2 Abstract Cloud Archive Challenges and Best Practices This session will appeal to Storage Vendors, Datacenter Managers, Developers, and those seeking a basic understanding of how best to implement a Cloud Storage Digital Data Archive and Cloud Storage Digital Data Preservation service. -
Comparing Tape and Cloud Storage for Long-Term Data Preservation 1
Comparing Tape and Cloud Storage for Long-Term Data Preservation November 2018 Table of Contents Abstract ......................................................................................................................................................... 2 Introduction .................................................................................................................................................. 2 Perceptions of Leading Edge Technology ..................................................................................................... 2 Reliability ....................................................................................................................................................... 3 Security ......................................................................................................................................................... 4 Speed ............................................................................................................................................................ 5 Storing Data .............................................................................................................................................. 5 Retrieving Data ......................................................................................................................................... 6 Data Growth .................................................................................................................................................. 6 Redundancy ............................................................................................................................................. -
Oracle Nosql Database
An Oracle White Paper November 2012 Oracle NoSQL Database Oracle NoSQL Database Table of Contents Introduction ........................................................................................ 2 Technical Overview ............................................................................ 4 Data Model ..................................................................................... 4 API ................................................................................................. 5 Create, Remove, Update, and Delete..................................................... 5 Iteration ................................................................................................... 6 Bulk Operation API ................................................................................. 7 Administration .................................................................................... 7 Architecture ........................................................................................ 8 Implementation ................................................................................... 9 Storage Nodes ............................................................................... 9 Client Driver ................................................................................. 10 Performance ..................................................................................... 11 Conclusion ....................................................................................... 12 1 Oracle NoSQL Database Introduction NoSQL databases -
NEWSLETTER February 2012
NEWSLETTER February 2012 Contents Universal Declaration on Archives adopted by UNESCO………………………….2 APEnet Liaison group ……………………………………………………………………2 EURBICA activities……………………..................................................…4 Hungarian Presidency of the EU………………………….…………………………….5 Polish Presidency of the EU ………………………….………………………………11 UNESCO Conference of the Memory of the World Programme ………………...13 DLM Forum Triennial Conference in Brussels……………………………………..15 1 Universal Declaration on Archives adopted by UNESCO Declaration, adopted unanimously by Annual General Meeting in Oslo (on 17 September 2010) by the ICA delegates officially become one of the core pillars in ICA's advocacy policy. This year the Declaration was officially endorsed also by the UNESCO in the plenary session on 10 November 2011. The Universal Declaration on Archives is currently available in 20 languages on ICA web page (Arabic, Catalan, Chinese, Croatian, Dutch, English, Finnish, French, German, Greek, Hebrew, Hungarian, Icelandic, Italian, Japanese, Maltese, Polish, Portuguese, Romanian, Slovenian, Spanish, Welsh) and was developed by ICA/SPA (Section of Professional Associations) on the model of the "Déclaration québécoise des Archives”.This is an important step in improving public understanding of archives, since it provides a splendid opportunity to raise still further awareness of archives among the general public and key decision-makers. The Declaration is a powerful succinct statement of the relevance of archives in modern society. It emphasizes the key role of archives in administrative transparency and democratic accountability, as well as the preservation of collective social memory. The Declaration repositions effective archives management as an essential function which underpins modern public administration, good practice in private business, and ready access to information by citizens. The first version of the Declaration was written by archivists in Québec in 2007. -
Preliminary Programme
Preliminary Programme DLM Forum Member Meeting 28-29th November 2018 Vienna, Austria The Austrian States Archives are pleased to invite members of the DLM Forum to the Mem- ber Meeting in Vienna on the 28th and 29th of November, 2018. The venue of the meeting is the Conference Hall of the Austrian State Archives (Notten- dorfer Gasse 2, 1030 Vienna). The Archives are situated only 5 stops by underground from the City Center. During the conference, Vienna will be in the middle of the holiday season. The city comes alive with lights, music, Christmas Markets and more. If you are considering a long weekend in Vienna, you might enjoy the magical Christmas spirit and get some gifts at its great shop- ping boulevards. The Christmas markets are selling traditional food, mulled wine and hand crafted goods and are loved by both locals and tourists alike. Please visit DLM Forum website and register If you have any questions, please contact Ms Beatrix Horvath at [email protected] See you in Vienna! Wednesday 28th November CROSS-BORDER COOPERATION AND NEW SOLUTIONS FOR DIGITAL DATA 11:45 – 12:20 Registration and coffee / tea 12:20 – 12:30 Welcome Chair: Jan Dalsten Sørensen Jan Dalsten Sørensen, Welcome from the chair of the DLM Forum and Chair of the DLM Forum the Austrian State Archives Mrs. Karin Holzer, Austrian State Archives Chair: Jonas Kerschner, Austrian 13:30 – 14:30 Session I, Interactive session States Archives J. Dalsten Sørensen, Danish National Archives, Denmark Meet the new eArchiving Building Block Mrs. Manuela Speiser, European -
Oracle® Nosql Database Changelog
Oracle® NoSQL Database Changelog Release 20.1 E91819-17 July 2020 Oracle NoSQL Database Changelog, Release 20.1 E91819-17 Copyright © 2011, 2020, Oracle and/or its affiliates. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable: U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs) and Oracle computer documentation or other Oracle data delivered to or accessed by U.S. Government end users are "commercial computer software" or “commercial computer software documentation” pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, reproduction, duplication, release, display, disclosure, modification, preparation of derivative works, and/or adaptation of i) Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs), ii) Oracle computer documentation and/or iii) other Oracle data, is subject to the rights and limitations specified in the license contained in the applicable contract. -
Database Preservation DPC Training Course
Database preservation DPC training course Practical session (advanced) Resolution www.keep.pt Activities on DBPTK Desktop www.keep.pt Click here to start the process of create a SIARD file 1. Select the DBMS on the left sidebar 2. Test the connection to panel and fill up ensure that you have the the connection right information form 3. Click Next to continue the process Click sakila to show the tables and views for that schema Select the tables: actor, category, film, film_actor, film_category and language Select the views: film_list and nicer_but_slower_film_list Materialize the nicer_but_slower_film_list 1. Remove the last_update column from each previous selected table 2. Click Next to continue the process 2. Save the query 1. Fill up the query text area and test the query Click Next to continue the process Click Skip to continue the process 1. Select the destination folder 2. Choose compress checkbox (this will reduce the size of the SIARD file) 3. Choose to save LOBs outside the SIARD file 4. Hit Next to continue the process 1. Fill up metadata information about the SIARD file 2. Click Create to start the migration process Wait for the process to finish, this may take a while, depending on the machine specs and total size of the database Click on Cancel Activities on DBPTK Enterprise www.keep.pt Do an advanced search and save it www.keep.pt Click on Login Choose the database Click Browse 2. Click on 1. Choose a advanced and table fill up the search criteria 3. Click on save search Click on save search Hide the table film_text and the store table www.keep.pt Click on Configuration Click on Manage tables 1. -
Oracle Nosql Database and Cisco- Collaboration That Produces Results
Oracle NoSQL Database and Cisco- Collaboration that produces results 1 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. What is Big Data? SOCIAL BLOG SMART METER VOLUME VELOCITY VARIETY VALUE 2 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Why Is It Important? US HEALTH CARE US RETAIL MANUFACTURING GLOBAL PERSONAL EUROPE PUBLIC LOCATION DATA SECTOR ADMIN Increase industry Increase net Decrease dev., Increase service Increase industry value per year by margin by assembly costs by provider revenue by value per year by $300 B 60+% –50% $100 B €250 B “In a big data world, a competitor that fails to sufficiently develop its capabilities will be left behind.” 3 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Source: * McKinsey Global Institute: Big Data – The next frontier for innovation, competition and productivity (May 2011) Big Data in Action DECIDE ACQUIRE Make Better Decisions Using Big Data ANALYZE ORGANIZE 4 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Oracle Integrated Solution Stack DATA VARIETY HDFS HADOOP (MapReduce) In-DB Oracle Loader Mining for HADOOP Oracle NoSQL DB Oracle In-DB Exadata ‘R’ In-DB MapReduce OBIEE Oracle Data Analytics Advanced Oracle Database Integrator INFORMATION DENSITY ACQUIRE ORGANIZE ANALYZE DECIDE 5 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Big Data in Action DECIDE ACQUIRE Acquire all available, schema-based and non- relational data ANALYZE ORGANIZE 6 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Acquiring Big Data Challenge Process high volume, low- Application changes With sub-millisecond density information frequently Velocity from various data-sets 7 Copyright © 2011, Oracle and/or its affiliates. -
Oracle Big Data SQL Release 4.1
ORACLE DATA SHEET Oracle Big Data SQL Release 4.1 The unprecedented explosion in data that can be made useful to enterprises – from the Internet of Things, to the social streams of global customer bases – has created a tremendous opportunity for businesses. However, with the enormous possibilities of Big Data, there can also be enormous complexity. Integrating Big Data systems to leverage these vast new data resources with existing information estates can be challenging. Valuable data may be stored in a system separate from where the majority of business-critical operations take place. Moreover, accessing this data may require significant investment in re-developing code for analysis and reporting - delaying access to data as well as reducing the ultimate value of the data to the business. Oracle Big Data SQL enables organizations to immediately analyze data across Apache Hadoop, Apache Kafka, NoSQL, object stores and Oracle Database leveraging their existing SQL skills, security policies and applications with extreme performance. From simplifying data science efforts to unlocking data lakes, Big Data SQL makes the benefits of Big Data available to the largest group of end users possible. KEY FEATURES Rich SQL Processing on All Data • Seamlessly query data across Oracle Oracle Big Data SQL is a data virtualization innovation from Oracle. It is a new Database, Hadoop, object stores, architecture and solution for SQL and other data APIs (such as REST and Node.js) on Kafka and NoSQL sources disparate data sets, seamlessly integrating data in Apache Hadoop, Apache Kafka, • Runs all Oracle SQL queries without modification – preserving application object stores and a number of NoSQL databases with data stored in Oracle Database. -
Abstracts of Foreign Periodicals LESTER K
Abstracts of Foreign Periodicals LESTER K. BORN, Editor Library of Congress Downloaded from http://meridian.allenpress.com/american-archivist/article-pdf/27/2/298/2744602/aarc_27_2_a138372207p60440.pdf by guest on 02 October 2021 DENMARK Nordisk Arkivnyt, VOL. 7 (1962), NO. 2. Staten overtager Erhvervsarkivet (The state takes over the business archives). P. 21-22. The business archives organized privately 20 years ago in Aarhus, now boasting about 6,000 running meters of archives and a library of about 19,000 volumes, were taken over by the state on October 1, 1962. The core of the collection consists of deposits from nationwide economic organizations, but there have been accessions also from numerous smaller private enterprises. The law authorizing this transfer to public administration provides for a board of five to seven members, including the national archivist and two or three representatives each from the business world and from the universities. A chief archivist administers the institution and is a nonvoting member of the board. Financial support is guaranteed by law and is to be provided for in the regular budget. The archives may also solicit private support for special projects and for the increase of its research funds. Centraladministrationens journaliseringsproblemer (Inventory problems of the central administration). P. 22. The Ministry for Archival Affairs has called attention to the need for revision of inventorying methods to insure a speedier system of disposal of the archives of the central administration. Dacia og Rhodos (Dacia and Rhodos). P. 22. Short review of a work found in the estate of Th. Hatt Olsen, which was published posthumously by colleagues in the National Archives at Copenhagen.