DOCSLIB.ORG

Get Programming with Go.Pdf

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Get Programming with Go.Pdf Get Programming with Go Get Programming with Go Nathan Youngman Roger Peppé MANNING Shelter Island For online information and ordering of this and other Manning books, please visit www.manning.com. The publisher offers discounts on this book when ordered in quantity. For more information, please contact Special Sales Department Manning Publications Co. 20 Baldwin Road PO Box 761 Shelter Island, NY 11964 Email: [email protected] ©2018 by Manning Publications Co. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by means electronic, mechanical, photocopying, or otherwise, without prior written permission of the publisher. Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in the book, and Manning Publications was aware of a trademark claim, the designations have been printed in initial caps or all caps. The Go Gopher is © 2009 Renée French and used under Creative Commons Attributions 3.0 license. Original illustrations by Olga Shalakhina are © 2015 Olga Shalakhina and used by permission. Original illustrations by Erick Zelaya are © 2018 Erick Zelaya and used by permission. Recognizing the importance of preserving what has been written, it is Manning’s policy to have the books we publish printed on acid-free paper, and we exert our best efforts to that end. Recognizing also our responsibility to conserve the resources of our planet, Manning books are printed on paper that is at least 15 percent recycled and processed without the use of elemental chlorine. Acquisition editor: Michael Stephens Development editors: Jenny Stout, Marina Michaels Technical development editors: Matthew Merkes, Joel Kotarski Review editor: Aleksandar Dragosavljevic´ Project editor: David Novak Copyeditor: Corbin Collins Proofreaders: Melody Dolab, Elizabeth Martin Technical proofreader: Christopher Haupt Typesetter: Dottie Marsico Graphics: Olga Shalakhina, Erick Zelaya, April Milne Cover designer: Monica Kamsvaag Manning Publications Co. 20 Baldwin Road PO Box 761 Shelter Island, NY 11964 ISBN 9781617293092 Printed in the United States of America 1 2 3 4 5 6 7 8 9 10 – DP – 23 22 21 20 19 18 Contents Preface vii Acknowledgments viii About this book x About the authors xiii Unit 0 Lesson 14 First-class functions 108 Lesson 15 Capstone: Temperature tables 117 GETTING STARTED Unit 4 Lesson 1 Get ready, get set, Go 3 COLLECTIONS Unit 1 Lesson 16 Arrayed in splendor 121 Lesson 17 Slices: Windows into arrays 130 IMPERATIVE PROGRAMMING Lesson 18 A bigger slice 138 Lesson 2 A glorified calculator 13 Lesson 19 The ever-versatile map 146 Lesson 3 Loops and branches 23 Lesson 20 Capstone: A slice of life 155 Lesson 4 Variable scope 34 Lesson 5 Capstone: Ticket to Mars 41 Unit 5 Unit 2 STATE AND BEHAVIOR Lesson 21 A little structure 161 TYPES Lesson 22 Go’s got no class 170 Lesson 6 Real numbers 45 Lesson 23 Composition and forwarding 177 Lesson 7 Whole numbers 53 Lesson 24 Interfaces 186 Lesson 8 Big numbers 62 Lesson 25 Capstone: Martian animal Lesson 9 Multilingual text 68 sanctuary 196 Lesson 10 Converting between types 79 Lesson 11 Capstone: The Vigenère cipher 88 Unit 6 Unit 3 DOWN THE GOPHER HOLE Lesson 26 A few pointers 201 BUILDING BLOCKS Lesson 27 Much ado about nil 220 Lesson 12 Functions 93 Lesson 28 To err is human 230 Lesson 13 Methods 101 Lesson 29 Capstone: Sudoku rules 248 v vi Contents Unit 7 CONCURRENT PROGRAMMING Lesson 30 Goroutines and concurrency 253 Lesson 31 Concurrent state 269 Lesson 32 Capstone: Life on Mars 282 Conclusion Where to Go from here 285 Appendix Solutions 287 Index 339 Preface Everything changes and nothing remains still. —Heraclitus While traveling Europe in 2005, Nathan heard rumblings of a new web framework called Ruby on Rails. Returning to Alberta in time to celebrate Christmas, he found a copy of Agile Web Development with Rails (Pragmatic Bookshelf, 2005) at the computer bookstore downtown. Over the next two years, he transitioned his career from Cold- Fusion to Ruby. At university in York, England, Roger was introduced to the radical simplicity of Bell Labs Research UNIX and the Plan 9 OS produced by the same group, which included Go authors Rob Pike and Ken Thompson. Roger became a fan and later worked with the Inferno system, which used its own language, Limbo, a close ancestor of Go. In November 2009, Go was announced as an open source project. Roger immediately saw its potential and started using it, making contributions to its standard library and ecosystem. He remains delighted by Go’s success, now programs in Go full time, and runs a local Go meetup. Nathan watched Rob Pike’s tech talk announcing Go but didn’t give Go a serious look until 2011. When a coworker spoke highly of Go, Nathan decided to read through a rough cut of The Go Programming Language Phrasebook (Addison-Wesley Professional, 2012) over Christmas break. Over the next few years, he went from using Go on hobby projects and blogging about Go (nathany.com) to organizing a local Go meetup (edmontongo.org) and writing Go at work. There’s no end to learning in the world of computer science, where the tools and tech- niques are continuously changing and improving. Whether you have a degree in com- puter science or are just starting out, teaching yourself new skills is important. We hope this book serves you well as you learn the Go programming language. vii Acknowledgments What a privilege it has been to write this book and help you learn Go. Thank you for reading! These pages represent the efforts of many individuals, not merely the authors on the cover. First and foremost, we would like to thank our editors Jennifer Stout and Marina Michaels for providing valuable feedback and for continuing to push us little by little over the finish line. Also, thank you to Joel Kotarski and Matt Merkes for your spot-on technical editing, Christopher Haupt for technical proofing, and copyeditor Corbin Collins for improving our grammar and style. Our thanks go to Bert Bates and to series editors Dan Maharry and Elesha Hyde for the conversations and guidelines that helped shape Get Programming with Go. We would like to thank Olga Shalakhina and Erick Zelaya for the wonderful illustra- tions, Monica Kamsvaag for the cover design, April Milne for sprucing up our figures, and Renée French for giving Go the lighthearted mascot that we all love. A special thank you goes to Dan Allen for creating AsciiDoctor, the tool used to write this book, and for his ongoing support. This book wouldn’t be a reality without Marjan Bace, Matko Hrvatin, Mehmed Pasic, Rebecca Rinehart, Nicole Butterfield, Candace Gillhoolley, Ana Romac, Janet Vail, David Novak, Dottie Marsico, Melody Dolab, Elizabeth Martin, and the whole crew at Manning for getting Get Programming with Go into the hands of readers. Thanks also to Aleksandar Dragosavljević for getting this book to reviewers, and to all the reviewers for providing valuable feedback, including Brendan Ward, Charles Kevin, Doug Sparling, Esther Tsai, Gianluigi Spagnuolo, Jeff Smith, John Guthrie, Luca Cam- pobasso, Luis Gutierrez, Mario Carrion, Mikaël Dautrey, Nat Luengnaruemitchai, Nathan Farr, Nicholas Boers, Nicholas Land, Nitin Gode, Orlando Sánchez, Philippe Charrière, Rob Weber, Robin Percy, Steven Parr, Stuart Woodward, Tom Goodheard, viii Acknowledgments ix Ulises Flynn, and William E. Wheeler. We’d also like to thank all the early access readers who provided feedback through the forums. Finally, we would like to thank Michael Stephens for suggesting the crazy idea of writ- ing a book, and the Go community for creating a language and ecosystem that we’re excited to write about! Nathan Youngman Naturally, I need to thank my parents, without whom I wouldn’t be here today. Both of my parents encouraged me to pursue my interest in computer programming from an early age, providing books and courses and access to computers. In addition to the official reviewers, I would like to thank Matthias Stone for providing feedback on early drafts, and Terry Youngman for helping me brainstorm ideas. I also want to thank the Edmonton Go community for cheering me on, and my employer, Mark Madsen, for providing the flexibility to make this endeavor feasible. More than anyone else, I want to thank Roger Peppé for coming alongside me as coauthor. He shortened the long road ahead by writing unit 7, and gave the project a much needed bump in momentum. Roger Peppé Most of all, I’d like to thank my wife, Carmen, for her forbearance and support as I worked on this book when we could have been out walking in the hills. Many thanks also to Nathan Youngman and Manning for their trust in taking me on as coauthor and for their patience during the final stages of this book. About this book Who should read this book Go is suitable for programmers with a wide range of skill levels—a necessity for any large project. Being a relatively small language, with minimal syntax and few concep- tual hurdles, Go could be the next great language for beginners. Unfortunately, many resources for learning Go presume a working knowledge of the C programming language. Get Programming with Go exists to fill the gap for scripters, hob- byists, and newcomers looking for a direct path to Go. To make it easier to get started, every code listing and exercise in this book can run inside the Go Playground (play .golang.org), so there’s nothing to install! If you’ve ever used a scripting language like JavaScript, Lua, PHP, Perl, Python, or Ruby, you’re ready to learn Go.
Load more

Recommended publications
  • Sinfonia: a New Paradigm for Building Scalable Distributed Systems
    Sinfonia: A New Paradigm for Building Scalable Distributed Systems Marcos K. Aguilera∗ Arif Merchant∗ Mehul Shah∗ Alistair Veitch∗ Christos Karamanolis† ∗HP Laboratories, Palo Alto, CA, USA †VMware, Palo Alto, CA, USA application application application application ABSTRACT node node node node We propose a new paradigm for building scalable distributed sys- tems. Our approach does not require dealing with message-passing protocols—a major complication in existing distributed systems. user minitransactions Instead, developers just design and manipulate data structures library within our service called Sinfonia. Sinfonia keeps data for appli- cations on a set of memory nodes, each exporting a linear address Sinfonia memory memory memory space. At the core of Sinfonia is a novel minitransaction primitive node node node that enables efficient and consistent access to data, while hiding the complexities that arise from concurrency and failures. Using Sinfo- Figure 1: Sinfonia allows application nodes to share data in a fault nia, we implemented two very different and complex applications tolerant, scalable, and consistent manner. in a few months: a cluster file system and a group communication service. Our implementations perform well and scale to hundreds of machines. We propose a new paradigm for building scalable distributed Categories and Subject Descriptors systems. With our scheme, developers do not have to deal with message-passing protocols. Instead, developers just design and ma- C.2.4 [Computer-Communication Networks]: Distributed sys- nipulate data structures within our service, called Sinfonia. We tems—Distributed applications; E.1 [Data Structures]: Dis- therefore transform the problem of protocol design into the much tributed data structures easier problem of data structure design.
    [Show full text]
  • Sedna Programmer's Guide
    Sedna Programmer's Guide Contents 1 Client Application Programming Interfaces3 1.1 Java API..............................3 1.1.1 Sessions..........................3 1.1.2 Transactions Management................4 1.1.3 Statements........................5 1.1.4 Results...........................6 1.1.5 Exceptions.........................7 1.1.6 Code Example.......................7 1.2 C API............................... 10 1.2.1 Errors Handling...................... 11 1.2.2 Connecting to a Database................ 11 1.2.3 Setting Session Options................. 13 1.2.4 Transactions Management................ 16 1.2.5 Getting Connection and Transaction Status...... 18 1.2.6 Executing Queries and Updates............. 18 1.2.7 Loading Data....................... 21 1.2.8 Example Code....................... 23 1.3 Scheme API............................ 25 1.3.1 Sessions.......................... 26 1.3.2 Manage Transactions................... 26 1.3.3 Executing Queries and Updates............. 27 1.3.4 Bulk Load from Stream................. 29 1.3.5 Higher-level Function for a Transaction......... 29 1.3.6 Error handling...................... 29 1.3.7 Code Example....................... 30 2 Database Language 32 2.1 XQuery Support......................... 32 2.2 XQuery Options and Extensions................. 33 2.2.1 Controlling Serialization................. 33 1 2.2.2 Value index-scan Functions............... 33 2.2.3 Full-Text Search Functions................ 34 2.2.4 SQL Connection..................... 35 2.2.5 External Functions.................... 41 2.2.6 Runtime Properties.................... 45 2.3 Update Language......................... 45 2.4 Bulk Load............................. 49 2.4.1 CDATA section preserving................ 50 2.5 Data Definition Language.................... 51 2.5.1 Managing Standalone Documents............ 51 2.5.2 Managing Collections................... 51 2.5.3 Managing Value Indices................
    [Show full text]
  • XML Schema to Describe the Data • XML with a DTD Or XML Schema Is Designed to Be Self-Descriptive • XML Is a W3C Recommendation
    EXtensible Markup Language XML Main source: W3C School tutorials GC: XML: Rajeev Wankar 1 Mark-up Languages • A way of describing information in a document. • Standard Generalized Mark-Up Language (SGML) - a specification for a mark-up language ratified in 1986. • Key aspect - using pairs of tags that surround information - a begin tag <tag_name> and a matching end tag </tag_name>. Example <title> Grid Computing Home Page </title> GC: XML: Rajeev Wankar 2 HyperText Markup Language (HTML) A mark-up language used in web pages. “Hypertext” refers to the text’s ability to link to other documents. “Markup” refers to providing information to tell browser how to display page and other things. GC: XML: Rajeev Wankar 3 XML • Very important standard mark-up language - a “simplified” SGML. • Developed to represent textual information in a structured manner that could be read and interpreted by a computer. • A foundation for web services and grid services. GC: XML: Rajeev Wankar 4 What is XML? • XML stands for EXtensible Markup Language • XML is a markup language much like HTML • XML was designed to describe data • XML tags are not predefined. We must define our own tags • XML uses a Document Type Definition (DTD) or an XML Schema to describe the data • XML with a DTD or XML Schema is designed to be self-descriptive • XML is a W3C Recommendation GC: XML: Rajeev Wankar 5 The main difference between XML and HTML • XML was designed to carry data. • XML is not a replacement for HTML. • XML and HTML were designed with different goals: • XML was designed with the focus on what data is.
    [Show full text]
  • Sedna Administration Guide
    Sedna Administration Guide Contents 1 Introduction3 2 Administration via Command Line4 2.1 Sedna Directory Structure....................4 2.2 Managing Sedna.........................4 2.2.1 Running Sedna......................4 2.2.2 Stopping Sedna......................6 2.2.3 Configuring Sedna....................7 2.3 Managing Databases.......................8 2.3.1 Creating a Database...................8 2.3.2 Configuring a Database.................. 11 2.3.3 Deleting a Database................... 12 2.3.4 Running a Database................... 12 2.3.5 Stopping a Database................... 13 2.4 Sedna Terminal.......................... 14 2.5 Backup and Restore....................... 16 2.5.1 Export/Import Utility.................. 17 2.5.2 File system level backup................. 19 2.5.3 Hot Backup........................ 19 2.5.4 Migration Between Releases............... 22 2.6 Event Log............................. 23 2.6.1 Files............................ 23 2.6.2 Severity Level Configuration............... 23 2.7 The Examples of Using Command Line Utilities........ 24 3 User-Based Authorization System 25 3.1 Database Users.......................... 25 3.2 Privileges and Roles....................... 27 3.3 Granting privileges........................ 28 3.4 Revoking privileges........................ 29 1 3.5 Client Authentication....................... 30 4 Localization 30 2 1 Introduction This guide describes administration of the Sedna XML Database Manage- ment System (Sedna for short). Sedna has the following components. Governor serves as a \control center" of the system. All other compo- nents register at the Governor. The Governor knows which other components (e.g. databases and sessions) are running in the system and controls them. Other components cannot function properly if the Governor is not running so you must start it to use Sedna.
    [Show full text]
  • XML Databases, SQL/XML, Sedna 5
    MI-PDB, MIE-PDB: Advanced Database Systems http://www.ksi.mff.cuni.cz/~svoboda/courses/2015-2-MIE-PDB/ Lecture 7: XML Databases, SQL/XML, Sedna 5. 4. 2016 Lecturer: Martin Svoboda [email protected] Author: Martin Svoboda Faculty of Mathematics and Physics, Charles University in Prague Course NPRG036: XML Technologies Course NPRG039: Advanced Aspects and New Trends in XML Outline • XML databases . Introduction . SQL/XML ‒ Extension to SQL for XML data ‒ Used in XML-enabled (object-)relational database systems . Sedna ‒ Native XML database system MI-PDB, MIE-PDB: Advanced Database Systems | Lecture 7: XML Databases, SQL/XML, Sedna | 5. 4. 2016 2 XML Databases Motivation • Why XML databases? . We have high volumes of data . We want to work with them efficiently ‒ Modeling, acquisition, creation, organization, evolution ‒ Retrieval, querying, processing, updates ‒ Administration, security, concurrency, recovery ‒ … MI-PDB, MIE-PDB: Advanced Database Systems | Lecture 7: XML Databases, SQL/XML, Sedna | 5. 4. 2016 4 Documents vs. Databases • World of documents . Many small and usually static documents . Implicit structure given by tagging . Suitable for humans . Operations: editing, printing, retrieval, searching, … • World of databases . Several huge and usually dynamic databases . Explicit structure given by a schema . Suitable for machines . Operations: storing, querying, cleansing, updating, … MI-PDB, MIE-PDB: Advanced Database Systems | Lecture 7: XML Databases, SQL/XML, Sedna | 5. 4. 2016 5 XML Data • Semi-structured data . Document-oriented ‒ Created and processed by humans ‒ Irregular and less structured ‒ Mixed contents, CDATA sections, … ‒ Important order of sibling elements . Hybrid . Data-oriented ‒ Created and processed by machines ‒ Regular and fully structured ‒ Unimportant order of sibling elements MI-PDB, MIE-PDB: Advanced Database Systems | Lecture 7: XML Databases, SQL/XML, Sedna | 5.
    [Show full text]
  • Implementing Block-Stored Prefix Trees in XML-DBMS
    Implementing block-stored prefix trees in XML-DBMS c Oleg Borisenko Ilya Taranov Institute for System Programming, Russian Academy of Sciences [email protected], [email protected] Abstract B-trees are widely used in modern databases for index- ing [6]. Storing the keys of arbitrary length in B-trees The problem of search efficiency through large is possible however causes implementation problems. It amount of text data is well-known problem in is difficult to implement the efficient storage of variable computer science. We would like to introduce a length keys. In practice usually only a limited part of the BST data structure that allows searches through key is stored in the tree node, and the remainder is stored a set of string values, and is optimized for read- in separate overflow pages[2, 16]. This approach is quite ing and writing large blocks of data. This paper effective if the keys are short or differ only in first char- describes the algorithms for insertion, deletion acters. and search of variable-length strings in disk- The other problem arises if one key corresponds to a resident trie structures. This data structure is set of different value nodes; it is difficult to implement an used for value indexes on XML data. We also efficient search by key/value pair. Most of B-tree imple- compare our implementation with existing B+ mentations do not provide an ability to store such mul- tree implementation and show that our structure timaps. At the same time our indexes may have duplicate occupies several times less space with the same key/value pairs.
    [Show full text]
  • Nosql - Notonly Sql
    International Journal of Enterprise Computing and Business Systems ISSN (Online) : 2230-8849 Volume 2 Issue 2 July 2013 International Manuscript ID : ISSN22308849-V2I2M3-072013 NOSQL - NOTONLY SQL Dr. S. George University of New Zealand Abstract A NoSQL database provides a mechanism for storage and retrieval of data that uses looser consistency models than traditional relational databases. Motivations for this approach include simplicity of design, horizontal scaling and finer control over availability. NoSQL databases are often highly optimized key–value stores intended for simple retrieval and appending operations, with the goal being significant performance benefits in terms of latency and throughput. NoSQL databases are finding significant and growing industry use in big data and real-time web applications. NoSQL systems are also referred to as "Not only SQL" to emphasize that they do in fact allow SQL-like query languages to be used. ACID vs BASE NoSQL cannot necessarily give full ACID guarantees. Usually eventual consistency is guaranteed or transactions limited to single data items. This means that given a sufficiently long period of time over which no changes are sent, all updates can be expected to propagate eventually through the system. [citation needed ]. Contents History Carlo Strozzi used the term NoSQL in 1998 to name his lightweight, open-source relational database that did not expose the standard SQL interface. Strozzi suggests that, as the International Journal of Enterprise Computing and Business Systems ISSN (Online) : 2230-8849 Volume 2 Issue 2 July 2013 International Manuscript ID : ISSN22308849-V2I2M3-072013 current NoSQL movement "departs from the relational model altogether; it should therefore have been called more appropriately 'NoREL'.
    [Show full text]
  • Managing Xml Trees Using Xpath, Xquery, Clustering and Tree Tuples Over Sedna Xml Database
    SINTEZA 2014 Intelligent system Impact of Internet on Business activities in Serbia and Worldwide Uticaj Interneta na poslovanje u Srbiji i svetu doI: 10.15308/SInteZa-2014-878-881 MANAGING XML TREES USING XPATH, XQUERY, CLUSTERING AND TREE TUPLES OVER SEDNA XML DATABASE Hasham Elzentani Singidunum University, Belgrade, Serbia Abstract: XML is a markup language that defines a set of rules for encoding semi-structured data in a readable format for both humans and machines, in other words the increase of various XML data as information source has raised a number of issues about how to represent and manage this data. Find out an ontology knowledge to derive semantics of XML document has become a major challenge in semi-structured data management. XPath and XQuery languages are used for selecting nodes and compute values from XML document, tuple Key words: the XML tree and address the problem of XML data clustering according to structure with Sedna, ontology knowledge. Experiment on real XML database gives evidence that our proposed XML clustering, approach is highly effective in tupling and clustering of XML tree. So this paper will propose XPath, Sedna, which is a free native XML database that provides flexible XML processing facilities XML trees, include W3C XQuery implementation. Finally we will discuss the results of No. of replayed XML tuples, nodes and time taken by XPath or XQuery. XQuery. INTRODUCTION alphabet ∑. Let Tag, Att, and Str be alphabets of tag names, attribute names and strings, respectively. An XML tree XT XML is touted as the driving-force for representing is a pair XT = <T, δ>, such that: (1) T is a tree de ned on and exchanging data on the Web.
    [Show full text]
  • Xquery Reloaded
    XQuery Reloaded Roger Bamford3 Vinayak Borkar5 Matthias Brantner2 Peter M. Fischer4 Daniela Florescu3 David Graf2 Donald Kossmann2;4 Tim Kraska4 Dan Muresan1 Sorin Nasoi1 Markos Zacharioudakis3 1FLWOR Foundation 228msec, Inc. 3Oracle Corp. www.flworfound.org www.28msec.com www.oracle.com 4Systems Group, ETH Zurich 5University of California, Irvine www.systems.ethz.ch www.cs.uci.edu Contact: contact@flworfound.org ABSTRACT try and academia. At the beginning of this decade, XML and, This paper describes a number of XQuery-related projects. Its goal as a consequence, XQuery, was a hot topic at the major database is to show that XQuery is a useful tool for many different applica- conferences (SIGMOD and VLDB). Furthermore, all the major tion scenarios. In particular, this paper tries to correct a common database vendors integrated XQuery into their database products myth that XQuery is merely a query language and that SQL is the and made XQuery, like SQL, one possible way to extract data from better query language. Instead, XQuery is a full-fledged program- a database. Based on user feedback, Oracle has at least 7000 cus- ming language for Web applications and services. Furthermore, tomers using this feature. this paper tries to correct a second myth that XQuery is slow. This Arguably, XQuery has been most successful in the middle-tier. paper gives an overview of the state-of-the-art in XQuery imple- In the middle-tier, XQuery can serve several purposes. One promi- mentation and optimization techniques and discusses one particu- nent example is the transformation and routing of XML messages lar open-source XQuery processor, Zorba, in more detail.
    [Show full text]
  • Calvin: Fast Distributed Transactions for Partitioned Database Systems
    Calvin: Fast Distributed Transactions for Partitioned Database Systems Alexander Thomson Thaddeus Diamond Shu-Chun Weng Ya l e U n i v e r s i t y Ya l e U n i v e r s i t y Ya l e U n i v e r s i t y [email protected] [email protected] [email protected] Kun Ren Philip Shao Daniel J. Abadi Ya l e U n i v e r s i t y Ya l e U n i v e r s i t y Ya l e U n i v e r s i t y [email protected] [email protected] [email protected] ABSTRACT 1. BACKGROUND AND INTRODUCTION Many distributed storage systems achieve high data access through- One of several current trends in distributed database system de- put via partitioning and replication, each system with its own ad- sign is a move away from supporting traditional ACID database vantages and tradeoffs. In order to achieve high scalability, how- transactions. Some systems, such as Amazon’s Dynamo [13], Mon- ever, today’s systems generally reduce transactional support, disal- goDB [24], CouchDB [6], and Cassandra [17] provide no transac- lowing single transactions from spanning multiple partitions. Calvin tional support whatsoever. Others provide only limited transaction- is a practical transaction scheduling and data replication layer that ality, such as single-row transactional updates (e.g. Bigtable [11]) uses a deterministic ordering guarantee to significantly reduce the or transactions whose accesses are limited to small subsets of a normally prohibitive contention costs associated with distributed database (e.g.
    [Show full text]
  • Updates of Compressed Dynamic XML Documents
    Applications and Impacts Updates of Compressed Dynamic XML Documents Tomasz Muldner¨ , Christopher Fry, Jan Krzysztof Miziołek, and Tyler Corbin Jodrey School of Computer Science, Acadia University IBI AL, University of Warsaw [email protected] [email protected] [email protected] [email protected] Abstract: Because of the ever-growing number of applications that send numerous and potentially large XML files over networks there has been a recent interest in effi- cient updates of XML documents. However all known approaches deal with uncom- pressed documents. In this paper, we describe a novel XML compressor, XSAQCT designed to improve the efficiency of querying and updating XML documents with minimal decompression in a network environment. 1 Introduction Although XML is now the de facto data standard for Web services, as well as for encod- ing semi-structured data, its verbose nature and the resulting large sizes of the underlying XML documents adversely affects various network-based XML services. One such service is remote XML storage and transmission of XML files to other nodes in the network (in particular, for devices with limited memory such as mobile devices and wireless sensors, which are becoming ubiquitous in today’s society). Furthermore, while querying large XML documents is a commonly-executed operation, the high execution time and memory requirements of query tools (e.g. XQuery [XQ008]) severely limits their usefulness for very large documents; similar issues exist for XML update operations. Therefore, improv- ing the efficiency of XML storage and processing is a key research challenge. However, practically all existing approaches to update operations are limited to updates of uncom- pressed documents, which suffer from scalability issues for large XML documents.
    [Show full text]
  • Comparison of Native XML Databases and Experimenting with INEX
    Comparison of Native XML Databases and Experimenting with INEX Petr Kol´aˇrand Pavel Loupal Petr Kol´aˇrand Pavel Loupal Dept. of Computer Science and Engineering Dept.FEE, of Computer Czech Technical Science and University Engineering KarlovoFEE, Czech n´amˇest´ı13, Technical 121 University 35 Praha 2 Karlovo n´amˇest´ı13,Czech Republic 121 35 Praha 2 [email protected],Czech Republic [email protected] [email protected], [email protected] Abstract. The aim of the article is to summarize and compare ap- proaches of design and architecture of native XML databases. We dis- cuss our results accomplished by utilizing the INEX data set in two open source database systems - eXist and Apache Xindice. There is also a basic performance comparison outlined as a basis for discussion about suitabil- ity for particular database system and for our consecutive experiments. 1 Introduction XML documents can be stored in a native XML database. Storage of semi- structured data in a native XML database (NXD) has an advantage in the fact that it has a regular structure but the structure varies enough that what means that mapping this structure into a relational database results in either a large number of columns with null values which wastes spaces or a large number of tables which is inefficient. Another advantage of storing data in a native XML database is the retrieval speed. It is much faster to retrieve data from a native XML database than relational database. The term native XML database is used in different ways by various groups. For our purposes we consider the XML:DB definition – but, to distinguish from XML-enabled databases, we require a native XML database to have the following two properties as well: – The XML data model (either in the XML Infoset or the XQuery/XPath Data Model) is the fundamental logical data model both used internally by the database and exposed to database users when XML is the data type.
    [Show full text]