DOCSLIB.ORG

Data Managementmanagementdata for Scientific Research

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Data Managementmanagementdata for Scientific Research DDaattaa MMaannaaggeemmeenntt For Scientific Research Photo: © Stanza. Used with permission. CCoouurrssee IInnttrroodduuccttiioonn Welcome to a course in data management for scientific research projects. CCoouurrssee SSttrruuccttuurree Casual “guided” study-group approach Presentations, demos, hands-on exercises, discussions and “homework” Materials: A textbook, eBooks, websites, and online videos WWhhyy TTaakkee TThhiiss CCoouurrssee?? PracticalComputing.org Researchers work with increasing amounts of data. Many students do not have training in data management. Science degree programs generally do not address this gap. It is difficult for “non-majors” to get into IT courses. This leaves students and research teams struggling to cope. And therefore places a heavy burden on IT support. Our data management course provides the needed skills to address these issues. Exciting new discoveries await those who can effectively sift through mounds of data! Participant IntroductionsIntroductionsParticipant Please introduce yourself and share your: Degree program and emphasis Research area (general topic) Your current research project (specific topic) The types of data or data systems you use in this project What you hope to get out of this course Session 1: Data System Essentials How will you manage your data? You need a data system. There are many choices. To pick the best one, you need to state your requirements. Photo: NASA Today's Learning Objectives In this session, you will … Become familiar with common types of data systems Learn to differentiate between flat files and relational databases Learn to differentiate between spreadsheets and databases Learn how to model system functions and interactions Learn how to create system diagrams Learn how to state system requirements Ultimately, this knowledge will help you select or design the best data system for your needs. TTyyppeess ooff DDaattaa SSyysstteemmss UUnnlliinnkkeedd LLiinnkkeedd Flat file Network Distributed Hierarchical Relational Object relational NoSQL FFllaatt FFiilleess RReellaattiioonnaall DDaattaabbaasseess MS Office Documents MS Access Plain Text Files (CSV, TXT) FileMaker Pro Instrument Output SQLite Stats. Program Output MS SQL Server Oracle MySQL MariaDB PostgreSQL Spreadsheets and Databases An excellent short video presentation explaining the differences between databases and spreadsheets can be found on YouTube: Video: What are Source: WHO and Mozilla/dietrich databases? - lynda.com Watching this video is a “homework” assignment. So for now, we will just summarize the differences. SpreadsheetsSpreadsheets Convenient Interactive Visual Flexible Portable Source: WHO DatabasesDatabases Manageable Structured Standardized Scalable Accessible Graphic: Mozilla/dietrich Designing a Data SystemSystemDesigning To design a data system, we need to identify requirements and map out interactions and components. In this course you will learn how to create: Use Case Diagrams Data Flow Diagrams Entity Relationship Graphic: EPISTLE and its successors / Matthew West, Julian Diagrams Fowler, Razorbliss / Wikimedia So let's get started! Get the Picture: Use Case Diagrams Let's visualize a model of a uc Use Cases System Boundary “system” … receive order Order <<extend!! Order Food Wine Waiter confirm order place order Serve Cook Food Food Use Case Diagrams focus on Chef <<extend!! "if #ine #as ordered$ the “what” and not the “how”. Serve Wine Eat <<extend!! Drink Food "if #ine Wine Client #as served$ They model what people want facilitate payment pay <<extend!! to do with a system. A use case accept Pay for "if #ine Pay for payment Food #as Wine describes a “goal”, expressed Cashier consumed$ as an “action”. People and Graphic: Kishorekumar 62 (redrawn by Marcel other external entities are Douwe Dekker) / Wikimedia modeled as “actors” that “interact” with the system. Example System Interactions Imagine a system called “research project.” Some interactions that might appear in a model of this system are: 1. Researcher proposes experimental design. 2. Principal investigator approves experimental design. 3. Researcher creates survey. 4. Subject takes survey. 5. Subject provides survey results. 6. Researcher analyses results. 7. Researcher produces manuscript. 8. Principal investigator reviews manuscript. Let's visualize these interactions in a use case diagram… Research Project Use Case Diagram If we were only modeling the data system, we would probably remove the goals (and some actors) which were “out of scope” with repect to the data system… Survey Data System Use Case Diagram 1. Researcher uploads survey. Here, the scope only 2. Subject takes survey. encompasses the goals of 3. Subject uploads results. conducting the survey and returning results. 4. Researcher downloads results. This is the basic operation of the Open Data Kit system which we will learn about next week. But what good are they, really? Modeling diagrams help you: Clarify your own understanding Explore possibilities Communicate with others Prepare for more detailed design steps As a researcher, you can use these to clarify your project scope and requirements. They will help you present your project needs to others, such as your collaborators and support staff. Use case diagrams identify what a system must do and how people will interact with it. A complete use case model includes use case diagrams and textual descriptions of each use case. HHaannddss--oonn GGrroouupp EExxeerrcciissee Photo: SarahStierch / Wikimedia Create a Use Case Diagram As a group, list the goals (actions, use cases) for your research data system in “verb noun” form. Then figure out who (actors) will interact to perform those actions. Draw a simple use case diagram with stick figures (actors) and elipses (goals, use cases). Use pen and paper or software. All of the elipses should be enclosed in a “system boundary” box (if the software supports that), with the stick figures outside of the box. Lines (interactions) should connect the actors to their goals. Label the lines with what the actor does (action) to achieve the goal. DDiissccuussssiioonn We will display your diagrams on the screen and discuss them. Graphic: Jagbirlehl / Wikimedia In the Coming Sessions...Sessions...In We will continue the Needs Analysis of your data system with: Detailed Use Cases - including text descriptions More Systems Analysis - including Data Flow Diagrams A Requirements Document - compiling the above A Feasibility Study Which will present us with some options, typically: Do nothing (business as usual) Get something “off the shelf” (free or commercial) Build something ourselves … or some combination of the above. AAccttiioonn IItteemmss VViiddeeooss RReeaaddiinnggss TTaasskkss Watch VideosVideosWatch Watch these videos in the order listed. What are databases? Discover to Deliver Structured Conversation Use Case Diagram Tutorial (watch first two or more) ODK (watch one or two) ReadingsReadings Read: In the PCfB textbook: “Before You Begin”, pp. 1-6; Chapters 1-3, pp. 9-43; and Appendix 1, pp. 451-453 Read: Use Case Tips Skim Wikipedia articles: Data Management, Data System, Data Modeling, Needs Analysis, Agile Modeling, SDLC Skim eBook chapter: Beginning Database Design Chapter 3: Initial Requirements and Use Cases Explore websites: Agile Modeling, ODK TasksTasks We have several tasks to perform as “homework” before our next session. They should be fairly quick to complete. You might do one task per day, spending maybe 15-30 minutes on each task. Task 1: Your favorite website's database Find out through Internet research what database system (product name, database type, etc.) underlies your favorite or most-visited website. Examples might be a webmail, search, social, video/movie/music/store, blog, forum, or news website. (Since there are links to information about this on Facebook below, pick another site if that was your favorite.) If the site is popular, you will likely find a blog, news article or conference presentation mentioning the technology that the site uses, including it's back-end database system. Look up the database system product name in Wikipedia. Try to determine why that product was chosen over the other alternatives. Be ready to share this information in the next class session in a one-minute verbal presentation. Task 2: Limits to Excel as a "database" Find out the actual limits on MS Excel (max. file size, number of rows, etc.) that would make it unusable as a database if those limits were exceeded. (These may vary depending on the software version.) How about for OpenOffice (LibreOffice) “Calc”? (bonus points) For the Excel experts (bonus points): How do you link spreadsheets by matching columns headings, control the allowed values which can be entered in a column, protect cells (say, those containing formulas or constants) from being changed, restrict who can modify or view certain spreadsheets, and access the linked spreadsheets from other applications (like websites or statistics programs) over a network? If you know how to do these things, please demonstrate in class for us. Task 3: Data Sources and Needs Analysis Use your wiki in Redmine (or GitHub, etc.) to document the list of the data sources you will be working with in your project. Note the file types/applications, organizations/persons /processes they came from, and what you will do to/with them. The wiki language supports tables, which might be a good way to format the information in the wiki. Later you will use this wiki to further elucidate your “data dictionary”. Perform a
Load more

Recommended publications
  • Mysql Workbench Mysql Workbench
    MySQL Workbench MySQL Workbench Abstract This manual documents the MySQL Workbench SE version 5.2 and the MySQL Workbench OSS version 5.2. If you have not yet installed MySQL Workbench OSS please download your free copy from the download site. MySQL Workbench OSS is available for Windows, Mac OS X, and Linux. Document generated on: 2012-05-01 (revision: 30311) For legal information, see the Legal Notice. Table of Contents Preface and Legal Notice ................................................................................................................. vii 1. MySQL Workbench Introduction ..................................................................................................... 1 2. MySQL Workbench Editions ........................................................................................................... 3 3. Installing and Launching MySQL Workbench ................................................................................... 5 Hardware Requirements ............................................................................................................. 5 Software Requirements .............................................................................................................. 5 Starting MySQL Workbench ....................................................................................................... 6 Installing MySQL Workbench on Windows .......................................................................... 7 Launching MySQL Workbench on Windows .......................................................................
    [Show full text]
  • Histcoroy Pyright for Online Information and Ordering of This and Other Manning Books, Please Visit Topwicws W.Manning.Com
    www.allitebooks.com HistCoroy pyright For online information and ordering of this and other Manning books, please visit Topwicws w.manning.com. The publisher offers discounts on this book when ordered in quantity. For more information, please contact Tutorials Special Sales Department Offers & D e al s Manning Publications Co. 20 Baldwin Road Highligh ts PO Box 761 Shelter Island, NY 11964 Email: [email protected] Settings ©2017 by Manning Publications Co. All rights reserved. Support No part of this publication may be reproduced, stored in a retrieval system, or Sign Out transmitted, in any form or by means electronic, mechanical, photocopying, or otherwise, without prior written permission of the publisher. Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in the book, and Manning Publications was aware of a trademark claim, the designations have been printed in initial caps or all caps. Recognizing the importance of preserving what has been written, it is Manning’s policy to have the books we publish printed on acid­free paper, and we exert our best efforts to that end. Recognizing also our responsibility to conserve the resources of our planet, Manning books are printed on paper that is at least 15 percent recycled and processed without the use of elemental chlorine. Manning Publications Co. PO Box 761 Shelter Island, NY 11964 www.allitebooks.com Development editor: Cynthia Kane Review editor: Aleksandar Dragosavljević Technical development editor: Stan Bice Project editors: Kevin Sullivan, David Novak Copyeditor: Sharon Wilkey Proofreader: Melody Dolab Technical proofreader: Doug Warren Typesetter and cover design: Marija Tudor ISBN 9781617292576 Printed in the United States of America 1 2 3 4 5 6 7 8 9 10 – EBM – 22 21 20 19 18 17 www.allitebooks.com HistPoray rt 1.
    [Show full text]
  • Beyond Relational Databases
    EXPERT ANALYSIS BY MARCOS ALBE, SUPPORT ENGINEER, PERCONA Beyond Relational Databases: A Focus on Redis, MongoDB, and ClickHouse Many of us use and love relational databases… until we try and use them for purposes which aren’t their strong point. Queues, caches, catalogs, unstructured data, counters, and many other use cases, can be solved with relational databases, but are better served by alternative options. In this expert analysis, we examine the goals, pros and cons, and the good and bad use cases of the most popular alternatives on the market, and look into some modern open source implementations. Beyond Relational Databases Developers frequently choose the backend store for the applications they produce. Amidst dozens of options, buzzwords, industry preferences, and vendor offers, it’s not always easy to make the right choice… Even with a map! !# O# d# "# a# `# @R*7-# @94FA6)6 =F(*I-76#A4+)74/*2(:# ( JA$:+49>)# &-)6+16F-# (M#@E61>-#W6e6# &6EH#;)7-6<+# &6EH# J(7)(:X(78+# !"#$%&'( S-76I6)6#'4+)-:-7# A((E-N# ##@E61>-#;E678# ;)762(# .01.%2%+'.('.$%,3( @E61>-#;(F7# D((9F-#=F(*I## =(:c*-:)U@E61>-#W6e6# @F2+16F-# G*/(F-# @Q;# $%&## @R*7-## A6)6S(77-:)U@E61>-#@E-N# K4E-F4:-A%# A6)6E7(1# %49$:+49>)+# @E61>-#'*1-:-# @E61>-#;6<R6# L&H# A6)6#'68-# $%&#@:6F521+#M(7#@E61>-#;E678# .761F-#;)7-6<#LNEF(7-7# S-76I6)6#=F(*I# A6)6/7418+# @ !"#$%&'( ;H=JO# ;(\X67-#@D# M(7#J6I((E# .761F-#%49#A6)6#=F(*I# @ )*&+',"-.%/( S$%=.#;)7-6<%6+-# =F(*I-76# LF6+21+-671># ;G';)7-6<# LF6+21#[(*:I# @E61>-#;"# @E61>-#;)(7<# H618+E61-# *&'+,"#$%&'$#( .761F-#%49#A6)6#@EEF46:1-#
    [Show full text]
  • Data Platforms Map from 451 Research
    1 2 3 4 5 6 Azure AgilData Cloudera Distribu2on HDInsight Metascale of Apache Kaa MapR Streams MapR Hortonworks Towards Teradata Listener Doopex Apache Spark Strao enterprise search Apache Solr Google Cloud Confluent/Apache Kaa Al2scale Qubole AWS IBM Azure DataTorrent/Apache Apex PipelineDB Dataproc BigInsights Apache Lucene Apache Samza EMR Data Lake IBM Analy2cs for Apache Spark Oracle Stream Explorer Teradata Cloud Databricks A Towards SRCH2 So\ware AG for Hadoop Oracle Big Data Cloud A E-discovery TIBCO StreamBase Cloudera Elas2csearch SQLStream Data Elas2c Found Apache S4 Apache Storm Rackspace Non-relaonal Oracle Big Data Appliance ObjectRocket for IBM InfoSphere Streams xPlenty Apache Hadoop HP IDOL Elas2csearch Google Azure Stream Analy2cs Data Ar2sans Apache Flink Azure Cloud EsgnDB/ zone Platforms Oracle Dataflow Endeca Server Search AWS Apache Apache IBM Ac2an Treasure Avio Kinesis LeanXcale Trafodion Splice Machine MammothDB Drill Presto Big SQL Vortex Data SciDB HPCC AsterixDB IBM InfoSphere Towards LucidWorks Starcounter SQLite Apache Teradata Map Data Explorer Firebird Apache Apache JethroData Pivotal HD/ Apache Cazena CitusDB SIEM Big Data Tajo Hive Impala Apache HAWQ Kudu Aster Loggly Ac2an Ingres Sumo Cloudera SAP Sybase ASE IBM PureData January 2016 Logic Search for Analy2cs/dashDB Logentries SAP Sybase SQL Anywhere Key: B TIBCO Splunk Maana Rela%onal zone B LogLogic EnterpriseDB SQream General purpose Postgres-XL Microso\ Ry\ X15 So\ware Oracle IBM SAP SQL Server Oracle Teradata Specialist analy2c PostgreSQL Exadata
    [Show full text]
  • XAMPP Web Development Stack
    XAMPP Web Development Stack Overview @author R.L. Martinez, Ph.D. The steps below outline the processes for installing the XAMPP stack on a local machine. The XAMPP (pronounced Zamp) stack includes the following: Apache HTTP Server, MariaDB (essentially MySQL), Database Server, Perl, and the PHP Interpreter. The “X” in XAMPP is used to signify the cross-platform compatibility of the stack. The Apache HTTP Server and PHP are required to run phpMyAdmin which is a PHP application that is used for database administration tasks such as creating databases and tables, adding users, etc. Alternative to XAMPP If you have experience with MySQL Workbench, you may prefer to install MySQL Server and MySQL Workbench via the MySQL Installer. MySQL Workbench performs the same functions as phpMyAdmin. However, unlike phpMyAdmin which is a web-based application, MySQL Workbench is a locally installed application and therefore does not require an HTTP Server (e.g. Apache) to run. Installing XAMPP Many of the steps listed have several alternatives (such as changing MySQL passwords via a command line) and students are welcomed and encouraged to explore alternatives. 1. Download XAMPP from the URL below and place the installer (.exe) in the location where you want to install XAMPP. Placing the installer (.exe) in the same location as the intended installation is not required but preferred. http://www.apachefriends.org/download.html Page 1 of 17 XAMPP Web Development Stack 2. See the warning which recommends not installing to C:\Program Files (x86) which can be restricted by UAC (User Account Control). In the steps below XAMPP is installed to a USB flash drive for portability.
    [Show full text]
  • Mariadb Presentation
    THE VALUE OF OPEN SOURCE MICHAEL ”MONTY” WIDENIUS Entrepreneur, MariaDB Hacker, MariaDB CTO MariaDB Corporation AB 2019-09-25 Seoul 11 Reasons Open Source is Better than Closed Source ● Using open standards (no lock in into proprietary standards) ● Resource friendly; OSS software tend to work on old hardware ● Lower cost; Usually 1/10 of closed source software ● No cost for testing the full software ● Better documentation and more troubleshooting resources ● Better support, in many cases directly from the developers ● Better security, auditability (no trap doors and more eye balls) ● Better quality; Developed together with users ● Better customizability; You can also participate in development ● No vendor lock in; More than one vendor can give support ● When using open source, you take charge of your own future Note that using open source does not mean that you have to become a software producer! OPEN SOURCE, THE GOOD AND THE BAD ● Open source is a better way to develop software ● More developers ● More spread ● Better code (in many cases) ● Works good for projects that can freely used by a lot of companies in their production or products. ● It's very hard to create a profitable company developing an open source project. ● Not enough money to pay developers. ● Hard to get money and investors for most projects (except for infrastructure projects like libraries or daemon services). OPEN SOURCE IS NATURAL OR WHY OPEN SOURCE WORKS ● You use open source because it's less expensive (and re-usable) ● You solve your own problems and get free help and development efforts from others while doing it.
    [Show full text]
  • High Performance Mysql Other Microsoft .NET Resources from O’Reilly
    High Performance MySQL Other Microsoft .NET resources from O’Reilly Related titles Managing and Using MySQL PHP Cookbook™ MySQL Cookbook™ Practical PostgreSQL MySQL Pocket Reference Programming PHP MySQL Reference Manual SQL Tuning Learning PHP Web Database Applications PHP 5 Essentials with PHP and MySQL .NET Books dotnet.oreilly.com is a complete catalog of O’Reilly’s books on Resource Center .NET and related technologies, including sample chapters and code examples. ONDotnet.com provides independent coverage of fundamental, interoperable, and emerging Microsoft .NET programming and web services technologies. Conferences O’Reilly Media bring diverse innovators together to nurture the ideas that spark revolutionary industries. We specialize in docu- menting the latest tools and systems, translating the innovator’s knowledge into useful skills for those in the trenches. Visit con- ferences.oreilly.com for our upcoming events. Safari Bookshelf (safari.oreilly.com) is the premier online refer- ence library for programmers and IT professionals. Conduct searches across more than 1,000 books. Subscribers can zero in on answers to time-critical questions in a matter of seconds. Read the books on your Bookshelf from cover to cover or sim- ply flip to the page you need. Try it today for free. SECOND EDITION High Performance MySQL Baron Schwartz, Peter Zaitsev, Vadim Tkachenko, Jeremy D. Zawodny, Arjen Lentz, and Derek J. Balling Beijing • Cambridge • Farnham • Köln • Sebastopol • Taipei • Tokyo High Performance MySQL, Second Edition by Baron Schwartz, Peter Zaitsev, Vadim Tkachenko, Jeremy D. Zawodny, Arjen Lentz, and Derek J. Balling Copyright © 2008 O’Reilly Media, Inc. All rights reserved. Printed in the United States of America.
    [Show full text]
  • Mysql Database Administrator
    MySQL Database Administrator Author: Kacper Wysocki Contact: [email protected] Date: December 2010 License: Creative Commons: CC BY-SA Oslo, December 2010, CC BY-SA Contents Introduction 5 Introductions everybody 5 About this course 5 Course outline 6 Course schedule 6 How to do excersies 6 MySQL: history and future 6 MySQL: the present 7 MySQL: the future 7 MySQL compared to other DBs 7 MySQL language support 8 Embedding MySQL 8 Getting help with MySQL 8 MySQL architecture 9 Modular architecture 9 The MySQL modules 9 Client/server architecture 10 Installing MySQL 10 Installation process 10 Distribution packages 11 MySQL official binaries 11 Deploying sandboxes 12 Installing from source 13 Server Startup and Shutdown 14 MySQL relevant files 15 Excersises: Installation 15 Upgrading MySQL 16 Clients: the mysql* suite 16 Client: mysql 16 Excersise: Client mysql 16 Excersise: mysql CLI 17 Further CLI fun 17 Digression: some SQL 18 Client: mysqladmin 18 Excersises: Client: mysql 18 Clients: applications and libraries 18 Oslo, December 2010, CC BY-SA migration 19 Importing data: timezones 19 Importing data 19 Excersises: importing data 20 Excersises: time zones 20 Exporting data 20 Excersises: Exporting data 21 Configuration 21 More configuration 21 Run-time Variables 22 MySQL Architecture 23 Storage Engines 23 Storage Engines 23 Storage Engines types 23 MyISAM 24 MYISAM_MRG 24 InnoDB 24 Excersises: InnoDB 24 FEDERATED 25 CSV 25 ARCHIVE 25 MEMORY 25 BLACKHOLE 25 So... which engine? 26 Engine Excersises 26 Implementing Security 26
    [Show full text]
  • Navicat Premium Romania V12
    Table of Contents Chapter 1 - Introduction 8 About Navicat 8 Installation 10 End-User License Agreement 12 Chapter 2 - User Interface 18 Main Window 18 Navigation Pane 19 Object Pane 20 Information Pane 21 Chapter 3 - Navicat Cloud 23 About Navicat Cloud 23 Manage Navicat Cloud 24 Chapter 4 - Connection 27 About Connection 27 General Settings 28 RDBMS 28 MongoDB 30 SSL Settings 31 SSH Settings 33 HTTP Settings 34 Advanced Settings 34 Databases / Attached Databases Settings 37 Chapter 5 - Server Objects 38 About Server Objects 38 MySQL / MariaDB 38 Databases 38 Tables 38 Views 39 Procedures / Functions 40 Events 41 Maintain Objects 41 Oracle 41 Schemas 41 Tables 42 Views 42 Materialized Views 43 Procedures / Functions 44 Packages 45 Recycle Bin 46 Other Objects 47 1 Maintain Objects 47 PostgreSQL 49 Databases & Schemas 49 Tables 50 Views 51 Materialized Views 51 Functions 52 Types 53 Foreign Servers 53 Other Objects 54 Maintain Objects 54 SQL Server 54 Databases & Schemas 54 Tables 55 Views 56 Procedures / Functions 56 Other Objects 57 Maintain Objects 58 SQLite 59 Databases 59 Tables 59 Views 60 Other Objects 60 Maintain Objects 61 MongoDB 61 Databases 61 Collections 61 Views 62 Functions 62 Indexes 63 MapReduce 63 GridFS 63 Maintain Objects 64 Chapter 6 - Data Viewer 66 About Data Viewer 66 RDBMS 66 RDBMS Data Viewer 66 Use Navigation Bar 66 Edit Records 67 Sort / Find / Replace Records 73 Filter Records 75 Manipulate Raw Data 75 2 Format Data View 76 MongoDB 77 MongoDB Data Viewer 77 Use Navigation Bar 78 Grid View 79 Tree View 85 JSON
    [Show full text]
  • Research Document
    Research Document Student Name: James Heneghan Student ID: C00155861 Course ID: CW_KCSOF_B Project Name: Take Me There Supervisor: Joseph Kehoe Institute: Institute of Technology Carlow Date: 16/10/2014 1 Contents Introduction ............................................................................................................................................ 3 Galileo Board ........................................................................................................................................... 3 Details of the Architecture .................................................................................................................. 3 Communication ................................................................................................................................... 3 Accelerometer......................................................................................................................................... 4 Cloud Hosting .......................................................................................................................................... 4 Google Maps API ..................................................................................................................................... 4 Google Maps JavaScript API ................................................................................................................ 4 Google Static Maps API ......................................................................................................................
    [Show full text]
  • Towards the Universal Spatial Data Model Based Indexing and Its Implementation in Mysql
    Towards the universal spatial data model based indexing and its implementation in MySQL Evangelos Katsikaros Kongens Lyngby 2012 IMM-M.Sc.-2012-97 Technical University of Denmark Informatics and Mathematical Modelling Building 321, DK-2800 Kongens Lyngby, Denmark Phone +45 45253351, Fax +45 45882673 [email protected] www.imm.dtu.dk IMM-M.Sc.: ISSN XXXX-XXXX Summary This thesis deals with spatial indexing and models that are able to abstract the variety of existing spatial index solutions. This research involves a thorough presentation of existing dynamic spatial indexes based on R-trees, investigating abstraction models and implementing such a model in MySQL. To that end, the relevant theory is presented. A thorough study is performed on the recent and seminal works on spatial index trees and we describe their basic properties and the way search, deletion and insertion are performed on them. During this effort, we encountered details that baffled us, did not make the understanding the core concepts smooth or we thought that could be a source of confusion. We took great care in explaining in depth these details so that the current study can be a useful guide for a number of them. A selection of these models were later implemented in MySQL. We investigated the way spatial indexing is currently engineered in MySQL and we reveal how search, deletion and insertion are performed. This paves the path to the un- derstanding of our intervention and additions to MySQL's codebase. All of the code produced throughout this research was included in a patch against the RDBMS MariaDB.
    [Show full text]
  • Course Outline & Schedule
    Course Outline & Schedule Call US 408-759-5074 or UK +44 20 7620 0033 Introduction to MariaDB Course Code MARI Duration 3 Day Course Price $1,335 Course Description The Introduction to MariaDB course covers the basics of the SQL language as implemented by MariaDB. The course is designed to give delegates practical experience in writing SQL statements using the MySQL client program and MySQL Workbench. The basic SQL statements, including the use of SQL functions and the basic table and view handling statements are introduced. Objectives The delegate will learn and acquire skills as follows: Using client programs to access a MariaDB database Creating, altering and dropping a MariaDB database Writing SQL statements to select data from a MariaDB database Writing joins and subqueries Using SQL expressions Using SQL aggregate functions and scalar functions Inserting, updating, deleting and replacing rows Creating and altering tables, indexes and views Using transactions Granting and revoking access privileges on tables and views Exporting and importing data Target Audience Anyone who needs to access and work with a MariaDB Database or is migrating from MySQL to MariaDB. Additional Information Perpetual Solutions - Page 1 of 5 Course Outline & Schedule Call US 408-759-5074 or UK +44 20 7620 0033 Course technical content is subject to change without notice. Course content is structured as sessions, this does not strictly map to course timings. Concepts, content and practicals often span sessions. Course Modules Database Concepts (9 topics) ◾
    [Show full text]