DOCSLIB.ORG

The New Mariadb Offering

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
The New Mariadb Offering The new MariaDB offering MariaDB 10, MaxScale, and more Rasmus Johansson, VP Engineering, SkySQL 24/06/2014 © SkySQL Corporaon Ab. Company Confiden-al. 1 MariaDB intro 24/06/2014 © SkySQL Corporaon Ab. Company Confiden-al. 2 What is MariaDB? • A free fork of MySQL with extra features • features, requested by the users • Backward compable • file formats, replicaon, configuraon files • aim at 100% drop-in replacement • Community developed • 50% of maria-captains are from the community • no hidden agenda © SkySQL Corporaon Ab. Company Confiden-al. Who’s using it? © SkySQL Corporaon Ab. Company Confiden-al. Where to get it • Distribu-ons: • RedHat Enterprise Linux (default in RHEL 7), Debian, Ubuntu (since 14.04), Fedora, Mageia (default), openSUSE (default), Gentoo, Slackware (default), Arch (default), ALTLinux, TurboLinux, Chakra Project (default), Kdu, … • FreeBSD, OpenBSD • Mac OS X with MacPorts or Homebrew • From MariaDB.org • sources, binaries in .tar.gz or .zip (Windows) • Windows MSI installer • MariaDB apt and yum repositories © SkySQL Corporaon Ab. Company Confiden-al. Before MariaDB 10.0 • MariaDB 5.1 – 17 releases since Oct 2009 • Aria, XtraDB, PBXT, FederatedX • table eliminaon, pool of threads, • MariaDB 5.2 – 15 releases since Apr 2010 • OQGraph, SphinxSE • virtual columns, pluggable auth, segmented key cache, extended stas-cs, • MariaDB 5.3 – 13 releases since July 2011 • major op-mizer improvements • replicaon: group commit, checksums • HandlerSocket, dynamic columns, Windows performance improvements, microsecond support, GIS precise operaons, progress repor-ng, … © SkySQL Corporaon Ab. Company Confiden-al. Before MariaDB 10.0 • MariaDB 5.5 – 20 releases since Feb 2012 • new thread pool • non-blocking client API • extended keys op-mizaon • dynamic replicate_do_*, replicate_ignore_*, replicate_wild_* variables © SkySQL Corporaon Ab. Company Confiden-al. Other MariaDB projects • MaxScale • MariaDB Galera Cluster • Connectors/Drivers • MariaDB C Client Library (LGPL) • MariaDB JDBC driver (LGPL) • MariaDB ODBC driver (LGPL) • MariaDB Audit Plugin © SkySQL Corporaon Ab. Company Confiden-al. Community ac-vity • Past month (March 2014): • Added/Changed Ar-cles in the KB: 123 • On Freenode IRC #maria, 550 people wrote 10173 lines • Source code (Launchpad): : GitHub • 25 ac-ve branches MariaDB is now on • 395 commits https://github.com/MariaDB/server/ 24/06/2014 9 © SkySQL Corporaon Ab. Company Confiden-al. Community Contribu-ons MariaDB 10.0 major contribu-ons: • Spider storage engine metadata_lock_info Informaon schema • Per thread memory coun-ng and usage • Code by Kentoku Shiba, Spiral Arms • Base code and idea by Lixun Peng, Taobao • Roles • Mul--source replicaon • Code by Vicenu Ciorbaru, Google Summer of Code 2013 • Base code by Lixun Peng, Taobao • PCRE Regular Expressions • GET_LOCK • Code by Sudheera Palihakkara, Google • Code by Konstan-n "Kostja" Osipov, Summer of Code 2013 mail.ru • Global Transac-on IDs • CONNECT storage engine • Some patches by Pavel Ivanov, Google • Code by Olivier Bertrand https://mariadb.com/kb/en/log-of-mariadb-contributions/ 24/06/2014 © SkySQL Corporaon Ab. Company Confiden-al. 10 Community Ongoing Dev Projects • WebScaleSQL patches • Stas-cally op-mize mysql-test runs by hpps://mariadb.atlassian.net/browse/MDEV-6039 running less tests, Pablo Estrada, Google Summer of Code • LevelDB/RocksDB storage engine (persistent key-value hpps://mariadb.atlassian.net/browse/ store for fast storage) MDEV-5776 hpps://mariadb.com/kb/en/leveldb-storage-engine/ • CREATE OR REPLACE, CREATE IF NOT • Fusion-IO page compression EXISTS, DROP IF EXISTS, Sriram Pal, hpps://blog.mariadb.org/significant-performance- Google Summer of Code hpps://mariadb.atlassian.net/browse/ boost-with-new-mariadb-page-compression-on- MDEV-5359 fusionio/ • Self-Tuning Op-mizer, Anshu Avinash, • Kerberos authen-caon plugin Google Summer of Code hpps://mariadb.atlassian.net/browse/MDEV-4691 hpps://mariadb.atlassian.net/browse/ • Mroonga storage engine (fast fulltext search) MDEV-350 hpps://mariadb.atlassian.net/browse/MDEV-5222 • Support of UseServerPrepStmts to MariaDB Java Connector, Puneet Dewan, Google Summer of Code 24/06/2014 © SkySQL Corporaon Ab. Company Confiden-al. 11 MariaDB 10.0 © SkySQL Corporaon Ab. Company Confiden-al. MariaDB 10 ● MariaDB 10.0 GA launched March 31st, 2014. ● Application-compatible with MySQL. ● Includes significant unique new features in scalability, replication, performance, NoSQL, operations, security. ● Available under the GPL v2. © SkySQL Ab. Company Confiden-al. MariaDB 10 Scalability: MySQL MariaDB ✘ ✔ Single in 10.0. Parallel Slave Replicaon threaded per database. ● Sponsored by Google. ● Allows slaves to process update events in parallel. ● Uses MariaDB 10’s improved Global Transaction ID (GTID). ● MariaDB unlike MySQL can process multiple updates for a single database in parallel. Much better throughput. ● Preliminary benchmarks: almost 10x faster at 12 threads. Improves scalability, reduces slave lag, making slaves more consistent. © SkySQL Ab. Company Confiden-al. Parallel Slave Benchmark sysbench OLTP single database slave tps relative to master © SkySQL Ab. Company Confiden-al. MariaDB 10 Scalability: MySQL MariaDB ✘ ✔ Multi-Source Replication in 10.0. Content Online E- Management Commerce System Application Master Master ● Collects data for S S S S S S S S analytics using built-in replication. Click-stream data Master ● Aids in administration S S S S example: consolidated backups of multiple databases. ● Uses MariaDB 10’s improved Global Transaction ID (GTID). Slave ETL Data Warehouse Easier analytics, more insight, simpler administration, fewer headaches. © SkySQL Ab. Company Confiden-al. Technology Preview MariaDB 10 Scalability: MySQL MariaDB ✘ ✔ Sharding with Spider optional 3rd in 10.0. party install ● Contributed by a 3rd party developer. Application ● Storage engine partitions large tables across multiple DBs. Spider ● No changes to the client application. Customers ● Developers aren’t aware, can keep A-H I-P applications simple. Q-Z ● Allows for more parallelism, scale-out. Shard 1 Shard 2 Shard 3 ● Transactional storage Customers Customers Customers engine. A-H I-P Q-Z Web-scale, without the development hassle. © SkySQL Ab. Company Confiden-al. MariaDB 10 Performance: MySQL MariaDB ✘ ✔ TokuDB Storage Engine optional 3rd in 10.0. party install ● 3rd party partner - TokuTek. ● Drop-in replacement for InnoDB/XtraDB. ● Advanced indexing and compression algorithms. ● Transactional. ● Up to 20x performance gain for inserts/updates. ● Up to 90% less disk storage. ● Online schema changes. ● Reduces or eliminates slave lag. ● Best when DB doesn’t fit in memory, and SSD longevity is important. © SkySQL Ab. Company Confiden-al. MariaDB 10 Performance: Op-mizer Improvements ● Of 29 distinct enhancements noted, 28 are in MariaDB 10. Just 1 only in MySQL 5.6. ● Enhancements include: ○ Disk access optimizations. ○ JOIN optimizations. ○ Subquery optimizations. ○ Optimized derived tables and views. ○ Execution control. ○ Optimizer control. ○ EXPLAIN improvements. Less I/O, CPU, memory requirements. Faster execution. © SkySQL Ab. Company Confiden-al. MariaDB 10 Performance: More Enhancements and Features ● Fusion-io Atomic Writes - improves performance on popular SSD hardware.✔ exclusive to MariaDB 10 ● XtraDB storage engine - enhanced from InnoDB. ● Improved InnoDB storage engine - based on MySQL 5.6. ● Performance schema - real-time performance management. ● Improved thread pool - better concurrent user performance.✔ exclusive to MariaDB 10 ● More optimizer improvements - higher efficiency in I/O accesses. ✔ exclusive to MariaDB 10 Faster performance, lower cost. © SkySQL Ab. Company Confiden-al. Fusion-IO page compression • Atomic writes gives a performance increase of about 30%. By enabling fast checksum for XtraDB it’s 50% • By using page compression the compression ratio is leading to better performance and there are less writes to disk. • Multi-threaded flush provides better throughput and decreases operation latencies delivering a performance boost https://blog.mariadb.org/significant-performance-boost-with-new-mariadb-page-compression-on-fusionio © SkySQL Ab. Company Confiden-al. Technology Preview MariaDB 10 Interoperability: MySQL MariaDB CONNECT Storage Engine ✘ ✔ in 10.0. ● From 3rd party developer. Application ● Maps diverse data to tables. MariaDB Parser/Optimizer/Connection Pool ● JOIN mapped data Spi der to DB tables. CONNECT Other Engine Engines ● Flat files including CSV. ● Tables in external DBs. ● Generated tables (PIVOT etc.) .log CSV Database ● Plug-in API for your own mappings. XML Tables Powerful tool for data integration, federation. © SkySQL Ab. Company Confiden-al. Technology Preview MariaDB 10 Interoperability: MySQL MariaDB Cassandra Storage Engine ✘ ✔ in 10.0. ● Window into a Cassandra ring: Application read/write like a table in MariaDB. ● Use standard SQL queries. ● JOIN Cassandra data MariaDB Parser/Optimizer/ConnectionSpi Pool to MariaDB tables. der Cassandra Other Engine Engines ● Use a MariaDB cluster for high-availability access. ● Bring data from Cassandra into OLTP Database applications. Tables Interoperate with Cassandra. Use Cassandra data in OLTP applications. © SkySQL Ab. Company Confiden-al. MariaDB 10 NoSQL Features: MySQL MariaDB Dynamic Columns ✘ ✔ in 10.0. Cust ID Account Balance Dyn_Col_BLOBs 2035 $154.04 NAME: John Smith|LOC: 45.35243, -74.98348|IMAGE: x27A8B8C ... 2036 $929.10 NAME: Jane Doe|LOC: 45.35243, -74.98348|AGE: 32| GENDER: F... 2037 $377.53 NAME: Carol
Load more

Recommended publications
  • Mariadb Presentation
    THE VALUE OF OPEN SOURCE MICHAEL ”MONTY” WIDENIUS Entrepreneur, MariaDB Hacker, MariaDB CTO MariaDB Corporation AB 2019-09-25 Seoul 11 Reasons Open Source is Better than Closed Source ● Using open standards (no lock in into proprietary standards) ● Resource friendly; OSS software tend to work on old hardware ● Lower cost; Usually 1/10 of closed source software ● No cost for testing the full software ● Better documentation and more troubleshooting resources ● Better support, in many cases directly from the developers ● Better security, auditability (no trap doors and more eye balls) ● Better quality; Developed together with users ● Better customizability; You can also participate in development ● No vendor lock in; More than one vendor can give support ● When using open source, you take charge of your own future Note that using open source does not mean that you have to become a software producer! OPEN SOURCE, THE GOOD AND THE BAD ● Open source is a better way to develop software ● More developers ● More spread ● Better code (in many cases) ● Works good for projects that can freely used by a lot of companies in their production or products. ● It's very hard to create a profitable company developing an open source project. ● Not enough money to pay developers. ● Hard to get money and investors for most projects (except for infrastructure projects like libraries or daemon services). OPEN SOURCE IS NATURAL OR WHY OPEN SOURCE WORKS ● You use open source because it's less expensive (and re-usable) ● You solve your own problems and get free help and development efforts from others while doing it.
    [Show full text]
  • Navicat Wine En.Pdf
    Table of Contents Getting Started 8 System Requirements 9 Registration 9 Installation 10 Maintenance/Upgrade 11 End-User License Agreement 11 Connection 17 Navicat Cloud 18 General Settings 21 Advanced Settings 24 SSL Settings 27 SSH Settings 28 HTTP Settings 29 Server Objects 31 MySQL/MariaDB Objects 31 MySQL Tables 31 MySQL/MariaDB Table Fields 32 MySQL/MariaDB Table Indexes 34 MySQL/MariaDB Table Foreign Keys 35 MySQL/MariaDB Table Triggers 36 MySQL/MariaDB Table Options 37 MySQL/MariaDB Views 40 MySQL/MariaDB Functions/Procedures 41 MySQL/MariaDB Events 43 Oracle Objects 44 Oracle Data Pump (Available only in Full Version) 44 Oracle Data Pump Export 45 Oracle Data Pump Import 48 Oracle Debugger (Available only in Full Version) 52 Oracle Physical Attributes/Default Storage Characteristics 53 Oracle Tables 55 Oracle Normal Tables 55 Oracle Table Fields 55 Oracle Table Indexes 57 Oracle Table Foreign Keys 58 Oracle Table Uniques 59 Oracle Table Checks 59 Oracle Table Triggers 60 Oracle Table Options 61 Oracle External Tables 62 2 Fields for Oracle External Tables 62 External Properties for Oracle External Tables 63 Access Parameters for Oracle External Tables 64 Oracle Index Organized Tables 64 Options for Oracle Index Organized Tables 64 Oracle Views 65 Oracle Functions/Procedures 66 Oracle Database Links 68 Oracle Indexes 68 Oracle Java 71 Oracle Materialized Views 72 Oracle Materialized View Logs 75 Oracle Packages 76 Oracle Sequences 77 Oracle Synonyms 78 Oracle Triggers 78 Oracle Types 81 Oracle XML Schemas 82 Oracle Recycle Bin
    [Show full text]
  • Mysql Workbench Release Notes
    MySQL Workbench Release Notes Abstract This document contains release notes for the changes in each release of MySQL Workbench. For additional MySQL Workbench documentation, see MySQL Workbench. MySQL Workbench platform support evolves over time. For the latest platform support information, see https:// www.mysql.com/support/supportedplatforms/workbench.html. Updates to these notes occur as new product features are added, so that everybody can follow the development process. If a recent version is listed here that you cannot find on the download page (https://dev.mysql.com/ downloads/), the version has not yet been released. The documentation included in source and binary distributions may not be fully up to date with respect to release note entries because integration of the documentation occurs at release build time. For the most up-to-date release notes, please refer to the online documentation instead. For legal information, see the Legal Notices. For help with using MySQL, please visit the MySQL Forums, where you can discuss your issues with other MySQL users. Document generated on: 2021-09-23 (revision: 23350) Table of Contents Preface and Legal Notices ................................................................................................................. 4 Changes in MySQL Workbench 8.0 .................................................................................................... 5 Changes in MySQL Workbench 8.0.27 (Not yet released, General Availability) .............................. 5 Changes in MySQL Workbench 8.0.26 (2021-07-20, General Availability) ..................................... 5 Changes in MySQL Workbench 8.0.25 (2021-05-11, General Availability) ..................................... 5 Changes in MySQL Workbench 8.0.24 (2021-04-20, General Availability) ..................................... 5 Changes in MySQL Workbench 8.0.23 (2021-01-18, General Availability) ..................................... 7 Changes in MySQL Workbench 8.0.22 (2020-10-19, General Availability) ....................................
    [Show full text]
  • The S3 Storage Engine in Mariadb 10.5 FOSDEM 2020
    The S3 storage engine in MariaDB 10.5 FOSDEM 2020 Michael Widenius CTO @ MariaDB What is Amazon S3 ● Storage of files in the cloud ● Works through http requests (think get/put) ● Supports basic functions like list files, copy to/from and delete. ● Move is implemented as copy + delete of the whole file (not fast) ● Quite slow for small files. Optimal file size for retrial is said to be around 4M. ● Many vendors support storage of files according to the ‘S3 interface’ ● Not really usable for databases who needs to update blocks withing a file. S3 storage ● All files are stored in one of several ‘buckets’ ● Files are stored as objects in a bucket accessed with a key. ● The key may contain ‘/’ and commands like ‘aws ls’ make S3 storage to feel like a file structure, even it it really isn’t. S3 storage engine in MariaDB 10.5 ● Read only tables (perfect for inexpensive archiving of old data). ● For some organizations S3 storage is cheaper than local storage ● Data and index can optionally be compressed on S3, which can make storage even cheaper. ● S3 works with partitioning for flexible handling of multiple tables ● Very fast, thanks to reading of blocks in big chunks (4M by default) ● Supports all key formats and optimizations that Aria supports ● Data can be accessed by multiple MariaDB servers. Tables are automatically discovered when needed. ● S3 has it’s own page cache ● S3 is also backported to 10.3 and 10.4 MariaDB enterprise server Converting a table to S3 Converting a table to S3: ALTER TABLE old_table ENGINE=S3 And converting back to local: ALTER TABLE table_on_s3 ENGINE=InnoDB Internally the data is first copied to a local Aria table with ROW_FORMAT=PAGE TRANSACTIONAL=0 and then moved to S3.
    [Show full text]
  • Mariadb Viable Mysql Replacement Scale12x.Pdf
    MariaDB: Viable MySQL replacement Colin Charles, Team MariaDB, SkySQL Ab [email protected] | [email protected] http://mariadb.org/ http://bytebot.net/blog/ | @bytebot on Twitter SCALE12x, Los Angeles, California, USA 22 February 2014 Sunday, 23 February 14 whoami • Work on MariaDB at SkySQL Ab • Merged with Monty Program Ab, makers of MariaDB • Formerly MySQL AB (exit: Sun Microsystems) • Past lives include Fedora Project (FESCO), OpenOffice.org • MHA experience • since November 2011 (MHA 0.52, 0.53) • NRE work to make it run in a Solaris 10 environment... with no Internet access! • Continued deployment advice + work for data centre use • Much thanks to SkySQL for the experience Sunday, 23 February 14 MySQL? Percona Server? MariaDB? Sunday, 23 February 14 Agenda • 4 years: major server releases (5.1, 5.2, 5.3, 5.5, 5.5+TokuDB, Galera Cluster) and 10.0 series • Delving into history of previous releases • MariaDB 10.0 • Client libraries, Galera Cluster • Roadmap Sunday, 23 February 14 What isn’t covered • MariaDB Enterprise • Galera Cluster + GUI + API • mariadb.com • SkySQL • trademarks... Sunday, 23 February 14 What is MariaDB? • Community developed branch of MySQL • Feature enhanced • Fully compatible & feature complete with MySQL Sunday, 23 February 14 Backed by MariaDB Foundation • Driver of the MariaDB project • Foundation not controlled by single entity/ person; has a Board • Ensure MariaDB is compatible with MySQL, maintain mariadb.org, keep community voice • Major sponsors: SkySQL, Parallels, Booking.com, Automattic, OpenQuery, Percona,
    [Show full text]
  • Mysql Performance Monitoring with Zabbix an Alternative
    MySQL Performance Monitoring with Zabbix An alternative to the MySQL Enterprise Monitor? by Oli Sennhauser [email protected] http://www.fromdual.com www.fromdual.com 1 How many of you ... ● ¼ monitor their database servers? ● ¼ monitor their (MySQL) databases? ● ¼ monitor performance metrics? ● ¼ all the others: Why not? www.fromdual.com 2 Linux monitoring ● Question: What is your favourite Linux monitoring application? ● 1187 votes, April 2010 ● Manipulated? ● Lit: Linux Journal, [1] www.fromdual.com 3 What to monitor? ● Devices / Software ● Server, Router, Switches, I/O systems etc. ● Operating System, Networks, Applications, etc. ● Incidents ● DB down, Replication stopped, Server not reachable, etc. ● Critical Events ● Disk more than n% full or less than m Gbyte free, Replication more than n seconds lagging, Data node down, 100% CPU utilization, etc. → Alert, immediate intervention, fire fighting www.fromdual.com 4 What to monitor? ● Trends (includes time!) → Graphs ● How long does it take until ¼ ● ¼ my disk is full? ● ¼ my Index Memory is filled up? ● When does it happen? ● Peak? Backup? ● How often does it happen? Does it happen periodically? ● Once a day? Always at Sunday night? ● How does it correlate to other informations? ● I/O problems during our backup window? ● Reading the patterns! → this can help us to find the root cause of problems¼ www.fromdual.com 5 How to monitor? ● Basic solutions: ● top, vmstat, iostat, mytop, innotop, SHOW GLOBAL STATUS, SHOW INNODB STATUS ● CLI!, no graphs, no log term information, but good for adhoc analysis! ● Graphical solutions ● Nagios, Cactii, Zabbix, ¼ ● Typically NOT specialised in DB monitoring... www.fromdual.com 6 Focus ● Database + Server ● Trends Not the other stuff..
    [Show full text]
  • Migrate from Oracle to Mariadb Platform
    LOWER TCO WITHOUT LOWERING STANDARDS Migrate to MariaDB Platform from Oracle WHITEPAPER TABLE OF CONTENTS 4 TOTAL COST OF OWNERSHIP AND SCALING BENEFITS 4 SAVING MILLIONS WITH MARIADB 5 MARIADB PLATFORM BENEFITS 6 FEATURE PARITY 7 BUILT-IN MIGRATION COMPATIBILITY 8 INFRASTRUCTURE 9 MIGRATION METHODOLOGY 9 ASSESSMENT 10 SCHEMA MIGRATION 10 APPLICATION CODE MIGRATION 11 DATA MIGRATION AND REPLICATION 12 QUALITY ASSURANCE 12 CUTOVER 13 NEXT STEPS 14 APPENDIX A: TCO 17 APPENDIX B: DATA TYPES Lower TCO without Lowering Standards WHITEPAPER LOWER TCO WITHOUT LOWERING STANDARDS: MIGRATE TO MARIADB PLATFORM FROM ORACLE Built on 20+ years of open source engineering and production use, MariaDB Server is an enterprise open source database for transactional workloads, analytical workloads, or both – at scale. MariaDB Server is the foundation of MariaDB Platform – an integrated suite of enterprise-grade products for storing and accessing data. MariaDB Platform is the only open source database with the same enterprise features found in proprietary databases, including Oracle Database compatibility (e.g., PL/SQL compatibility), temporal tables, sharding, point-in-time rollback, and transparent data encryption. And all of this comes at a much lower total cost of ownership (TCO) than Oracle. MariaDB has displaced MySQL in leading Linux distributions, including Red Hat Enterprise Linux (RHEL) and SUSE Linux Enterprise Server (SLES). MariaDB Platform is used on premises, as well as on public and private cloud infrastructure platforms, including OpenStack. It is a trusted, proven, and reliable replacement for proprietary databases. 3 Lower TCO without Lowering Standards WHITEPAPER TOTAL COST OF OWNERSHIP & SCALING BENEFITS MariaDB Platform frees companies from the costs, constraints, and complexity of proprietary databases, enabling them to reinvest in what matters most – rapidly developing innovative, customer-facing applications.
    [Show full text]
  • Mysql Architectures for Oracle DBA's
    MySQL Architectures for Oracle DBA's UKOUG Conference 2011 December 5th, Birmingham Oli Sennhauser Senior MySQL Consultant, FromDual [email protected] www.fromdual.com 1 FromDual ● FromDual provides neutral and independent: ● Consulting for MySQL (on-site and remote) ● Remote-DBA / MySQL operations ● Support for Galera (synchronous MySQL Replication) ● Support for MySQL (Basic and Silver) ● Training for MySQL ● Consulting Partner of Open Database Alliance (ODBA.org) ● Oracle Silver Partner (OPN) ● More informations at: www.fromdual.com www.fromdual.com 2 Our customer www.fromdual.com 3 Content ● The LAMP Stack ● History of MySQL ● Open Source ● Branches and Forks ● Move from Oracle? ● MySQL Architecture ● Pluggable Storage Engines ● Differences between Oracle and MySQL ● Scale-Up vs. Scale-Out ● High-Availability solutions ● Architectures put in place www.fromdual.com 4 The LAMP Stack We are the Web! Who is Alternatives behind? Perl, Java, Python, Zend Technologies PHP Ruby MySQL MySQL/Oracle PostgreSQL, others Apache Software Apache Foundation Lighty (lighttpd), IIS Windows, Solaris, Linux Foundation Linux BSD, others www.fromdual.com 5 History of MySQL Oracle tries to 1995: project started buy MySQL by Monty Widenius, Oct 2005: David Axmark and Oracle buys Allan Larsson Innobase OY InnoDB Friday IPO is announced for 2008 ... 2000 01 02 03 04 2005 06 07 08 09 2010 Jun Jan 2008: Sun buys 2000: MySQL for USD 1000 GPL Mio Apr 2009: Jan 2001: v3.23 2008: Branching Oracle buys GA of MySQL begins Sun for USD 7400 Mio www.fromdual.com
    [Show full text]
  • Data Management Organization Charter
    Large Synoptic Survey Telescope (LSST) Database Design Jacek Becla, Daniel Wang, Serge Monkewitz, K-T Lim, Douglas Smith, Bill Chickering LDM-135 08/02/2013 LSST Database Design LDM-135 08/02/13 Change Record Version Date Description Revision Author 1.0 6/15/2009 Initial version Jacek Becla 2.0 7/12/2011 Most sections rewritten, added scalability test Jacek Becla section 2.1 8/12/2011 Refreshed future-plans and schedule of testing Jacek Becla, sections, added section about fault tolerance Daniel Wang 3.0 8/2/2013 Synchronized with latest changes to the Jacek Becla, requirements (LSE-163). Rewrote most of the Daniel Wang, “Implementation” chapter. Documented new Serge Monkewitz, tests, refreshed all other chapters. Kian-Tat Lim, Douglas Smith, Bill Chickering 2 LSST Database Design LDM-135 08/02/13 Table of Contents 1. Executive Summary.....................................................................................................................8 2. Introduction..................................................................................................................................9 3. Baseline Architecture.................................................................................................................10 3.1 Alert Production and Up-to-date Catalog..........................................................................10 3.2 Data Release Production....................................................................................................13 3.3 User Query Access.............................................................................................................13
    [Show full text]
  • Percona Xtrabackup 2.4 Documentation Release 2.4.20
    Percona XtraBackup 2.4 Documentation Release 2.4.20 Percona LLC and/or its affiliates Apr 14, 2020 CONTENTS I Introduction2 II Installation8 III Prerequisites 16 IV Backup Scenarios 20 V User’s Manual 33 VI Advanced Features 91 VII Tutorials, Recipes, How-tos 100 VIII References 122 IX Indices and tables 149 i Percona XtraBackup 2.4 Documentation, Release 2.4.20 Percona XtraBackup is an open-source hot backup utility for MySQL - based servers that doesn’t lock your database during the backup. It can back up data from InnoDB, XtraDB, and MyISAM tables on MySQL 5.11, 5.5, 5.6 and 5.7 servers, as well as Percona Server for MySQL with XtraDB. For a high-level overview of many of its advanced features, including a feature comparison, please see About Percona XtraBackup. Whether it is a 24x7 highly loaded server or a low-transaction-volume environment, Percona XtraBackup is designed to make backups a seamless procedure without disrupting the performance of the server in a production environment. Commercial support contracts are available. Important: Percona XtraBackup 2.4 does not support making backups of databases created in MySQL 8.0, Percona Server for MySQL 8.0 or Percona XtraDB Cluster 8.0. 1 Support for InnoDB 5.1 builtin has been removed in Percona XtraBackup 2.1 CONTENTS 1 Part I Introduction 2 CHAPTER ONE ABOUT PERCONA XTRABACKUP Percona XtraBackup is the world’s only open-source, free MySQL hot backup software that performs non-blocking backups for InnoDB and XtraDB databases. With Percona XtraBackup, you can achieve the following benefits: • Backups that complete quickly and reliably • Uninterrupted transaction processing during backups • Savings on disk space and network bandwidth • Automatic backup verification • Higher uptime due to faster restore time Percona XtraBackup makes MySQL hot backups for all versions of Percona Server for MySQL, MySQL, and MariaDB.
    [Show full text]
  • System-Versioned Tables
    MariaDB Improvements in the Latest Versions September 14-16, 2020 Sveta Smirnova Sveta Smirnova • MySQL Support Engineer • Author of • MySQL Troubleshooting • JSON UDF functions • FILTER clause for MySQL • Speaker • Percona Live, OOW, Fosdem, DevConf, HighLoad... 2 Table of Contents •Storage Improvements •Optimizer and SQL Improvements 3 2006 Percona Server for MySQL 2008 Sun owns MySQL 2010 Oracle owns Sun and MySQL 2010 MariaDB MySQL 1995 Initial Release by MySQL AB 4 2008 Sun owns MySQL 2010 Oracle owns Sun and MySQL 2010 MariaDB MySQL 1995 Initial Release by MySQL AB 2006 Percona Server for MySQL 4 2010 Oracle owns Sun and MySQL 2010 MariaDB MySQL 1995 Initial Release by MySQL AB 2006 Percona Server for MySQL 2008 Sun owns MySQL 4 2010 MariaDB MySQL 1995 Initial Release by MySQL AB 2006 Percona Server for MySQL 2008 Sun owns MySQL 2010 Oracle owns Sun and MySQL 4 MySQL 1995 Initial Release by MySQL AB 2006 Percona Server for MySQL 2008 Sun owns MySQL 2010 Oracle owns Sun and MySQL 2010 MariaDB 4 • Independent product • Hundreds of unique features • Important improvements are backported • from MySQL MariaDB • Started as fork of MySQL 5 • Hundreds of unique features • Important improvements are backported • from MySQL MariaDB • Started as fork of MySQL • Independent product 5 • Important improvements are backported • from MySQL MariaDB • Started as fork of MySQL • Independent product • Hundreds of unique features 5 MariaDB • Started as fork of MySQL • Independent product • Hundreds of unique features • Important improvements are backported
    [Show full text]
  • The S3 Storage Engine in Mariadb 10.5
    The S3 storage engine in MariaDB 10.5 Michael Widenius CTO @ MariaDB S3 storage engine in MariaDB 10.5 ● Read only tables (perfect for inexpensive archiving or sharing of old data). ● For some organizations S3 storage is cheaper than local storage ● Data and index can optionally be compressed on S3 ● S3 works with MariaDB partitioning for flexible handling of multiple tables ● Very fast, thanks to reading of blocks in big chunks (4M by default) ● Supports all key formats and optimizations that Aria supports ● Data can be accessed by multiple MariaDB servers. Tables are automatically discovered when needed. ● S3 has it’s own configurable page cache ● S3 is also backported to 10.3 and 10.4 MariaDB enterprise server What is Amazon S3 ● Storage of files in the cloud ● Works trough http requests (think get/put of whole files) ● Supports basic functions like list, copy to/from and delete ● Move and rename are implemented as copy + delete of the whole file (not fast) ● Quite slow for small files. Optimal file size for retrial is said to be around 4M. ● Many vendors support storage of files according to the ‘S3 interface’ ● Not really usable for databases who needs to update blocks withing a file. S3 storage ● All files are stored in one of several ‘buckets’ ● Files are stored as objects in a bucket accessed with a key. ● The key may contain ‘/’ and commands like ‘aws ls’ make S3 storage to feel like a file structure, even it it really isn’t. Converting a table to S3 Converting a table to S3: ALTER TABLE old_table ENGINE=S3 And converting back to local: ALTER TABLE table_on_s3 ENGINE=InnoDB Internally the data is first copied to a local Aria table with ROW_FORMAT=PAGE TRANSACTIONAL=0 and then moved to S3.
    [Show full text]