Mysql Globalization Abstract

Total Page:16

File Type:pdf, Size:1020Kb

Mysql Globalization Abstract MySQL Globalization Abstract This is the MySQL Globalization extract from the MySQL 8.0 Reference Manual. For legal information, see the Legal Notices. For help with using MySQL, please visit the MySQL Forums, where you can discuss your issues with other MySQL users. Document generated on: 2021-09-27 (revision: 70895) Table of Contents Preface and Legal Notices ............................................................................................................ v 1 Character Sets, Collations, Unicode ........................................................................................... 1 1.1 Character Sets and Collations in General ........................................................................ 2 1.2 Character Sets and Collations in MySQL ......................................................................... 3 1.2.1 Character Set Repertoire ...................................................................................... 5 1.2.2 UTF-8 for Metadata .............................................................................................. 7 1.3 Specifying Character Sets and Collations ......................................................................... 8 1.3.1 Collation Naming Conventions .............................................................................. 8 1.3.2 Server Character Set and Collation ....................................................................... 9 1.3.3 Database Character Set and Collation ................................................................. 10 1.3.4 Table Character Set and Collation ...................................................................... 11 1.3.5 Column Character Set and Collation ................................................................... 11 1.3.6 Character String Literal Character Set and Collation ............................................. 13 1.3.7 The National Character Set ................................................................................ 14 1.3.8 Character Set Introducers ................................................................................... 15 1.3.9 Examples of Character Set and Collation Assignment .......................................... 17 1.3.10 Compatibility with Other DBMSs ........................................................................ 17 1.4 Connection Character Sets and Collations ..................................................................... 17 1.5 Configuring Application Character Set and Collation ....................................................... 23 1.6 Error Message Character Set ........................................................................................ 25 1.7 Column Character Set Conversion ................................................................................. 26 1.8 Collation Issues ............................................................................................................ 27 1.8.1 Using COLLATE in SQL Statements ................................................................... 27 1.8.2 COLLATE Clause Precedence ............................................................................ 28 1.8.3 Character Set and Collation Compatibility ............................................................ 28 1.8.4 Collation Coercibility in Expressions .................................................................... 28 1.8.5 The binary Collation Compared to _bin Collations ................................................ 30 1.8.6 Examples of the Effect of Collation ..................................................................... 32 1.8.7 Using Collation in INFORMATION_SCHEMA Searches ........................................ 34 1.9 Unicode Support ........................................................................................................... 35 1.9.1 The utf8mb4 Character Set (4-Byte UTF-8 Unicode Encoding) .............................. 37 1.9.2 The utf8mb3 Character Set (3-Byte UTF-8 Unicode Encoding) .............................. 38 1.9.3 The utf8 Character Set (Alias for utf8mb3) ........................................................... 38 1.9.4 The ucs2 Character Set (UCS-2 Unicode Encoding) ............................................ 39 1.9.5 The utf16 Character Set (UTF-16 Unicode Encoding) ........................................... 39 1.9.6 The utf16le Character Set (UTF-16LE Unicode Encoding) .................................... 39 1.9.7 The utf32 Character Set (UTF-32 Unicode Encoding) ........................................... 39 1.9.8 Converting Between 3-Byte and 4-Byte Unicode Character Sets ........................... 40 1.10 Supported Character Sets and Collations ..................................................................... 42 1.10.1 Unicode Character Sets .................................................................................... 43 1.10.2 West European Character Sets ......................................................................... 50 1.10.3 Central European Character Sets ...................................................................... 51 1.10.4 South European and Middle East Character Sets ............................................... 52 1.10.5 Baltic Character Sets ........................................................................................ 53 1.10.6 Cyrillic Character Sets ...................................................................................... 53 1.10.7 Asian Character Sets ........................................................................................ 53 1.10.8 The Binary Character Set ................................................................................. 58 1.11 Restrictions on Character Sets .................................................................................... 59 1.12 Setting the Error Message Language ........................................................................... 59 1.13 Adding a Character Set ............................................................................................... 60 1.13.1 Character Definition Arrays ............................................................................... 62 1.13.2 String Collating Support for Complex Character Sets .......................................... 63 1.13.3 Multi-Byte Character Support for Complex Character Sets .................................. 63 1.14 Adding a Collation to a Character Set .......................................................................... 63 1.14.1 Collation Implementation Types ......................................................................... 64 iii MySQL Globalization 1.14.2 Choosing a Collation ID .................................................................................... 67 1.14.3 Adding a Simple Collation to an 8-Bit Character Set ........................................... 68 1.14.4 Adding a UCA Collation to a Unicode Character Set ........................................... 69 1.15 Character Set Configuration ......................................................................................... 75 1.16 MySQL Server Locale Support .................................................................................... 76 2 MySQL Server Time Zone Support ........................................................................................... 81 iv Preface and Legal Notices This is the MySQL Globalization extract from the MySQL 8.0 Reference Manual. Licensing information—MySQL 8.0. This product may include third-party software, used under license. If you are using a Commercial release of MySQL 8.0, see the MySQL 8.0 Commercial Release License Information User Manual for licensing information, including licensing information relating to third-party software that may be included in this Commercial release. If you are using a Community release of MySQL 8.0, see the MySQL 8.0 Community Release License Information User Manual for licensing information, including licensing information relating to third-party software that may be included in this Community release. Legal Notices Copyright © 1997, 2021, Oracle and/or its affiliates. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error- free. If you find any errors, please report them to us in writing. If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable: U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs) and Oracle computer documentation or other Oracle data delivered to or accessed by U.S. Government end users are "commercial computer software" or "commercial computer software documentation" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, reproduction, duplication,
Recommended publications
  • IBM Unica Campaign: Administrator's Guide to Remove a Dimension Hierarchy
    IBM Unica Campaign Version 8 Release 6 February, 2013 Administrator's Guide Note Before using this information and the product it supports, read the information in “Notices” on page 385. This edition applies to version 8, release 6, modification 0 of IBM Unica Campaign and to all subsequent releases and modifications until otherwise indicated in new editions. © Copyright IBM Corporation 1998, 2013. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Chapter 1. Administration in IBM Unica To view system table contents .......27 Campaign ..............1 Working with user tables ..........28 Campaign-related administrative tasks in IBM Unica About working with user tables ......28 Marketing ...............1 Guidelines for mapping user tables .....28 To access data sources from within a flowchart 29 Chapter 2. Managing security in IBM Working with user tables while editing a flowchart ..............29 Unica Campaign ...........3 Working with user tables from the Campaign About security policies ...........3 Settings page .............30 The global security policy .........3 Working with data dictionaries ........39 How Campaign evaluates permissions.....4 To open a data dictionary.........39 Using the Owner and Folder Owner roles . 4 To apply changes to a data dictionary ....40 Guidelines for designing security policies....5 When to use a data dictionary .......40 Security scenarios.............5 Data dictionary syntax..........40 Scenario 1: Company with a single division . 5 To manually create a new data dictionary . 40 Scenario 2: Company with multiple separate Working with table catalogs .........41 divisions...............7 To access table catalogs .........41 Scenario 3: Restricted access within a division .
    [Show full text]
  • Awk, Perl, Etc
    CNAM, spécialité Informatique NSY116- Multimédia & interaction humain-machine (2008-9) Le texte P. Cubaud <[email protected]> 1. Codes, structures (2. Transport, compression, cryptage) 3. Analyse (4. Synthèse) 5. Présentation Bibliographie B. Habert, C. Fabre, F. Isaac De l’écrit au numérique InterEditions, 1998 I.H. Witten, A. Moffat, T.C. Bell Managing gygabytes. Compressing and indexing documents and images Van Nostrand, 1994 Techniques de l’ingénieur série H. section Document numérique (en ligne au CNAM) R. Laufer, D. Scavetta Texte, hypertexte, hypermédia Que-sais-je n°2629 (v2 1995) 1. Codes - Structures Codage des caractères Trois problèmes : • caractère ≠ glyphe • coder ≠ classer • norme ≠ standard Aussi vieux que le télégraphe… et toujours non résolus. 7 bits : American Standard Code for Information Interchange (ASCII, 1967 - puis ISO646 en 1983) 8 bits : ISO-Latin-XXX (ISO 8859-n) Au delà : Unicode (1990, v3 en 2000) et ISO 10646 = Site web unicode: www.unicode.org Une table à garder en attendant… et un outil : iconv MACCROATIAN [numer:~] pcubaud% iconv -l MACROMANIA ANSI_X3.4-1968 ANSI_X3.4-1986 ASCII CP367 IBM367 ISO-IR-6 ISO646-US ISO_646.IRV:1991 US US-ASCII CSASCII MACCYRILLIC UTF-8 MACUKRAINE ISO-10646-UCS-2 UCS-2 CSUNICODE MACGREEK UCS-2BE UNICODE-1-1 UNICODEBIG CSUNICODE11 MACTURKISH UCS-2LE UNICODELITTLE MACHEBREW ISO-10646-UCS-4 UCS-4 CSUCS4 MACARABIC UCS-4BE MACTHAI UCS-4LE HP-ROMAN8 R8 ROMAN8 CSHPROMAN8 UTF-16 NEXTSTEP UTF-16BE ARMSCII-8 UTF-16LE GEORGIAN-ACADEMY UTF-32 GEORGIAN-PS UTF-32BE KOI8-T UTF-32LE MULELAO-1
    [Show full text]
  • Java Bytecode Manipulation Framework
    Notice About this document The following copyright statements and licenses apply to software components that are distributed with various versions of the OnCommand Performance Manager products. Your product does not necessarily use all the software components referred to below. Where required, source code is published at the following location: ftp://ftp.netapp.com/frm-ntap/opensource/ 215-09632 _A0_ur001 -Copyright 2014 NetApp, Inc. All rights reserved. 1 Notice Copyrights and licenses The following component is subject to the ANTLR License • ANTLR, ANother Tool for Language Recognition - 2.7.6 © Copyright ANTLR / Terence Parr 2009 ANTLR License SOFTWARE RIGHTS ANTLR 1989-2004 Developed by Terence Parr Partially supported by University of San Francisco & jGuru.com We reserve no legal rights to the ANTLR--it is fully in the public domain. An individual or company may do whatever they wish with source code distributed with ANTLR or the code generated by ANTLR, including the incorporation of ANTLR, or its output, into commerical software. We encourage users to develop software with ANTLR. However, we do ask that credit is given to us for developing ANTLR. By "credit", we mean that if you use ANTLR or incorporate any source code into one of your programs (commercial product, research project, or otherwise) that you acknowledge this fact somewhere in the documentation, research report, etc... If you like ANTLR and have developed a nice tool with the output, please mention that you developed it using ANTLR. In addition, we ask that the headers remain intact in our source code. As long as these guidelines are kept, we expect to continue enhancing this system and expect to make other tools available as they are completed.
    [Show full text]
  • The GNU General Public License (GPL) Does Govern All Other Use of the Material That Constitutes the Autoconf Macro
    Notice About this document The following copyright statements and licenses apply to software components that are distributed with various versions of the StorageGRID PreGRID Environment products. Your product does not necessarily use all the software components referred to below. Where required, source code is published at the following location: ftp://ftp.netapp.com/frm-ntap/opensource/ 215-10078_A0_ur001-Copyright 2015 NetApp, Inc. All rights reserved. 1 Notice Copyrights and licenses The following component is subject to the BSD 1.0 • Free BSD - 44_lite BSD 1.0 Copyright (c) 1982, 1986, 1990, 1991, 1993 The Regents of the University of California. All rights reserved. Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met: 1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer. 2. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution. • All advertising materials mentioning features or use of this software must display the following acknowledgement: This product includes software developed by the University of California, Berkeley and its contributors. • Neither the name of the University nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission. THIS SOFTWARE IS PROVIDED BY THE REGENTS AND CONTRIBUTORS ``AS IS'' AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED.
    [Show full text]
  • TDSQL for Mysql Development Guide
    TDSQL for MySQL TDSQL for MySQL Development Guide Product Documentation ©2013-2019 Tencent Cloud. All rights reserved. Page 1 of 58 TDSQL for MySQL Copyright Notice ©2013-2019 Tencent Cloud. All rights reserved. Copyright in this document is exclusively owned by Tencent Cloud. You must not reproduce, modify, copy or distribute in any way, in whole or in part, the contents of this document without Tencent Cloud's the prior written consent. Trademark Notice All trademarks associated with Tencent Cloud and its services are owned by Tencent Cloud Computing (Beijing) Company Limited and its affiliated companies. Trademarks of third parties referred to in this document are owned by their respective proprietors. Service Statement This document is intended to provide users with general information about Tencent Cloud's products and services only and does not form part of Tencent Cloud's terms and conditions. Tencent Cloud's products or services are subject to change. Specific products and services and the standards applicable to them are exclusively provided for in Tencent Cloud's applicable terms and conditions. ©2013-2019 Tencent Cloud. All rights reserved. Page 2 of 58 TDSQL for MySQL Contents Development Guide Overview Use Limits Compatibility Connecting Database Join and Subquery Sequence Frequently Used DML Statements Read/Write Separation Distributed Transaction Creating Tables Connection Protection Subpartitioning Globally Unique Field Exporting/Importing Data Database Management Statements Passthrough SQL Error Codes and Messages Preprocessing ©2013-2019 Tencent Cloud. All rights reserved. Page 3 of 58 TDSQL for MySQL Development Guide Overview Last updated:2021-01-08 17:49:54 TDSQL for MySQL is highly compatible with MySQL protocols and syntax.
    [Show full text]
  • Mysql Globalization Abstract
    MySQL Globalization Abstract This is the MySQL Globalization extract from the MySQL 5.6 Reference Manual. For legal information, see the Legal Notices. For help with using MySQL, please visit the MySQL Forums, where you can discuss your issues with other MySQL users. Document generated on: 2021-09-23 (revision: 70881) Table of Contents Preface and Legal Notices ............................................................................................................ v 1 Character Sets, Collations, Unicode ........................................................................................... 1 1.1 Character Sets and Collations in General ........................................................................ 2 1.2 Character Sets and Collations in MySQL ......................................................................... 3 1.2.1 Character Set Repertoire ...................................................................................... 4 1.2.2 UTF-8 for Metadata .............................................................................................. 6 1.3 Specifying Character Sets and Collations ......................................................................... 7 1.3.1 Collation Naming Conventions .............................................................................. 7 1.3.2 Server Character Set and Collation ....................................................................... 8 1.3.3 Database Character Set and Collation .................................................................. 9 1.3.4 Table
    [Show full text]
  • Proposal for an Armenian Script Root Zone LGR 1 General Information
    Proposal for an Armenian Script Root Zone LGR Version 3 Date: 2015-06-04 1 General information The purpose of this document is to give an overview of the proposed LGR and the rationale behind the design decisions taken. It includes a discussion of relevant features of the script, the communities or languages using it, the process and methodology used and information on the contributors. The formal specification of the LGR can be found in the accompanying XML document (Proposed-LGR-Armn- 20150604.xml). 1.1 Script for which the LGR is proposed Code: Armn N°: 230 English Name: Armenian Property Value Alias: Armenian Date: 2004-05-01 English name of the script: Hye Native name of the script: հայ The Armenian language is an Indo-European language spoken by the Armenians. It is the official language of the Republic of Armenia and the self-proclaimed Nagorno-Karabakh Republic. It has historically been spoken throughout the Armenian Highlands and today is widely spoken in the Armenian Diaspora. Armenian has its own unique script, the Armenian alphabet, invented in 405 AD by Mesrop Mashtots. Linguists classify Armenian as an independent branch of the Indo-European language family. There are two standardized modern literary forms, Eastern Armenian and Western Armenian, with which most contemporary dialects are mutually intelligible. 1 1.2 Principal languages using that script List Language code and name for each (from ISO 639-3) ISO 639-1 hy ISO 639-2 arm (B) hye (T) ISO 639-3 Variously: hye – Modern Armenian xcl – Classical Armenian axm – Middle Armenian Glottolog arme1241 Linguasphere 57-AAA-a 1.3 Geographic territories or countries with significant user communities for the script Official language in Armenia Nagorno-Karabakh Republic Big Diaspora using the Armenian language in Argentina Brazil Cyprus France Georgia (Samtskhe- Javakheti) Hungary Iraq Lebanon Poland Romania Syria Turkey Ukraine United States 2 Uruguay Total Armenian population in the world is about 10mln.
    [Show full text]
  • Armenian Eternity Sign
    Armenian Eternity Sign SYMBOL NAME SHORT NAME, ASSUMED PLACE IN NICK UNICODE ISO 10646 Dingbats Range 2700-27BF ETERNITY SIGN armeternity No proposed position Reason: the range is filled up History Armenian Eternity Sign is the ancient national symbol and in Armenian reality it can be met in many variations. The appearance of the Sign resembles both clockwise and anti-clockwise rotating ornament, which is composed with curves running from center of the symbol. As a rule the Sign should have eight curves, as this number stands for revival, rebirth and recurrence. However, the symbol may be represented with four and more curves as well. Right and left rotations have accordingly active and passive meanings, as in case of Swastika, and are used in order to accentuate these meanings. For example, a cradle for а boy is decorated with the right whirling eternity sign and a cradle for а girl with the left whirling eternity sign. It can be performed both two-dimensionally and three-dimensionally. Eternity Sign opens the list of symbols included in ArmSCII . Armenian Standard Code for Information Interchange, in http://en.wikipedia.org/wiki/ArmSCII Armenian Symbol of Eternity is the direct descendent of the pre-historic Swastika and has clear Armenian interpretation. It symbolizes the identity of Armenian nation suchlike a David’s star for Hebrews. The earliest roots of round whirling sun-like symbols in the Armenian Highland are rock inscriptions from the Stone Age. Ancient Armenian stone pictures (Stone Age) In Armenia the eternity sign can be found everywhere, in architecture; on doors, walls and etc.
    [Show full text]
  • Mysql Globalization Abstract
    MySQL Globalization Abstract This is the MySQL Globalization extract from the MySQL 8.0 Reference Manual. For legal information, see the Legal Notices. For help with using MySQL, please visit the MySQL Forums, where you can discuss your issues with other MySQL users. Document generated on: 2021-09-27 (revision: 70895) Table of Contents Preface and Legal Notices .................................................................................................................. v 1 Character Sets, Collations, Unicode ................................................................................................. 1 1.1 Character Sets and Collations in General .............................................................................. 2 1.2 Character Sets and Collations in MySQL ............................................................................... 3 1.2.1 Character Set Repertoire ........................................................................................... 5 1.2.2 UTF-8 for Metadata ................................................................................................... 7 1.3 Specifying Character Sets and Collations .............................................................................. 8 1.3.1 Collation Naming Conventions .................................................................................... 9 1.3.2 Server Character Set and Collation .......................................................................... 10 1.3.3 Database Character Set and Collation .....................................................................
    [Show full text]
  • Proposal to Add an Armenian Eternity Sign to The
    Universal Multiple-Octet Coded Character Set International Organization for Standardization Organisation Internationale de Normalisation Международная организация по стандартизации Doc Type: Working Group Document Title: Proposal to add an Armenian Eternity Sign to the UCS Author: Karl Pentzlin Status: Individual Contribution Action: For consideration by JTC1/SC2/WG2 and UTC Date: 2010-09-24 1. Introduction The addition of the Eternity Sign to the UCS was requested twice until now by the Armenian National Standard body. The request contained in N3824-SARM could not be accepted as the Armenian NB then did not accompany its request by a formal proposal. Thus, the request was rejected as documented in N3827. N3921 shows a new request, now presenting more evidence of use. One sample shows use in printed text (see fig. 1). However, a formal proposal is at least not referenced in N3921. This proposal intends to fill this gap, thus the Armenian request can be considered without having to reject it on formal reasons only. The text specimen in N3921 shows the use of the Eternity Sign as a fleuron. As symbols with similar use are encoded, the Eternity Sign is considered to be a valid character on this base. 2. Additional information beyond N3921 The Eternity Sign is contained at least in the following Armenian 7-bit and 8-bit encoding standards, according to http://en.wikipedia.org/wiki/ArmSCII as of 2010-09-24: AST 34.005:1997 (ArmSCII-7) (see fig. 3) AST 34.002:1997 (ArmSCII-8) (see fig. 3) AST 34.001:1997 (ArmSCII-8A) Therefore, it is needed for round trip compatibility to these existing standards predating the widespread use of Unicode.
    [Show full text]
  • War of the Keyboards
    Chapter 1: War of the Keyboards Chapter 1: War of the Keyboards Learning from mistakes is a good thing, Teaching mistakes is fooling around. QWERTY, The Sequel After two decades of neglect for the Armenian language support in the Windows operating systems series, Microsoft finally included the minimal support in their January 2007 release of their new Windows Vista operating systems. It is ironic how Microsoft has again introduced the inevitable sequel of an old scandal whereby a standard is created for the purpose to de-standardize the obvious. Let me make myself clear. In Windows Vista, not only do we have a keyboard for the Armenian language, but thanks to the generosity of Microsoft Corp., we now have two keyboards, namely, Western Armenian and Eastern Armenian keyboards. Did you get the point? Western Armenian keyboard to be used for the Western dialect, while the Eastern Armenian keyboard for the Eastern dialect. It may make sense, if it were not the fact that both dialects use precisely the same character sets. So why is Microsoft trying to confuse us by artificially creating a wedge between the Armenian users? I can only doubt an answer in the realms of two extremes, that of ignorance and that of carelessness wherever the commercial strategy radar does not blink. The real scandal however, is not so much of the confusion of the concept of dialects of a natural language with their common character set encoding mechanization, but rather the fact that both of these Microsoft keyboard drivers assume that QWERTY ergonomics fits the Armenian language typing like a glove.
    [Show full text]
  • Unicode for Linguists
    Unicode for Linguists Kevin Scannell INNET Summer School Gniezno, Poland 4 September 2013 Encoding basics ● Encoding: a mapping characters ↔ numbers ● Computers are good at storing numbers! ● Encodings don't care how chars are input ● Also not concerned with how they're displayed ● No fonts, formatting, boldface, etc. – just text! ● “Modularity”; three independent layers ● Confusion in part b/c it was not always so ● (keyboards and fonts bundled together) Fonts ● Again, correctly-encoded text stands on its own ● Sure, fonts let you to render text on the screen ● But you have good wide-coverage fonts already ● There are some exceptions of course: ● I I I I I I I I I I I I I I I I ● And some fonts are buggy... ● Especially stacked diacritics, ligatures The Joy of Text ● Unicode encodes “plain text” (and no more) ● Plain text is portable across platforms ● Plain text is long-lived ● Plain text is the ultimate “open” format ● Plain text is indexed by Google, “discoverable” ● No proprietary tools needed to manipulate text ● Plain text is easily viewable, editable ● Allows you to bring powerful Unix tools to bear ● Even marked-up text like XML counts! Encodings: Some History ● ASCII (1963); A-Za-z, 0-9, etc., map to 0-127 ● EBCDIC (1964); mapping to 0-255 (w/ gaps) ● ISO 8859 series (1987-); 0-255, extend ASCII ● Big5 (1984); traditional Chinese ● Shift JIS; Japanese ● GB2312/18030; simplified Chinese ● Literally hundreds of others ● Why was this so terrible? Alphabet soup IBM1124, CP424, ISO_10367-BOX, ECMA-128, ISO8859-1, KOI-7, CSIBM1137,
    [Show full text]