Revised Proposal to Disunify U+5F50 Table of Contents
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Building a Collation Element Table for a Large Chinese Character Set in YES
Building a Collation Element Table for a Large Chinese Character Set in YES Xiaoheng Zhang1 and Xiaotong Li2 1 Department of Chinese and Bilingual Studies, Hong Kong Polytechnic University [email protected] 2 College of International Exchange, Shenzhen University [email protected] Abstract. YES is a simplified stroke-based method for sorting Chinese characters. It is free from stroke counting and grouping, and thus much faster and more accurate than the traditional method. This paper presents a collation element table built in YES for a large joint Chinese character set covering (a) all 20,902 characters of Unicode CJK Unified Ideographs, (b) all 11,408 characters in the Complete List of Chinese Characters Used by the Media in 2013, (c) all 13,000 plus characters in the latest versions of Xinhua Dictionary(v11) and Contemporary Chinese Dictionary(v6). Of the 20,902 Chinese characters in Unicode, 97.23% have one-to-one relationship with their stroke order codes in YES, comparing with 90.69% of the traditional method. Enhanced with the secondary and tertiary sorting levels of stroke layout and Unicode value, there is a guarantee of one-to-one relationship between the characters and collation elements. The collation element table has been successfully applied to sorting CC-CEDICT, a Chinese-English dictionary of over 112,000 word entries. Keywords: Chinese characters, collation, Unicode, YES 1 Introduction Collation, or determining the sorting order of strings of characters, is a key function in computer systems and a basic need of the human society. Whenever a list of texts—such as the records of a database and the entries of a dictionary—is presented to users, they are likely to want it in a sorted order so that they can easily and reliably find their target words. -
Assessment of Options for Handling Full Unicode Character Encodings in MARC21 a Study for the Library of Congress
1 Assessment of Options for Handling Full Unicode Character Encodings in MARC21 A Study for the Library of Congress Part 1: New Scripts Jack Cain Senior Consultant Trylus Computing, Toronto 1 Purpose This assessment intends to study the issues and make recommendations on the possible expansion of the character set repertoire for bibliographic records in MARC21 format. 1.1 “Encoding Scheme” vs. “Repertoire” An encoding scheme contains codes by which characters are represented in computer memory. These codes are organized according to a certain methodology called an encoding scheme. The list of all characters so encoded is referred to as the “repertoire” of characters in the given encoding schemes. For example, ASCII is one encoding scheme, perhaps the one best known to the average non-technical person in North America. “A”, “B”, & “C” are three characters in the repertoire of this encoding scheme. These three characters are assigned encodings 41, 42 & 43 in ASCII (expressed here in hexadecimal). 1.2 MARC8 "MARC8" is the term commonly used to refer both to the encoding scheme and its repertoire as used in MARC records up to 1998. The ‘8’ refers to the fact that, unlike Unicode which is a multi-byte per character code set, the MARC8 encoding scheme is principally made up of multiple one byte tables in which each character is encoded using a single 8 bit byte. (It also includes the EACC set which actually uses fixed length 3 bytes per character.) (For details on MARC8 and its specifications see: http://www.loc.gov/marc/.) MARC8 was introduced around 1968 and was initially limited to essentially Latin script only. -
Alan Ng Systems Librarian the Chinese University of Hong Kong Library Agenda
Enhancing Chinese character normalization in Primo with the HKIUG TSVCC mapping table Alan Ng Systems Librarian The Chinese University of Hong Kong Library Agenda ❖ Primo out-of-box character normalization ❖ Background on CJK normalization ❖ HKIUG TSVCC mapping table ❖ Implementing TSVCC on Primo About CUHK Library ❖ established in 1963 ❖ 7 branches ❖ 200 staff ❖ 260K current patrons ❖ 130K journal subscriptions, 4.5M ebooks, 2.5M printed volumes ❖ special collections includes from oracles bones, Chinese rare books, modern Chinese literary archives … character normalization ❖ different people type differently ❖ normal to expect “Apple” will have the exact results from “aPPLE”, “ApPle”, “appLE” … ❖ before indexing, Primo will first “clean up” (normalize) the data to its lower case (e.g. A —> a, B —> b …) ❖ Primo FE will do the same for the search term typed by users, to get a match with the index Primo out-of-box normalizations ❖ Primo provides OTB normalizations for different languages at: ❖ /exlibris/primo/p4_1/ng/jaguar/home/profile/ analysis/specialCharacters/CharConversion/OTB/ OTB ❖ e.g. ❖ latin languages (non_cjk_unicode_normalization.txt) ❖ CJK (cjk_unicode_trad_to_simp_normalization.txt) OTB CJK normalization table ❖ 2700+ entries ❖ mainly for mapping Traditional Chinese into its Simplified form ❖ assume it is a 1:1 mapping, Simplified Chinese being the “lowercase” like the English language ❖ But in fact, Simplified Chinese is only one kind of variant form for Chinese character ❖ other variant forms (ideograph) of the same character need to be cover as well extract of the OTB table background on CJK ❖ Traditional Chinese characters have been used since as early as 2nd centuryBC (Han Dynasty, 漢朝) ❖ used by people in Taiwan, Hong Kong and Macau ❖ Simplified Chinese characters were introduced by PRC government during 1950’s ❖ used by people in PRC, SE Asia countries e.g. -
1. Introduction
ISO/IEC JTC1/SC2/WG2 N3643 L2/09-171 2009-04-30 Universal Multiple-Octet Coded Character Set International Organization for Standardization Organisation Internationale de Normalisation Международная организация по стандартизации Doc Type: Working Group Document Title: Proposal to redefine the scope of Ideographic Description Sequences and to encode four additional Ideographic Description Characters Source: Andrew West Status: Individual Contribution Action: For consideration by JTC1/SC2/WG2 and UTC Date: 2009-04-30 1. Introduction This is a proposal to redefine the scope of Ideographic Description Sequences (IDS) to cover non-Han scripts (see Section 3), and also to encode four new Ideographic Description Characters (IDC) in order to represent IDS sequences in non-Han scripts (see Section 2). 1.1 Current Definition of IDS Sequences The Unicode Standard 5.1 section 12.2 defines Ideographic Description Sequences as follows: Ideographic Description Sequences. Ideographic Description Sequences are defined by the following grammar. The list of characters associated with the Unified_CJK_Ideograph and CJK_Radical properties can be found in the Unicode Character Database. See Appendix A, Notational Conventions , for the notational conventions used here. IDS := Unified_CJK_Ideograph | CJK_Radical | IDS_BinaryOperator IDS IDS | IDS_TrinaryOperator IDS IDS IDS IDS_BinaryOperator := U+2FF0 | U+2FF1 | U+2FF4 | U+2FF5 | U+2FF6 | U+2FF7 | U+2FF8 | U+2FF9 | U+2FFA | U+2FFB IDS_TrinaryOperator := U+2FF2 | U+2FF3 This definition is also echoed in ISO/IEC 10646:2003 Annex F.3.1: F.3.1 Syntax of an ideographic description sequence An IDS consists of an IDC followed by a fixed number of Description Components (DC). A DC may be any one of the following : - a coded ideograph - a coded radical - another IDS NOTE 1 – The above description implies that any IDS may be nested within another IDS. -
Proste Unikodne Vektorske Pisave
Proste unikodne vektorske pisave Primozˇ Peterlin Univerza v Ljubljani, Medicinska fakulteta, Institutˇ za biofiziko Lipiceˇ va 2, 1000 Ljubljana primoz.peterlin@biofiz.mf.uni-lj.si Povzetek Predstavljen je projekt prostih unikodnih vektorskih pisav. Uvodoma predstavimo stanje s pisavami v prostih programskih okoljih in motive za izdelavo prostih pisav. Osrednji del prispevka je namenjen opisu zasnove tipografije, ki vkljucujeˇ pismenke iz razlicnihˇ pisav. Sledi opis razlogov, zakaj je OpenType najboljsaˇ trenutno dostopna tehnologija. Zakljucimoˇ s pregledom stanja projekta in nacrtiˇ za delo v prihodnje. 1. Uvod se porajajo tako v akademskih jezikoslovnih krogih kot tudi “na terenu”, torej v okoljih, kjer ziˇ vijo govorci jezikov, ki Prosti operacijski sistemi, kot so GNU/Linux ter sistemi te pismenke uporabljajo. FreeBSD, OpenBSD in NetBSD, izhajajociˇ iz BSD Unixa, so od sistema Unix podedovali stihijsko obravnavanje pi- 1.1. Znaki in pismenke sav. Tako graficniˇ sistem X Window System uporablja svojo Standard ISO10646/Unicode (Unicode Consortium, obliko zapisa pisav, terminalski nacinˇ svojo, stavni program 2000) izrecno locujeˇ med “znaki” (angl. character) in “pi- T X pa spet svoje. Krajevna prilagoditev (lokalizacija) ta- E smenkami” (angl. glyph): “Characters reside only in the kih sistemov je zato po nepotrebnem bolj zapletena, kot bi machine, as strings in memory or on disk, in the backing bilo nujno potrebno, saj je treba poskrbeti za vsakega od store. The Unicode standard deals only with character locenihˇ podsistemov posebej. codes. In contrast to characters, glyphs appear on the Boljsaˇ resiteˇ v je uporaba enotne oblike zapisa pisave, screen or paper as particular representation of one or more ki ga uporabljajo vsi programi za prikaz pismenk na za- backing store characters. -
Glyphs in Font Noto Sans CJK TC (Notosanscjktc-Regular.Otf from Noto-Hinted)
Glyphs in font Noto Sans CJK TC (NotoSansCJKtc-Regular.otf from Noto-hinted) asic !atin" #$%%%%-%%&' #$%%(%-)' *+,-./()0$"-.1%2()345&6789:;<= #$%%3%-4' >? C@A'GHCJK!DNEFGRSTUHIJKLMNOPQ #$%%5%-&' RaScdefghiTUlmnopqrstuWXYyZ[\]^ !atin-2 Supplement" #$%%6%-%%'' #$%%?%- ' _`abcdefghijklmnopqrstuvwxyz{| #$%%C%-@' }~ÂÃÄÅÆÇÈÉÊËÌÍÎÏÐÑÒÓÔÕÖרÙÚÛÜÝÞß #$%%A%-'' àáâã¡¢£¤¥¦§¨©ª«¬®¯ó±²³÷ø¶·¸¹º»¼ !atin AYtended-?" #$%2%%-%2&' #$%2%%-2' ½ā¿ă ÁÂÃÄ ÅÆ #$%2(%-)' ÇÈĪÊ #$%23%-4' Ëń ÍÎ ÏÐŎŏ Œœ #$%25%-&' ŨũŪūŬŭ !atin AYtended- " #$%26%-%(3' #$%26%-7' ƒ #$%2?%- ' Ơơ Ưư #$%2C%-@' ǍáǏãǑǒǓǔèéêëǙǚǛǜ #$%2A%-'' Ǹñ CF? AYtensions" #$%(4%-%(?' #$%(4%-5' ɑ ɡ Spacing Dodifier !etters" #$%( %-%('' #$%( %-C' ˇ ˉˊˋ #$%(@%-A' ˙ GreeU and Coptic, #$%)&%-%)'' #$%)7%-?' úûΓΔΕΖΗΘΙΚΛΜΝΞΟΠΡ ΣΤΥΦΧΨΩ #$%) %-C' αβγδεζηθικλμν !"# $%&'()* Cyrillic, #$%3%%-%3'' #$%3%%-2' + ,-./0123456789:; #$%3(%-)' <=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[ #$%33%-4' \]^_`abcdefghijk l Noto Sans CJK TC 2 Bangul Jamo" #$22%%-22'' #$22%%-2' ᄀᄁᄂᄃᄄᄅᄆᄇᄈᄉᄊᄋᄌᄍᄎᄏᄐᄑᄒᄓᄔᄕᄖᄗᄘᄙᄚᄛᄜᄝᄞᄟ #$22(%-)' ᄠᄡᄢᄣᄤᄥᄦᄧᄨᄩᄪᄫᄬᄭᄮᄯᄰᄱᄲᄳᄴᄵᄶᄷᄸᄹᄺᄻᄼᄽᄾᄿ #$223%-4' ᅀᅁᅂᅃᅄᅅᅆᅇᅈᅉᅊᅋᅌᅍᅎᅏᅐᅑᅒᅓᅔᅕᅖᅗᅘᅙᅚᅛᅜᅝᅞᅟ #$225%-&' ᅠᅡᅢᅣᅤᅥᅦᅧᅨᅩᅪᅫᅬᅭᅮᅯᅰᅱᅲᅳᅴᅵᅶᅷᅸᅹᅺᅻᅼᅽᅾᅿ #$226%-7' ᆀᆁᆂᆃᆄᆅᆆᆇᆈᆉᆊᆋᆌᆍᆎᆏᆐᆑᆒᆓᆔᆕᆖᆗᆘᆙᆚᆛᆜᆝᆞᆟ #$22?%- ' ᆠᆡᆢᆣᆤᆥᆦᆧᆨᆩᆪᆫᆬᆭᆮᆯᆰᆱᆲᆳᆴᆵᆶᆷᆸᆹᆺᆻᆼᆽᆾᆿ #$22C%-@' ./0123456789:;<=>?@ABCDEFGHIJKLM #$22A%-'' NOPQRSTUVWXYZ[\]^_`abcdefghijklm !atin AYtended ?dditional" #$2A%%-2A'' #$2A(%-)' no #$2A?%- ' pqrstuvwxyz{|}~ắẰằẲẳẴẵẶặẸẹẺẻẼẽẾế #$2AC%-@' ỀềỂểỄễỆệỈỉỊịỌọỎỏỐ¡¢£¤¥¦§¨©ª«¬®¯ #$2AA%-'' Ỡ±²³´ụ¶·¸¹º»¼½Ữ¿ỰÁÂÃÄÅÆÇÈỹ General Functuation" #$(%%%-(%5' #$(%%%-2' ÊË ‐-ÍÍÎÏÐ ‘’‚ “”„ #$(%(%-)' -
Section 18.1, Han
The Unicode® Standard Version 13.0 – Core Specification To learn about the latest version of the Unicode Standard, see http://www.unicode.org/versions/latest/. Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and the publisher was aware of a trade- mark claim, the designations have been printed with initial capital letters or in all capitals. Unicode and the Unicode Logo are registered trademarks of Unicode, Inc., in the United States and other countries. The authors and publisher have taken care in the preparation of this specification, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein. The Unicode Character Database and other files are provided as-is by Unicode, Inc. No claims are made as to fitness for any particular purpose. No warranties of any kind are expressed or implied. The recipient agrees to determine applicability of information provided. © 2020 Unicode, Inc. All rights reserved. This publication is protected by copyright, and permission must be obtained from the publisher prior to any prohibited reproduction. For information regarding permissions, inquire at http://www.unicode.org/reporting.html. For information about the Unicode terms of use, please see http://www.unicode.org/copyright.html. The Unicode Standard / the Unicode Consortium; edited by the Unicode Consortium. — Version 13.0. Includes index. ISBN 978-1-936213-26-9 (http://www.unicode.org/versions/Unicode13.0.0/) 1. -
EDA095 Extensible Markup Language Character Sets Unicode
Character Sets EDA095 eXtensible Markup Language Codes are used to represent characters. ASCII has 0 to 127 code points and is only for English Latin-1 extends it to 256 code points. It can be used for most Western Pierre Nugues European languages but forgot many characters, like the French Œ, œ, the German quote ,, or the Dutch IJ, ij. Lund University http://cs.lth.se/pierre_nugues/ It is not adopted by all the operating systems, MacOS for instance April 7, 2011 Pierre Nugues EDA095 eXtensible Markup Language April 7, 2011 1 / 63 Pierre Nugues EDA095 eXtensible Markup Language April 7, 2011 2 / 63 Unicode Unicode Blocks (Simplified) Unicode is an attempt to represent most alphabets. From Programming Perl by Larry Wall,Tom Christiansen,Jon Orwant, Code Name Code Name O’Reilly, 2000: U+0000 Basic Latin U+1400 Unified Canadian Aboriginal Syllabic If you don’t know yet what Unicode is, you will soon—even if U+0080 Latin-1 Supplement U+1680 Ogham, Runic you skip reading this chapter—because working with Unicode is U+0100 Latin Extended-A U+1780 Khmer U+0180 Latin Extended-B U+1800 Mongolian becoming a necessity. U+0250 IPA Extensions U+1E00 Latin Extended Additional U+02B0 Spacing Modifier Letters U+1F00 Extended Greek It started with 16 bits and has now uses 32 bits. U+0300 Combining Diacritical Marks U+2000 Symbols The standard character representation in many OSes and programming U+0370 Greek U+2800 Braille Patterns languages, including Java U+0400 Cyrillic U+2E80 CJK Radicals Supplement Characters have a code point and a name as U+0530 Armenian -
十六shí Liù Sixteen / 16 二八èr Bā 16 / Sixteen 和hé Old Variant of 和/ [He2
十六 shí liù sixteen / 16 二八 èr bā 16 / sixteen 和 hé old variant of 和 / [he2] / harmonious 子 zǐ son / child / seed / egg / small thing / 1st earthly branch: 11 p.m.-1 a.m., midnight, 11th solar month (7th December to 5th January), year of the Rat / Viscount, fourth of five orders of nobility 亓 / 等 / 爵 / 位 / [wu3 deng3 jue2 wei4] 动 dòng to use / to act / to move / to change / abbr. for 動 / 詞 / |动 / 词 / [dong4 ci2], verb 公 gōng public / collectively owned / common / international (e.g. high seas, metric system, calendar) / make public / fair / just / Duke, highest of five orders of nobility 亓 / 等 / 爵 / 位 / [wu3 deng3 jue2 wei4] / honorable (gentlemen) / father-in 两 liǎng two / both / some / a few / tael, unit of weight equal to 50 grams (modern) or 1&frasl / 16 of a catty 斤 / [jin1] (old) 化 huà to make into / to change into / -ization / to ... -ize / to transform / abbr. for 化 / 學 / |化 / 学 / [hua4 xue2] 位 wèi position / location / place / seat / classifier for people (honorific) / classifier for binary bits (e.g. 十 / 六 / 位 / 16-bit or 2 bytes) 乎 hū (classical particle similar to 於 / |于 / [yu2]) in / at / from / because / than / (classical final particle similar to 嗎 / |吗 / [ma5], 吧 / [ba5], 呢 / [ne5], expressing question, doubt or astonishment) 男 nán male / Baron, lowest of five orders of nobility 亓 / 等 / 爵 / 位 / [wu3 deng3 jue2 wei4] / CL:個 / |个 / [ge4] 弟 tì variant of 悌 / [ti4] 伯 bó father's elder brother / senior / paternal elder uncle / eldest of brothers / respectful form of address / Count, third of five orders of nobility 亓 / 等 / 爵 / 位 / [wu3 deng3 jue2 wei4] 呼 hū variant of 呼 / [hu1] / to shout / to call out 郑 Zhèng Zheng state during the Warring States period / surname Zheng / abbr. -
The Unicode Standard, Version 4.0--Online Edition
This PDF file is an excerpt from The Unicode Standard, Version 4.0, issued by the Unicode Consor- tium and published by Addison-Wesley. The material has been modified slightly for this online edi- tion, however the PDF files have not been modified to reflect the corrections found on the Updates and Errata page (http://www.unicode.org/errata/). For information on more recent versions of the standard, see http://www.unicode.org/standard/versions/enumeratedversions.html. Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and Addison-Wesley was aware of a trademark claim, the designations have been printed in initial capital letters. However, not all words in initial capital letters are trademark designations. The Unicode® Consortium is a registered trademark, and Unicode™ is a trademark of Unicode, Inc. The Unicode logo is a trademark of Unicode, Inc., and may be registered in some jurisdictions. The authors and publisher have taken care in preparation of this book, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein. The Unicode Character Database and other files are provided as-is by Unicode®, Inc. No claims are made as to fitness for any particular purpose. No warranties of any kind are expressed or implied. The recipient agrees to determine applicability of information provided. Dai Kan-Wa Jiten used as the source of reference Kanji codes was written by Tetsuji Morohashi and published by Taishukan Shoten. -
Wg2 N5069r & L2/19-212R
ISO/IEC JTC1/SC2/WG2 N5069R L2/19-212R Universal Multiple-Octet Coded Character Set International Organization for Standardization Doc Type: Working Group Document Title: Proposal to change the font for the CJK Radicals Supplement & Kangxi Radicals blocks Source: Ken Lunde, Adobe Inc. Date: 2019-06-20 (revised) This proposal raises issues in two CJK-related blocks, and proposes a solution that involves using a new font for their representative glyphs. As a result, the CJK Radicals Supplement and Kangxi Radicals blocks will become more correct/consistent and region-agnostic, respectively. Code Chart Issues There have been recent reports of issues affecting the representative glyphs in the CJK Radi- cals Supplement and Kangxi Radicals blocks, such as L2/19-175 that points out an issue with the representative glyph for U+2F2A KANGXI RADICAL LAME—it should look like ⼪. Jaemin Chung also pointed out on the Unihan⼪ mailing list that the representative glyphs for U+2E93 CJK RADICAL THREAD and U+2F33 KANGXI RADICAL SHORT THREAD are identical—the representative⺓ glyph for the latter should⺓ look like ⼳. According to the original proposal, L2/98-332 (aka SC2 N3213), there are several errors or in- consistencies in the current code charts for these blocks, beyond what was indicated in the paragraph above: • The representative glyphs in the entire Kangxi Radicals block follow modern Chinese con- ventions, specifically those for China (PRC). The representative glyph for U+2FAE KANGXI RADICAL WRONG—ironic character name, by the way—is perhaps the most illustrative⾮ ex- ample, because no other Chinese-speaking region—perhaps other than Singapore—uses this particular form. -
The Unicode Standard, Version 3.0, Issued by the Unicode Consor- Tium and Published by Addison-Wesley
The Unicode Standard Version 3.0 The Unicode Consortium ADDISON–WESLEY An Imprint of Addison Wesley Longman, Inc. Reading, Massachusetts · Harlow, England · Menlo Park, California Berkeley, California · Don Mills, Ontario · Sydney Bonn · Amsterdam · Tokyo · Mexico City Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and Addison-Wesley was aware of a trademark claim, the designations have been printed in initial capital letters. However, not all words in initial capital letters are trademark designations. The authors and publisher have taken care in preparation of this book, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein. The Unicode Character Database and other files are provided as-is by Unicode®, Inc. No claims are made as to fitness for any particular purpose. No warranties of any kind are expressed or implied. The recipient agrees to determine applicability of information provided. If these files have been purchased on computer-readable media, the sole remedy for any claim will be exchange of defective media within ninety days of receipt. Dai Kan-Wa Jiten used as the source of reference Kanji codes was written by Tetsuji Morohashi and published by Taishukan Shoten. ISBN 0-201-61633-5 Copyright © 1991-2000 by Unicode, Inc. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording or other- wise, without the prior written permission of the publisher or Unicode, Inc.