Unicode-HOWTO.Pdf

Total Page:16

File Type:pdf, Size:1020Kb

Unicode-HOWTO.Pdf The Unicode HOWTO The Unicode HOWTO Table of Contents The Unicode HOWTO........................................................................................................................................1 Bruno Haible, <haible@clisp.cons.org>.................................................................................................1 1. Introduction..........................................................................................................................................1 2. Display setup........................................................................................................................................1 3. Locale setup.........................................................................................................................................1 4. Specific applications............................................................................................................................1 5. Printing.................................................................................................................................................2 6. Making your programs Unicode aware................................................................................................2 7. Other sources of information...............................................................................................................2 1. Introduction..........................................................................................................................................2 1.1 Why Unicode?...................................................................................................................................2 1.2 Unicode encodings.............................................................................................................................3 Footnotes for C/C++ developers.................................................................................................4 1.3 Related resources...............................................................................................................................4 2. Display setup........................................................................................................................................5 2.1 Linux console.....................................................................................................................................5 2.2 X11 Foreign fonts..............................................................................................................................6 2.3 X11 Unicode fonts.............................................................................................................................6 2.4 Unicode xterm....................................................................................................................................7 2.5 TrueType fonts...................................................................................................................................8 2.6 Miscellaneous....................................................................................................................................9 3. Locale setup.........................................................................................................................................9 3.1 Files & the kernel...............................................................................................................................9 3.2 Upgrading the C library...................................................................................................................10 3.3 General data conversion...................................................................................................................10 3.4 Locale environment variables..........................................................................................................11 3.5 Creating the locale support files......................................................................................................12 4. Specific applications..........................................................................................................................12 4.1 Shells................................................................................................................................................12 bash...........................................................................................................................................12 4.2 Networking......................................................................................................................................12 telnet..........................................................................................................................................12 kermit........................................................................................................................................13 4.3 Browsers..........................................................................................................................................13 Netscape....................................................................................................................................13 Mozilla......................................................................................................................................13 Amaya.......................................................................................................................................13 lynx...........................................................................................................................................14 w3m..........................................................................................................................................14 Test pages.................................................................................................................................15 4.4 Editors..............................................................................................................................................15 yudit..........................................................................................................................................15 yudit−1.5...................................................................................................................................15 yudit−2.1...................................................................................................................................15 Fonts for yudit...........................................................................................................................15 vim............................................................................................................................................15 cooledit......................................................................................................................................16 emacs........................................................................................................................................16 i The Unicode HOWTO Table of Contents xemacs......................................................................................................................................19 nedit..........................................................................................................................................19 xedit..........................................................................................................................................19 axe.............................................................................................................................................20 pico............................................................................................................................................20 mined98....................................................................................................................................20 qemacs......................................................................................................................................20 4.5 Mailers.............................................................................................................................................20 pine............................................................................................................................................21 kmail.........................................................................................................................................21 Netscape Communicator...........................................................................................................21 emacs (rmail, vm).....................................................................................................................22 mutt...........................................................................................................................................22 exmh..........................................................................................................................................22 4.6 Text processing................................................................................................................................22 groff..........................................................................................................................................22 TeX...........................................................................................................................................22
Recommended publications
  • SLP-5 Setup for Uni-3/5/7 & WM-Nano Chinese BIG5 Characters
    SLP-5 Configuration for Uni-3, Uni-5, Uni-7 & WM-Nano Chinese BIG5 Characters The Uni-3, Uni-5, Uni-7 scales and WM-Nano wrapper can display and print PLU information in Chinese BIG5, also known as Traditional, characters but all menus, etc. remain in English. Chinese characters are entered in SLP-5 and sent to the scales. Chinese characters cannot be entered at the scales. Refer to the following procedure to configure the scales and wrapper and SLP-5. SCALE SETUP Update the firmware for the Uni-5, Uni-7 and WM-Nano to the following versions. Uni-5: C1830x Uni-7: C1828x (PK-260A CF CPU), C2072x (PK-260B SD CPU) WM-Nano: C1832x (PK-260A CF CPU), C2074x (PK-260B SD CPU) Uni-3: C1937U or later, C2271x The Language setting in the Uni-3 must be set to print and display Chinese characters. Note: Only the Uni-3L2 models display Chinese characters. KEY IN ITEM No. Enter 6000, press MODE 0.000 0.000 0.00 0.00 <B00 SETUP> Enter 495344, press PLU <B00 SETUP> <B00 SETUP> Enter 26, press Down Arrow <B00 SETUP> B26 COUNTRY Press ENTER B26 COUNTRY *LANGUAGE 1:ENGLISH Enter 15, press ENTER B26-01-02 LANGUAGE 1 *LANGUAGE 15:FORMOSAN After the long beep press MODE B26-01-02 LANGUAGE 15 REBOOT Shut off the scale for this setting change to 19004-0000 take effect. SLP-5 SETUP SLP-5 must be configured to use Chinese fonts. Refer to the instructions below. The following Chinese character sizes are available.
    [Show full text]
  • Ubuntu Kung Fu
    Prepared exclusively for Alison Tyler Download at Boykma.Com What readers are saying about Ubuntu Kung Fu Ubuntu Kung Fu is excellent. The tips are fun and the hope of discov- ering hidden gems makes it a worthwhile task. John Southern Former editor of Linux Magazine I enjoyed Ubuntu Kung Fu and learned some new things. I would rec- ommend this book—nice tips and a lot of fun to be had. Carthik Sharma Creator of the Ubuntu Blog (http://ubuntu.wordpress.com) Wow! There are some great tips here! I have used Ubuntu since April 2005, starting with version 5.04. I found much in this book to inspire me and to teach me, and it answered lingering questions I didn’t know I had. The book is a good resource that I will gladly recommend to both newcomers and veteran users. Matthew Helmke Administrator, Ubuntu Forums Ubuntu Kung Fu is a fantastic compendium of useful, uncommon Ubuntu knowledge. Eric Hewitt Consultant, LiveLogic, LLC Prepared exclusively for Alison Tyler Download at Boykma.Com Ubuntu Kung Fu Tips, Tricks, Hints, and Hacks Keir Thomas The Pragmatic Bookshelf Raleigh, North Carolina Dallas, Texas Prepared exclusively for Alison Tyler Download at Boykma.Com Many of the designations used by manufacturers and sellers to distinguish their prod- ucts are claimed as trademarks. Where those designations appear in this book, and The Pragmatic Programmers, LLC was aware of a trademark claim, the designations have been printed in initial capital letters or in all capitals. The Pragmatic Starter Kit, The Pragmatic Programmer, Pragmatic Programming, Pragmatic Bookshelf and the linking g device are trademarks of The Pragmatic Programmers, LLC.
    [Show full text]
  • Linux on the Road
    Linux on the Road Linux with Laptops, Notebooks, PDAs, Mobile Phones and Other Portable Devices Werner Heuser <wehe[AT]tuxmobil.org> Linux Mobile Edition Edition Version 3.22 TuxMobil Berlin Copyright © 2000-2011 Werner Heuser 2011-12-12 Revision History Revision 3.22 2011-12-12 Revised by: wh The address of the opensuse-mobile mailing list has been added, a section power management for graphics cards has been added, a short description of Intel's LinuxPowerTop project has been added, all references to Suspend2 have been changed to TuxOnIce, links to OpenSync and Funambol syncronization packages have been added, some notes about SSDs have been added, many URLs have been checked and some minor improvements have been made. Revision 3.21 2005-11-14 Revised by: wh Some more typos have been fixed. Revision 3.20 2005-11-14 Revised by: wh Some typos have been fixed. Revision 3.19 2005-11-14 Revised by: wh A link to keytouch has been added, minor changes have been made. Revision 3.18 2005-10-10 Revised by: wh Some URLs have been updated, spelling has been corrected, minor changes have been made. Revision 3.17.1 2005-09-28 Revised by: sh A technical and a language review have been performed by Sebastian Henschel. Numerous bugs have been fixed and many URLs have been updated. Revision 3.17 2005-08-28 Revised by: wh Some more tools added to external monitor/projector section, link to Zaurus Development with Damn Small Linux added to cross-compile section, some additions about acoustic management for hard disks added, references to X.org added to X11 sections, link to laptop-mode-tools added, some URLs updated, spelling cleaned, minor changes.
    [Show full text]
  • Typing Vietnamese on Window
    TYPING VIETNAMESE WITH UNICODE FONT It is recommended that you use a Vietnamese keyboard or keyboard driver for the task. Despite its name, it is not hardware: it is a small program that sits in your OS and converts your keystrokes into Vietnamese characters. Unikey. Its advantages are: It's free. It's just a download away: for NT/2000/XP, for 95/98/MEor for Linux. Installation is simple: just unzip it and it is ready to go. It sits on the taskbar. This makes it easy to switch between "English" mode and "Vietnamese" mode: just click on the icon on the taskbar. The user interface actually provides for English speakers, which makes it easier to understand. Setup 1. When you start up Unikey, you see the following dialogue: What does it all mean? Fortunately, you can find out what is happening by clicking on the "Mở rộng" button. "Mở rộng" means expand, and that's what you need to do. Uncheck the checkbox with "Vietnamese interface”. The whole interface will turn into English: I recommend you always set the "Character Set" to Unicode - always. A character set is basically how characters like "ư" and "a" are represented as numbers that computers can handle. The Microsoft Office programs are set to handle Unicode by default. Unicode is an international standard, so you can't go much wrong with it. The "Input method" is what keystrokes will form a character like "ư". I prefer TELEX, but I will give instructions for using Unikey with VNI as well. See the next section for instructions.
    [Show full text]
  • Download the Specification
    Internationalizing and Localizing Applications in Oracle Solaris Part No: E61053 November 2020 Internationalizing and Localizing Applications in Oracle Solaris Part No: E61053 Copyright © 2014, 2020, Oracle and/or its affiliates. License Restrictions Warranty/Consequential Damages Disclaimer This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. Warranty Disclaimer The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. Restricted Rights Notice If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable: U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs) and Oracle computer documentation or other Oracle data delivered to or accessed by U.S. Government end users are "commercial
    [Show full text]
  • Introducing Opentype Ab
    UBS AG ab Postfach CH-8098 Zürich Tel. +41-44-234 11 11 Brand Management Visual Identity Stephanie Teige FG09 G5R4-Z8S Tel. +41-1-234 59 09 Introducing OpenType Fax +41-1-234 36 41 stephanie.teige@ubs.com July 2005 www.ubs.com OpenType is a new font format developed collaboratively by Adobe and Microsoft. OpenType enhances the TrueType and PostScript technologies and extends their capabilities. Most fonts today are released in the OpenType format, now considered the industry standard. The resulting new generation of UBSHeadline and Frutiger fonts offers improved typographic and layout features. 1. What is OpenType? Frutiger is not always Frutiger Due to the wide variety of Frutiger styles available world- A single font format wide, be sure to install and use only the client-specific UBS OpenType provides a single universally acceptable font licensed version of this font. Do not use any other versions format that can be used on any major operating system of Frutiger to create UBS media. and in any application. Using the client-specific UBS Frutiger guarantees access to Macintosh Windows UBS-relevant cuts. It also prevents changes to kerning and line-break in comparison to random Frutiger styles. UBSHeadline, Frutiger UBSHeadline, Frutiger (PostScript) (TrueType) Linotype Frutiger UBS Frutiger Frutiger LT 45 Light Frutiger 45 Light Macintosh and Frutiger LT 46 Light Italic Frutiger 45 Light Italic Windows Frutiger LT 55 Roman Frutiger 55 Roman Frutiger LT 56 Italic Frutiger 55 Roman Italic UBSHeadline, Frutiger Frutiger LT 65 Bold Frutiger 45 Light Bold (OpenType) Frutiger LT 75 Black Frutiger 55 Roman Bold Frutiger LT 47 Light Condensed Frutiger 47 Light CN Unicode OpenType supports Unicode, which allows much larger Comparison of common Linotype Frutiger versus UBS client- character sets – more than 65,000 glyphs per font in many specific Frutiger.
    [Show full text]
  • Download Free Chinese Fonts for Mac
    1 / 4 Download Free Chinese Fonts For Mac ttc and Songti ttc and include TC fonts Hiragino Sans GB ~ Beginning with OS X 10.. 01[?]KaiTi楷体GB18030simkai ttfv5 01[?]FangSong_GB2312仿宋_GB2312GB2312SIMFANG.. [NEED MORE DETAILS HERE] [DISCUSSION OF WEB FONTS AND CSS3]Arphic [文鼎]Taiwan.. If you want to use this font for both simplified and traditional Chinese, then use Font Book to deactivate BiauKai and activate DFKai-SB instead.. ttf file and select install MacOS X (10 3 or later)Double-click on the ttf file and select install.. West is an IRG participant as a member of the UK delegation, so he is well-informed and up-to-date on the progress of their work, and his fonts reflect that knowledge. In addition, the Microsoft Office XP Proofing Tools (and Chinese editions) include the font Simsun (Founder Extended) [SURSONG.. A long time vendor of Chinese OEM fonts, in 2006 Monotype's new owners [Monotype Imaging] also acquired China Type Design [中國字體設計] in Hong Kong.. For the character sets and weights for each, see the Fonts section for your OS: 10.. If you have downloaded a font that is saved in Free Chinese Fonts Free Chinese Font is all about Chinese fonts that are free to download! This site aims to help you download high quality Chinese fonts in.. FamilyFile nameCharsetOS 910 310 410 510 610 710 810 1010 11PingFang SC PingFang HK PingFang TCPingFang.. Font files had to be converted between Windows and Macintosh Regardless, all TrueType fonts contain 'cmap' tables that map its glyphs to various encodings. chinese fonts chinese fonts, chinese fonts generator, chinese fonts download, chinese fonts copy and paste, chinese fonts google docs, chinese fonts dafont, chinese fonts adobe, chinese fonts in microsoft word, chinese fonts word, chinese fonts calligraphy Arial Unicode MS ~ Beginning with OS X 10 5, Apple includes this basic Monotype Unicode font from Microsoft Office [Arial Unicode.
    [Show full text]
  • Chapter 2 Working with Characters and Strings
    C02624245.fm Page 11 Friday, October 19, 2007 7:46 PM Chapter 2 Working with Characters and Strings In this chapter: Character Encodings. 12 ANSI and Unicode Character and String Data Types. 13 Unicode and ANSI Functions in Windows . 15 Unicode and ANSI Functions in the C Run-Time Library . 17 Secure String Functions in the C Run-Time Library. 18 Why You Should Use Unicode. 26 How We Recommend Working with Characters and Strings. 26 Translating Strings Between Unicode and ANSI. 27 With Microsoft Windows becoming more and more popular around the world, it is increasingly important that we, as developers, target the various international markets. It was once common for U.S. versions of software to ship as much as six months prior to the shipping of international ver- sions. But increasing international support for the operating system is making it easier to produce applications for international markets and therefore is reducing the time lag between distribution of the U.S. and international versions of our software. Windows has always offered support to help developers localize their applications. An application can get country-specific information from various functions and can examine Control Panel set- tings to determine the user’s preferences. Windows even supports different fonts for our applica- tions. Last but not least, in Windows Vista, Unicode 5.0 is now supported. (Read “Extend The Global Reach Of Your Applications With Unicode 5.0” at http://msdn.microsoft.com/msdnmag/ issues/07/01/Unicode/default.aspx for a high-level presentation of Unicode 5.0.) Buffer overrun errors (which are typical when manipulating character strings) have become a vec- tor for security attacks against applications and even against parts of the operating system.
    [Show full text]
  • A Modern Introduction to Programming
    Eloquent JavaScript A Modern Introduction to Programming Marijn Haverbeke Copyright © 2014 by Marijn Haverbeke This work is licensed under a Creative Commons attribution-noncommercial license (http://creativecommons.org/licenses/by-nc/3.0/). All code in the book may also be considered licensed under an MIT license (http://opensource. org/licenses/MIT). The illustrations are contributed by various artists: Cover by Wasif Hyder. Computer (introduction) and unicycle people (Chapter 21) by Max Xiantu. Sea of bits (Chapter 1) and weresquirrel (Chapter 4) by Margarita Martínez and José Menor. Octopuses (Chapter 2 and 4) by Jim Tierney. Object with on/off switch (Chapter 6) by Dyle MacGre- gor. Regular expression diagrams in Chapter 9 generated with regex- per.com by Jeff Avallone. Game concept for Chapter 15by Thomas Palef. Pixel art in Chapter 16 by Antonio Perdomo Pastor. The second edition of Eloquent JavaScript was made possible by 454 financial backers. You can buy a print version of this book, with an extra bonus chapter included, printed by No Starch Press at http://www.amazon.com/gp/product/ 1593275846/ref=as_li_qf_sp_asin_il_tl?ie=UTF8&camp=1789&creative=9325&creativeASIN= 1593275846&linkCode=as2&tag=marijhaver-20&linkId=VPXXXSRYC5COG5R5. i Contents On programming .......................... 2 Why language matters ....................... 5 What is JavaScript? ......................... 9 Code, and what to do with it ................... 11 Overview of this book ........................ 12 Typographic conventions ...................... 14 1 Values, Types, and Operators 15 Values ................................. 16 Numbers ............................... 17 Strings ................................ 21 Unary operators ........................... 22 Boolean values ............................ 23 Undefined values ........................... 26 Automatic type conversion ..................... 27 Summary ............................... 30 2 Program Structure 32 Expressions and statements .................... 32 Variables ..............................
    [Show full text]
  • UTR #23: the Unicode Character Property Model
    Technical Reports Proposed Update Unicode Technical Report #23 Author Ken Whistler (ken@unicode.org) and Asmus Freytag Editors (asmus@unicode.org) Date 2014-08-12 This Version http://www.unicode.org/reports/tr23/tr23-10.html Previous http://www.unicode.org/reports/tr23/tr23-9.html Version Latest http://www.unicode.org/reports/tr23/ Version Revision 10 Summary This document presents a conceptual model of character properties defined in the Unicode Standard. Status This document is a proposed update of a previously approved Unicode Technical Report. This document may be updated, replaced, or superseded by other documents at any time. Publication does not imply endorsement by the Unicode Consortium. This is not a stable document; it is inappropriate to cite this document as other than a work in progress. A Unicode Technical Report (UTR) contains informative material. Conformance to the Unicode Standard does not imply conformance to any UTR. Other specifications, however, are free to make normative references to a UTR. Please submit corrigenda and other comments with the online reporting form [Feedback]. Related information that is useful in understanding this document is found in the References. For the latest version of the Unicode Standard see [Unicode]. For a list of current Unicode Technical Reports see [Reports]. For more information about versions of the Unicode Standard, see [Versions]. Contents 1. Scope 2. Overview 2.1 Origin of Character Properties 2.2 Character Behavior in Context 2.3 Relation of Character Properties to Algorithms 2.4 Code Point Properties and Abstract Character Properties 2.5 Normative Properties 2.6 Informative Properties 2.7 Referring to Properties 2.8 The Unicode Character Database 3.
    [Show full text]
  • The Unicode Cookbook for Linguists: Managing Writing Systems Using Orthography Profiles
    Zurich Open Repository and Archive University of Zurich Main Library Strickhofstrasse 39 CH-8057 Zurich www.zora.uzh.ch Year: 2017 The Unicode Cookbook for Linguists: Managing writing systems using orthography profiles Moran, Steven ; Cysouw, Michael DOI: https://doi.org/10.5281/zenodo.290662 Posted at the Zurich Open Repository and Archive, University of Zurich ZORA URL: https://doi.org/10.5167/uzh-135400 Monograph The following work is licensed under a Creative Commons: Attribution 4.0 International (CC BY 4.0) License. Originally published at: Moran, Steven; Cysouw, Michael (2017). The Unicode Cookbook for Linguists: Managing writing systems using orthography profiles. CERN Data Centre: Zenodo. DOI: https://doi.org/10.5281/zenodo.290662 The Unicode Cookbook for Linguists Managing writing systems using orthography profiles Steven Moran & Michael Cysouw Change dedication in localmetadata.tex Preface This text is meant as a practical guide for linguists, and programmers, whowork with data in multilingual computational environments. We introduce the basic concepts needed to understand how writing systems and character encodings function, and how they work together. The intersection of the Unicode Standard and the International Phonetic Al- phabet is often not met without frustration by users. Nevertheless, thetwo standards have provided language researchers with a consistent computational architecture needed to process, publish and analyze data from many different languages. We bring to light common, but not always transparent, pitfalls that researchers face when working with Unicode and IPA. Our research uses quantitative methods to compare languages and uncover and clarify their phylogenetic relations. However, the majority of lexical data available from the world’s languages is in author- or document-specific orthogra- phies.
    [Show full text]
  • Assessment of Options for Handling Full Unicode Character Encodings in MARC21 a Study for the Library of Congress
    1 Assessment of Options for Handling Full Unicode Character Encodings in MARC21 A Study for the Library of Congress Part 1: New Scripts Jack Cain Senior Consultant Trylus Computing, Toronto 1 Purpose This assessment intends to study the issues and make recommendations on the possible expansion of the character set repertoire for bibliographic records in MARC21 format. 1.1 “Encoding Scheme” vs. “Repertoire” An encoding scheme contains codes by which characters are represented in computer memory. These codes are organized according to a certain methodology called an encoding scheme. The list of all characters so encoded is referred to as the “repertoire” of characters in the given encoding schemes. For example, ASCII is one encoding scheme, perhaps the one best known to the average non-technical person in North America. “A”, “B”, & “C” are three characters in the repertoire of this encoding scheme. These three characters are assigned encodings 41, 42 & 43 in ASCII (expressed here in hexadecimal). 1.2 MARC8 "MARC8" is the term commonly used to refer both to the encoding scheme and its repertoire as used in MARC records up to 1998. The ‘8’ refers to the fact that, unlike Unicode which is a multi-byte per character code set, the MARC8 encoding scheme is principally made up of multiple one byte tables in which each character is encoded using a single 8 bit byte. (It also includes the EACC set which actually uses fixed length 3 bytes per character.) (For details on MARC8 and its specifications see: http://www.loc.gov/marc/.) MARC8 was introduced around 1968 and was initially limited to essentially Latin script only.
    [Show full text]