Wording Improvements for Encodings and Character Sets
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Download the Specification
Internationalizing and Localizing Applications in Oracle Solaris Part No: E61053 November 2020 Internationalizing and Localizing Applications in Oracle Solaris Part No: E61053 Copyright © 2014, 2020, Oracle and/or its affiliates. License Restrictions Warranty/Consequential Damages Disclaimer This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. Warranty Disclaimer The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. Restricted Rights Notice If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable: U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs) and Oracle computer documentation or other Oracle data delivered to or accessed by U.S. Government end users are "commercial -
Chapter 2 Working with Characters and Strings
C02624245.fm Page 11 Friday, October 19, 2007 7:46 PM Chapter 2 Working with Characters and Strings In this chapter: Character Encodings. 12 ANSI and Unicode Character and String Data Types. 13 Unicode and ANSI Functions in Windows . 15 Unicode and ANSI Functions in the C Run-Time Library . 17 Secure String Functions in the C Run-Time Library. 18 Why You Should Use Unicode. 26 How We Recommend Working with Characters and Strings. 26 Translating Strings Between Unicode and ANSI. 27 With Microsoft Windows becoming more and more popular around the world, it is increasingly important that we, as developers, target the various international markets. It was once common for U.S. versions of software to ship as much as six months prior to the shipping of international ver- sions. But increasing international support for the operating system is making it easier to produce applications for international markets and therefore is reducing the time lag between distribution of the U.S. and international versions of our software. Windows has always offered support to help developers localize their applications. An application can get country-specific information from various functions and can examine Control Panel set- tings to determine the user’s preferences. Windows even supports different fonts for our applica- tions. Last but not least, in Windows Vista, Unicode 5.0 is now supported. (Read “Extend The Global Reach Of Your Applications With Unicode 5.0” at http://msdn.microsoft.com/msdnmag/ issues/07/01/Unicode/default.aspx for a high-level presentation of Unicode 5.0.) Buffer overrun errors (which are typical when manipulating character strings) have become a vec- tor for security attacks against applications and even against parts of the operating system. -
Delimited Escape Sequences
Delimited escape sequences Document #: D2290R2 Date: 2021-07-15 Programming Language C++ Audience: EWG, SG-22 Reply-to: Corentin Jabot <[email protected]> Abstract We propose an additional, clearly delimited syntax for octal, hexadecimal and universal character name escape sequences. Revisions R2 • Improve wording • Add a note about feature macros (we do not need one) • Mention that a paper will be submitted to the C committee R1 • Remove obsolete note about wording Motivation universal-character-name escape sequences As their name does not indicate, universal-character-name escape sequences represent Uni- code scalar values, using either 4, or 8 hexadecimal digits, which is either 16 or 32 bits. However, the Unicode codespace is limited to 0-0x10FFFF, and all currently assigned code- points can be written with 5 or less hexadecimal digits (Supplementary Private Use Area-B non-withstanding). As such, the ~50% of codepoints that needs 5 hexadecimal digits to be expressed are currently a bit awkward to write: \U0001F1F8. 1 Octal and hexadecimal escape sequences have variable length \1, \01, \001 are all valid escape sequences. \17 is equivalent to 0x0F while \18 is equivalent to "0x01" "8" While octal escape sequences accept 1 to 3 digits as arguments, hexadecimal sequences accept an arbitrary number of digits applying the maximal much principle. This is how the Microsoft documentation describes this problem: Unlike octal escape constants, the number of hexadecimal digits in an escape sequence is unlimited. A hexadecimal escape sequence terminates at the first character that is not a hexadecimal digit. Because hexadecimal digits include the letters a through f, care must be exercised to make sure the escape sequence terminates at the intended digit. -
Unicode and Code Page Support
Natural for Mainframes Unicode and Code Page Support Version 4.2.6 for Mainframes October 2009 This document applies to Natural Version 4.2.6 for Mainframes and to all subsequent releases. Specifications contained herein are subject to change and these changes will be reported in subsequent release notes or new editions. Copyright © Software AG 1979-2009. All rights reserved. The name Software AG, webMethods and all Software AG product names are either trademarks or registered trademarks of Software AG and/or Software AG USA, Inc. Other company and product names mentioned herein may be trademarks of their respective owners. Table of Contents 1 Unicode and Code Page Support .................................................................................... 1 2 Introduction ..................................................................................................................... 3 About Code Pages and Unicode ................................................................................ 4 About Unicode and Code Page Support in Natural .................................................. 5 ICU on Mainframe Platforms ..................................................................................... 6 3 Unicode and Code Page Support in the Natural Programming Language .................... 7 Natural Data Format U for Unicode-Based Data ....................................................... 8 Statements .................................................................................................................. 9 Logical -
Lexical Structure
j.book Page 13 Monday, May 23, 2005 11:36 AM CHAPTER 3 Lexical Structure Lexicographer: A writer of dictionaries, a harmless drudge. —Samuel Johnson, Dictionary (1755) THIS chapter specifies the lexical structure of the Java programming language. Programs are written in Unicode (§3.1), but lexical translations are provided (§3.2) so that Unicode escapes (§3.3) can be used to include any Unicode charac- ter using only ASCII characters. Line terminators are defined (§3.4) to support the different conventions of existing host systems while maintaining consistent line numbers. The Unicode characters resulting from the lexical translations are reduced to a sequence of input elements (§3.5), which are white space (§3.6), comments (§3.7), and tokens. The tokens are the identifiers (§3.8), keywords (§3.9), literals (§3.10), separators (§3.11), and operators (§3.12) of the syntactic grammar. 3.1 Unicode Programs are written using the Unicode character set. Information about this character set and its associated character encodings may be found at: http://www.unicode.org The Java platform tracks the Unicode specification as it evolves. The precise ver- sion of Unicode used by a given release is specified in the documentation of the class Character. Versions of the Java programming language prior to 1.1 used Unicode version 1.1.5. Upgrades to newer versions of the Unicode Standard occurred in JDK 1.1 (to Unicode 2.0), JDK 1.1.7 (to Unicode 2.1), J2SE 1.4 (to Unicode 3.0), and J2SE 5.0 (to Unicode 4.0). The Unicode standard was originally designed as a fixed-width 16-bit charac- ter encoding. -
AIX Globalization
AIX Version 7.1 AIX globalization IBM Note Before using this information and the product it supports, read the information in “Notices” on page 233 . This edition applies to AIX Version 7.1 and to all subsequent releases and modifications until otherwise indicated in new editions. © Copyright International Business Machines Corporation 2010, 2018. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents About this document............................................................................................vii Highlighting.................................................................................................................................................vii Case-sensitivity in AIX................................................................................................................................vii ISO 9000.....................................................................................................................................................vii AIX globalization...................................................................................................1 What's new...................................................................................................................................................1 Separation of messages from programs..................................................................................................... 1 Conversion between code sets............................................................................................................. -
Introduction
01-P1437 9/8/00 4:54 PM Page 1 ONE Introduction Around twenty years ago a computer revolution started when the IBM PC was released. The IBM PC took computing away from the air-conditioned environ- ment of the mainframe and minicomputer and put it onto the desk of poten- tially everyone. Nowadays most workers have a PC on their desk, and many have a PC at home, too. Laptop computers allow users to have one computer that can be used both at home and at work, as well as on the road. PCs are ge- neric computing devices providing tremendous computing power and flexibil- ity, and all PCs in the world from laptops to desktop PCs and through to servers have fundamentally the same architecture. Living through the PC era has been fun, frustrating, and exciting. However, there is an even bigger revolution on the way with more potential and even more challenges—the move to truly mobile-device-based computing. In the last few years computing devices have been coming onto the mar- ket that provide unparalleled portability and accessibility. Microsoft Windows CE devices, such as the palm-size device and handheld PC, provide cutdown desktop PC capabilities in a really small footprint, and Palm Pilot has been a very successful PDA (Personal Digital Assistant). Microsoft Pocket PC has tremen- dous features for enterprise computing, games, and entertainment. The Win- dows CE operating system has been embedded into many appliances (such as gas pumps and productions systems) for monitoring and control. Unlike the generic PC, these computing devices are not all the same and are designed for specific purposes. -
An Introduction to Ada's Predefined Packages
John McCormick Fall 2004 An Introduction to Ada's Predefined Packages The Annexes of the Ada Reference Manual (ARM) provides descriptions of the packages that every conforming Ada compiler vendor must provide (Chapters 1-13 and Annex A) and those that they usually provide. Here is a list of the names of those packages along with the location of their specifications in the ARM. Standard -- A.1 Strings (continued) Ada -- A.2 Unbounded -- A.4.5 Asynchronous_Task_Control -- D.11 Wide_Bounded -- A.4.7 Calendar -- 9.6 Wide_Fixed -- A.4.7 Characters -- A.3.1 Wide_Maps -- A.4.7 Handling -- A.3.2 Wide_Constants -- A.4.7 Latin_1 -- A.3.3 Wide_Unbounded -- A.4.7 Command_Line -- A.15 Synchronous_Task_Control -- D.10 Decimal -- F.2 Tags -- 3.9 Direct_IO -- A.8.4 Task_Attributes -- C.7.2 Dynamic_Priorities -- D.5 Task_Identification -- C.7.1 Exceptions -- 11.4.1 Text_IO -- A.10.1 Finalization -- 7.6 Complex_IO -- G.1.3 Interrupts -- C.3.2 Editing -- F.3.3 Names -- C.3.2 Text_Streams -- A.12.2 IO_Exceptions -- A.13 Unchecked_Conversion -- 13.9 Numerics -- A.5 Unchecked_Deallocation -- 13.11.2 Complex_Elementary_Functions -- G.1.2 Wide_Text_IO -- A.11 Complex_Types -- G.1.1 Complex_IO -- G.1.3 Discrete_Random -- A.5.2 Editing -- F.3.4 Elementary_Functions -- A.5.1 Text_Streams -- A.12.3 Float_Random -- A.5.2 Generic_Complex_Elementary_Functions -- G.1.2 Interfaces -- B.2 Generic_Complex_Types -- G.1.1 C -- B.3 Generic_Elementary_Functions -- A.5.1 Pointers -- B.3.2 Real_Time -- D.8 Strings -- B.3.1 Sequential_IO -- A.8.1 COBOL -- B.4 Storage_IO -- A.9 Fortran -- B.5 Streams -- 13.13.1 Stream_IO -- A.12.1 System -- 13.7 Strings -- A.4.1 Address_To_Access_Conversions -- 13.7.2 Bounded -- A.4.4 Machine_Code -- 13.8 Fixed -- A.4.3 RPC -- E.5 Maps -- A.4.2 Storage_Elements -- 13.7.1 Constants -- A.4.6 Storage_Pools -- 13.11 The purpose of this guide is to help you learn how to read the specifications for these packages. -
Wording Improvements for Encodings and Character Sets
Wording improvements for encodings and character sets Document #: P2297R0 Date: 2021-02-19 Project: Programming Language C++ Audience: SG-16 Reply-to: Corentin Jabot <[email protected]> Abstract Summary of behavior changes Alert & backspace The wording mandated that the executions encoding be able to encode ”alert, backspace, and carriage return”. This requirement is not used in the core wording (Tweaks of [5.13.3.3.1] may be needed), nor in the library wording, and therefore does not seem useful, so it was not added in the new wording. This will not have any impact on existing implementations. Unicode in raw string delimiters Falls out of the wording change. should we? New terminology Basic character set Formerly basic source character set. Represent the set of abstract (non-coded) characters in the graphic subset of the ASCII character set. The term ”source” has been dropped because the source code encoding is not observable nor relevant past phase 1. The basic character set is used: • As a subset of other encodings • To restric accepted characters in grammar elements • To restrict values in library literal character set, literal character encoding, wide literal character set, wide lit- eral character encoding Encodings and associated character sets of narrow and wide character and string literals. implementation-defined, and locale agnostic. 1 execution character set, execution character encoding, wide execution character set, wide execution character encoding Encodings and associated character sets of the encoding used by the library. isomorphic or supersets of their literal counterparts. Separating literal encodings from libraries encoding allows: • To make a distinction that exists in practice and which was not previously admitted by the standard previous. -
Programming Languages Ð C
Programming languages Ð C ABSTRACT (Cover sheet to be provided by ISO Secretariat.) This International Standard speci®es the form and establishes the interpretation of programs expressed in the programming language C. Its purpose is to promote portability, reliability, maintainability, and ef®cient execution of C language programs on a variety of computing systems. Clauses are included that detail the C language itself and the contents of the C language execution library. Annexes summarize aspects of both of them, and enumerate factors that in¯uence the portability of C programs. Although this International Standard is intended to guide knowledgeable C language programmers as well as implementors of C language translation systems, the document itself is not designed to serve as a tutorial. -- -- Introduction 1 With the introduction of new devices and extended character sets, new features may be added to this International Standard. Subclauses in the language and library clauses warn implementors and programmers of usages which, though valid in themselves, may con¯ict with future additions. 2 Certain features are obsolescent, which means that they may be considered for withdrawal in future revisions of this International Standard. They are retained because of their widespread use, but their use in new implementations (for implementation features) or new programs (for language [6.9] or library features [7.20]) is discouraged. 3 This International Standard is divided into four major subdivisions: Ð the introduction and preliminary elements; Ð the characteristics of environments that translate and execute C programs; Ð the language syntax, constraints, and semantics; Ð the library facilities. 4 Examples are provided to illustrate possible forms of the constructions described. -
Delimited Escape Sequences
Delimited escape sequences Document #: N2785 Date: 2021-07-28 Project: Programming Language C Audience: Application programmers Proposal category: New feature Reply-to: Corentin Jabot <[email protected]> Aaron Ballman <[email protected]> Abstract We propose an additional, clearly delimited syntax for octal, hexadecimal and universal character name escape sequences to clearly delimit the boundaries of the escape sequence. WG21 has shown an interest in adjusting this feature, and this proposal is intended to keep C and C++ in alignment. This feature is a pure extension to the language that should not impact existing code. Motivation universal-character-name escape sequences As their name does not indicate, universal-character-name escape sequences represent Uni- code scalar values, using either 4, or 8 hexadecimal digits, which is either 16 or 32 bits. However, the Unicode codespace is limited to 0-0x10FFFF, and all currently assigned code- points can be written with 5 or less hexadecimal digits (Supplementary Private Use Area-B non-withstanding). As such, the ~50% of codepoints that need 5 hexadecimal digits to be expressed are currently a bit awkward to write: \U0001F1F8. Octal and hexadecimal escape sequences have variable length \1, \01, \001 are all valid escape sequences. \17 is equivalent to "0x0F" while \18 is equivalent to "0x01" "8" While octal escape sequences accept 1 to 3 digits as arguments, hexadecimal sequences accept an arbitrary number of digits applying the maximal much principle. This is how the Microsoft documentation describes this problem: 1 Unlike octal escape constants, the number of hexadecimal digits in an escape sequence is unlimited. -
Character Data
CHARACTER DATA A variable of the data type char can hold one keyboard character. Its value is stored in memory as a 16-bit binary code using the Unicode encoding scheme. Unicode has 65,536 codes of which approximately 35,000 are in use. It is designed to handle all characters in all written languages. Character literals are typed as single quotation marks (') delimiting a single keyboard character. Example Unicode value shown in hexadecimal char a, b, c, d, e; a 0063 a = 'c'; b 0032 b = '2'; c 006E c = 'n'; d 0025 d = '%'; e 0022 e = '"'; Inside a character literal, you sometimes need to specify a character that is either invisible (e.g. a line ending) or cannot be found on many keyboards (e.g. the symbol £). To do this, you use an escape sequence. The syntax is: \u character code character code is the 4-digit hexadecimal Unicode value denoting the desired character. Example This code fragment outputs Temperature:70°F. char degreeSymbol = '\u00B0'; int temp = 70; System.out.println("Temperature:" + temp + degreeSymbol + "F"); Example This code fragment outputs London Pizza £9.25. double price = 9.25; System.out.println( "London Pizza " + '\u00A3' + price ); Character Data Page 1 Since the ' delimits a character literal, you must use the escape character if you want the ' to stand for itself. Since the \ signals an escape character, you must use two together if you want it to stand for itself. The line ending character is the special escape sequence \n. Example Unicode value shown in hexadecimal char a, b, c; a 0027 a = '\''; b 005C b = '\\'; c 000A c = '\n'; Beginner Errors using Character Data Examples char letter = "n"; Error! " cannot delimit a character literal.