Wording Improvements for Encodings and Character Sets
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
C Strings and Pointers
Software Design Lecture Notes Prof. Stewart Weiss C Strings and Pointers C Strings and Pointers Motivation The C++ string class makes it easy to create and manipulate string data, and is a good thing to learn when rst starting to program in C++ because it allows you to work with string data without understanding much about why it works or what goes on behind the scenes. You can declare and initialize strings, read data into them, append to them, get their size, and do other kinds of useful things with them. However, it is at least as important to know how to work with another type of string, the C string. The C string has its detractors, some of whom have well-founded criticism of it. But much of the negative image of the maligned C string comes from its abuse by lazy programmers and hackers. Because C strings are found in so much legacy code, you cannot call yourself a C++ programmer unless you understand them. Even more important, C++'s input/output library is harder to use when it comes to input validation, whereas the C input/output library, which works entirely with C strings, is easy to use, robust, and powerful. In addition, the C++ main() function has, in addition to the prototype int main() the more important prototype int main ( int argc, char* argv[] ) and this latter form is in fact, a prototype whose second argument is an array of C strings. If you ever want to write a program that obtains the command line arguments entered by its user, you need to know how to use C strings. -
Download the Specification
Internationalizing and Localizing Applications in Oracle Solaris Part No: E61053 November 2020 Internationalizing and Localizing Applications in Oracle Solaris Part No: E61053 Copyright © 2014, 2020, Oracle and/or its affiliates. License Restrictions Warranty/Consequential Damages Disclaimer This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. Warranty Disclaimer The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. Restricted Rights Notice If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable: U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs) and Oracle computer documentation or other Oracle data delivered to or accessed by U.S. Government end users are "commercial -
Chapter 2 Working with Characters and Strings
C02624245.fm Page 11 Friday, October 19, 2007 7:46 PM Chapter 2 Working with Characters and Strings In this chapter: Character Encodings. 12 ANSI and Unicode Character and String Data Types. 13 Unicode and ANSI Functions in Windows . 15 Unicode and ANSI Functions in the C Run-Time Library . 17 Secure String Functions in the C Run-Time Library. 18 Why You Should Use Unicode. 26 How We Recommend Working with Characters and Strings. 26 Translating Strings Between Unicode and ANSI. 27 With Microsoft Windows becoming more and more popular around the world, it is increasingly important that we, as developers, target the various international markets. It was once common for U.S. versions of software to ship as much as six months prior to the shipping of international ver- sions. But increasing international support for the operating system is making it easier to produce applications for international markets and therefore is reducing the time lag between distribution of the U.S. and international versions of our software. Windows has always offered support to help developers localize their applications. An application can get country-specific information from various functions and can examine Control Panel set- tings to determine the user’s preferences. Windows even supports different fonts for our applica- tions. Last but not least, in Windows Vista, Unicode 5.0 is now supported. (Read “Extend The Global Reach Of Your Applications With Unicode 5.0” at http://msdn.microsoft.com/msdnmag/ issues/07/01/Unicode/default.aspx for a high-level presentation of Unicode 5.0.) Buffer overrun errors (which are typical when manipulating character strings) have become a vec- tor for security attacks against applications and even against parts of the operating system. -
Unicode and Code Page Support
Natural for Mainframes Unicode and Code Page Support Version 4.2.6 for Mainframes October 2009 This document applies to Natural Version 4.2.6 for Mainframes and to all subsequent releases. Specifications contained herein are subject to change and these changes will be reported in subsequent release notes or new editions. Copyright © Software AG 1979-2009. All rights reserved. The name Software AG, webMethods and all Software AG product names are either trademarks or registered trademarks of Software AG and/or Software AG USA, Inc. Other company and product names mentioned herein may be trademarks of their respective owners. Table of Contents 1 Unicode and Code Page Support .................................................................................... 1 2 Introduction ..................................................................................................................... 3 About Code Pages and Unicode ................................................................................ 4 About Unicode and Code Page Support in Natural .................................................. 5 ICU on Mainframe Platforms ..................................................................................... 6 3 Unicode and Code Page Support in the Natural Programming Language .................... 7 Natural Data Format U for Unicode-Based Data ....................................................... 8 Statements .................................................................................................................. 9 Logical -
Technical Study Desktop Internationalization
Technical Study Desktop Internationalization NIC CH A E L T S T U D Y [This page intentionally left blank] X/Open Technical Study Desktop Internationalisation X/Open Company Ltd. December 1995, X/Open Company Limited All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording or otherwise, without the prior permission of the copyright owners. X/Open Technical Study Desktop Internationalisation X/Open Document Number: E501 Published by X/Open Company Ltd., U.K. Any comments relating to the material contained in this document may be submitted to X/Open at: X/Open Company Limited Apex Plaza Forbury Road Reading Berkshire, RG1 1AX United Kingdom or by Electronic Mail to: [email protected] ii X/Open Technical Study (1995) Contents Chapter 1 Internationalisation.............................................................................. 1 1.1 Introduction ................................................................................................. 1 1.2 Character Sets and Encodings.................................................................. 2 1.3 The C Programming Language................................................................ 5 1.4 Internationalisation Support in POSIX .................................................. 6 1.5 Internationalisation Support in the X/Open CAE............................... 7 1.5.1 XPG4 Facilities......................................................................................... -
AIX Globalization
AIX Version 7.1 AIX globalization IBM Note Before using this information and the product it supports, read the information in “Notices” on page 233 . This edition applies to AIX Version 7.1 and to all subsequent releases and modifications until otherwise indicated in new editions. © Copyright International Business Machines Corporation 2010, 2018. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents About this document............................................................................................vii Highlighting.................................................................................................................................................vii Case-sensitivity in AIX................................................................................................................................vii ISO 9000.....................................................................................................................................................vii AIX globalization...................................................................................................1 What's new...................................................................................................................................................1 Separation of messages from programs..................................................................................................... 1 Conversion between code sets............................................................................................................. -
Introduction
01-P1437 9/8/00 4:54 PM Page 1 ONE Introduction Around twenty years ago a computer revolution started when the IBM PC was released. The IBM PC took computing away from the air-conditioned environ- ment of the mainframe and minicomputer and put it onto the desk of poten- tially everyone. Nowadays most workers have a PC on their desk, and many have a PC at home, too. Laptop computers allow users to have one computer that can be used both at home and at work, as well as on the road. PCs are ge- neric computing devices providing tremendous computing power and flexibil- ity, and all PCs in the world from laptops to desktop PCs and through to servers have fundamentally the same architecture. Living through the PC era has been fun, frustrating, and exciting. However, there is an even bigger revolution on the way with more potential and even more challenges—the move to truly mobile-device-based computing. In the last few years computing devices have been coming onto the mar- ket that provide unparalleled portability and accessibility. Microsoft Windows CE devices, such as the palm-size device and handheld PC, provide cutdown desktop PC capabilities in a really small footprint, and Palm Pilot has been a very successful PDA (Personal Digital Assistant). Microsoft Pocket PC has tremen- dous features for enterprise computing, games, and entertainment. The Win- dows CE operating system has been embedded into many appliances (such as gas pumps and productions systems) for monitoring and control. Unlike the generic PC, these computing devices are not all the same and are designed for specific purposes. -
An Introduction to Ada's Predefined Packages
John McCormick Fall 2004 An Introduction to Ada's Predefined Packages The Annexes of the Ada Reference Manual (ARM) provides descriptions of the packages that every conforming Ada compiler vendor must provide (Chapters 1-13 and Annex A) and those that they usually provide. Here is a list of the names of those packages along with the location of their specifications in the ARM. Standard -- A.1 Strings (continued) Ada -- A.2 Unbounded -- A.4.5 Asynchronous_Task_Control -- D.11 Wide_Bounded -- A.4.7 Calendar -- 9.6 Wide_Fixed -- A.4.7 Characters -- A.3.1 Wide_Maps -- A.4.7 Handling -- A.3.2 Wide_Constants -- A.4.7 Latin_1 -- A.3.3 Wide_Unbounded -- A.4.7 Command_Line -- A.15 Synchronous_Task_Control -- D.10 Decimal -- F.2 Tags -- 3.9 Direct_IO -- A.8.4 Task_Attributes -- C.7.2 Dynamic_Priorities -- D.5 Task_Identification -- C.7.1 Exceptions -- 11.4.1 Text_IO -- A.10.1 Finalization -- 7.6 Complex_IO -- G.1.3 Interrupts -- C.3.2 Editing -- F.3.3 Names -- C.3.2 Text_Streams -- A.12.2 IO_Exceptions -- A.13 Unchecked_Conversion -- 13.9 Numerics -- A.5 Unchecked_Deallocation -- 13.11.2 Complex_Elementary_Functions -- G.1.2 Wide_Text_IO -- A.11 Complex_Types -- G.1.1 Complex_IO -- G.1.3 Discrete_Random -- A.5.2 Editing -- F.3.4 Elementary_Functions -- A.5.1 Text_Streams -- A.12.3 Float_Random -- A.5.2 Generic_Complex_Elementary_Functions -- G.1.2 Interfaces -- B.2 Generic_Complex_Types -- G.1.1 C -- B.3 Generic_Elementary_Functions -- A.5.1 Pointers -- B.3.2 Real_Time -- D.8 Strings -- B.3.1 Sequential_IO -- A.8.1 COBOL -- B.4 Storage_IO -- A.9 Fortran -- B.5 Streams -- 13.13.1 Stream_IO -- A.12.1 System -- 13.7 Strings -- A.4.1 Address_To_Access_Conversions -- 13.7.2 Bounded -- A.4.4 Machine_Code -- 13.8 Fixed -- A.4.3 RPC -- E.5 Maps -- A.4.2 Storage_Elements -- 13.7.1 Constants -- A.4.6 Storage_Pools -- 13.11 The purpose of this guide is to help you learn how to read the specifications for these packages. -
Data Types in C
Princeton University Computer Science 217: Introduction to Programming Systems Data Types in C 1 Goals of C Designers wanted C to: But also: Support system programming Support application programming Be low-level Be portable Be easy for people to handle Be easy for computers to handle • Conflicting goals on multiple dimensions! • Result: different design decisions than Java 2 Primitive Data Types • integer data types • floating-point data types • pointer data types • no character data type (use small integer types instead) • no character string data type (use arrays of small ints instead) • no logical or boolean data types (use integers instead) For “under the hood” details, look back at the “number systems” lecture from last week 3 Integer Data Types Integer types of various sizes: signed char, short, int, long • char is 1 byte • Number of bits per byte is unspecified! (but in the 21st century, pretty safe to assume it’s 8) • Sizes of other integer types not fully specified but constrained: • int was intended to be “natural word size” • 2 ≤ sizeof(short) ≤ sizeof(int) ≤ sizeof(long) On ArmLab: • Natural word size: 8 bytes (“64-bit machine”) • char: 1 byte • short: 2 bytes • int: 4 bytes (compatibility with widespread 32-bit code) • long: 8 bytes What decisions did the designers of Java make? 4 Integer Literals • Decimal: 123 • Octal: 0173 = 123 • Hexadecimal: 0x7B = 123 • Use "L" suffix to indicate long literal • No suffix to indicate short literal; instead must use cast Examples • int: 123, 0173, 0x7B • long: 123L, 0173L, 0x7BL • short: -
Programming Languages Ð C
Programming languages Ð C ABSTRACT (Cover sheet to be provided by ISO Secretariat.) This International Standard speci®es the form and establishes the interpretation of programs expressed in the programming language C. Its purpose is to promote portability, reliability, maintainability, and ef®cient execution of C language programs on a variety of computing systems. Clauses are included that detail the C language itself and the contents of the C language execution library. Annexes summarize aspects of both of them, and enumerate factors that in¯uence the portability of C programs. Although this International Standard is intended to guide knowledgeable C language programmers as well as implementors of C language translation systems, the document itself is not designed to serve as a tutorial. -- -- Introduction 1 With the introduction of new devices and extended character sets, new features may be added to this International Standard. Subclauses in the language and library clauses warn implementors and programmers of usages which, though valid in themselves, may con¯ict with future additions. 2 Certain features are obsolescent, which means that they may be considered for withdrawal in future revisions of this International Standard. They are retained because of their widespread use, but their use in new implementations (for implementation features) or new programs (for language [6.9] or library features [7.20]) is discouraged. 3 This International Standard is divided into four major subdivisions: Ð the introduction and preliminary elements; Ð the characteristics of environments that translate and execute C programs; Ð the language syntax, constraints, and semantics; Ð the library facilities. 4 Examples are provided to illustrate possible forms of the constructions described. -
Character Encodings
Character encodings Andreas Fester June 26, 2005 Abstract This article is about the concepts of character encoding. Earlier there were only a few encodings like EBCDIC and ASCII, and everything was quite simple. Today, there are a lot of terms like UNICODE, Code- page, UTF8, UTF16 and the like. The goal of this article is to explain the concepts behind these terms and how these concepts are supported in programming languages, especially Java, C and C++. 1 Introduction Character encodings are necessary because the computer hardware can only handle (and only knows) about numbers. The first computers could handle eight bit numbers (lets take aside the very first micropro- cessors which could only handle 4 bits), which is a range from 0 to 255. Larger numbers must be handled by combining two or more eight bit values. Later, computers were enhanced so that they could handle 16-, 32- and meanwhile 64 bit numbers without having to combine smaller units. But - its still all numbers, i.e. a sequence of 0 and 1 bits. However, it soon became clear that interfacing with a computer system through sequences of 0 and 1 is very cumbersome and only possible for very simple communication. Usually an end user wants to read text like "Name:" and enter words like "Bill", so it was necessary to define some conventions how numbers correspond to letters. These conventions are generally called character encodings. 2 Single byte encoding The traditional way of assigning a code to a character is to represent each character as a byte or a part of a byte (for example six or seven bits). -
Attacking Internationalized Software
Attacking Internationalized Software Scott Stender [email protected] Black Hat Japan October 6, 2006 Information Security Partners, LLC iSECPartners.com Information Security Partners, LLC www.isecpartners.com Attacking Internationalized Software Introduction • Who are you? – Founding Partner of Information Security Partners, LLC (iSEC Partners) – Application security consultants and researchers • Why listen to this talk? – Every application uses internationalization (whether you know it or not!) – A great deal of research potential • Platforms – Much of this talk will use Windows for examples – Internationalization is a cross-platform concern! 2 Information Security Partners, LLC www.isecpartners.com Attacking Internationalized Software • Introduction • Background – Internationalization Basics – Platform Support – The Internationalization “Stack” • Historical Attacks – Width calculation – Encoding attacks • Current Attacks – Conversion from Unicode – Conversion to Unicode – Encoding Attacks • Tools – I18NAttack • Q&A 3 Information Security Partners, LLC www.isecpartners.com Attacking Internationalized Software Background – Internationalization Basics • Internationalization Defined – Provides support for potential use across multiple languages and locale- specific preferences – Most of this talk will focus on character manipulation • Character Manipulation – Text must be represented in 1s and 0s internal to the machine – Many standards have emerged to encode text into a binary representation – ASCII is a common example 4 Information