The Multilingual Web, Policy Making and Access to Digital Knowledge for All Handout Reinhard Schäler LRC, University of Limerick This handout has been prepared as background information for the Multilingual Web Workshop held in Madrid, 26-27 October 2010, by Reinhard Schäler. The programme of the workshop is available on: http://www.w3.org/International/multilingualweb/madrid/program Recent Surveys Interoperability within the Supply Chain — It’s Time! Author: Sven Andrä Date: October 2010 Survey results: http://www.surveymonkey.com/sr.aspx?sm=8Jjl1edI9NIg1mIhVXkCEaHKWIv_2fNoz_ 2bLwoQqNkdInA_3d The Multilingual Web, Policy Making and Access to Digital Knowledge for All Author: Reinhard Schäler Date: October 2010 Survey results: http://www.surveymonkey.com/sr.aspx?sm=UQPSaGUxepboE_2fjNBGilQnE_2fvHHlr wmYeUA8EIMeU3g_3d The Multilingual Web, Policy Making and Access to Digital Knowledge for All Handout Reinhard Schäler, 26-27 Oct 2010 Page 1 Standards – A Genesis The genesis towards automation, the use of standards and interoperability could be described as going through the following development phases. • Individual Effort Where issues are dealt with in a fire fighting mode facing up to them as they occur. • In-house Tools Support Where individual tasks are automated for specific, specialised parts of processes. • Third Party Tools Mainstream development companies take up the tasks above to handle individual parts of the process. • Best of Breed Where tools and processes start to be combined such as terminology tools and translation memories. • "Ad-Hoc" Standards Where individual groups start to promote their own processes as standards such as TMX and TBX. • Open Standards Where large sections of industry leaders join together to develop a common standard using the combined experience that has been learned to produce viable standards that can be used throughout the industry as a whole. Examples of these are XLIFF and Trans-WS. Open standards are a pre-requisite for interoperability, and interoperability is a pre-requisite for flexible, adaptable, open, and automated localisation and translation processes. The Multilingual Web, Policy Making and Access to Digital Knowledge for All Handout Reinhard Schäler, 26-27 Oct 2010 Page 2 Standards and Standards Organizations The following are some of the standards organizations, and some of their standards and guidelines relevant to localization. This list has been prepared to give readers an indication of the type and number of standards organizations, and the standards developed by them. While care has been taken in its preparation, the author does not guarantee its accuracy and completeness. Note: Some of the information in this section has been prepared as part of the EU funded IGNITE project. International Standards Body Relevant Standards Links 1. ECMA 1. Ecma International facilitates the http://www.ecma- International timely creation of a wide range of global international.org Information and Communications Technology (ICT) and Consumer Electronics (CE) standards. 2. European 2. European quality standard for http://www.cen.eu Committee for translation services (disbanded) Standardization 3. Free Standards 3. OpenI18N is a workgroup of the Free http://www.openi18n.or Group Open Standards Group with the goal to propose g/ Internationalisation and coordinate any techniques, Initiative conventions, guidelines, and activities within the open-source community. 4. Internet 4. The mission of the IETF is to make http://www.iett.org/ Engineering Task the Internet work better by producing Force (IETF) high quality, relevant technical documents that influence the way people design, use, and manage the Internet. 5. Internet 5. an independent international http://www.isoc.org Society (ISOC) nonprofit organisation founded in 1992 to provide leadership in Internet related standards, education, and policy around the world. 6. Interoperability 6. is not a standards organization but a http://interoperability- Now (IN) platform for the discussion of now.org interoperability issues in localization 7. ISO 7. Technical Committee 37 – http://www.iso.org/ Terminology and other language resources 8. ISO 639 – Language Codes 9. ISO 639-1:2002 : Alpha 2 codes for the Representation of Names of Languages 10. ISO 639-2 : Alpha-3 Codes for the Representation of Names of Languages 11. Terminology Data Categories – ISO 12620 12. MARTIF – ISO 12200 - Machine- readable terminology interchange format 13. Terminology Work – ISO 704 14. Vocabulary – ISO 1087-1 – Part 1: Theory and Application 15. Vocabulary - ISO 1087-2 - Part 2: Computer Applications 16. Terminological Markup Framework – The Multilingual Web, Policy Making and Access to Digital Knowledge for All Handout Reinhard Schäler, 26-27 Oct 2010 Page 3 ISO DIS 16642 8. LISA 17. TMX – The purpose of TMX is to http://www.lisa.org/ allow easier exchange of translation memory data between tools and/or translation vendors with little or no loss of critical data during the process. 18. TBX – is an open XML-based standard format for terminological data. 19. SRX – Segmentation Rules eXchange (SRX) is an XML-based standard for description of the ways in which translation and other language-processing tools segment text for processing. 20. GMX – Global Information Management Metrics eXchange (GMX) is a family of proposed standards concerning translation-related metrics. 21. QA – Quality Assurance Standard/Guidelines 9. OASIS 22. XLIFF – the XML-based Localisation http://www.oasis- Interchange File Format open.org/ 23. Trans-WS – the Translation Vendor Web services Standard (not active) 24. OAXL - Open Architecture for XML Authoring and Localization Reference Model TC 10. OLIF2 25. OLIF – is XML-compliant and offers http://www.olif.net/ Consortium support for natural language processing (NLP) systems, such as machine translation, by providing coverage of a wide and detailed range of linguistic features. 11. Termnet 26. International Network for http://linux.termnet.org Terminology – is a non-profit association / with the objective of promoting the international terminology market 12. Text Encoding 27. A consortium which collectively http://www.tei- Initiative develops and maintains a standard for c.org/index.xml the representation of texts in digital form. 13. Translation 28. A hink tank for the translation www.translationautomat Automation User industry, undertaking research for buyers ion.com Society (TAUS) and providers of translation services and technologies. 14. Unicode 29. An International Standard Character http://www.unicode.org/ Repertoire and Code Points fully synchronised with ISO/IEC 10646 15. Unicode CDLR 30. Common Locale Data Repository http://www.unicode.org/ (CLDR) Project - The purpose of the cldr / Common Locale Data Repository project is to provide a general XML format for the The Multilingual Web, Policy Making and Access to Digital Knowledge for All Handout Reinhard Schäler, 26-27 Oct 2010 Page 4 exchange of locale information for use in application and system development, and to gather, store, and make available a common set of locale data generated in that format. 16. W3C 31. CSS – Cascading Style Sheets http://www.w3.org/ 32. DOM 1–Document Object Model http://www.w3.org/Inter Level 1 national/ 33. HTML 4.0 – HyperText Markup http://www.w3.org/Inter national/its/ Language 34. The Internationalization Tag Set (ITS) Working Group - developing a set of elements and attributes that can be used with new DTDs/Schemas to support the internationalization and localization of documents; and provide best practice techniques for developers of DTDs/Schemas that show how to enable internationalization of their documents. 35. XHTML 1.0, 1.1, and Modularization 36. XML 1.0 - Extensible Markup Language De Facto Standard Standards Body Brief Description Links IBM Coded character sets and related http://www- resources 306.ibm.com/software/g Character Data Representation lobalization/g11n-res.jsp Architecture (CDRA) Reference Coded Character Set Identifier (CCSID) Code pages Character sets Graphic character identifiers Microsoft Language, Locale and Codepage http://www.microsoft.co conventions m/globaldev/nlsweb/ The WordForge WordForge is a project that attempts to http://www.wordforge.o Project simplify the process of localisation of rg/ Software. It is developed with Free and Open Source software in mind, but its process and tools are also applicable to other types of software. International Standards used for Content Development Body Brief Description Links Accellera Standards and open interfaces in http://www.acceller Organization electronic design automation a.org/ ASTM International American Society for Testing and http://www.astm.or (American Society Materials g/ for Testing and Materials) Automotive Open For vehicular software, user interfaces http://autosar.org/ System and management Architecture (AUTOSAR) International Three organisations established to http://www.bipm.or Bureau of Weights maintain the International System of g/ and Measures Units (SI) (BIPM) / General The Multilingual Web, Policy Making and Access to Digital Knowledge for All Handout Reinhard Schäler, 26-27 Oct 2010 Page 5 Conference on Weights and Measures (CGPM) / International Committee for Weights and Measures (CIPM) CableLabs Standards organisation serving the US http://www.cablela cable television industry bs.com/ Ecma International Standardising information and http://www.ecma- (European communication systems international.org/ Computer Manufacturers Association) Fédération