Open Virtual Network (OVN) Release 21.06.0

Total Page:16

File Type:pdf, Size:1020Kb

Open Virtual Network (OVN) Release 21.06.0 Open Virtual Network (OVN) Release 21.06.0 Jun 18, 2021 Contents 1 Open Virtual Network (OVN) Documentation1 1.1 How the Documentation is Organised..................................1 1.2 First Steps................................................1 1.3 Deeper Dive...............................................1 1.4 The Open Virtual Network (OVN) Project................................2 1.5 Getting Help...............................................2 2 Getting Started 3 2.1 Installing Open Virtual Network (OVN).................................3 2.1.1 Installation from Source....................................3 2.1.2 Installation from Packages................................... 13 2.1.3 Upgrades............................................ 18 2.1.4 Others.............................................. 20 3 Tutorials 23 3.1 OVN Sandbox.............................................. 23 3.1.1 Getting Started......................................... 23 3.1.2 Using GDB........................................... 24 3.1.3 Creating OVN Resources.................................... 24 3.1.4 Using ovn-trace......................................... 25 3.2 OVN OpenStack Tutorial........................................ 25 3.2.1 Setting Up DevStack...................................... 26 3.2.2 DevStack preliminaries..................................... 28 3.2.3 Shortening UUIDs....................................... 29 3.2.4 Overview............................................ 29 3.2.5 Switching............................................ 31 3.2.6 Routing............................................. 42 3.2.7 Adding a Gateway....................................... 46 3.2.8 IPv6............................................... 50 3.2.9 ACLs.............................................. 53 3.2.10 DHCP.............................................. 55 3.2.11 Further Directions........................................ 57 3.3 OVN Role-Based Access Control (RBAC) Tutorial........................... 57 3.3.1 Generating Certificates and Keys................................ 57 3.3.2 Configuring RBAC....................................... 58 3.4 OVN IPsec Tutorial........................................... 59 3.4.1 Generating Certificates and Keys................................ 60 i 3.4.2 Configuring OVN IPsec..................................... 60 3.4.3 Enabling OVN IPsec...................................... 60 3.4.4 Troubleshooting......................................... 60 3.4.5 Bug Reporting......................................... 61 3.5 OVN Interconnection........................................... 61 3.5.1 Setup Interconnection Databases................................ 61 3.5.2 Register OVN to Interconnection Databases.......................... 62 3.5.3 Configure Gateways...................................... 62 3.5.4 Create Transit Logical Switches................................ 63 3.5.5 Connect Logical Routers to Transit Switches......................... 63 3.5.6 Create Static Routes...................................... 64 3.5.7 Route Advertisement...................................... 64 3.6 Adding a new OVN feature to the DDlog version of ovn-northd.................... 64 3.6.1 Overview............................................ 64 3.6.2 Update NB and/or SB OVSDB schemas............................ 65 3.6.3 Configuring DDlog/OVSDB bindings............................. 65 3.6.4 Define intermediate DDlog relations and rules to compute them................ 66 3.6.5 Write rules to update output relations............................. 68 3.6.6 Generate Logical_Flow and/or other forwarding records................. 68 3.6.7 Appendix A. Additional relations generated by ovsdb2ddlog ............... 69 4 Deep Dive 71 4.1 OVN................................................... 71 4.1.1 Debugging the DDlog version of ovn-northd.......................... 71 4.1.2 Integration Guide for Centralized Control........................... 75 4.1.3 OVN Gateway High Availability Plan............................. 76 4.1.4 Role Based Access Control................................... 82 4.1.5 What’s New with OVS and OVN 2.8.............................. 83 4.1.6 Testing............................................. 87 5 How-to Guides 91 5.1 OVS................................................... 91 5.1.1 Encrypt Open vSwitch Tunnels with IPsec........................... 91 5.1.2 Open vSwitch with SSL.................................... 91 5.2 OVN................................................... 91 5.2.1 Open Virtual Networking With Docker............................. 91 5.2.2 Integration of Containers with OVN and OpenStack...................... 96 5.2.3 Open Virtual Network With firewalld............................. 97 6 Reference Guide 99 6.1 Man Pages................................................ 99 6.1.1 ovn-sim............................................. 99 7 Open Virtual Network (OVN) FAQ 103 7.1 Development............................................... 103 7.2 General.................................................. 104 8 OVN Internals 107 8.1 Contributing to OVN........................................... 107 8.1.1 Submitting Patches....................................... 107 8.1.2 Backporting patches...................................... 113 8.1.3 OVN Coding Style....................................... 115 8.1.4 OVN Documentation Style................................... 123 8.1.5 Open vSwitch Library ABI Updates.............................. 129 8.2 Mailing Lists............................................... 131 ii 8.2.1 ovs-announce.......................................... 131 8.2.2 ovs-discuss........................................... 131 8.2.3 ovs-dev............................................. 131 8.2.4 bugs............................................... 131 8.2.5 security............................................. 131 8.3 Patchwork................................................ 131 8.3.1 git-pw.............................................. 132 8.3.2 pwclient............................................. 132 8.4 OVN Release Process.......................................... 132 8.4.1 Release Strategy........................................ 132 8.4.2 Release Numbering....................................... 133 8.4.3 Release Scheduling....................................... 133 8.4.4 Release Calendar........................................ 133 8.4.5 Contact............................................. 134 8.5 Reporting Bugs in OVN......................................... 134 8.6 OVN’s Security Process......................................... 135 8.6.1 What is a vulnerability?..................................... 135 8.6.2 Step 1: Reception........................................ 135 8.6.3 Step 2: Assessment....................................... 135 8.6.4 Step 3a: Document....................................... 136 8.6.5 Step 3b: Fix........................................... 137 8.6.6 Step 4: Embargoed Disclosure................................. 138 8.6.7 Step 5: Public Disclosure.................................... 138 8.7 Emeritus Status for OVN Committers.................................. 138 8.8 Expectations for Developers with OVN Repo Access.......................... 139 8.8.1 Pre-requisites.......................................... 139 8.8.2 Review............................................. 139 8.8.3 Git conventions......................................... 139 8.9 OVN Committer Grant/Revocation Policy................................ 140 8.9.1 Granting Commit Access.................................... 140 8.9.2 Revoking Commit Access................................... 141 8.9.3 Changing the Policy...................................... 142 8.9.4 Nomination to Grant Commit Access............................. 142 8.9.5 Vote to Grant Commit Access................................. 142 8.9.6 Vote Results for Grant of Commit Access........................... 142 8.9.7 Invitation to Accepted Committer............................... 142 8.9.8 Proposal to Revoke Commit Access for Detrimental Behavior................ 143 8.9.9 Vote to Revoke Commit Access................................ 143 8.9.10 Vote Results for Revocation of Commit Access........................ 143 8.9.11 Notification of Commit Revocation for Detrimental Behavior................. 144 8.10 Authors.................................................. 144 8.11 Committers................................................ 157 8.12 How OVN’s Documentation Works................................... 158 8.12.1 reStructuredText and Sphinx.................................. 158 8.12.2 ovs-sphinx-theme........................................ 158 8.12.3 Read the Docs.......................................... 158 8.12.4 ovn.org............................................. 158 iii iv CHAPTER 1 Open Virtual Network (OVN) Documentation 1.1 How the Documentation is Organised The Open Virtual Network (OVN) documentation is organised into multiple sections: • Installation guides guide you through installing Open vSwitch (OVS) and Open Virtual Network (OVN) on a variety of different platforms • Tutorials take you through a series of steps to configure OVS and OVN in sandboxed environments • Topic guides provide a high level overview of OVS and OVN internals and operation • How-to guides are recipes or use-cases for OVS and OVN. They are more advanced than the tutorials. • Frequently Asked Questions provide general insight into a variety of topics related to configuration and operation of OVS and OVN. 1.2 First
Recommended publications
  • Basis Technology Unicode対応ライブラリ スペックシート 文字コード その他の名称 Adobe-Standard-Encoding A
    Basis Technology Unicode対応ライブラリ スペックシート 文字コード その他の名称 Adobe-Standard-Encoding Adobe-Symbol-Encoding csHPPSMath Adobe-Zapf-Dingbats-Encoding csZapfDingbats Arabic ISO-8859-6, csISOLatinArabic, iso-ir-127, ECMA-114, ASMO-708 ASCII US-ASCII, ANSI_X3.4-1968, iso-ir-6, ANSI_X3.4-1986, ISO646-US, us, IBM367, csASCI big-endian ISO-10646-UCS-2, BigEndian, 68k, PowerPC, Mac, Macintosh Big5 csBig5, cn-big5, x-x-big5 Big5Plus Big5+, csBig5Plus BMP ISO-10646-UCS-2, BMPstring CCSID-1027 csCCSID1027, IBM1027 CCSID-1047 csCCSID1047, IBM1047 CCSID-290 csCCSID290, CCSID290, IBM290 CCSID-300 csCCSID300, CCSID300, IBM300 CCSID-930 csCCSID930, CCSID930, IBM930 CCSID-935 csCCSID935, CCSID935, IBM935 CCSID-937 csCCSID937, CCSID937, IBM937 CCSID-939 csCCSID939, CCSID939, IBM939 CCSID-942 csCCSID942, CCSID942, IBM942 ChineseAutoDetect csChineseAutoDetect: Candidate encodings: GB2312, Big5, GB18030, UTF32:UTF8, UCS2, UTF32 EUC-H, csCNS11643EUC, EUC-TW, TW-EUC, H-EUC, CNS-11643-1992, EUC-H-1992, csCNS11643-1992-EUC, EUC-TW-1992, CNS-11643 TW-EUC-1992, H-EUC-1992 CNS-11643-1986 EUC-H-1986, csCNS11643_1986_EUC, EUC-TW-1986, TW-EUC-1986, H-EUC-1986 CP10000 csCP10000, windows-10000 CP10001 csCP10001, windows-10001 CP10002 csCP10002, windows-10002 CP10003 csCP10003, windows-10003 CP10004 csCP10004, windows-10004 CP10005 csCP10005, windows-10005 CP10006 csCP10006, windows-10006 CP10007 csCP10007, windows-10007 CP10008 csCP10008, windows-10008 CP10010 csCP10010, windows-10010 CP10017 csCP10017, windows-10017 CP10029 csCP10029, windows-10029 CP10079 csCP10079, windows-10079
    [Show full text]
  • Inews V3.4.2 Readme • 9390-65038-00 Rev
    iNEWS® Newsroom Computer System Version 3.4.2 ReadMe Date Revised Changes Made July 28, 2011 Added information related to v3.4.2 release July 5, 2011 Added information related to v3.4.1 release 12 May 2011 Added information related to v3.4.0 release 7 March 2011 Added information related to v3.3.1 release 30 November 2010 Added information related to v3.3.0 release 23 November 2010 Added information related to v3.2.2 release 14 October 2010 Added information related to v3.2.1 release 24 May 2010 Initial version (based off of v3.1.1 doc.) Important Information Avid recommends that you thoroughly read all of the information in this ReadMe file before installing or using any new software release. Note: Search the Avid Knowledge Base (http://www.avid.com/onlinesupport) for the most up-to-date ReadMe file, which contains the latest information that might have become available after the documentation was published. This document describes compatibility issues with previous releases, hardware and software requirements, software installation instructions, and summary information on system and memory requirements, when applicable. This document also lists any hardware and/or software limitations. Note: Since this release of iNEWS will be more widely distributed than previous versions, some notes on important features and changes have been brought forward from previous ReadMe documents. Notes that are less important were not brought forward, and users should reference older iNEWS ReadMe files for additional change information not contained in this ReadMe. Version 3.4.2 ReadMe Contents Important Information .............................................................................................................................................. 1 Compatibility Notes and Issues ................................................................................................................................
    [Show full text]
  • Instantly Identify and Triage Many Languages
    Rosette® BIG TEXT ANALYTICS Language Identifier RLI RLI ROSETTE Identify languages and encodings Language Identifier Sortedwww.basistech.com Languages [email protected] +1 617-386-2090 Base Linguistics RBL RBL ROSETTE Search many languages with high accuracy InstantlyBase Linguistics identify and triageBetter Search Entity Extractor REX REX ROSETTE Tag names of people, places, and organizations manyEntity languages Extractor within largeTagged Entities English Primary Language Entity Resolver 8% RES voRESlumes ROSETTE of text. French Make real-world connections in your data Chinese Entity Resolver Chinese RealPrimary Scrip Identitiest 即时识别和处理大量多语言文本。 22% Arabic 39% Latin Identifiez et triez instantanément plusieurs French French Name Indexer English RNI languesRNI à travers ROSETTE de nombreux textes. Match names between many variations Name Indexer Matched Names %31 اﻟﺘﺤﺪﻳﺪ واﻟﺘﺼﻨﻴﻒ اﻟﻔﻮري ﻟﻠﻌﺪﻳﺪ ﻣﻦ اﻟﻠﻐﺎت ﺿﻤﻦ ﻛﻤﻴﺎت ﻛﺒﻴﺮة ﻣﻦ اﻟﻨﺼﻮص. Arabic Name Translator RNT RNT ROSETTE Translate foreign names into English Name Translator Translated Names Identify languages and Supported Categorizer Languages transform ROSETTE encodings 55 RCA Categorize Everything In Sight RCA Rosette® LanguageCategorizer Identifier (RLI) analyzes text from a few words to whole KEY FEATURES Sorted Content documents, to detect the languages and character encoding with speed and very high accuracy. Automatic language identification is the necessary first - Simple API Sentiment Analyzer step for applications that categorize, search, process, and store text in many - Fast and scalable ROSETTE - Industrial-strength support RSA languages.RSA Individual documents may be routed to language specialists, or sent Detect The Sentiments Of Your Text - Easy installation into language-specificSentiment analysis pipelines Analyzer (such as Rosette Base Linguistics) to Actionable Insights - Flexible and customizable improve the quality of search results.
    [Show full text]
  • Gain Insight and Deep Value from Unstructured
    www.basistech.com [email protected] +1 617-386-2090 Concept What is Big Text ? Pronoun Verb Name English It's huge volumes of multilingual , unstructured Pronoun+Verb Adjective Noun Prep. Adjective Adjective text that must be processed to deliver insights Noun Rel. Pronoun Verb Verb Verb Inf. Verb Noun Person and build connections . It’s President Clinton Conjunction Verb Noun Pronoun+Verb Title Name Place Person Place helping Malawi . Secretary Clinton in . Verb Name Title Name Prep. Name Urdu: “Islamabad” Place Concept The 福島 '"*!& &+' Determiner Noun Pronoun Verb Name Japanese: "Fukushima” Gain insight and deep value Supported from unstructured text 55 Languages ® Modern enterprise is well-acquainted Rosette is a suite of software KEY FEATURES with the promise of big data to components for use in enterprise revolutionize our insights and applications. It uses linguistic analysis, - Simple API decision making, although it is less statistical modeling, and machine - Fast and scalable well-known that up to 80% of big data learning to accurately process Big Text, - Industrial-strength support is represented by Big Text. Big Text revealing valuable information and - Easy installation is large quantities of “unstructured” actionable data. - Flexible and customizable text chunks found in documents, - Java or C++ webpages, and databases with all the Individually, each component is a - Unix, Linux, Mac, or Windows hallmarks of big data: the three Vs robust tool for processing language, - Built to work with Apache Solr™ and Elasticsearch (Volume, Velocity, and Variety). Big documents, or names. When - Cloudera certified partner Text is also multilingual, covering combined together, they create many languages and scripts, in all of powerful solutions that deliver useful their complexities and challenges.
    [Show full text]
  • Man Pages Section 7 Device and Network Interfaces
    man pages section 7: Device and Network Interfaces Part No: 816–5177–16 September 2010 Copyright © 2010, Oracle and/or its affiliates. All rights reserved. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. If this is software or related software documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are “commercial computer software” or “commercial technical data” pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, duplication, disclosure, modification, and adaptation shall be subject to the restrictions and license terms setforth in the applicable Government contract, and, to the extent applicable by the terms of the Government contract, the additional rights set forth in FAR 52.227-19, Commercial Computer Software License (December 2007). Oracle America, Inc., 500 Oracle Parkway, Redwood City, CA 94065.
    [Show full text]
  • Identifiez Et Triez Instantanément Plusieurs Langues À Travers De
    Rosette® BIG TEXT ANALYTICS Language Identifier RLI RLI ROSETTE Identifiez les langues et les codages de caractères Language Identifier Deswww.basistech.com langues triées [email protected] +1 617-386-2090 Base Linguistics RBL RBL ROSETTE Lancez des recherches multilingues Base Linguistics Une recherche améliorée extrêmement précises Identifiez et triez instantanément Entity Extractor REX REX ROSETTE Ajoutez les noms de personnes, de lieux et d'organisations en mots-clés plusieursEntity Extractor langues à travers deNoms des entités Français Langue principale Entity Resolver 8% RES nombreuxRES ROSETTE textes. Anglais Make real-world connections in your data Entity Resolver Real Identities Chinois Chinois Charactères principaux 即时识别和处理大量多语言文本。 22% Arabe 39% Latin Instantly identify and triage many languages Name Indexer Anglais Anglais ROSETTE RNI withinRNI large volumes of text. Français Assurez la concordance des noms entre leurs nombreuses variantes Name Indexer Concordance des identités %31 اﻟﺘﺤﺪﻳﺪ واﻟﺘﺼﻨﻴﻒ اﻟﻔﻮري ﻟﻠﻌﺪﻳﺪ ﻣﻦ اﻟﻠﻐﺎت Arabe ﺿﻤﻦ ﻛﻤﻴﺎت ﻛﺒﻴﺮة ﻣﻦ اﻟﻨﺼﻮص. Name Translator RNT RNT ROSETTE Traduisez des noms étrangers en anglais Name Translator Noms traduits Identifiez les langues et Categorizer RCA transformezRCA ROSETTE les codages Langues prises Categorize Everything In Sight Categorizer 55 enSorted charge Content Rosette® Language Identifier (RLI) balaie le texte des documents pour FONCTIONNALITÉS PRINCIPALES déterminer et localiser les langues écrites et le codage des caractères avec rapidité et une précision très élevée. L'identification automatique des langues simplifie le - API simple Sentiment Analyzer - Grande échelle et haut rendement traitement de grandes ROSETTE quantités de texte, ce qui est nécessaire pour les logiciels RSA Detect The Sentiments Of Your Text RSA - Assistance professionnelle qui catégorisent, recherchent, traitent et stockent du texte composé de plusieurs Sentiment Analyzer - Installation facile Actionable Insights langues.
    [Show full text]
  • Tutorial: Internet Languages, Character Sets and Encodings
    TUTORIAL: INTERNET LANGUAGES, CHARACTER SETS AND ENCODINGS by Michael K. Bergman BrightPlanet Corporation March 23, 2006 Broad-scale, international open source harvesting from the Internet poses many challenges in use and translation of legacy encodings that have vexed academics and researchers for many years. Successfully addressing these challenges will only grow in importance as the relative percentage of international sites grows in relation to conventional English ones. A major challenge in internationalization and foreign source support is “encoding.” Encodings specify the arbitrary assignment of numbers to the symbols (characters or ideograms) of the world’s written languages needed for electronic transfer and manipulation. One of the first encodings developed in the 1960s was ASCII (numerals, plus a-z; A-Z); others developed over time to deal with other unique characters and the many symbols of (particularly) the Asiatic languages. Some languages have many character encodings and some encodings, for example Chinese and Japanese, have very complex systems for handling the large number of unique characters. Two different encodings can be incompatible by assigning the same number to two distinct symbols, or vice versa. So-called Unicode set out to consolidate many different encodings, all using separate code plans into a single system that could represent all written languages within the same character encoding. There are a few Unicode techniques and formats, the most common being UTF-8. The Internet was originally developed via efforts in the United States funded by ARPA (later DARPA) and NSF, extending back to the 1960s. At the time of its commercial adoption in the early 1990s via the Word Wide Web protocols, it was almost entirely dominated by English by virtue of this U.S.
    [Show full text]
  • Vntex — Typesetting Vietnamese Hàn Thế Thành Reinhard Kotucha
    VnTEX — Typesetting Vietnamese Hàn Thế Thành Reinhard Kotucha Abstract VnTEX is an extension to Donald Knuth’s TEX typesetting system which provides support for typesetting Vietnamese. The primary site of VnTEX is http://vntex.sf.net. 1 Where to get Help The current maintainers of VnTEX are: I Hàn Thế Thành [email protected] I Reinhard Kotucha [email protected] I Werner Lemberg [email protected] There is a mailing list (very low traffic) for questions about VnTEX and typesetting Vietnamese. To subscribe to the list, visit: http://lists.sourceforge.net/lists/listinfo/vntex-users There is also a Wiki: http://vntex.info 2 Related Documents 1 The following files are part of the VnTEX distribution I Hàn Thế Thành, Hỗ trợ tiếng Việt cho TEX [print version] I Hàn Thế Thành, Minimal steps to typeset Vietnamese[print version] I Hàn Thế Thành và Thái Phú Khánh Hòa, Dùng font với VnTEX [print version] The following files are not part of VnTEX but might be part of the TEX distribution you are using. I The American Mathematical Society, Hướng dẫn sử dụng gói amsmath, http://ctan.org/tex-archive/info/amslatex/vietnamese/amsldoc-vi.pdf http://ctan.org/tex-archive/info/amslatex/vietnamese/amsldoc-print-vi.pdf I H. Partl, E. Schlegl, I. Hyna, T. Oetiker, Một tài liệu ngắn gọn giới thiệu về LATEX 2", Translated by Nguyễn Tân Khoa. http://ctan.org/tex-archive/info/lshort/vietnamese/lshort-vi.pdf I Wolfgang May, Andreas Schlechte, Mở rộng môi trường định lý. Translated by Huỳnh Kỳ Anh. http://ctan.org/tex-archive/info/translations/vn/ntheorem-doc-vn.pdf 1The print versions should be used with monochrome printers.
    [Show full text]
  • Typing Vietnamese Characters with Vpskeys Microsoft Word Setup
    Typing Vietnamese Characters with VPSKeys Tutorial :: www.yale.edu/vietnamese/vietfont.htm Typing Vietnamese Characters with VPSKeys In order to type Vietnamese characters, you must have a set of keyboard drivers that allow you to insert accents at the appropriate locations. One great FREE program is VPSKeys by the Vietnamese Professionals Society. The best part of this program is that it features Unicode. Unicode is a special type of encoding method that allows the user to type Vietnamese characters using regular Windows fonts such as Times, Arial, Courier, etc. This standard allows any computer, even those without Vietnamese fonts, to read text that you've typed. It also allows browsers to display Vietnamese characters without the need of previously installed Vietnamese fonts. Before the creation of Unicode, websites were often illegible because the browsers had difficulty selecting the right type of font to display. Installation 1. Download VPSKeys at www.vps.org under the DOWNLOAD section. 2. Once you've download it, double click on it to install. Please follow the on-screen instructions to install. Microsoft Word Setup One of the biggest problems users may encounter while typing Vietnamese characters in Microsoft Word is that it automatically changes the spelling of some Vietnamese words. For example, "người" (people) gets changed into "ngườI". To prevent this problem, you will need to disable the AutoCorrect option: 1. Click on the Tools menu and select AutoCorrect Options menu. 2. Uncheck the Replace text as you type box. 3. Click OK. Created on 08/17/02 by Tung Huu Nguyen :: [email protected] :: Revised 11/15/02 1 Typing Vietnamese Characters with VPSKeys Tutorial :: www.yale.edu/vietnamese/vietfont.htm VPSKeys Setup Now that you’ve installed VPSKeys and setup MS Word, the next step is to setup VPSKeys.
    [Show full text]
  • PAN Localization Survey of Language Computing in Asia 2005
    Survey of Language Computing in Asia 2005 Sarmad Hussain Nadir Durrani Sana Gul Center for Research in Urdu Language Processing National University of Computer and Emerging Sciences www.nu.edu.pk www.idrc.ca Published by Center for Research in Urdu Language Processing National University of Computer and Emerging Sciences Lahore, Pakistan Copyrights © International Development Research Center, Canada Printed by Walayatsons, Pakistan ISBN: 969-8961-00-3 This work was carried out with the aid of a grant from the International Development Research Centre (IDRC), Ottawa, Canada, administered through the Centre for Research in Urdu Language Processing (CRULP), National University of Computer and Emerging Sciences (NUCES), Pakistan. ii To the languages which will be lost before they are saved iii iv Preface This report is an effort to document the state of localization in Asia. There are a lot of different initiatives undertaken to localize technology across Asia. However, no study surveys the extent of work completed. It is necessary to document the status to formulate effective and coordinated strategies for further development. Therefore, current work was undertaken to collect the available data to baseline local language computing in Asia. This work has been done through PAN Localization project. There are about 2200 languages spoken in Asia. It is difficult to undertake the task of documenting the status of all these languages. Twenty languages are being surveyed to assess the level of language computing across Asia. The selected languages have official status in Asian countries of Middle East, South, South East and East Asia. The selection has been done to cover a variety of scripts and languages of Asia, but is eventually arbitrary.
    [Show full text]
  • Soforterkennung Und Sortierung Vieler Verschiedener Sprachen Innerhalb
    Rosette® BIG TEXT ANALYTICS Language Identifier RLI RLI ROSETTE Identifizierung von Sprachen und Language Identifier Sortierung nach Sprachen Codierungen www.basistech.com [email protected] +1 617-386-2090 Base Linguistics RBL RBL ROSETTE Suche für viele Sprachen mit hoher Base Linguistics Bessere Suche Genauigkeit Soforterkennung und Sortierung vieler Entity Extractor REX REX ROSETTE Erkennung von Personen, Orten und Organisationen verschiedenerEntity Extractor Sprachen innerhalb Namen von Entitäten Deutsch Hauptsprache Entity Resolver 8% RES größererRES ROSETTE Textvolumina. Französisch Make real-world connections in your data Entity Resolver Real Identities Chinesisch Chinesisch Hauptschrift 即时识别和处理大量多语言文本。 22% Arabisch 39% Lateinisch Identifiez et triez instantanément plusieurs Name Indexer Französisch ROSETTE Französisch RNI languesRNI à travers de nombreux textes. Deutsch Vergleich von Namen in vielen Variationen Name Indexer Übereinstimmende Identitäten %31 اﻟﺘﺤﺪﻳﺪ واﻟﺘﺼﻨﻴﻒ اﻟﻔﻮري ﻟﻠﻌﺪﻳﺪ ﻣﻦ اﻟﻠﻐﺎت Arabisch ﺿﻤﻦ ﻛﻤﻴﺎت ﻛﺒﻴﺮة ﻣﻦ اﻟﻨﺼﻮص. Name Translator RNT RNT ROSETTE Übersetzung fremdsprachiger Namen ins Englische Name Translator Übersetzte Namen Spracherkennung Unterstützte Categorizer Sprachen RCA undRCA Umwandlung ROSETTE von 55 Categorize Everything In Sight Categorizer Sorted Content Zeichencodierungen HAUPTMERKMALE Sentiment Analyzer Der Rosette® Language Identifier (RLI) analysiert Texte innerhalb von Dokumenten, um Sprachen und ROSETTE Zeichencodierungen mit extrem hoher Geschwindigkeit - Einfache API RSA Detect The Sentiments
    [Show full text]
  • On the Use of Machine Translation-Based Approaches for Vietnamese Diacritic Restoration
    On the Use of Machine Translation-Based Approaches for Vietnamese Diacritic Restoration Thai-Hoang Pham Xuan-Khoai Pham Phuong Le-Hong Alt Inc FPT University Vietnam National University Hanoi, Vietnam Hanoi, Vietnam Hanoi, Vietnam Email: [email protected] Email: [email protected] Email: [email protected] Abstract —This paper presents an empirical study of two Table I: A map from non-diacritic characters to diacritic machine translation-based approaches for Vietnamese diacritic restoration problem, including phrase-based and neural-based characters machine translation models. This is the first work that applies Non-diacritic Non-diacritic + Type 1 Non-diacritic + Type 1 + Type 2 neural-based machine translation method to this problem and a a, ă, â a, à, ả, ã, ạ, ă, ắ, ằ, ẳ, ẵ, ặ, â, ấ, ầ, ẩ, ẫ, ậ gives a thorough comparison to the phrase-based machine trans- e e, ê e, é, è, ẻ, ẽ, ẹ, ê, ế, ề, ể, ễ, ệ lation method which is the current state-of-the-art method for i i i, í, ì, ỉ, ĩ, ị o o, ô o, ó, ò, ỏ, õ, ọ, ô, ố, ồ, ổ, ỗ, ộ this problem. On a large dataset, the phrase-based approach has u u, ư u, ú, ù, ủ, ũ, ụ, ư, ứ, ừ, ử, ữ, ự an accuracy of 97.32% while that of the neural-based approach y y y, ý, ỳ, ỷ, ỹ, ỵ is 96.15%. While the neural-based method has a slightly lower d d, đ accuracy, it is about twice faster than the phrase-based method in terms of inference speed.
    [Show full text]