Soforterkennung Und Sortierung Vieler Verschiedener Sprachen Innerhalb

Total Page:16

File Type:pdf, Size:1020Kb

Soforterkennung Und Sortierung Vieler Verschiedener Sprachen Innerhalb Rosette® BIG TEXT ANALYTICS Language Identifier RLI RLI ROSETTE Identifizierung von Sprachen und Language Identifier Sortierung nach Sprachen Codierungen www.basistech.com [email protected] +1 617-386-2090 Base Linguistics RBL RBL ROSETTE Suche für viele Sprachen mit hoher Base Linguistics Bessere Suche Genauigkeit Soforterkennung und Sortierung vieler Entity Extractor REX REX ROSETTE Erkennung von Personen, Orten und Organisationen verschiedenerEntity Extractor Sprachen innerhalb Namen von Entitäten Deutsch Hauptsprache Entity Resolver 8% RES größererRES ROSETTE Textvolumina. Französisch Make real-world connections in your data Entity Resolver Real Identities Chinesisch Chinesisch Hauptschrift 即时识别和处理大量多语言文本。 22% Arabisch 39% Lateinisch Identifiez et triez instantanément plusieurs Name Indexer Französisch ROSETTE Französisch RNI languesRNI à travers de nombreux textes. Deutsch Vergleich von Namen in vielen Variationen Name Indexer Übereinstimmende Identitäten %31 اﻟﺘﺤﺪﻳﺪ واﻟﺘﺼﻨﻴﻒ اﻟﻔﻮري ﻟﻠﻌﺪﻳﺪ ﻣﻦ اﻟﻠﻐﺎت Arabisch ﺿﻤﻦ ﻛﻤﻴﺎت ﻛﺒﻴﺮة ﻣﻦ اﻟﻨﺼﻮص. Name Translator RNT RNT ROSETTE Übersetzung fremdsprachiger Namen ins Englische Name Translator Übersetzte Namen Spracherkennung Unterstützte Categorizer Sprachen RCA undRCA Umwandlung ROSETTE von 55 Categorize Everything In Sight Categorizer Sorted Content Zeichencodierungen HAUPTMERKMALE Sentiment Analyzer Der Rosette® Language Identifier (RLI) analysiert Texte innerhalb von Dokumenten, um Sprachen und ROSETTE Zeichencodierungen mit extrem hoher Geschwindigkeit - Einfache API RSA Detect The Sentiments Of Your Text undRSA Genauigkeit zu identifizieren und zu lokalisieren. Durch die automatische - Hohe Skalierung und hoherActionable Durchsatz Insights SpracherkennungSentiment wird die Verarbeitung großerAnalyzer Textmengen optimiert. Dies ist - Zuverlässiger Support notwendig für die Kategorisierung, Suche, Verarbeitung und Speicherung von - Einfache Installation Texten in vielen Sprachen. Einzelne Dokumente können an Sprachexperten - Flexibel und kundenspezifisch anpassbar weitergeleitet oder automatisch dem Workflow zur Verbesserung zugeführt werden. - Integration: Java, C++ und Web Services Dieses Verfahren kann auch mit sprachspezifischen Suchmaschinen-Plug-ins (wie - Plattform: Unix, Linux, Mac, PC (64- oder Rosette Base Linguistics) kombiniert werden, um die Qualität der Suchergebnisse 32-Bit) zu verbessern. - Komponente des Rosette SDK Der RLI erreicht seine sehr hohe Treffsicherheit durch die Anwendung proprietärer Algorithmen, die durch hochangereicherte Sprachprofile und statistische Analysen ergänzt werden. Als Linguistik-Experte mit umfassenden Kenntnissen hinsichtlich der Verknüpfung von Sprache und Technologie nimmt Basis Technology kontinuierliche Verbesserungen an der Rosette-Produktfamilie vor. So werden ständig zusätzliche Sprachen integriert, Funktionen aktualisiert und die neuesten Innovationen aus der akademischen Welt angewandt. Kundenauswahl RLI noch heute nutzen, StumbleUpon kostenlose Produktevaluierung www.basistech.com Rosette® BIG TEXT ANALYTICS Language Identifier RLI RLI ROSETTE Identifizierung von Sprachen und Language Identifier Sortierung nach Sprachen ® Codierungen Rosette Base Linguistics BIG TEXT ANALYTICS RBL RBL ROSETTE Suche für viele Sprachen mit hoher Base Linguistics KENNZEICHNUNG VON Bessere Suche Genauigkeit ERKENNUNGSFUNKTIONEN SPRACHSEGMENTENLanguage Identifier UMWANDLUNG VON CODIERUNGEN ROSETTE RLI Identifizierung von Sprachen und RLI Entity Extractor - Erkennung der primären bzw. dominanten J'ai été surprise par cette surprise. Vice President Language Identifier Sortierung nach Sprachen ROSETTE Codierungen REX REXSprache eines Dokuments Erkennung von Personen, Orten und Entity Extractor Biden spoke about this in Munich. El carpinterNameno von Entitäten Organisationen - Erkennung der Alphabete in dem Dokument, prensa los bordes de la placa decorativa. Proper Obwohl moderne Textcodierungsstandards z. B. lateinisch und kyrillisch wound careBase management Linguistics prevents die Geige gibt ROSETTE Entity Resolver RBL wie XML die Verwendung von UnicodeRBL einen schoenen Laut von sich. RES - RESBestimmung ROSETTE aller Sprachen und ihres Anteils Suche für viele Sprachen mit vorschreiben,hoher benutzen viele bestehende Bessere Suche Make real-world connections in your data Base Linguistics in mehrsprachigenEntity Dokumenten Resolver Genauigkeit Real IdentitiesAnwendungen, Dokumente, Websites und - Kompatibilität mit transkribierten Texten, Englisch Französisch Deutsch Spanisch Datenströme alte Codierungen wie ASCII, ISO wie zum Beispiel arabischen Chats in In einem Dokument werden oft mehrere 8859-1, Shift-JIS und viele andere. Name Indexer lateinischen Zeichen. Sprachen verwendet.Entity Dies Extractor stellt eine ROSETTE RNI RNI Herausforderung für Computer und Menschen Rosette wandelt große Textmengen mit diesen ROSETTE Vergleich von Namen in vielen Variationen REX REX Name Indexer Erkennung von Personen,Übereinstimmende Orten und Identitäten dar. Der RLI fügt Kennzeichnungen für Beginn alten Codierungen in ein einziges, einheitliches Entity Extractor Namen von Entitäten und Ende derOrganisationen einzelnen Sprachsegmente in Format im Unicode-Standard um. Dieser mehrsprachige Dokumente ein – auch wenn umgewandelte Text kann dann in jeder Sprache Name Translator genutzt werden, wodurch die Beschädigung RNT RNT ROSETTE alle Sprachen das gleiche Alphabet verwenden, Übersetzung fremdsprachiger Namen ins wie zum BeispielEntity Englisch, Resolver Französisch, Deutsch von Daten und andere Probleme aufgrund Name Translator Übersetzte Namen ROSETTE Englische RESoder Italienisch. Auch Schriftwechsel werden inkompatibler Codes vermieden werden.RES Make real-world connections in your data erkannt, wie zum Beispiel vom lateinischen zum Entity Resolver Real Identities Categorizer kyrillischen Alphabet, vom japanischen Kana RCA RCA ROSETTE zum chinesischen Hanzi. Categorize Everything In Sight Categorizer Sorted Content Name Indexer KOMPATIBILITÄT MIT SPRACHENRNI UND CODIERUNGEN RNI ROSETTE Sentiment Analyzer Vergleich von Namen in vielen Variationen Name Indexer Übereinstimmende Identitäten ROSETTE RSA Detect The Sentiments Of Your Text RSA Albanisch — ISO-8859-1, Windows-1252 Litauisch — ISO-8859-13, Windows-1257 SentimentSprachen-/ Analyzer Arabisch — ISO-8859-6, Windows-720,Actionable Mazedonisch Insights — ISO-8859-5, Windows-1251 Codierungspaare Windows-1256 Malaiisch — ISO-8859-1, Windows-1252 Arabisch (transkribiert)Name Translator — ISO-8859-1, Malayalam — ISCII-Malayalam 188 ROSETTE RNTWindows-1252, Windows-1256 Norwegisch — ISO-8859-1, Windows-1252RNT Übersetzung fremdsprachiger Namen ins Bengali — EnglischeISCII-Bengali Paschtunisch — ISO-8859-6, Windows-1256 Name Translator Übersetzte Namen Sprachen Bulgarisch — ISO-8859-5, Windows-1251, KOI8-R Paschtunisch (transkribiert) — ISO-8859-1, mit Unicode Katalanisch — ISO-8859-1, Windows-1252 Windows-1252 55 Chinesisch, vereinfacht — GB-2312, GB-18030, Persisch — ISO-8859-6, Windows-1256 HZ-GB-2312,Categorizer ISO-2022-CN Persisch (transkribiert) — ISO-8859-1, ROSETTE Lateinische RCAChinesisch,Categorize traditionell — Everything Big5, Big5-HKSCS In Sight Windows-1252, Windows-1256 RCA Kroatisch — Windows-1250 Polnisch — ISO-8859-2, Windows-1250 Categorizer Sorted Content Schriftvarianten Tschechisch — ISO-8859-2, Windows-1250 Portugiesisch — ISO-8859-1, Windows-1252 7 Dänisch — ISO-8859-1, Windows-1252 Rumänisch — ISO-8859-2, Windows-1250 (Transkribierungen) NiederländischSentiment — ISO-8859-1, Windows-1252 Analyzer Russisch — ISO-8859-5, Windows-1251, KOI8-R, Legacy- RSAEnglisch — ISO-8859-1, Windows-1252 IBM-866, Mac Kyrillisch RSA ROSETTE codierung Estnisch —Detect ISO-8859-13, The Windows-1257Sentiments Of YourSerbisch Text — ISO-8859-5, Windows-1251 Sentiment Analyzer Actionable Insights 44 Finnisch — ISO-8859-1, Windows-1252 Serbisch (transkribiert) — ISO-8859-2, Französisch — ISO-8859-1, Windows-1252 Windows-1250 Deutsch — ISO-8859-1, Windows-1252 Slowakisch — Windows-1250 Griechisch — ISO-8859-7, Windows-1253 Slowenisch — Windows-1250 Gujarati — ISCII-Gujarati Somali — ISO-8859-1, Windows-1252 Hebräisch — ISO-8859-8, Windows-1255 Spanisch — ISO-8859-1, Windows-1252 Hindi — ISCII-Hindi Schwedisch — ISO-8859-1, Windows-1252 Ungarisch — ISO-8859-2, Windows-1250 Tagalog — ISO-8859-1, Windows-1252 Isländisch — ISO-8859-1, Windows-1252 Tamil — ISCII-Tamil Indonesisch — ISO-8859-1, Windows-1252 Telugu — ISCII-Telugu Kompatibilität Italienisch — ISO-8859-1, Windows-1252 Thai — Windows-874 Japanisch — EUC-JP, ISO-2022-JP, Shift-JIS, Türkisch — ISO-8859-9, Windows-1254 Code-Basis Plattformen Shift-JIS-2004 (JIS X 0213) Ukrainisch — ISO-8859-5, Windows-1251, KOI8-R Kannada — ISCII-Kannada Urdu — ISO-8859-6, Windows-1256 Koreanisch — EUC-KR, ISO-2022-KR Urdu (transkribiert) — ISO-8859-1, Kurdisch — Windows-1256 Windows-1252 Kurdisch (transkribiert) — ISO-8859-1, Usbekisch — ISO-8859-5, Windows-1251, KOI8-R Windows-1252, Windows-1256 Usbekisch (transkribiert) — Windows-1251 Lettisch — ISO-8859-13, Windows-1257 Vietnamesisch — TCVN, VIQR, VISCII, VNI, VPS © 2015 Basis Technology Corporation. „Basis Technology“ ZENTRALE USA FEDERAL US-WESTKÜSTE EUROPA ASIEN und „Rosette“ sind eingetragene Marken der Basis Technology Corporation. Alle Marken, Dienstleistungszeichen und Logos, One Alewife Center 2553 Dulles View Dr. 1700 Montgomery St Furzeground Way 9-6 Nibancho, die in diesem Dokument verwendet werden, sind Eigentum der Cambridge, MA Suite 450 San Francisco, CA Middlesex UB11 1BD, Chiyoda-ku jeweiligen Inhaber. (2014-12-18-RLI) 02140 Herndon, VA 94111 UK Tokyo 102-0084, 20171 Japan.
Recommended publications
  • Basis Technology Unicode対応ライブラリ スペックシート 文字コード その他の名称 Adobe-Standard-Encoding A
    Basis Technology Unicode対応ライブラリ スペックシート 文字コード その他の名称 Adobe-Standard-Encoding Adobe-Symbol-Encoding csHPPSMath Adobe-Zapf-Dingbats-Encoding csZapfDingbats Arabic ISO-8859-6, csISOLatinArabic, iso-ir-127, ECMA-114, ASMO-708 ASCII US-ASCII, ANSI_X3.4-1968, iso-ir-6, ANSI_X3.4-1986, ISO646-US, us, IBM367, csASCI big-endian ISO-10646-UCS-2, BigEndian, 68k, PowerPC, Mac, Macintosh Big5 csBig5, cn-big5, x-x-big5 Big5Plus Big5+, csBig5Plus BMP ISO-10646-UCS-2, BMPstring CCSID-1027 csCCSID1027, IBM1027 CCSID-1047 csCCSID1047, IBM1047 CCSID-290 csCCSID290, CCSID290, IBM290 CCSID-300 csCCSID300, CCSID300, IBM300 CCSID-930 csCCSID930, CCSID930, IBM930 CCSID-935 csCCSID935, CCSID935, IBM935 CCSID-937 csCCSID937, CCSID937, IBM937 CCSID-939 csCCSID939, CCSID939, IBM939 CCSID-942 csCCSID942, CCSID942, IBM942 ChineseAutoDetect csChineseAutoDetect: Candidate encodings: GB2312, Big5, GB18030, UTF32:UTF8, UCS2, UTF32 EUC-H, csCNS11643EUC, EUC-TW, TW-EUC, H-EUC, CNS-11643-1992, EUC-H-1992, csCNS11643-1992-EUC, EUC-TW-1992, CNS-11643 TW-EUC-1992, H-EUC-1992 CNS-11643-1986 EUC-H-1986, csCNS11643_1986_EUC, EUC-TW-1986, TW-EUC-1986, H-EUC-1986 CP10000 csCP10000, windows-10000 CP10001 csCP10001, windows-10001 CP10002 csCP10002, windows-10002 CP10003 csCP10003, windows-10003 CP10004 csCP10004, windows-10004 CP10005 csCP10005, windows-10005 CP10006 csCP10006, windows-10006 CP10007 csCP10007, windows-10007 CP10008 csCP10008, windows-10008 CP10010 csCP10010, windows-10010 CP10017 csCP10017, windows-10017 CP10029 csCP10029, windows-10029 CP10079 csCP10079, windows-10079
    [Show full text]
  • Inews V3.4.2 Readme • 9390-65038-00 Rev
    iNEWS® Newsroom Computer System Version 3.4.2 ReadMe Date Revised Changes Made July 28, 2011 Added information related to v3.4.2 release July 5, 2011 Added information related to v3.4.1 release 12 May 2011 Added information related to v3.4.0 release 7 March 2011 Added information related to v3.3.1 release 30 November 2010 Added information related to v3.3.0 release 23 November 2010 Added information related to v3.2.2 release 14 October 2010 Added information related to v3.2.1 release 24 May 2010 Initial version (based off of v3.1.1 doc.) Important Information Avid recommends that you thoroughly read all of the information in this ReadMe file before installing or using any new software release. Note: Search the Avid Knowledge Base (http://www.avid.com/onlinesupport) for the most up-to-date ReadMe file, which contains the latest information that might have become available after the documentation was published. This document describes compatibility issues with previous releases, hardware and software requirements, software installation instructions, and summary information on system and memory requirements, when applicable. This document also lists any hardware and/or software limitations. Note: Since this release of iNEWS will be more widely distributed than previous versions, some notes on important features and changes have been brought forward from previous ReadMe documents. Notes that are less important were not brought forward, and users should reference older iNEWS ReadMe files for additional change information not contained in this ReadMe. Version 3.4.2 ReadMe Contents Important Information .............................................................................................................................................. 1 Compatibility Notes and Issues ................................................................................................................................
    [Show full text]
  • Instantly Identify and Triage Many Languages
    Rosette® BIG TEXT ANALYTICS Language Identifier RLI RLI ROSETTE Identify languages and encodings Language Identifier Sortedwww.basistech.com Languages [email protected] +1 617-386-2090 Base Linguistics RBL RBL ROSETTE Search many languages with high accuracy InstantlyBase Linguistics identify and triageBetter Search Entity Extractor REX REX ROSETTE Tag names of people, places, and organizations manyEntity languages Extractor within largeTagged Entities English Primary Language Entity Resolver 8% RES voRESlumes ROSETTE of text. French Make real-world connections in your data Chinese Entity Resolver Chinese RealPrimary Scrip Identitiest 即时识别和处理大量多语言文本。 22% Arabic 39% Latin Identifiez et triez instantanément plusieurs French French Name Indexer English RNI languesRNI à travers ROSETTE de nombreux textes. Match names between many variations Name Indexer Matched Names %31 اﻟﺘﺤﺪﻳﺪ واﻟﺘﺼﻨﻴﻒ اﻟﻔﻮري ﻟﻠﻌﺪﻳﺪ ﻣﻦ اﻟﻠﻐﺎت ﺿﻤﻦ ﻛﻤﻴﺎت ﻛﺒﻴﺮة ﻣﻦ اﻟﻨﺼﻮص. Arabic Name Translator RNT RNT ROSETTE Translate foreign names into English Name Translator Translated Names Identify languages and Supported Categorizer Languages transform ROSETTE encodings 55 RCA Categorize Everything In Sight RCA Rosette® LanguageCategorizer Identifier (RLI) analyzes text from a few words to whole KEY FEATURES Sorted Content documents, to detect the languages and character encoding with speed and very high accuracy. Automatic language identification is the necessary first - Simple API Sentiment Analyzer step for applications that categorize, search, process, and store text in many - Fast and scalable ROSETTE - Industrial-strength support RSA languages.RSA Individual documents may be routed to language specialists, or sent Detect The Sentiments Of Your Text - Easy installation into language-specificSentiment analysis pipelines Analyzer (such as Rosette Base Linguistics) to Actionable Insights - Flexible and customizable improve the quality of search results.
    [Show full text]
  • Gain Insight and Deep Value from Unstructured
    www.basistech.com [email protected] +1 617-386-2090 Concept What is Big Text ? Pronoun Verb Name English It's huge volumes of multilingual , unstructured Pronoun+Verb Adjective Noun Prep. Adjective Adjective text that must be processed to deliver insights Noun Rel. Pronoun Verb Verb Verb Inf. Verb Noun Person and build connections . It’s President Clinton Conjunction Verb Noun Pronoun+Verb Title Name Place Person Place helping Malawi . Secretary Clinton in . Verb Name Title Name Prep. Name Urdu: “Islamabad” Place Concept The 福島 '"*!& &+' Determiner Noun Pronoun Verb Name Japanese: "Fukushima” Gain insight and deep value Supported from unstructured text 55 Languages ® Modern enterprise is well-acquainted Rosette is a suite of software KEY FEATURES with the promise of big data to components for use in enterprise revolutionize our insights and applications. It uses linguistic analysis, - Simple API decision making, although it is less statistical modeling, and machine - Fast and scalable well-known that up to 80% of big data learning to accurately process Big Text, - Industrial-strength support is represented by Big Text. Big Text revealing valuable information and - Easy installation is large quantities of “unstructured” actionable data. - Flexible and customizable text chunks found in documents, - Java or C++ webpages, and databases with all the Individually, each component is a - Unix, Linux, Mac, or Windows hallmarks of big data: the three Vs robust tool for processing language, - Built to work with Apache Solr™ and Elasticsearch (Volume, Velocity, and Variety). Big documents, or names. When - Cloudera certified partner Text is also multilingual, covering combined together, they create many languages and scripts, in all of powerful solutions that deliver useful their complexities and challenges.
    [Show full text]
  • Man Pages Section 7 Device and Network Interfaces
    man pages section 7: Device and Network Interfaces Part No: 816–5177–16 September 2010 Copyright © 2010, Oracle and/or its affiliates. All rights reserved. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. If this is software or related software documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are “commercial computer software” or “commercial technical data” pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, duplication, disclosure, modification, and adaptation shall be subject to the restrictions and license terms setforth in the applicable Government contract, and, to the extent applicable by the terms of the Government contract, the additional rights set forth in FAR 52.227-19, Commercial Computer Software License (December 2007). Oracle America, Inc., 500 Oracle Parkway, Redwood City, CA 94065.
    [Show full text]
  • Identifiez Et Triez Instantanément Plusieurs Langues À Travers De
    Rosette® BIG TEXT ANALYTICS Language Identifier RLI RLI ROSETTE Identifiez les langues et les codages de caractères Language Identifier Deswww.basistech.com langues triées [email protected] +1 617-386-2090 Base Linguistics RBL RBL ROSETTE Lancez des recherches multilingues Base Linguistics Une recherche améliorée extrêmement précises Identifiez et triez instantanément Entity Extractor REX REX ROSETTE Ajoutez les noms de personnes, de lieux et d'organisations en mots-clés plusieursEntity Extractor langues à travers deNoms des entités Français Langue principale Entity Resolver 8% RES nombreuxRES ROSETTE textes. Anglais Make real-world connections in your data Entity Resolver Real Identities Chinois Chinois Charactères principaux 即时识别和处理大量多语言文本。 22% Arabe 39% Latin Instantly identify and triage many languages Name Indexer Anglais Anglais ROSETTE RNI withinRNI large volumes of text. Français Assurez la concordance des noms entre leurs nombreuses variantes Name Indexer Concordance des identités %31 اﻟﺘﺤﺪﻳﺪ واﻟﺘﺼﻨﻴﻒ اﻟﻔﻮري ﻟﻠﻌﺪﻳﺪ ﻣﻦ اﻟﻠﻐﺎت Arabe ﺿﻤﻦ ﻛﻤﻴﺎت ﻛﺒﻴﺮة ﻣﻦ اﻟﻨﺼﻮص. Name Translator RNT RNT ROSETTE Traduisez des noms étrangers en anglais Name Translator Noms traduits Identifiez les langues et Categorizer RCA transformezRCA ROSETTE les codages Langues prises Categorize Everything In Sight Categorizer 55 enSorted charge Content Rosette® Language Identifier (RLI) balaie le texte des documents pour FONCTIONNALITÉS PRINCIPALES déterminer et localiser les langues écrites et le codage des caractères avec rapidité et une précision très élevée. L'identification automatique des langues simplifie le - API simple Sentiment Analyzer - Grande échelle et haut rendement traitement de grandes ROSETTE quantités de texte, ce qui est nécessaire pour les logiciels RSA Detect The Sentiments Of Your Text RSA - Assistance professionnelle qui catégorisent, recherchent, traitent et stockent du texte composé de plusieurs Sentiment Analyzer - Installation facile Actionable Insights langues.
    [Show full text]
  • Tutorial: Internet Languages, Character Sets and Encodings
    TUTORIAL: INTERNET LANGUAGES, CHARACTER SETS AND ENCODINGS by Michael K. Bergman BrightPlanet Corporation March 23, 2006 Broad-scale, international open source harvesting from the Internet poses many challenges in use and translation of legacy encodings that have vexed academics and researchers for many years. Successfully addressing these challenges will only grow in importance as the relative percentage of international sites grows in relation to conventional English ones. A major challenge in internationalization and foreign source support is “encoding.” Encodings specify the arbitrary assignment of numbers to the symbols (characters or ideograms) of the world’s written languages needed for electronic transfer and manipulation. One of the first encodings developed in the 1960s was ASCII (numerals, plus a-z; A-Z); others developed over time to deal with other unique characters and the many symbols of (particularly) the Asiatic languages. Some languages have many character encodings and some encodings, for example Chinese and Japanese, have very complex systems for handling the large number of unique characters. Two different encodings can be incompatible by assigning the same number to two distinct symbols, or vice versa. So-called Unicode set out to consolidate many different encodings, all using separate code plans into a single system that could represent all written languages within the same character encoding. There are a few Unicode techniques and formats, the most common being UTF-8. The Internet was originally developed via efforts in the United States funded by ARPA (later DARPA) and NSF, extending back to the 1960s. At the time of its commercial adoption in the early 1990s via the Word Wide Web protocols, it was almost entirely dominated by English by virtue of this U.S.
    [Show full text]
  • Vntex — Typesetting Vietnamese Hàn Thế Thành Reinhard Kotucha
    VnTEX — Typesetting Vietnamese Hàn Thế Thành Reinhard Kotucha Abstract VnTEX is an extension to Donald Knuth’s TEX typesetting system which provides support for typesetting Vietnamese. The primary site of VnTEX is http://vntex.sf.net. 1 Where to get Help The current maintainers of VnTEX are: I Hàn Thế Thành [email protected] I Reinhard Kotucha [email protected] I Werner Lemberg [email protected] There is a mailing list (very low traffic) for questions about VnTEX and typesetting Vietnamese. To subscribe to the list, visit: http://lists.sourceforge.net/lists/listinfo/vntex-users There is also a Wiki: http://vntex.info 2 Related Documents 1 The following files are part of the VnTEX distribution I Hàn Thế Thành, Hỗ trợ tiếng Việt cho TEX [print version] I Hàn Thế Thành, Minimal steps to typeset Vietnamese[print version] I Hàn Thế Thành và Thái Phú Khánh Hòa, Dùng font với VnTEX [print version] The following files are not part of VnTEX but might be part of the TEX distribution you are using. I The American Mathematical Society, Hướng dẫn sử dụng gói amsmath, http://ctan.org/tex-archive/info/amslatex/vietnamese/amsldoc-vi.pdf http://ctan.org/tex-archive/info/amslatex/vietnamese/amsldoc-print-vi.pdf I H. Partl, E. Schlegl, I. Hyna, T. Oetiker, Một tài liệu ngắn gọn giới thiệu về LATEX 2", Translated by Nguyễn Tân Khoa. http://ctan.org/tex-archive/info/lshort/vietnamese/lshort-vi.pdf I Wolfgang May, Andreas Schlechte, Mở rộng môi trường định lý. Translated by Huỳnh Kỳ Anh. http://ctan.org/tex-archive/info/translations/vn/ntheorem-doc-vn.pdf 1The print versions should be used with monochrome printers.
    [Show full text]
  • Typing Vietnamese Characters with Vpskeys Microsoft Word Setup
    Typing Vietnamese Characters with VPSKeys Tutorial :: www.yale.edu/vietnamese/vietfont.htm Typing Vietnamese Characters with VPSKeys In order to type Vietnamese characters, you must have a set of keyboard drivers that allow you to insert accents at the appropriate locations. One great FREE program is VPSKeys by the Vietnamese Professionals Society. The best part of this program is that it features Unicode. Unicode is a special type of encoding method that allows the user to type Vietnamese characters using regular Windows fonts such as Times, Arial, Courier, etc. This standard allows any computer, even those without Vietnamese fonts, to read text that you've typed. It also allows browsers to display Vietnamese characters without the need of previously installed Vietnamese fonts. Before the creation of Unicode, websites were often illegible because the browsers had difficulty selecting the right type of font to display. Installation 1. Download VPSKeys at www.vps.org under the DOWNLOAD section. 2. Once you've download it, double click on it to install. Please follow the on-screen instructions to install. Microsoft Word Setup One of the biggest problems users may encounter while typing Vietnamese characters in Microsoft Word is that it automatically changes the spelling of some Vietnamese words. For example, "người" (people) gets changed into "ngườI". To prevent this problem, you will need to disable the AutoCorrect option: 1. Click on the Tools menu and select AutoCorrect Options menu. 2. Uncheck the Replace text as you type box. 3. Click OK. Created on 08/17/02 by Tung Huu Nguyen :: [email protected] :: Revised 11/15/02 1 Typing Vietnamese Characters with VPSKeys Tutorial :: www.yale.edu/vietnamese/vietfont.htm VPSKeys Setup Now that you’ve installed VPSKeys and setup MS Word, the next step is to setup VPSKeys.
    [Show full text]
  • PAN Localization Survey of Language Computing in Asia 2005
    Survey of Language Computing in Asia 2005 Sarmad Hussain Nadir Durrani Sana Gul Center for Research in Urdu Language Processing National University of Computer and Emerging Sciences www.nu.edu.pk www.idrc.ca Published by Center for Research in Urdu Language Processing National University of Computer and Emerging Sciences Lahore, Pakistan Copyrights © International Development Research Center, Canada Printed by Walayatsons, Pakistan ISBN: 969-8961-00-3 This work was carried out with the aid of a grant from the International Development Research Centre (IDRC), Ottawa, Canada, administered through the Centre for Research in Urdu Language Processing (CRULP), National University of Computer and Emerging Sciences (NUCES), Pakistan. ii To the languages which will be lost before they are saved iii iv Preface This report is an effort to document the state of localization in Asia. There are a lot of different initiatives undertaken to localize technology across Asia. However, no study surveys the extent of work completed. It is necessary to document the status to formulate effective and coordinated strategies for further development. Therefore, current work was undertaken to collect the available data to baseline local language computing in Asia. This work has been done through PAN Localization project. There are about 2200 languages spoken in Asia. It is difficult to undertake the task of documenting the status of all these languages. Twenty languages are being surveyed to assess the level of language computing across Asia. The selected languages have official status in Asian countries of Middle East, South, South East and East Asia. The selection has been done to cover a variety of scripts and languages of Asia, but is eventually arbitrary.
    [Show full text]
  • On the Use of Machine Translation-Based Approaches for Vietnamese Diacritic Restoration
    On the Use of Machine Translation-Based Approaches for Vietnamese Diacritic Restoration Thai-Hoang Pham Xuan-Khoai Pham Phuong Le-Hong Alt Inc FPT University Vietnam National University Hanoi, Vietnam Hanoi, Vietnam Hanoi, Vietnam Email: [email protected] Email: [email protected] Email: [email protected] Abstract —This paper presents an empirical study of two Table I: A map from non-diacritic characters to diacritic machine translation-based approaches for Vietnamese diacritic restoration problem, including phrase-based and neural-based characters machine translation models. This is the first work that applies Non-diacritic Non-diacritic + Type 1 Non-diacritic + Type 1 + Type 2 neural-based machine translation method to this problem and a a, ă, â a, à, ả, ã, ạ, ă, ắ, ằ, ẳ, ẵ, ặ, â, ấ, ầ, ẩ, ẫ, ậ gives a thorough comparison to the phrase-based machine trans- e e, ê e, é, è, ẻ, ẽ, ẹ, ê, ế, ề, ể, ễ, ệ lation method which is the current state-of-the-art method for i i i, í, ì, ỉ, ĩ, ị o o, ô o, ó, ò, ỏ, õ, ọ, ô, ố, ồ, ổ, ỗ, ộ this problem. On a large dataset, the phrase-based approach has u u, ư u, ú, ù, ủ, ũ, ụ, ư, ứ, ừ, ử, ữ, ự an accuracy of 97.32% while that of the neural-based approach y y y, ý, ỳ, ỷ, ỹ, ỵ is 96.15%. While the neural-based method has a slightly lower d d, đ accuracy, it is about twice faster than the phrase-based method in terms of inference speed.
    [Show full text]
  • Hoàng Ngọc Ẩn
    TRANG 66 ÁI HU CÔNG CHÁNH Hoàng Ng c Pn ài ny vit v/v Convert ra Unicode các c !c, tr trng-h!p Computer ca ngi nh(n Attachment ã dùng nhng Font khác nhau có kh-nng ging nh ngi g i. VNI, TCVN, VISCII, VPS … và VIQR, nh(n !c t các E-mail ca AH kh p n i. Nu vit m t bài dài, chúng ta thng g i trong Attachment, chuyn theo E-mail, nó cng bin- dng, ngi nh(n phi bit cách Convert nó ra Vit ting Vit có y- du rt !c ph&-bin k Unicode mi c !c . t ngày có Universal Code, g i là Unicode. Tuy nhiên, các Font có th dùng vit !c Unicode rt Riêng tôi, không rành v/v x,-dng Computer, gii-hn. Computer ra i sau Window 98 SE mi nhng rt may-m n ã !c AH T Minh Tâm c- có sMn các Font cn-thit h&-tr! cho Unicode là: vn, ch. cho m t Website Address cho Arial, Times New Roman, Courier New, Tahoma và Attachment vào ó thì nó Convert nhng bài dùng Verdana. các Font VNI, VPS, VIQR, VISCII hay TCVN ra Unicode. Tôi s+ nói rõ-ràng h n cách Convert trong Phn A di ây. Khi bit các Font y có sMn trong Computer, mun vit !c Unicode, chúng ta cn phi có các Sau ó, tôi có dp i thm các cháu, và !c bit Software và Program vit. Có rt nhiu Software thêm m t cách khác Convert ra Font Unicode khác nhau, nhng v)n cùng m t mc-tiêu là vit ra nh bng Hoán-Chuyn Clipboard ca VPSKeys !c Unicode, có th c !c rõ-ràng nh c các 4.3 và ã có kt-qu rt mau-l#, chính-xác vi nhiu sách-báo Vit-Ng.
    [Show full text]