Corpus of the Georgian Language
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Computational Development of Lesser Resourced Languages
Computational Development of Lesser Resourced Languages Martin Hosken WSTech, SIL International © 2019, SIL International Modern Technical Capability l Grammar checking l Wikipedia l OCR l Localisation l Text to speech l Speech to text l Machine Translation © 2019, SIL International Digital Language Vitality l 0.2% doing well − 43% world population l 78% score nothing! − ~10% population © 2019, SIL International Simons and Thomas, 2019 Climbing from the Bottom l Language Tag l Linebreaking l Unicode encoding l Locale Information l Font − Character Lists − Sort order l Keyboard − physical l Content − phone © 2019, SIL International Language Tag l Unique orthography l lng – ISO639 identifier l Scrp – ISO 15924 l Structure: l RE – ISO 3166-1 − lng-Scrp-RE-variants − ahk = ahk-Latn-MM − https://ldml.api.sil.org/langtags.json BCP 47 © 2019, SIL International Language Tags l Variants l Policy Issues − dialect/language − ISO 639 is linguistic − orthography/script − Language tags are sociolinguistic − registration/private use © 2019, SIL International Unicode Encoding l Engineering detail l Policy Issues l Almost all scripts in − Use Unicode − Publish Orthography l Find a char Descriptions − Sequences are good l Implies an orthography © 2019, SIL International Fonts l Lots of fonts! l Policy Issues l SIL Fonts − Ensure industry support − Full script coverage − Encourage free fonts l Problems − adding fonts to phones © 2019, SIL− InternationalNoto styling Keyboards l Keyman l Wider industry − All platforms − More capable standard − Predictive text − More industry interest − Open Source − IDE © 2019, SIL International Keyboards l Policy Issues − Agreed layout l Per language l Physical & Mobile © 2019, SIL International Linebreaking l Unsolved problem l Word frequencies − Integration − open access − Description − same as for predictive text l Resources © 2019, SIL International Locale Information l A deep well! l Key terms l Unicode CLDR l Sorting − Industry base data l Dates, Times, etc. -
Technical Reference Manual for the Standardization of Geographical Names United Nations Group of Experts on Geographical Names
ST/ESA/STAT/SER.M/87 Department of Economic and Social Affairs Statistics Division Technical reference manual for the standardization of geographical names United Nations Group of Experts on Geographical Names United Nations New York, 2007 The Department of Economic and Social Affairs of the United Nations Secretariat is a vital interface between global policies in the economic, social and environmental spheres and national action. The Department works in three main interlinked areas: (i) it compiles, generates and analyses a wide range of economic, social and environmental data and information on which Member States of the United Nations draw to review common problems and to take stock of policy options; (ii) it facilitates the negotiations of Member States in many intergovernmental bodies on joint courses of action to address ongoing or emerging global challenges; and (iii) it advises interested Governments on the ways and means of translating policy frameworks developed in United Nations conferences and summits into programmes at the country level and, through technical assistance, helps build national capacities. NOTE The designations employed and the presentation of material in the present publication do not imply the expression of any opinion whatsoever on the part of the Secretariat of the United Nations concerning the legal status of any country, territory, city or area or of its authorities, or concerning the delimitation of its frontiers or boundaries. The term “country” as used in the text of this publication also refers, as appropriate, to territories or areas. Symbols of United Nations documents are composed of capital letters combined with figures. ST/ESA/STAT/SER.M/87 UNITED NATIONS PUBLICATION Sales No. -
Multilingual Content Management and Standards with a View on AI Developments Laurent Romary
Multilingual content management and standards with a view on AI developments Laurent Romary To cite this version: Laurent Romary. Multilingual content management and standards with a view on AI developments. AI4EI - Conference Artificial Intelligence for European Integration, Oct 2020, Turin / Virtual, Italy. hal-02961857 HAL Id: hal-02961857 https://hal.inria.fr/hal-02961857 Submitted on 8 Oct 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Distributed under a Creative Commons Attribution| 4.0 International License Multilingual content management and standards with a view on AI developments Laurent Romary Directeur de Recherche, Inria, team ALMAnaCH ISO TC 37, chair Language and AI • Central role of language in the revival of AI (machine-learning based models) • Applications: document management and understanding, chatbots, machine translation • Information sources: public (web, cultural heritage repositories) and private (Siri, Amazon Alexa) linguistic information • European context: cf. Europe's Languages in the Digital Age, META-NET White Paper Series • Variety of linguistic forms • Spoken, written, chats and forums • Multilingualism, accents, dialects, technical domains, registers, language learners • General notion of language variety • Classifying and referencing the relevant features • Role of standards and standards developing organization (SDO) A concrete example for a start Large scale corpus Language model BERT Devlin, J., Chang, M. -
Tags for Identifying Languages File:///C:/W3/International/Draft-Langtags/Draft-Phillips-Lan
Tags for Identifying Languages file:///C:/w3/International/draft-langtags/draft-phillips-lan... Network Working Group A. Phillips, Ed. TOC Internet-Draft webMethods, Inc. Expires: October 7, 2004 M. Davis IBM April 8, 2004 Tags for Identifying Languages draft-phillips-langtags-02 Status of this Memo This document is an Internet-Draft and is in full conformance with all provisions of Section 10 of RFC2026. Internet-Drafts are working documents of the Internet Engineering Task Force (IETF), its areas, and its working groups. Note that other groups may also distribute working documents as Internet-Drafts. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." The list of current Internet-Drafts can be accessed at http://www.ietf.org/ietf/1id-abstracts.txt. The list of Internet-Draft Shadow Directories can be accessed at http://www.ietf.org/shadow.html. This Internet-Draft will expire on October 7, 2004. Copyright Notice Copyright (C) The Internet Society (2004). All Rights Reserved. Abstract This document describes a language tag for use in cases where it is desired to indicate the language used in an information object, how to register values for use in this language tag, and a construct for matching such language tags, including user defined extensions for private interchange. Table of Contents 1. Introduction 2. The Language Tag 2.1 Syntax 2.2 Language Tag Sources 2.2.1 Pre-Existing RFC3066 Registrations 1 of 20 08/04/2004 11:03 Tags for Identifying Languages file:///C:/w3/International/draft-langtags/draft-phillips-lan.. -
A Könyvtárüggyel Kapcsolatos Nemzetközi Szabványok
A könyvtárüggyel kapcsolatos nemzetközi szabványok 1. Állomány-nyilvántartás ISO 20775:2009 Information and documentation. Schema for holdings information 2. Bibliográfiai feldolgozás és adatcsere, transzliteráció ISO 10754:1996 Information and documentation. Extension of the Cyrillic alphabet coded character set for non-Slavic languages for bibliographic information interchange ISO 11940:1998 Information and documentation. Transliteration of Thai ISO 11940-2:2007 Information and documentation. Transliteration of Thai characters into Latin characters. Part 2: Simplified transcription of Thai language ISO 15919:2001 Information and documentation. Transliteration of Devanagari and related Indic scripts into Latin characters ISO 15924:2004 Information and documentation. Codes for the representation of names of scripts ISO 21127:2014 Information and documentation. A reference ontology for the interchange of cultural heritage information ISO 233:1984 Documentation. Transliteration of Arabic characters into Latin characters ISO 233-2:1993 Information and documentation. Transliteration of Arabic characters into Latin characters. Part 2: Arabic language. Simplified transliteration ISO 233-3:1999 Information and documentation. Transliteration of Arabic characters into Latin characters. Part 3: Persian language. Simplified transliteration ISO 25577:2013 Information and documentation. MarcXchange ISO 259:1984 Documentation. Transliteration of Hebrew characters into Latin characters ISO 259-2:1994 Information and documentation. Transliteration of Hebrew characters into Latin characters. Part 2. Simplified transliteration ISO 3602:1989 Documentation. Romanization of Japanese (kana script) ISO 5963:1985 Documentation. Methods for examining documents, determining their subjects, and selecting indexing terms ISO 639-2:1998 Codes for the representation of names of languages. Part 2. Alpha-3 code ISO 6630:1986 Documentation. Bibliographic control characters ISO 7098:1991 Information and documentation. -
Addressing — Digital Interchange Models
© The Calendaring and Scheduling Consortium, Inc. 2019 – All rights reserved CC/WD 19160-6:2019 CalConnect TC VCARD Addressing — Digital interchange models Working Dra Standard Warning for dras This document is not a CalConnect Standard. It is distributed for review and comment, and is subject to change without notice and may not be referred to as a Standard. Recipients of this dra are invited to submit, with their comments, notification of any relevant patent rights of which they are aware and to provide supporting documentation. Recipients of this dra are invited to submit, with their comments, notification of any relevant patent rights of which they are aware and to provide supporting documentation. The Calendaring and Scheduling Consortium, Inc. 2019 CC/WD 19160-6:2019:2019 © 2019 The Calendaring and Scheduling Consortium, Inc. All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on the internet or an intranet, without prior written permission. Permission can be requested from the address below. The Calendaring and Scheduling Consortium, Inc. 4390 Chaffin Lane McKinleyville California 95519 United States of America [email protected] www.calconnect.org ii © The Calendaring and Scheduling Consortium, Inc. 2019 – All rights reserved CC/WD 19160-6:2019:2019 Contents .Foreword...................................................................................................................................... -
Version 13.0 Release Notes
Release Notes The tool of thought for expert programming Version 13.0 Dyalog is a trademark of Dyalog Limited Copyright 1982-2011 by Dyalog Limited. All rights reserved. Version 13.0 First Edition April 2011 No part of this publication may be reproduced in any form by any means without the prior written permission of Dyalog Limited. Dyalog Limited makes no representations or warranties with respect to the contents hereof and specifically disclaims any implied warranties of merchantability or fitness for any particular purpose. Dyalog Limited reserves the right to revise this publication without notification. TRADEMARKS: SQAPL is copyright of Insight Systems ApS. UNIX is a registered trademark of The Open Group. Windows, Windows Vista, Visual Basic and Excel are trademarks of Microsoft Corporation. All other trademarks and copyrights are acknowledged. iii Contents C H A P T E R 1 Introduction .................................................................................... 1 Summary........................................................................................................................... 1 System Requirements ....................................................................................................... 2 Microsoft Windows .................................................................................................... 2 Microsoft .Net Interface .............................................................................................. 2 Unix and Linux .......................................................................................................... -
Analysis of Mutual Influence of Music and Text in Svan Songs
Analysis of mutual influence of music and text in Svan songs Nana Mzhavanadze Madona Chamgeliani University of Potsdam Lidbashi Foundation [email protected] [email protected] ABSTRACT stand and, secondly, due to the phonetic reservoir (es- pecially vowels in upper Svaneti) of Svans being rich The present paper discusses the influence of musicological, lin- and often having grammatical function. This raises a guistic, and ethnological aspects on the music-text relation in question about phonetic events being of musical or Svan songs. In a lot of cases, there is a deep bond between verbal linguistic origin. texts and their musical counterparts (Mzhavanadze & Chamgeliani, 2015). Despite the fact that the lyrics of songs are • In contradiction to the hypothesis of some authors that of critical importance to the rituals in which they are performed, Svan songs are believed to be “song-poems“ many of them are difficult (at times impossible) to transcribe. The (Shanidze et al., 1939), the texts often do not show present analysis shows that the reservoir of Svan melos is rela- high integrity with the music as they are sung. tively modest in comparison with the verbal texts. In songs in which musical patterns repeat and texts alter, the latter get modi- This suggests that in order to understand Svans’ musical fied and often distorted to the degree to make them incomprehen- grammar, the interrelationship between music and verbal sible. This is also true for texts of pre-Christian origin, which has texts cannot be ignored. The presented paper touches on interesting ethnological consequences. The results of the current the issues what role either play in the forming process of study challenge the isolated linguistic interpretation of verbal texts of Svan songs and emphasize the need for a joint analysis a musical (artistic) image. -
The Tatoeba Translation Challenge--Realistic Data Sets For
The Tatoeba Translation Challenge – Realistic Data Sets for Low Resource and Multilingual MT Jorg¨ Tiedemann University of Helsinki [email protected] https://github.com/Helsinki-NLP/Tatoeba-Challenge Abstract most important point is to get away from artificial This paper describes the development of a new setups that only simulate low-resource scenarios or benchmark for machine translation that pro- zero-shot translations. A lot of research is tested vides training and test data for thousands of with multi-parallel data sets and high resource lan- language pairs covering over 500 languages guages using data sets such as WIT3 (Cettolo et al., and tools for creating state-of-the-art transla- 2012) or Europarl (Koehn, 2005) simply reducing tion models from that collection. The main or taking away one language pair for arguing about goal is to trigger the development of open the capabilities of learning translation with little or translation tools and models with a much without explicit training data for the language pair broader coverage of the World’s languages. Using the package it is possible to work on in question (see, e.g., Firat et al.(2016a,b); Ha et al. realistic low-resource scenarios avoiding arti- (2016); Lakew et al.(2018)). Such a setup is, how- ficially reduced setups that are common when ever, not realistic and most probably over-estimates demonstrating zero-shot or few-shot learning. the ability of transfer learning making claims that For the first time, this package provides a do not necessarily carry over towards real-world comprehensive collection of diverse data sets tasks. -
Proposal for Generation Panel for Latin Script Label Generation Ruleset for the Root Zone
Generation Panel for Latin Script Label Generation Ruleset for the Root Zone Proposal for Generation Panel for Latin Script Label Generation Ruleset for the Root Zone Table of Contents 1. General Information 2 1.1 Use of Latin Script characters in domain names 3 1.2 Target Script for the Proposed Generation Panel 4 1.2.1 Diacritics 5 1.3 Countries with significant user communities using Latin script 6 2. Proposed Initial Composition of the Panel and Relationship with Past Work or Working Groups 7 3. Work Plan 13 3.1 Suggested Timeline with Significant Milestones 13 3.2 Sources for funding travel and logistics 16 3.3 Need for ICANN provided advisors 17 4. References 17 1 Generation Panel for Latin Script Label Generation Ruleset for the Root Zone 1. General Information The Latin script1 or Roman script is a major writing system of the world today, and the most widely used in terms of number of languages and number of speakers, with circa 70% of the world’s readers and writers making use of this script2 (Wikipedia). Historically, it is derived from the Greek alphabet, as is the Cyrillic script. The Greek alphabet is in turn derived from the Phoenician alphabet which dates to the mid-11th century BC and is itself based on older scripts. This explains why Latin, Cyrillic and Greek share some letters, which may become relevant to the ruleset in the form of cross-script variants. The Latin alphabet itself originated in Italy in the 7th Century BC. The original alphabet contained 21 upper case only letters: A, B, C, D, E, F, Z, H, I, K, L, M, N, O, P, Q, R, S, T, V and X. -
Georgian Romanization
Georgian Values are shown for the older Khutsuri and the modern Mkhedruli alphabets. There are no upper case letters in Mkhedruli. Upper case letters Lower case letters Khutsuri Romanization Khutsuri Mkhedruli Romanization Ⴀ A ⴀ ა a Ⴁ B ⴁ ბ b Ⴂ G ⴂ ზ g Ⴃ D ⴃ დ d Ⴄ E ⴄ ე e Ⴅ V ⴅ ქ v Ⴆ Z ⴆ ჩ z Ⴇ Tʻ ⴇ უ tʻ Ⴈ I ⴈ ი i Ⴉ K ⴉ ჯ k Ⴊ L ⴊ მ l Ⴋ M ⴋ ნ m Ⴌ N ⴌ ო n Ⴍ O ⴍ პ o Ⴎ P ⴎ ჰ p Ⴏ Ž ⴏ შ ž Ⴐ R ⴐ ს r Ⴑ S ⴑ ტ s Ⴒ T ⴒ ჳ t Ⴓ U ⴓ ფ u Ⴔ Pʻ ⴔ ჟ pʻ Ⴕ Kʻ ⴕ ლ kʻ Ⴖ Ġ ⴖ ჭ ġ Ⴗ Q ⴗ ჱ q Ⴘ Š ⴘ ჲ š Ⴙ Čʻ ⴙ ძ čʻ Ⴚ Cʻ ⴚ გ cʻ Ⴛ Ż ⴛ ჴ ż Ⴜ C ⴜ ც c Ⴝ Č ⴝ წ č Ⴞ X ⴞ ყ x Ⴟ J ⴟ ხ j Ⴠ H ⴠ თ h Ⴡ Ē ⴡ ჵ ē Ⴢ Y ⴢ კ y Ⴤ X ⴤ რ x Ⴥ Ō ⴥ ჶ ō Ⴣ W ⴣ ღ w ვ f ჷ ĕ ჸ ʻ (ayn) , ŭ Transliteration of Georgian 1/3 GEORGIAN Georgian script* ISO 9984 National IKE ALA-LC KNAB BGN/PCGN TITUS 1996(1.0) 2002(2.0) 1974(3.0) 1997(4.0) 1993(5.0) 1981(6.0) 2000(7.0) 01 Ⴀ ა a a a a a a a 02 Ⴁ ბ b b b b b b b 03 Ⴂ გ g g g g g g g 04 Ⴃ დ d d d d d d d 05 Ⴄ ე e e e e e e e 06 Ⴅ ვ v v v v v v v 07 Ⴆ ზ z z z z z z z 08 Ⴡ ჱ a ē — ē / ey ē — (ey) (ē) 09 Ⴇ თ t’ t t tʻ t tʼ t 10 Ⴈ ი i i i i i i i 11 Ⴉ კ k k’ ḳ k ķ k ḳ 12 Ⴊ ლ l l l l l l l 13 Ⴋ მ m m m m m m m 14 Ⴌ ნ n n n n n n n 15 Ⴢ ჲ a y — y y — (j) — 16 Ⴍ ო o o o o o o o 17 Ⴎ პ p p’ ṗ p ṗ p ṗ 18 Ⴏ ჟ ž zh ž z̆ ž zh ž 19 Ⴐ რ r r r r r r r 20 Ⴑ ს s s s s s s s 21 Ⴒ ტ t t’ ṭ t ţ t ṭ 22 Ⴣ ჳ a w — wi / ü w — — — 23 Ⴓ უ u u u u u u u 24 Ⴔ ფ pʼ p p pʻ p pʼ p 25 Ⴕ ქ kʼ k k kʻ k kʼ k 26 Ⴖ ღ ḡ gh ǧ / ɣ ġ ǧ gh ġ 27 Ⴗ ყ q q’ q̇ q q q q̇ 28 Ⴘ შ š sh š š š sh š 29 Ⴙ ჩ čʼ ch č čʻ č chʼ č 30 Ⴚ ც cʼ ts c cʻ c tsʼ c 31 Ⴛ ძ j dz j / ʒ ż dz dz ʒ 32 Ⴜ წ c ts’ c̣ c ç ts c̣ 33 Ⴝ ჭ č ch’ č̣ č ç̌ ch č̣ 34 Ⴞ ხ x kh x x x kh χ 35 Ⴤ ჴ a ẖ — q x̣ — (qʼ) q 36 Ⴟ ჯ ǰ j ǰ / ǯ j dž j ǯ 37 Ⴠ ჰ h h h h h h h 38 Ⴥ ჵ a ō — ō / ow ō — — (ō) Thomas T. -
Svan Funeral Dirges (Zär): Musical Acoustical Analysis of a New Collection of Field Recordings
Trabzon University State Conservatory © 2017-2020 Volume 4 Issue 2 December 2020 Research Article Musicologist 2020. 4 (2): 138-167 DOI: 10.33906/musicologist.782094 FRANK SCHERBAUM Universität Potsdam, Germany [email protected] orcid.org/0000-0002-5050-7331 NANA MZHAVANADZE Universität Potsdam, Germany [email protected] orcid.org/0000-0001-5726-1656 Svan Funeral Dirges (Zär): Musical Acoustical Analysis of a New Collection of Field Recordings ABSTRACT This paper is a companion paper to Mzhavanadze & Scherbaum (2020). KEYWORDS Jointly, the two papers describe the results of an interdisciplinary study of three-voiced Svan funeral dirges, known as zär in Svan and zari in Traditional Georgian Georgian. In the present paper, to which we refer as paper 1, we analyze Vocal Music the musical acoustical properties of a new set of field recordings Computational collected during an ethnomusicological field expedition to Georgia in Ethnomusicology 2016. The aim of the study is to investigate the tonal organization of eleven different performances of six different variants of zär, performed Ethnomusicological by singers from different villages. For some of the performances, we Field Recordings observe a strong gradual pitch rise of up to 100 cents per minute. The intra-variant differences in the performances of different groups of singers were observed to be remarkably different, including the use of significantly different harmonic tuning systems. In contrast, two subsequent performances of the Mest’ia variant of zär by a group of singers recorded in Zargǟsh were essentially identical. This demonstrates the widespread absence of improvisational elements in these two performances. One of the most interesting results of our analysis is the observation that the musical structure of zär, expressed, for example, in its ambitus, the complexity of its melodic progression, and its harmonic chord inventory, change systematically along the course of the Enguri valley.