The Language Grid Project Part 3: Intercultural Collaboration Project in Vietnam Part 4: Ongoing Phd Research
Total Page:16
File Type:pdf, Size:1020Kb
The Language Grid Multi‐Language Service Platform for Intercultural Collaboration Part 1: Getting Started with Machine Translator: ICE2002 Part 2: The Language Grid Project Part 3: Intercultural Collaboration Project in Vietnam Part 4: Ongoing PhD Research Toru Ishida Department of Social Informatics Kyoto University Part 1 Getting Started with Machine Translator ICE2002 At the beginning of the new millennium, we proposed the concept of intercultural collaboration where participants with different cultures and languages work together towards shared goals. Intercultural Collaboration Experiment 2002 Develop open source software using machine translation Japan Team ICE2002 Organizers Translation Checker Malaysia Team Korea Team China Team Multi‐Language BBS Translation among Japanese, Chinese, Selection of Interface Language Korean, Malay, and English 31,000 messages in one year. Message Input Translation Button Translated Massage Chinese Japanese Korean Malay English Example Discussion Translation Pentagon for ICE2002 Hard to collect translation engines to cover five Japanese languages. Hard to understand their English contracts. Malay Hard to evaluate their services. Hard to get budget to cover expenses for machine Chinese Korean translations. Hard to customize provided services. J - server Arcnet/sangenjaya Part 2 The Language Grid Project We believe that fragmentation and recombination is the key to creating a full range of customized language environments for different types of user activities. The Language Grid Disaster Mgt. Education Medical Care more more Sharing Multilingual Translation Services at Information Universal Playground Hospital Receptions Language Support for Multicultural and Global Societies Sharing language resources such as dictionaries and machine translators around the world German Research Center for Artificial Intelligence Princeton University Stuttgart University National Institute of Kookmin University Informatics National Research Council, Italy NICT Chinese Academy of NTT Research Labs Sciences Asian Disaster Reduction NECTEC Center University of Indonesia From Language Resources to Language Services Dictionary (Data) 避難場所 Wrapping Dictionary Accurate disaster shelter Dictionary Service word translation Parallel Text (Data) 避難場所は、家から近い学校です。 Wrapping In the case of disaster, people should be Approximate evacuated to a school nearby their house. Parallel Text translation Parallel Text Service Machine Translation (Software) 避難場所は、家から近い学校です。 Wrapping Low quality Disaster shelter is school close from a house. Machine Machine Translation high speed Translator Service translation Human Interpreter (Human) 避難場所は、家から近い学校です。 Wrapping High quality Your disaster shelter is the school closest to Human Human Translation low speed your house. Translator Service translation Participants and Services •Participants (22 countries, 170 groups) – University/Research防災 Institute 教育 医療 • Kyoto Univ. (Japan), Univ. of Indonesia, ITB (Indonesia), Shanghai Jiao Tong Univ. (China), Univ. of Stuttgart (Germany), IT Univ. of Copenhagen (Denmark), Princeton Univ. (U.S), DFKI (Germany), CNR (Italy), Chinese Academy of Sciences (China), NECTEC (Thailand), and more. – NPO/NGO/Public Sector • NGOs for disaster reduction, NGOs for Intercultural exchange, Public Junior-high schools, City Boards of Education, and more. – Corporate (CSR activities/language resource providers) • NTT, Toshiba, Oki, Google, Kodensha, Translution, and more. • Language Services (225 services) – Machine Translator • J-Server (ja/en/ko/zh), Web-Transer (ja/en/ko/zh/fr/de/it/es), Toshiba (en/zh), Parsit (en>th), Google Translate (51 languages), and more. – Bilingual Dictionary, Concept Dictionary • EDR , Wordnet, Life Science Dictionary, Multi-language Glossary on Natural Disasters, and more. – Parallel Text – Morphological Analyzer – Dependency Parser Operation from December 2007 Language Grid Applications Shared Screen Multilingual Chat System Multilingual Medical Communication Support System (2007) for Junior High School (Wakayama University and NPO Center for Multicultural Society, Kyoto) (2007) Award for Encouragement from the Minister of State for Special Missions at the (Developed by three master students in 10 days) commendation of the promoter of barrier-free universal design in 2009 Conference Support System by Human‐Machine Cooperation Enhance translation quality by human‐machine cooperation • Automatic speech recognition helps human dictators. • Dictators modify the text so that machine translators can create better results. • Translation service cooperates domain specific dictionaries. Y’sMen Intl. Asia Convention 2015 (1000 participants) Speech Speaker(en) Recognizer(en) Translation with Dictionary (en‐>ja,zh) Dictator(en) Audience(ja, zh) Software is Available! • Service Grid Server Software: – http://servicegrid.net/oss‐project/ – Source code repository: http://sourceforge.net/projects/servicegrid/ • Language Grid Multilingual Studio: – http://langrid.org/developer/ – Source code repository: https://github.com/langrid/langrid‐php‐library • Language Mashup: – Will release from Google Play & App Store Language Grid Software (Available on Sourceforge) Web Browser Application System Service Manager Service Supervisor Composite Service Service Management User Request Handler Container Interface Web UI SOAP API Other API Java Method Handler Other Protocol Handlers HTTP Request Handler Management Management Management Management Management Management Invocation Processor Resource Domain Service Node User Grid Intra‐Grid Executor Atomic Access Other Access Control Java Method Logging Service Protocol HTTP Invoker Container Invoker Invoker Resources Grid Composer Intra‐Grid Data Access Inter‐Grid Data Access Inter‐Grid Executor PostgreSQL Other Other File JXTA Other P2P Data Access DBMS Framework HTTP Invoker Protocol Access Access Data Access Data Access Invoker Other Service Service Database Grid Domain Definition Profile Repository Definition Profile Database Profile List Access Log Database (Flexible) (Fixed) HTTP SOAP Protocol Buffers P2P sharing protocol Other protocols Java method invocation Standard specification Various implementations are allowed Open Language Grid 15 The Language Grid Operation Operation r Strict License Center Federation Center (Agreement) Kyoto Bangkok, Jakarta, Xinjiang Federation (Terms of Use) Operation US NSF, … Center Operation Federation Center (Terms of Use) Open source Kyoto Operation Center Open Language Grid EU ELDA/ELRA, … Registration (Terms of Use) Personal Personal License User Personal Grid Language Mashup: Personal Grid for Language Services Compose & Execute Commercial language services Academia language services provided for personal use provided by the LR research community Stanford POS MaltParser Tagger OpenNLP POS LX‐Tagger Tagger FreeLing Morphological analysis Open Language Grid ■Android version and iOS version will be released. Language Grid Operation Centers Share 225 language services among Language Grid Operators Xinjiang Operation Center Kyoto Operation Center (Xinjiang Univ., 2014‐ ) (Kyoto Univ.,2007 ‐ ) Federated Operation of the Language Grid East Asian Languages Bangkok Operation Center Central Asian Languages (NECTEC, 2010 ‐ ) Jakarta Operation Center (Univ. of Indonesia, 2012 ‐ ) South‐East/South Asian Languages International Collaboration Philadelphia New York Paris Xinjiang ELDA Kyoto Univ. of Pennsylvania Vassar College Xinjiang Univ. Kyoto Univ. Boston Brandeis Univ. Kyoto Kyoto Univ. Toyohashi Toyohashi Univ. of Tech. Barcelona Universitat ILSP Nanjing Pompeu Fabra Pisa CNR Athens Southeast Univ. Shizuoka Shizuoka Univ. Bangkok Ho Chi Minh Jakarta SIIT VNU‐HCM Univ. of Indonesia Role of the Language Grid Real World Language Grid Generalization Customization A small number of A large number of professional researchers non-professional users Natural Language Processing Computational Model Part 3 Intercultural Collaboration Project in Vietnam Tien My Commune, Tra On District, Vinh Long Province, Vietnam, Jan 5th, 2013 Farmers have difficulties in reading/writing messages. A youth-mediated communication (YMC) model was invented, where the children act as mediators between their parents and experts. Agriculture Support Project in Vietnam Our Idea is to Realize Agricultural Knowledge Communication between Japanese Experts and Vietnamese Farmers via Youth Parents Agriculture Vietnamese Youth Education Knowledge Farmers VI EN JA Japanese Experts Other Media Includes Available Language Services Mobile Phones Japanese-English-Vietnamese Translation Sensors Agricultural Dictionaries Passports Agricultural Parallel Texts Recipe Cards Vietnamese Speech Synthesis Combining Language Services Japanese: たんぼの準備として、田起こしや代 掻き、あぜぬりをして下さい。 Vietnamese: Chuẩn bị đất là kết hợp giữa canh Japanese Vietnamese tác đất, cày bừa và đắp bờ. Experts Farmers (English: Land preparation is a combination of tillage of the soil, puddling and levee painting.) Composite Translation Example-based Composite Composite Best Translation Service with Dictionary Translation Service Selection Service Japanese- Japanese Example- Best Based English Multilingual Part-of-Speech Multilingual Translation Machine Translator Dictionary Tagger Parallel Texts Selection Translator for Agriculture for Agriculture Online ☆ ☆☆ Consultation by Human English- Vietnamese Back Vietnamese Japanese Part-of-Speech Translation Translator Tagger Dependency Parser ☆ Multilingual Dictionary for Agriculture (YMC Rice Dictionary, Japan Agriculture