Bauer Et Al. 2009 Corpus Technology
Total Page:16
File Type:pdf, Size:1020Kb
PROJECT REPORT Survey of Gaelic Corpus Technology Michael Bauer Prof Roibeard Ó Maolalaigh Rob Wherrett for Bòrd na Gàidhlig Darach Fèith nan Clach Inbhir Nis IV2 7PA October 2009 1 Executive Summary This report is compiled in response to the requirement from Bòrd na Gàidhlig (BnG) to investigate the current and future landscape of Corpus and related Language Technologies for Gaelic. The intention is to inform the strategic thinking about how and where to direct resources in the future to improve the technical aspects of the language development. It has been based on a tripartite approach looking at: Current tools and technologies, their application and usability Wider ongoing and proposed developments - particularly amongst the other Celtic languages and opportunities for collaboration; and Aspirational needs of the user community, especially those professionally involved in the use of Gaelic through translation, education or media. The emphasis being on understanding how this translates into Speech and Language Technology (SALT) requirements. The current focus of Gaelic SALT is seriously mismatched with where it should be, focusing on dictionaries and word lists rather than a comprehensive and integrated approach to codification and standardisation, essential SALT, corpus and lexicographical tools. These latter should feed into the everyday usage and uptake of the language in all its forms. Furthermore the structures currently in place are disparate and uncoordinated. Best practice shows that there ought to be a formal Gaelic Academy that owns the codification (orthography, grammar and terminology) and is final arbiter on matters of technical aspects relating to the formal language. Other key aspects include the setting up of proper funding structures to give foundation to the technical work and to underpin the longer-term progression. The value to the language of some of the proposals is significant (considerably in excess of £175m) provided that the recommended structured approaches are followed. Until now this fact has been signally obscured by the inability of virtually all stakeholders to see the hidden impacts of the current plethora of uncoordinated tools and approaches. Using best practice estimating models from the world of management consulting, this report shows how these hidden impacts can be given a capital value in the current Gaelic environment. When compared to the actual costs of getting it right - they also show just how much can be achieved. Conclusion Gaelic needs to revisit the structures in place to control and manage the technical aspects of corpus development and SALT. This in turn will lead to developing a completely new set of arrangements for moving forward. Current developments need to be critically reviewed and in many cases suspended or cancelled altogether. Failures of Quality Assurance to date have wasted significant amounts of resource that could have been better utilised. Overall this highlights the need for a strategic/planned approach, for language professionals to be put in charge of corpus development and SALT; and to move away the carrying out of corpus development and SALT from the schools’ sector. BnG Report November 2009 Page 2 of 170 The following immediate steps are to be encouraged: Core codification of the language as soon as is practically possible Transferring ownership of the orthography to the beginnings of a Gaelic Academy, making the latter responsible for the Quality Assurance of the codification and terminology development Development of a gold standard corpus, managed by a Celtic/Gaelic HEI. (This alone will have a capital value to the Gaelic Language community in excess of £173m and can be delivered for a tiny fraction of that cost.) Setting up a Governance Framework that has adequate guaranteed funding to enable the baselining of the Language and Tools Temporary suspension of the publication of authorised publications prescribing orthography/lexical/grammar usage (e.g. An Seotal, Ainmean-àite na h-Alba). This does not mean these project should cease all work, rather that they will be engaged in coordinating with the new Gaelic Academy training in best practice other foundation activity. Once the fundamentals (including core codification) are in place, these projects should then resume. If possible, delay the launch of new proofing tools until codification is complete and can be implemented. Beyond that adherence to International Protocols and Standards must be achieved at all levels. In addition to these core recommendations, there are various additional recommendations, suggestions and ideas which can be found in the different sections of this report. Collaboration with the following projects and partners should also commence at the earliest opportunity: Canolfan Bedwyr (Welsh SALT centre) Fiontar (Irish SALT centre) Foras na Gaeilge (Irish cross-border development agency) NCI (New Corpus for Ireland project) Professor Scannell (Professor of Computing, University of St. Louis, Missouri) Traslán (Translation company working in conjunction with Foras na Gaeilge) Training and development of core teams must take place to engage in the technical work of Terminology Standardisation, and Corpus work Finally wider aspects such as engaging with younger people to develop appropriate supportive technologies in areas like games and texting should be encouraged. All of this downstream activity should be professionally project-managed to ensure that there is cohesion and optimisation of resources and sharing of the collective output. This represents a major challenge but if the proposals are followed Gaelic will take its place among the leading minority languages, rather than fire-fighting. The outcome can do nothing but good for the wider development and uptake of the language in the 21st century. University of Glasgow September 2009 BnG Report November 2009 Page 3 of 170 Survey of Gaelic Corpus Technology University of Glasgow CONTENTS EXECUTIVE SUMMARY 2 GLOSSARIES 8 1 INTRODUCTION 10 1.1 Structure and Explanations 11 1.2 Value Estimates 12 2 A GENERAL SCHEMA FOR SALT DEVELOPMENT 14 2.1 Foundations 14 2.1.1 Professionalism 14 2.1.2 Centres of Excellence 15 2.1.3 Collaboration and Funding 15 2.1.4 International Standard Protocols 15 2.1.5 Future-proofing 15 2.2 Standardisation and Development 15 2.3 Development of a Corpus 16 2.4 Developing Terminology Resources 17 2.5 Developing Tools 17 2.5.1 General Tools 18 2.5.2 General Software 18 2.5.3 Proofing Tools 18 2.5.4 Speech Technology 19 2.5.5 Computer-assisted Translation (CAT) 19 2.6 Other Aspects 19 2.6.1 Information Management 19 2.6.2 Research 20 3 THE CURRENT GAELIC WORLD 21 3.1 Stakeholder research 21 3.2 Foundations 21 3.2.1 Standards 21 3.2.2 Centres of Excellence 21 3.2.3 Collaboration 22 3.3 Standardisation and Development 22 3.4 Development of a Corpus 22 3.5 Developing Terminology Resources 22 3.5.1 Dictionaries 23 3.5.2 Historical Dictionaries 23 3.5.3 Terminology Development 24 3.6 Developing Tools 25 3.6.1 General Tools 25 BnG Report November 2009 Page 4 of 170 Survey of Gaelic Corpus Technology University of Glasgow 3.6.2 General Software 26 3.6.3 Proofing Tools 26 3.6.4 Speech Technology 26 3.6.5 Computer-assisted Translation (CAT) 26 3.6.6 Information Management 27 3.6.7 Research 27 3.6.8 Non-Gaelic Skills Pool 27 3.7 Planned Projects 27 3.7.1 Faclair Bun-tùsach 27 3.7.2 Grammar-checker 28 3.7.3 Talking Dictionary 28 3.7.4 Grammar Dictionary 28 4 ASPIRATIONS OF GAELIC USERS 29 4.1.1 Communication, Consultation and Information 29 4.1.2 Gaelic Academy 29 4.1.3 Codification 30 4.1.4 Standardisation 30 4.1.5 Terminological Tools 30 4.1.6 SALT in the Wider Context 31 4.1.7 SALT Tools 32 4.1.8 SALT Technology in Education 32 4.1.9 Mobile Technology 33 4.1.10 Translation 33 4.1.11 Research 33 4.1.12 Other Points 33 5 A ROADMAP FOR GAELIC 35 5.1 Governance Framework 35 5.1.1 Strategic Business Case 36 5.1.2 Funding for Framework 36 5.2 General Principles 36 5.2.1 Detailed Principles 36 5.3 Stage 1 - Linguistic Foundation 38 5.3.1 Standardisation 40 5.3.2 A Gaelic Corpus 48 5.3.3 Academic Research 49 5.3.4 Information Management 50 5.4 Stage 2 - The SALT Centre 50 5.4.1 Setting up a Centre of Excellence 52 5.4.2 Typographical Tools 53 5.4.3 Common Use Tools 54 5.4.4 Community Translation Projects 59 5.4.5 Other Technologies 60 5.4.6 Speech Technology 61 5.4.7 Becoming Cutting Edge 62 6 CONCLUSION 64 APPENDIX 1 66 APPENDIX 2 67 BnG Report November 2009 Page 5 of 170 Survey of Gaelic Corpus Technology University of Glasgow APPENDIX 3 139 APPENDIX 4 158 GLASGOW 159 Output 159 Rules Framework 159 Preserving the Richness and Diversity 159 Focus Groups 159 Media, Government or Private Sector 159 Gaelic Education Connections 160 EDINBURGH 161 Output 161 Aspects of Teaching Gaelic at Tertiary Level 161 Mobilising Existing Skills 161 Developing Higher Registers 161 SecondLife University 162 General points made 162 Focus Groups 162 People in Tertiary Education 162 IT and the Media 162 INVERNESS 163 Output 163 Reality for Young People 163 Mobile Technology 163 Finding a Niche 163 Virtual Learner Environment 164 Focus Group 164 SKYE (SMO) 165 Output 165 Focus of Gaelic Development 165 Perception of Language Learning 165 Standards Implementation 165 Handling Dialects 165 Criticism of Isolated Development 165 Idiom 166 Pure Gaelic-speaking Centre 166 Mobility of Teaching 166 History & Culture 166 Colloquialisms & slang 166 Random Idea 166 Focus Groups 167 STORNOWAY 168 Output 168 BnG Report November 2009 Page 6 of 170 Survey of Gaelic Corpus Technology University of Glasgow Translators’ Skills 168 Mobile Technology 168 The Workplace 168 Guidance required 168 Need for a Professional body 168 Terminology 169 Tools 169 Focus Groups 170 Translators 170 IT & Media 170 BnG Report November 2009 Page 7 of 170 Survey of Gaelic Corpus Technology University of Glasgow Glossaries This is a glossary of technical terms and abbreviations used in this report: Abbreviation Description CALL Computer Assisted Language Learning refers to computer-based tools that support the teaching and learning of languages.