Enhancement of Post-Editing Performance
Total Page:16
File Type:pdf, Size:1020Kb
ADVERTIMENT. Lʼaccés als continguts dʼaquesta tesi queda condicionat a lʼacceptació de les condicions dʼús establertes per la següent llicència Creative Commons: http://cat.creativecommons.org/?page_id=184 ADVERTENCIA. El acceso a los contenidos de esta tesis queda condicionado a la aceptación de las condiciones de uso establecidas por la siguiente licencia Creative Commons: http://es.creativecommons.org/blog/licencias/ WARNING. The access to the contents of this doctoral thesis it is limited to the acceptance of the use conditions set by the following Creative Commons license: https://creativecommons.org/licenses/?lang=en Doctorat en Traducció i Estudis Interculturals Departament de Traducció i d’Interpretació i d’Estudis de l’Àsia Oriental Olena Blagodarna Enhancement of Post-Editing Performance: Introducing Machine Translation Post-Editing in Translator Training Tesi doctoral dirigida per: Dra. Pilar Sánchez Gijón Bellaterra, juliol 2018 Acknowledgements Many people contributed to this PhD research, and hereafter I would like to acknowledge their great assistance and support. First of all, I am very grateful to my academic supervisor Dr. Pilar Sánches Gijón for guiding and enlightening me on how to perform research of academic value, her encouragement and insightful comments were very stimulating. Also, I would like to say thank you to all members of Tradumàtica Research Group (UAB) for sharing their friendship and experience during our meetings. You have been a great example and inspiration to me! A special mention goes to all anonymous post-editors who took part in the survey and whose answers were an essential element of my research, and I express my sincere gratitude to Jeannette Ørsted and the International Federation of Translators for their invaluable help. A heartfelt thanks to National Aerospace University "Kharkiv Aviation Institute" and Dr. Viktoria Ryzhkova for accepting to have me as a research visitor and providing me with all the support for conducting the experimental study, it was an honor to be there. I should also acknowledge the assistance of Dr. Olga Torres Hostench (UAB) and Dr. Marharyta Ilchenko (KhAI) in arranging experimental training and testing sessions, and I am very grateful to all those undergraduate students who volunteered to participate and provide their data for further analysis and interpretation. A general thanks to all the great scholars I have had the honor to learn from during research seminars, conferences, lectures and tutorials, especially to Dr. Caroline Rossi for her assistance during the final phase of my PhD journey, Dr. Christian Olalla Soler for helping to choose and apply the most appropriate models of statistical analysis, Dr. Sheila Castilho for practical suggestions on training materials, and Dr. Joss Moorkens for his willingness to help me organize my ideas. To my wonderful family that I am blessed with, and to Ruben – you were always there for me; the accomplishment of this thesis can be attributed to your support and care. THANK YOU ALL for contributing directly or indirectly, this dissertation would have definitely not been possible without each and every one of you! Table of contents List of tables and figures ................................................................................................................ v List of abbreviations ....................................................................................................................... x Abstract .......................................................................................................................................... 1 Resumen ......................................................................................................................................... 2 Introduction ................................................................................................................................... 3 Part I. Theoretical framework ................................................................................................... 11 Chapter 1. Overview of EHEA ..................................................................................... 13 1.1. Recent evolution of training paradigms ................................................................ 14 1.2. Notion of competency ........................................................................................... 17 1.3. CBT model and programmed learning .................................................................. 20 Concluding remarks ......................................................................................................... 26 Chapter 2. Scope of translator training ....................................................................... 27 2.1. Training objectives ................................................................................................ 29 2.2. Translation modalities ........................................................................................... 32 2.3. MTPE assignment ................................................................................................. 36 2.3.1. Project workflow ............................................................................................ 39 2.3.2. MT error typologies ....................................................................................... 41 2.3.3. Tools and systems .......................................................................................... 45 2.3.4. References for decision-making ..................................................................... 47 2.4. Post-editor’s profile ............................................................................................... 52 2.5. Specialized training in MTPE ............................................................................... 56 Concluding remarks ......................................................................................................... 59 Chapter 3. Expertise in PE ............................................................................................ 60 3.1. Sharing Post-Editing Practices: survey setup ........................................................ 60 3.1.1. Data collection ............................................................................................... 62 3.1.2. Questionnaire structure .................................................................................. 64 3.1.3. Sample and dissemination .............................................................................. 66 i 3.1.4. Piloting ........................................................................................................... 69 3.2. Sharing Post-Editing Practices: survey outcomes ................................................. 70 3.2.1. Block 1: Respondents’ profiles and experience ............................................. 71 3.2.2. Block 2: MTPE workflow .............................................................................. 86 3.2.3. Block 3: Expertise and decision-making in PE .............................................. 90 3.2.4. Block 4: Post-editors’ vs. translators’ performance ....................................... 93 Concluding remarks ......................................................................................................... 96 Part II. Experimental Study ....................................................................................................... 99 Chapter 4. Study methodology and design ................................................................ 100 4.1. Research construct operationalization................................................................. 100 4.2. Methodological framework ................................................................................. 101 4.3. Experimental study design .................................................................................. 103 4.3.1. Training goals............................................................................................... 104 4.3.2. Training principles and content .................................................................... 105 4.4. Study piloting ...................................................................................................... 109 4.4.1. Participants ................................................................................................... 109 4.4.2. Study corpus ................................................................................................. 112 4.4.3. Instruments and tools ................................................................................... 114 4.4.4. Protocol ........................................................................................................ 116 4.4.5. Preliminary evaluation of training outcomes ............................................... 118 Concluding remarks ................................................................................................... 122 Chapter 5. Experimental study conduct .................................................................... 124 5.1. Participants .......................................................................................................... 124 5.2. Study corpus ........................................................................................................ 126 5.3. Instruments .......................................................................................................... 129 5.4. Protocol ..............................................................................................................