题名

機器譯文錯誤類型再探－以新聞文本中翻英譯文為例

并列篇名

Error Typology in MT Revisited: Chinese to English Translation Output of Journalistic Texts

作者

藍月素(Lan, Yu-Su)；邱東龍(Andrew Chiu)

关键词

機後編輯能力 ； 新聞文本 ； Google神經機器翻譯系統（GNMT） ； 多維度質量指標（MQM） ； 精確度及流暢度 ； 錯誤嚴重度 ； post-editing competency ； journalistic texts ； Google Neural Machine Translation (GNMT) ； Multidimensional Quality Metrics (MQM) ； accuracy and fluency ； error severity

期刊名称

翻譯學研究集刊

卷期/出版年月

25輯（2022 / 05 / 01）

页次

227 - 257

内容语文

繁體中文
中文摘要

因應AI科技的發展，全球翻譯語言服務業者也將機器翻譯融入專業工作流程中，而且工作產值量不容忽視。在此趨勢下，在翻譯教學中訓練學生的機後編輯（Machine Translation Post-Editing, MTPE）能力變成不可或缺的一環。本論文主要採用質性分析法，以六篇2019年2月份紐約時報中文網國際縱覽網頁中最受歡迎文章為文本，分別於2019年和2021年利用Google神經機器翻譯系統（GNMT），將這些文本之人工中譯文回譯成英文，並以英文原文為評價指標，然後應用適合各種語言配對且錯誤類型定義清楚的「多維度質量指標」（Multidimensional Quality Metrics, MQM），分析與比較2019年與2021年之英文機器譯文文本的錯誤類型、質量及錯誤嚴重度（severity）之差異，最後提出機後編輯教學相關建議。研究結果只發現精確度、流暢度等二維度的錯誤類型。在「精確度」維度方面，主要錯誤集中在「誤譯」類型；整體而言，2021年版較2019版譯文的精確度錯誤類型數量明顯減少，在「漏譯」部分也稍有改善，「增譯」數量極少，而且兩版本沒有質量上之差別。在「流暢度」維度方面，本研究僅發現「連貫錯誤」和「文法錯誤」，而且兩版的機器英譯文在此兩方面的翻譯質量從2019到2021年沒有進展；錯誤數量也幾乎一樣，僅是文法錯誤較多些。此外，兩版英譯文的整體精確度錯誤嚴重度僅有小幅差異，然重大級及嚴重級的「誤譯」錯誤最多，而在流暢度錯誤嚴重度上可謂沒有差別。研究結果有助於了解GNMT在中譯英翻譯上的進展，也對機後編輯教學有啟示作用。
英文摘要

Translation services around the world have incorporated the use of machine translation (MT) in their professional workflow as a response to the development of artificial intelligence. Therefore, post-editing competency training has become indispensable in the translation instruction. The authors use qualitative analysis to track the changes in the quality of the MT output produced by Google Neural Machine Translation (GNMT) in the years of 2019 and 2021. The study selects six articles from the New York Times Chinese language websites in 2019 for analysis and comparison. GNMT is used to back-translate the manually translated Chinese versions into English, and the non-translated texts are used as an evaluation reference. The discrepancies in terms of quality and quantity of the machine translated texts between 2019 and 2021 are analyzed according to the MT error typology in Multidimensional Quality Metrics (MQM). As news texts are used in this study, only errors in accuracy and fluency are found. Errors in accuracy are mostly mistranslations. In the fluency category, only errors in ＂coherence＂ and ＂grammar＂ are found. Very similar mistakes in ＂coherence＂ and ＂grammar＂ in both years, but 2021 versions contain more errors in ＂grammar＂. The severity of ＂accuracy＂ errors in both versions varies, with major and critical errors accounting for the most part. The severity of ＂fluency＂ errors in both years is about the same. The error types analyzed in these texts will help see the development of GNMT in the Chinese to English translation and serve in the teaching of post-editing skills.
主题分类 人文學 > 語言學
参考文献
  1. Lee, J.,Liao, P.(2011).A Comparative Study of Human Translation and Machine Translation with Post-editing.Compilation and Translation Review,4(2),105-149.
    連結：
  2. Shih, Chung-ling(2019).Meta-cognitive teaching of machine translation: Moving towards mind-on/thinking-based learning.Studies of Interpretation and Translation,23,1-22.
    連結：
  3. Shih, Chung-ling(2008).Production and consumption of machine translation: A probe from the deconstructionist.Compilation and Translation Review,1(1),1113-140.
    連結：
  4. Shih, Chung-ling(2002).Materials development and task design for an MT course.Studies of Interpretation and Translation,7,1-28.
    連結：
  5. Shih, Chung-ling(2013).Computer-aided business translation teaching: The use of MT and TM as aids to translation.Compilation and Translation Review,6(1),113-145.
    連結：
  6. Shih, Chung-ling(2007).Mapping out students’ translation process: An MT-specific comparative study.Studies of Interpretation and Translation,10,163-190.
    連結：
  7. Shih, Chung-ling(2003).The customized editing training in MT education.Studies of Interpretation and Translation,8,1-24.
    連結：
  8. 黃俐絲(2005).What sense makes sense? Beginning translators’ difficulties with English polysemous words.翻譯學研究集刊,9,201-234.
    連結：
  9. Allen, J.(2003).Post-editing: An Integrated Part of a Translation Software Program.Language International,13(2),26-29.
  10. Allen, J. P. B.(Ed.),Corder, S.(Ed.)(1974).Edinburgh course in applied linguistics Vol. 3. Techniques in applied linguistics.London:Oxford University Press.
  11. Alves, F.(Ed.)(2003).Triangulating translation: Perspectives in process-oriented research.Amsterdam, Netherlands:John Benjamins publishing company.
  12. Austermuehl, F.(2013).Future (and not-so-future) trends in the teaching of translation technology.Revista Tradumàtica: technologies de la traducció,11,326-337.
  13. Carl, M.,Dragsted, B,Elming, J.,Hardt, D.,Jakobsen, A. L.(2011).The Process of Post-Editing: a Pilot Study.Proceedings of the 8th International NLPCS Workshop (Special theme: Human-Machine Interaction in Translation Copenhagen Business School)
  14. Castilho, S.,Moorkens, J.,Gaspari, F.,Calixto, I.,Tinsley, J.,Way, A.(2017).Is neural machine translation the new state of the art?.The Prague Bulletin of Mathematical Linguistics,108,109-120.
  15. Daems, J.,Vandepitte, S.,Hartsuiker, R. J.,Macken, L.(2017).Translation methods and experience: A comparative analysis of human translation and post-editing with students and professional translators.Meta,62(2),245-270.
  16. Densmer, L. (2014). Light and Full MT Post-Editing Explained, Retrieved from: http://info.moravia.com/blog/bid/353532/Light-and-Full-MT-Post-Editing-Explained
  17. Dohery, S.,Moorkens, J.,Gaspari, F.,Castilho, S.(2018).On Education and Training in Translation Quality Assessment.Translation Quality Assessment: From Principles to Practice
  18. Garcia, I.(2011).Translating by post-editing: Is it the way forward?.Machine Translation,25(3),217-237.
  19. Groves, D.,Schmidtke, D.(2009).Identification and analysis of post-editing patterns for MT.Proceedings of Machine Translation Summit XII: Commercial MT User Program
  20. Guerberof, A. (2009). Productivity and quality in MT post-editing. Retrieved from: https://aclanthology.org/2009.mtsummit-btm.7.pdf
  21. Hatim, B.(2001).Teaching and researching translation.Essex, UK:Pearson Education.
  22. Hu, K.,Cadwell, P.(2016).A Comparative Study of Post-editing Guidelines.Baltic Journal of Modern Computing,4(2),346-353.
  23. Koehn, P.,Germann, U.(2014).The impact of machine translation quality on Human post-editing.Workshop on Humans and Computer-assisted Translation
  24. Koponen, M.(2016).Is machine translation post-editing worth the effort? A survey of research into post-editing and effort.The Journal of Specialised Translation,25,131-148.
  25. Koponen, M.(2015).How to teach machine translation post-editing? Experiences from a post-editing course.Proceedings of 4th Workshop on Post-Editing Technology and Practice (WPTP4),Miami:
  26. Koponen, M.,Salmi, L.(2015).On the correctness of machine translation: A machine translation post-editing task.The Journal of Specialised Translation,23(23),118-136.
  27. Krings, H. P.(ed.),Koby, G. S.(ed.)(2001).Repairing Texts: Empirical Investigations of Machine-Translation Post-Editing Processes.Kent, Ohio:Kent State University Press.
  28. Löffler-Laurian, A.- M.(1985).Traduction automatique et style.Babel,31(2),70-76.
  29. Lommel, A.(2018).Metrics for Translation Quality Assessment: A Case for Standardising Error Typologies.Translation Quality Assessment: From Principles to Practice
  30. Lommel, A.,Uszkoreit, H.,Burchardt, A.(2014).Multidimensional Quality Metrics (MQM): A Framework for Declaring and Describing Translation Quality Metrics.Revista Tradumàtica: tecnologies de la traducció,12
  31. Mariana,V.,Cox, T.,Melby, A.(2015).The Multidimensional Quality Metrics (MQM) Framework: a new framework for translation quality assessment.The Journal of Specialised Translation,23,137-161.
  32. Massardo, I.,van der Meer, J.,O’Brien, S.,Hollowood, F.,Aranberri, N.,Drescher, K.(2016).MT Post-Editing Guidelines.Amsterdam:Translation Automation User Society.
  33. Melby, A.,Fields, P.,Hague, D.,Koby, G.,Lommel, A.(2014).Defining Translation Quality.Revista Tradumàtica: tecnologies de la traducció,12
  34. Melis, N. M.,Albir, A. H.(2001).Assessment in translation studies: Research needs.Meta,46(2),272-287.
  35. Mossop, B.(2014).Revising and Editing for Translators.New York:Routledge.
  36. Nitzke, J.,Hansen-Schirra, S.,Canfora, C.(2019).Risk management and post-editing competence.The Journal of Specialised Translation,31,230-250.
  37. O’Brien, S. (2002). Teaching post-editing: a proposal for course content. Retrieved from: https://www.academia.edu/1160352/Teaching_Post_Editing_A_Proposal_for_Course_Content
  38. O'Brien, S.,Balling, L. W.,Carl, M.,Simard, M.,Specia, L.(2014).Post-editing of Machine Translation: Processes and Applications,Newcastle:
  39. O'Hagan, M.(Ed.)(2019).The Routledge Handbook of Translation and Technology.Routledge.
  40. Popović, M.(2017).Comparing language related issues for NMT and PBMT between German and English.The Prague Bulletin of Mathematical Linguistics,108,209-220.
  41. Pym, A.(1992).Translation error analysis and the interface with language teaching.Teaching translation and interpreting: Training, talent, and experience,Amsterdam:
  42. Rico, C.,Torrejón, E.(2012).Skills and Profile or the New Role of the Translator as MT Post-editor. Postedició, canvi de paradigm?.Revista Tradumàtica: technologies de la traducció,10,166-178.
  43. Senez, D.(1998).Post-Editing Service for Machine Translation Users at the European Commission.Translating and the Computer 20. Proceedings of the Twentieth International Conference on Translating and the Computer,London:
  44. Shih, Chung-ling(2002).An inquiry into pedagogical benefits of MT application.Journal of Ching-Yun Institute of Technology,22(1),223-234.
  45. Shih, Chung-ling(2003).A proposal for the implementation of computer-assisted translation curriculum module.Ching-Yun Journal,23(1),195-204.
  46. Shih, Chung-ling(2010).Shift in controlled English norms for different purposes and for different machine translation systems.Journal of Language and Translation,11(2),227-254.
  47. Shih, Chung-ling(2016).A new scenario of machine translation: Dynamic contextual effects with diverse paratextual application.Theory and Practice in Language Studies,6(6),1183-1190.
  48. Shih, Chung-ling(2015).Toward one-stop information mining: Tailoring web texts to effective machine translation.International Journal of Language and Linguistics,2(4),15-24.
  49. Shih, Chung-ling(2005).Translation memory: A teaching challenge.Perspectives: Studies in Translatology,15(3),205-214.
  50. Shih, Chung-ling(2013).Adaptations in controlled cultural writing for effective machine translation: A register-specific probe.Theory and Practice in Language Studies,3(7),1093-1102.
  51. Shih, Chung-ling(2016).Can machine translation declare a new realm of service? Online folktales as a case study.Theory and Practice in Language Studies,6(2),252-259.
  52. Shih, Chung-ling(2002).Complimentary relevance of machine translation to human translation.English Teaching & Learning,27(1),85-102.
  53. Shih, Chung-ling(2013).Controlled cultural writing for effective machine-translation-enabled intercultural communication on the web.Cultus: The Journal of Intercultural Mediation and Communication,6,125-148.
  54. Shih, Chung-ling,Xu, shu-yi,Chen, hui-lan(2001).An investigation and critique of MT application in Taiwan’s translation industry.Journal of Ching-Yun University,21(2),313-327.
  55. Shih, Chung-ling,Zheng, You-di(2006).The technical turn and its impacts on translation, teaching and research.Journal of the National Institute for Compilation and Translation,34(3),45-58.
  56. Snow, T. A.(2015).Brigham Young University - Provo.
  57. TAUS. (2016). TAUS Post-Editing Guidelines. Retrieved from https://www.taus.net/think-tank/articles/postedit-articles/taus-post-editing-guidelines
  58. Vasconcellos, M.,Léon, M.(1985)."SPANAM and ENGSPA: Machine Translation at the Pan American Health Organization".Computational Linguistics,11,122-136.
  59. Vivanco, H.,Palazuelos, J. C.,Hormann, P.,Garbarini, C.,Blajtrach, M.(1990).Error analysis in translation: A preliminary report.Meta,35(3),538-542.
  60. Yamada, M.(2019).The impact of google neural machine translation on post-editing by student translators.The Journal of Specialised Translation,31,14-37.
  61. Yin, J.(2017).University of Electronic Science and Technology of China.
  62. Zhechev, Ventsislav(2014).Analysing the post-editing of Machine Translation at Autodesk.Post-editing of Machine Translation: Processes and Applications,Newcastle:
  63. 史宗玲(2004).電腦輔助翻譯─MT&TM.臺北:書林.
  64. 史宗玲(2020).翻譯科技發展與應用.臺北:書林.
  65. 何慧玲(1997)。英中視譯錯誤分析與教學關係。翻譯學研究集刊，2，111-135。
  66. 周兆样(1986).翻譯實務.香港:商務印書館.
  67. 柯平(2003).英漢與漢英翻譯.臺北:書林.
  68. 陳獻忠(1999)。錯誤分析在翻譯教學中的應用。翻譯學研究集刊，4，51-80。
  69. 廖柏森(2010)。大學生英譯中的筆譯錯誤分析與教學上的應用。編譯論叢，3(2)，101-128。
  70. 賴慈芸(2009).譯者的養成：翻譯教學、評量與批評.臺北:國立編譯館.
  71. 藍月素,邱東龍(2019)。新聞媒體文本中翻英機器譯文非二元性錯誤問題探討。第 23 屆口筆譯國際學術研討會
print cancel