Exploring the Effects of Phonological Processing on Foreign-Language Reading: An Eye-Tracking Study for Chinese Learners of Japanese-as-a-Foreign-Language

探索語音處理對外語閱讀的影響：一個針對中文母語者閱讀日語為外語的眼動研究

10.6251/BEP.202003_51(3).0007

官英華(Ying-Hua Guan)

Eye-tracking ； Foreign language reading ； Linear mixed models ； Phonological processing ； 外語閱讀 ； 眼動追蹤 ； 語音處理 ； 線性混合模型

教育心理學報

51卷3期（2020 / 03 / 01）

483 - 504

英文

This study explored the effects of phonological processing on text comprehension and word processing in a group of advanced Chinese students learning Japanese-as-a-foreign-language (JFL). Participants' reading performance and global- and word-level eye-movement patterns were compared under five reading conditions: articulatory suppression, read-aloud, concurrent reading while listening to the text or to an irrelevant speech, and silent reading. In addition, the study examined whether text complexity moderates participants' phonological processing when reading Japanese text. Finally, how participants' Chinese knowledge affects their processing of Japanese words written in different script types was investigated through analysis of their word-level eye-movement behavior. The results indicated that participants could comprehend short Japanese texts without relying much on phonological recoding: Articulatory suppression and reading while listening to an irrelevant speech did not significantly impair reading comprehension nor did read-aloud and reading while listening to the text enhance text comprehension. Text complexity did not reliably moderate participants' phonological processing under the reading conditions. The word processing results showed that participants' Chinese knowledge facilitated their processing of Chinese-Japanese cognates (i.e., kanji existing both in Chinese and Japanese with the same meanings) but not the processing of Chinese-Japanese homographs or Japanese-coined kanji words. The fact that reading while listening to the text tended to only facilitate the processing of kana words but not the Chinese-Japanese cognates suggests that phonological recoding might not be necessary for accessing the Chinese-Japanese cognates' meanings but is essential for the processing of words written in kana.

本研究以中文母語的高階日語學習者為研究對象，探索語音處理對文章理解和字詞辨識的影響。透過實驗在5個閱讀條件下（語音抑制、逐字朗讀、聽不相干語音、聽文章語音以及安靜閱讀）比較了受試者的閱讀表現、整體性和詞層次的眼動模式。此外，研究也檢視文章難度是否影響受試者在閱讀日文文章時處理語音的傾向。藉由分析受試者在詞層次的眼動行為來檢視中文知識如何影響他們處理以不同字體書寫的日語詞彙。實驗結果顯示受試者不太需要依賴語音轉碼即可理解日文短文：語音抑制和聽不相干語音並未妨礙閱讀理解，而逐字朗讀以及聽文章語音並不能提升閱讀理解。除了在逐字朗讀的情況下，文章難度並不影響受試者在其他閱讀條件下語音處理的傾向。在字詞處理方面，受試者的中文知識僅促進他們處理中日同源詞，並無法促進他們處理中日文間的同形異義詞或僅在日語裡使用的漢字詞。聽文章語音傾向只有利於處理平假名或片假名的字詞，但會延長對中日同源詞的注視時間，此結果指向語音轉碼在提取中日同源詞的意義時，可能並非必要的過程，但對處理以平假名或片假名書寫的字詞較為重要。

1. Guan, Y. H.(2015).Investigating the role of phonological recoding in English-as-a-foreign-language reading processes.English Teaching & Learning,39(3),107-140.
   連結：
2. Liu, H.-M.,Tsao, F.-M.,Chang, C.-J.,Hsu, L.-L.(2013).The development of speech discrimination in preschool and school-aged children: Association with word comprehension.Bulletin of Educational Psychology,45(2),221-240.
   連結：
3. Akamatsu, N.(2003).The effects of first language orthographic features on second language reading in text.Language Learning,53,207-231.
4. Alexander, J. D.,Nygaard, L. C.(2008).Reading voices and hearing text: Talker-specific auditory imagery in reading.Journal of Experimental Psychology: Human Perception and Performance,34(2),446-459.
5. Baddeley, A. D.(1997).Human Memory: Theory and Practice.East Sussex, UK:Psychology Press.
6. Baddeley, A. D.,Eldridge, M.,Lewis, V.(1981).The role of subvocalisation in reading.Quarterly Journal of Experimental Psychology,33A,439-454.
7. Bernhart, E. B.(1983).Three approaches to reading comprehension in intermediate German.The Modern Language Journal,67,111-115.
8. Bhide, A.(2015).Early literacy experiences constrain L1 and L2 reading procedures.Frontiers in Psychology,6,1446.
9. Chang, A. C. S.,Millett, S.(2015).Improving reading rates and comprehension through audio-assisted extensive reading for beginner learners.System,52,91-102.
10. Chen, Y. R.,Liu, Y. T.,Todd, A. G.(2018).Transient but effective? Captioning and Adolescent EFL Learners’ Spoken Vocabulary Acquisition.English Teaching & Learning,42(1),25-56.
11. Chikamatsu, N.(1996).The effect of L1 orthography on L2 word recognition. A study of American and Chinese learners of Japanese.Studies in Second Language Acquisition,18,403-432.
12. Coltheart, V.,Avons, S. E.,Trollope, J.(1990).Articulatory suppression and phonological codes in reading for meaning.Quarterly Journal of Experimental Psychology,42,375-399.
13. Cook, V.(ed.),Bassetti, B.(ed.)(2005).Second language writing systems.Clevedon, UK:Multilingual Matters.
14. Daneman, M.,Newson, M.(1992).Assessing the importance of subvocalization during normal silent reading.Reading and Writing: An Interdisciplinary Journal,4,55-77.
15. Diao, Y.,Sweller, J.(2007).Redundancy in foreign language reading comprehension instruction: Concurrent written and spoken presentations.Learning and Instruction,17(1),78-88.
16. Eiter, B. M.,Inhoff, A. W.(2010).Visual word recognition during reading is followed by subvocal articulation.Journal of Experimental Psychology: Learning, Memory, and Cognition,36(2),457-470.
17. Gerbier, E.,Bailly, G.,Bosse, M.-L.(2018).Audio-visual synchronization in reading while listening to texts: Effects on visual behavior and verbal learning.Computer Speech and Language,47,79-92.
18. Gibson, S.(2008).Reading aloud: a useful learning tool?.ELT Journal,62(1),29-36.
19. Hamada, M.,Koda, K.(2008).Influence of first language orthographic experience on second language decoding and word learning.Language Learning,58,1-31.
20. Hamada, M.,Koda, K.(2011).The role of the phonological loop in English word learning: a comparison of Chinese ESL learners and native speakers.Journal of Psycholinguistic Research,40(2),75-92.
21. Hardyck, C. D.,Petrinovich, L. F.(1970).Subvocal speech and comprehension level as a function of the difficulty level of reading material.Journal of Verbal Learning and Verbal Behavior,9,647-652.
22. Holmes, B. C.(1985).The effect of four different modes of reading on comprehension.Reading Research Quarterly,20(5),575-585.
23. Holmes, B. C.,Allison, R. W.(1986).The effect of four modes of reading on children's comprehension.Reading Research and Instruction,25(1),9-20.
24. Huff, S.(2012).Stillwater, Oklahoma,Oklahoma State University.
25. Jobard, G.,Vigneau, M.,Simon, G.,Tzourio-Mazoyer, N.(2011).The weight of skill: Interindividual variability of reading related brain activation patterns in fluent readers.Journal of Neurolinguistics,24(1),113-132.
26. Jones, D.(1995).The fate of the unattended stimulus: Irrelevant speech and cognition.Applied Cognitive Psychology,9,S23-S38.
27. Jorm, A. F.,Share, D. L.(1983).An invited article: Phonological recoding and reading acquisition.Applied Psycholinguistics,4(2),103-147.
28. Kailani, Z.(1998).Reading aloud in EFL revisited.Reading in a Foreign Language,12(1),281-294.
29. Kato, S.(2009).Suppressing inner speech in ESL reading: Implications for developmental changes in second language word recognition processes.The Modern Language Journal,93(4),471-488.
30. Klapper, J.(2007).Preliminary considerations for the teaching of FL reading.The Language Learning Journal,6(1),53-56.
31. Kliegl, R.,Hohenstein, S.,Yan, M.,McDonald, S. A.(2013).How preview space/time translates into preview cost/benefit for fixation durations during reading.The Quarterly Journal of Experimental Psychology,66(3),581-600.
32. Kolers, P. A.(ed.),Wrolstad, M. E.(ed.),Bouma, H.(ed.)(1979).Processing of visible language.New York, NY:Plenum.
33. Larsen, J. D.,Baddeley, A.(2003).Disruption of verbal STM by irrelevant speech, articulatory suppression, and manual tapping: Do they have a common source?.The Quarterly Journal of Experimental Psychology Section A,56(8),1249-1268.
34. Larsen, J. D.,Baddeley, A.,Andrade, J.(2000).Phonological similarity and the irrelevant speech effect: Implications for models of short-term verbal memory.Memory,8(3),145-157.
35. Leinenger, M.(2014).Phonological coding during reading.Psychological Bulletin,140(6),1534-1555.
36. Luo, C. R.,Johnson, R. A.,Gallo, D. A.(1998).Automatic activation of phonological information in reading: Evidence from the semantic relatedness decision task.Memory & Cognition,26(4),833-843.
37. Machida, S.(2001).Japanese text comprehension by Chinese and non-Chinese background learners.System,29,103-118.
38. Martin, R. C.,Wogalter, M. S.,Forlano, J. G.(1988).Reading comprehension in the presence of unattended speech and music.Journal of Memory and Language,27,382-398.
39. Matsumoto, K.(2013).Kanji recognition by second language learners: Exploring effects of first language writing systems and second language exposure.The Modern Language Journal,97(1),161-177.
40. Matsuo, K.,Chen, S. H.,Hue, C. W.,Wu, C. Y.,Bagarinao, E.,Tseng, W. Y.,Nakai, T.(2010).Neural substrates of phonological selection for Japanese character Kanji based on fMRI investigations.Neuroimage,50(3),1280-1291.
41. McCallum, R. S.,Sharp, S.,Bell, S. M.,George, T.(2004).Silent versus oral reading comprehension and efficiency.Psychology in the Schools,41(2),241-246.
42. McCusker, L. X.,Hillinger, M. L.,Bias, R. G.(1981).Phonological recoding and reading.Psychological Bulletin,89,217-245.
43. Nakayama, M.(Ed.)(2015).Handbook of Japanese psycholinguistics.Berlin:De Gruyter Mouton.
44. Norris, D.,Butterfield, S.,Hall, J.,Page, M. P. A.(2018).Phonological recoding under articulatory suppression.Memory & Cognition,46(2),173-180.
45. Oswald, C. J.,Tremblay, S.,Jones, D. M.(2000).Disruption of comprehension by the meaning of irrelevant sound.Memory,8(5),345-350.
46. Perfetti, C. A.(2003).The universal grammar of reading.Scientific Studies of Reading,7,3-24.
47. Perrone-Bertolotti, M.,Kujala, J.,Vidal, J. R.,Hamame, C. M.,Ossandon, T.,Bertrand, O.,Lachaux, J. P.(2012).How silent is silent reading? Intracerebral evidence for top-down activation of temporal voice areas during reading.The Journal of Neuroscience,32(49),17554-17562.
48. Perrone-Bertolotti, M.,Rapin, L.,Lachaux, J. P.,Baciu, M.,Lœvenbruck, H.(2014).What is that little voice inside my head? Inner speech phenomenology, its role in cognitive performance, and its relation to self-monitoring.Behavioural Brain Research,261,220-239.
49. Pollatsek, A.(ed.),Treiman, R.(ed.)(2015).The Oxford handbook of reading.New York:Oxford University Press.
50. Raney, G. E.,Campbell, S. J.,Bovee, J. C.(2014).Using eye movements to evaluate the cognitive processes involved in text comprehension.Journal of Visualized Experiments,83,e50780.
51. Rayner, K.,Chace, K. H.,Slattery, T. J.,Ashby, J.(2006).Eye movements as reflections of comprehension processes in reading.Scientific Studies of Reading,10(3),241-255.
52. Rayner, K.,Pollatsek, A.,Ashby, J.,Clifton, C., Jr.(2012).Psychology of Reading.New York, NY:Psychology Press.
53. Ridgway, A. J.(2009).The inner voice.International Journal of English Studies,9,45-58.
54. Sakurai, Y.,Momose, T.,Iwata, M.,Sudo, Y.,Ohtomo, K.,Kanazawa, I.(2000).Different cortical activity in reading of Kanji words, Kana words and Kana nonwords.Cognitive Brain Research,9(1),111-115.
55. Slowiaczek, M. L.,Clifton, C., Jr.(1980).Subvocalization and reading for meaning.Journal of Verbal Learning and Verbal Behavior,19,573-582.
56. Sörqvist, P.,Halin, N.,Hygge, S.(2010).Individual differences in susceptibility to the effects of speech on reading comprehension.Applied Cognitive Psychology,24(1),67-76.
57. Takeuchi, O.(2003).What can we learn from good foreign language learners? A qualitative study in the Japanese foreign language context.System,31,385-392.
58. Takeuchi, O.,Ikeda, M.,Mizumoto, A.(2012).Reading aloud activity in L2 and cerebral activation.RELC Journal,43(2),151-167.
59. Tamaoka, K.(1991).Psycholinguistic nature of the Japanese orthography.Studies in Language and Literature,11(1),49-82.
60. Toh, S. C.,Munassar, W. A.,Yahaya, W. A.(2010).Redundancy effect in multimedia learning: A closer look.Proceedings ascilite Sydney 2010,Sydney:
61. v. Gompel, R. P. G.(ed.),Fischer, M. H.(ed.),Murray, W. S.(ed.),Hill, R. L.(ed.)(2007).Eye movements: A window on mind and brain.Amsterdam:Elsevier.
62. Wang, M.,Koda, K.,Perfetti, C. A.(2003).Alphabetic and nonalphabetic L1 effects in English word identification: A comparison of Korean and Chinese English L2 learners.Cognition,87(2),129-149.
63. White, S.,Liversedge, S.(2004).Orthographic familiarity influences initial eye fixation positions in reading.European Journal of Cognitive Psychology,16(1-2),52-78.
64. Woodall, B.(2010).Simultaneous listening and reading in ESL: Helping second language learners read (and enjoy reading) more efficiently.TESOL Journal,1(2),186-205.

1. 官英華(2020)。語音轉碼對臺灣大學生閱讀歷程的影響：來自眼動實驗的證據。教育心理學報，52(2)，459-488。