题名

語音轉碼對臺灣大學生閱讀歷程的影響：來自眼動實驗的證據

并列篇名

The Effects of Phonological Recoding on Taiwanese Students' Reading Processes: Evidence from Eye-Tracking Experiments

DOI

10.6251/BEP.202012_52(2).0010

作者

官英華(Ying-Hua Guan)

关键词

中文閱讀 ； 眼動實驗 ； 語音轉碼 ； Chinese reading ； eye-movement experiments ； phonological recoding

期刊名称

教育心理學報

卷期/出版年月

52卷2期（2020 / 12 / 01）

页次

459 - 488

内容语文

繁體中文
中文摘要

語音在中文閱讀中的角色長久以來是心理語言學界爭論的話題。雖然一些證據顯示中文母語者閱讀中文時，語音可以在字詞辨識早期被激活，語音在字詞辨識和閱讀理解中的角色仍有爭議。本研究進行了兩個眼動實驗，探討是否中文成人的讀者需要依賴語音轉碼來理解短篇論說文，以及是否當讀者沒有與特定領域文章內容相關的背景知識時，更需要依賴語音轉碼來理解文意。實驗一請30位大學生在5個閱讀條件（語音抑制、逐字朗讀、聽不相干語音、聽文章語音以及安靜閱讀）下閱讀20篇短篇論說文。受試者在每篇文章後的閱讀測驗分數以及他們的眼動行為都被記錄下來，之後針對每個依變項進行數個（廣義）線性混合模型分析，以找出最佳配適度的模型。結果顯示語音抑制明顯的降低閱讀理解且造成較大的回視率和目標詞的重讀率，表示語音轉碼在中文閱讀理解和字詞辨識的重要性。實驗二沿用同樣的實驗法另請30位大學生在上述5個閱讀條件下閱讀15篇物理學專業的短文，其中15位主修人文社會科學，15位主修自然科學。實驗結果顯示只有背景知識對閱讀理解有顯著效果，但閱讀條件以及它與背景知識的交互作用都不顯著。背景知識無法調節受試者閱讀理解時對語音轉碼的依賴程度。整體來說，語音轉碼對特定知識領域短文的理解並不那麼重要。語音抑制並未顯著降低物理學專業短文的閱讀理解表現。逐字朗讀會使閱讀變慢並降低回視率，但不能提升閱讀理解。聽文章語音會增加閱讀短篇論說文中目標詞的重讀率，也會增加閱讀物理學專業短文的閱讀時間和平均凝視時間。聽不相干語音不影響閱讀理解表現，只增加物理學專有名詞的重讀率以及延長沒有背景知識受試者的首次凝視時間。
英文摘要

Phonological recoding is a psychological process in which readers convert printed words into sounds (i.e., phonological codes) during silent reading. The role of phonological recoding in reading has long been debated in the field of psycholinguistics. Most relevant studies have mainly focused on examining the role of phonological recoding in word recognition. Three major theoretical approaches have been proposed for lexical access. First, the phonological mediation model assumes that the meaning of a word is accessed through its phonology; that is, the sequence of the word recognition process is orthography phonology semantics. Phonological recoding of a word occurs prior to the access of its meaning (Lukatela & Turvey, 1994; Rayner, Pollatsek, & Binder, 1998; Van Orden, Johnston, & Hale, 1988). Second, the direct access route model assumes that the meaning of a word can be directly accessed through the transition from orthography to semantics without the mediation of phonology (M. Coltheart & Coltheart, 1997; Taft & Van Graan, 1998). The model, however, does not deny the possibility of phonological activation. Rather, it assumes that phonological recoding occurs concurrently to or later than the access of the word's meaning. Third, the dual route model suggests that two parallel running routes can achieve lexical access: one is the phonologically mediated route, and the other is the direct access route (M. Coltheart, 2000). The route that achieves lexical access depends on the route that runs the fastest (Barron, 1986; Paap, Noel, & Johansen, 1992). McCusker, Hillinger, and Bias (1981) indicated that the difficulty of material, subjects' reading fluency, the frequency of occurrence of items, and task demands can determine the use of phonological recoding. Chinese is a logographic language and is also regarded as a phonologically opaque one. Nevertheless, studies investigating the time course of phonological activation in Chinese word recognition have yielded inconsistent results. Although some evidence has suggested that phonology can be activated very early in the word recognition process when Chinese readers read Chinese words or sentences (Guo, Peng, & Liu, 2005; Tan, Hoosain, & Peng, 1995; Zhang & Perfetti, 1993), it remains controversial whether phonological recoding plays a crucial role in word recognition and text comprehension. Few studies have measured Chinese subjects' reading comprehension under the condition of articulatory suppression, which has been proven to interfere with phonological recoding (Lu & Zhang, 2007; Ding & Wang, 2006). However, the results of such studies have been inconsistent, and whether phonological recoding is important for Chinese text comprehension remains unclear. This study conducted two eye-tracking experiments by using the same experimental paradigm implemented by Guan (2015, 2020) to investigate whether adult Chinese readers need to rely on phonological recoding to understand short expository texts and also whether readers without the background knowledge relevant to domain-specific texts must rely more on phonological recoding to comprehend them. In Experiment 1, 30 university students in Taipei were recruited whose mother tongue was Mandarin Chinese. They were asked to read 20 short expository texts (each one was 350 characters in length) under five different reading conditions: articulatory suppression, reading aloud, concurrent reading and listening to an irrelevant text (IRS), reading while listening to the same text (RWL), and silent reading. The topics of the texts included, for example, ＂advice for new graduates when entering workforce,＂ ＂the impact of 3C products on human cognition,＂ ＂water pollution,＂ ＂the color of eggs,＂ ＂the crisis of water resources,＂ ＂the function of sun light,＂ ＂the philosopher and the frog,＂ ＂Mr. thought,＂ ＂experiment with monkeys,＂ ＂the stereotypes of teachers in Taiwan,＂ and ＂the influences of watching TV on small children.＂ Subjects' reading time and comprehension score for each text as well as their eye movements were recorded, which were then analyzed by several linear or generalized linear mixed models to find the best fitting model for each dependent variable. The results revealed that articulatory suppression significantly impaired reading comprehension and caused a larger regression ratio in text reading as well as a higher rereading rate on target words, whereas the effects of the other reading conditions on comprehension did not differ from each other. These results suggest that phonological recoding is essential for Chinese expository text comprehension and word recognition. Reading aloud, compared with silent reading, significantly increased the overall reading time, mean fixation duration, and number of fixations in a text but substantially reduced the mean saccade length and regression ratio. In word-level processing, reading aloud led to a much longer first fixation duration, gaze duration, rereading time, and total reading time on target words selected in the texts. Through word-by-word reading, reading aloud seemed to facilitate integrated sentence meaning, but it failed to significantly enhance overall reading comprehension. Moreover, RWL caused higher rereading rates on target words than did silent reading, and it did not improve reading comprehension. In line with results found under the reading aloud condition, the null effects of reading aloud and RWL on reading comprehension could indicate that both reading conditions make the covert phonological recoding during silent reading overt and therefore imposed similar effects on reading comprehension to those exerted by the phonological recoding in silent reading. Experiment 2 was conducted to further examine whether subjects' background knowledge regarding the text content would moderate their reliance on phonological recoding in understanding domain-specific texts, such that subjects without much background knowledge would rely more on phonological recoding in the processing of unfamiliar terms and text content. To this end, 15 excerpts from journal articles in Scientific American were used as experimental materials. The topics of these texts were all about physics, such as the Higgs boson, quantum computing, loop quantum gravity, antimatter, charge-coupled devices, and 3He superfluid. The same experimental paradigm as in Experiment 1 was used in Experiment 2, and a different sample of 30 university students in Taipei were recruited as participants. Half majored in humanities and social sciences and had no background knowledge in physics. The other half of the students majored in natural sciences, such as physics, atmospheric physics, and materials science; therefore, they had background knowledge in physics. Participants were asked to read the texts and answer four comprehension questions after reading each text. The results revealed that only background knowledge had a significant effect on reading comprehension, whereas reading conditions and their interaction with background knowledge did not exhibit any significant effects. Participants with relevant background knowledge performed significantly better than did their counterparts. However, background knowledge did not moderate participants' dependency on phonological recoding in reading comprehension. It seems that phonological recoding did not play a crucial role in understanding short domain-specific texts. Analysis of participants' eye movements indicated that reading aloud could slow their reading speed and reduce their regression ratio, but it did not enhance reading comprehension. RWL increased the rereading rate on target words in short expository texts, and it increased reading time and the mean fixation duration in domain specific texts. IRS did not affect comprehension performance; it only increased the rereading rate on domain-specific target words and prolonged the first fixation duration for participants without relevant background knowledge. In sum, the results of this study suggest that phonological recoding provides critical support for Chinese adult readers to comprehend short expository texts, but it only plays a minor role in understanding domain-specific texts. When participants read domain-specific texts, it was their background knowledge that dominated their reading comprehension performance.
主题分类 社會科學 > 心理學
社會科學 > 教育學
参考文献
  1. Elbro, C.(2018).Knowledge-based inference making for reading comprehension: what to teach and what not.Bulletin of Educational Psychology,49(4),701-713.
    連結：
  2. Guan, Y.-H.(2020).Exploring the effects of phonological processing on foreign-language reading: An eye-tracking study for Chinese learners of Japanese-as-a-foreign-language.Bulletin of Educational Psychology,51(3),483-504.
    連結：
  3. 李俊仁, J.-R.,柯華葳, H.-W.(2009)。台灣學生聲韻覺識作業之聲韻表徵運作單位。教育心理學報，41(1)，111-124。
    連結：
  4. 官英華, Y.-H.(2015)。檢視語音轉碼在英語為外語閱讀歷程中扮演的角色。英語教學期刊，39(5)，107-140。
    連結：
  5. 官英華, Y.-H.(2020)。以眼動實驗探索歐美、日本與臺灣大學生閱讀漢字詞時，利用字形、字音線索的差異。華語文教學研究，17(2)，91-129。
    連結：
  6. 陳惠茹, H.-J.,張鑑如, C.-J.(2011)。指讀及文字討論之共讀方式對幼兒認字的影響。教育心理學報，43(2)，377-396。
    連結：
  7. (2014).The basics of financial econometrics: Tools, concepts, and asset management applications.John Wiley & Sons.
  8. Baayen, R. H.,Davidson, D. J.,Bates, D. M.(2008).Mixed-effects modeling with crossed random effects for subjects and items.Journal of Memory and Language,59(4),390-412.
  9. Baddeley, A. D.(1997).Human memory: Theory and practice.Psychology Press.
  10. Baddeley, A.,Salamé, P.(1986).The unattended speech effect: Perception or memory?.Journal of Experimental Psychology: Learning, Memory, and Cognition,12(4),525-529.
  11. Barron, R. W.(1986).Word recognition in early reading: A review of the direct and indirect access hypotheses.Cognition,24(1–2),93-119.
  12. Beck, I. L.,McKeown, M. G.(2001).Text talk: Capturing the benefits of read aloud experiences for young children.The Reading Teacher,55(1),10-20.
  13. Bernhart, E. B.(1983).Three approaches to reading comprehension in intermediate German.The Modern Language Journal,67(2),111-115.
  14. Box, G. E.,Cox, D. R.(1964).An analysis of transformations.Journal of the Royal Statistical Society: Series B (Methodological),26(2),211-243.
  15. Chen, H.-C.,d‘Arcais, G. B. F.,Cheung, S.-L.(1995).Orthographic and phonological activation in recognizing Chinese characters.Psychological Research,58(2),144-153.
  16. Colle, H. A.,Welsh, A.(1976).Acoustic masking in primary memory.Journal of Verbal Learning and Verbal Behavior,15(1),17-31.
  17. Coltheart, M.,Coltheart, V.(1997).Reading comprehension is not exclusively reliant upon phonological representation.Cognitive Neuropsychology,14(1),167-175.
  18. Coltheart, V.,Avons, S. E.,Trollope, J.(1990).Articulatory suppression and phonological codes in reading for meaning.The Quarterly Journal of Experimental Psychology Section A,42(2),375-399.
  19. Cook, V.(Ed.),Bassetti, B.(Ed.)(2005).Second language writing systems.Multilingual Matters Ltd..
  20. Cunnings, I.(2012).An overview of mixed-effects statistical models for second language researchers.Second Language Research,28(3),369-382.
  21. Daneman, M.,Newson, M.(1992).Assessing the importance of subvocalization during normal silent reading.Reading and Writing,4(1),55-77.
  22. Diao, Y.,Sweller, J.(2007).Redundancy in foreign language reading comprehension instruction: Concurrent written and spoken presentations.Learning and Instruction,17(1),78-88.
  23. Dwyer, M. A.(1983).Some strategies for improving reading efficiency.FORUM,12(3),5-10.
  24. Eiter, B. M.,Inhoff, A. W.(2010).Visual word recognition during reading is followed by subvocal articulation.Journal of Experimental Psychology: Learning, Memory, and Cognition,36(2),457-470.
  25. Elliott, E.,Barrilleaux, K.,Cowan, N.(2006).Individual differences in the ability to avoid distracting sounds.European Journal of Cognitive Psychology,18(1),90-108.
  26. Frost, R.(Ed.),Katz, L.(Ed.)(1992).Orthography, phonology, morphology, and meaning.North Holland.
  27. Frost, R.(Ed.),Katz, L.(Ed.)(1992).Orthography, phonology, morphotogy, and meaning.Elsevier Science.
  28. Gerbier, E.,Bailly, G.,Bosse, M.-L.(2018).Audio-visual synchronization in reading while listening to texts: Effects on visual behavior and verbal learning.Computer Speech and Language,47,79-92.
  29. Gibson, S.(2008).Reading aloud: A useful learning tool?.ELT Journal,62(1),29-36.
  30. Glen, S. (2015, July 14). Box Cox transformation. https://www.statisticshowto.datasciencecentral.com/box-cox-transformation/
  31. Guo, T.,Peng, D.,Liu, Y.(2005).The role of phonological activation in the visual semantic retrieval of Chinese characters.Cognition,98(2),B21-B34.
  32. Hanley, J. R.,Bakopoulou, E.(2003).Irrelevant speech, articulatory suppression, and phonological similarity: A test of the phonological loop model and the feature model.Psychon Bull Rev,10(2),435-444.
  33. Holmes, B. C.(1985).The effect of four different modes of reading on comprehension.Reading Research Quarterly,20(5),575-585.
  34. Huang, L.(2010).Reading aloud in the foreign language teaching.Asian Social Science,6(4),148-150.
  35. Inhoff, A. W.,Connie, C.,Eiter, B.,Radach, R.,Heller, D.(2004).Phonological representation of words in working memory during sentence reading.Psychon Bull Rev,11(2),320-325.
  36. Jared, D.,Levy, B. A.,Rayner, K.(1999).The role of phonology in the activation of word meanings during reading: Evidence from proofreading and eye movements.Journal of Experimental Psychology: General,128(3),219-264.
  37. Jian, Y.-C.,Ko, H.-W.(2014).Investigating the effects of background knowledge on Chinese word processing during text reading: Evidence from eye movements.Journal of Research in Reading,37(S1),S71-S86.
  38. Jones, D. M.,Macken, W. J.(1993).Irrelevant tones produce an irrelevant speech effect: Implications for phonological coding in working memory.Journal of Experimental Psychology: Learning, Memory, and Cognition,19(2),369-381.
  39. Kailani, Z.(1998).Reading aloud in EFL revisited.Reading in a Foreign Language,12(1),281-294.
  40. Kennedy, A.(Ed.),Radach, R.(Ed.),Heller, D.(Ed.),Pynte, J.(Ed.)(2000).Reading as a perceptual process.Elsevier Science Ltd..
  41. Lane, H. B.,Wright, T. L.(2007).Maximizing the Effectiveness of Reading Aloud.The Reading Teacher,60(7),668-675.
  42. Larsen, J. D.,Baddeley, A.(2003).Disruption of verbal STM by irrelevant speech, articulatory suppression, and manual tapping: Do they have a common source?.The Quarterly Journal of Experimental Psychology Section A,56(8),1249-1268.
  43. Leinenger, M.(2014).Phonological coding during reading.Psychological Bulletin,140(6),1534-1555.
  44. Linck, J. A.,Cunnings, I.(2015).The utility and application of mixed-effects models in second language research.Language Learning,65(S1),185-207.
  45. Lukatela, G.,Turvey, M. T.(1994).Visual lexical access is initially phonological: I. Evidence from associative priming by words, homophones, and pseudo-homophones.Journal of Experimental Psychology: General,123(2),107-128.
  46. Martin, R. C.,Wogalter, M. S.,Forlano, J. G.(1988).Reading comprehension in the presence of unattended speech and music.Journal of Memory and Language,27,382-398.
  47. McCusker, L. X.,Hillinger, M. L.,Bias, R. G.(1981).Phonological recoding and reading.Psychological Bulletin,89,217-245.
  48. Norris, D.,Butterfield, S.,Hall, J.,Page, M. P. A.(2018).Phonological recoding under articulatory suppression.Memory & Cognition,46(2),173-180.
  49. Oswald, C. J.,Tremblay, S.,Jones, D. M.(2000).Disruption of comprehension by the meaning of irrelevant sound.Memory,8(5),345-350.
  50. Pan, J.,Yan, M.,Laubrock, J.,Shu, H.(2019).Lexical and sublexical phonological effects in Chinese silent and oral reading.Scientific Studies of Reading,23(5),403-418.
  51. Perfetti, C. A.,Cao, F.,Booth, J.(2013).Specialization and universals in the development of reading skill: How Chinese research informs a universal science of reading.Scientific Studies of Reading,17(1),5-21.
  52. Perfetti, C. A.,Liu, Y.,Tan, L. H.(2005).The lexical constituency model: Some implications of research on Chinese for general theories of reading.Psychol Rev,112(1),43-59.
  53. Rayner, K.(1998).Eye movements in reading and information processing: 20 years of research.Psychological Bulletin,124(3),372-422.
  54. Rayner, K.,Chace, K. H.,Slattery, T. J.,Ashby, J.(2006).Eye movements as reflections of comprehension processes in reading.Scientific Studies of Reading,10(3),241-255.
  55. Rayner, K.,Pollatsek, A.,Ashby, J.,Clifton, C., Jr.(2012).Psychology of reading.Psychology Press.
  56. Rayner, K.,Pollatsek, A.,Binder, K. S.(1998).Phonological codes and eye movements in reading.Journal of Experimental Psychology: Learning, Memory, and Cognition,24(2),476-497.
  57. Sadoski, M.,Paivio, A.(2013).Imagery and text: A dual coding theory of reading and writing.Routledge.
  58. Shen, D.,Forster, K. I.(1999).Masked phonological priming in reading Chinese words depends on the task.Language and Cognitive Processes,14(5–6),429-459.
  59. Snowling, M. J.(Ed.),Hulme, C.(Ed.)(2005).The science of reading: A handbook.Blackwell.
  60. Sörqvist, P.,Halin, N.,Hygge, S.(2010).Individual differences in susceptibility to the effects of speech on reading comprehension.Applied Cognitive Psychology,24(1),67-76.
  61. Swanson, E.,Wanzek, J.,Petscher, Y.,Vaughn, S.,Heckert, J.,Cavanaugh, C.,Kraft, G.,Tackett, K.(2011).A synthesis of read-aloud interventions on early reading outcomes among preschool through third graders at risk for reading difficulties.J Learn Disabil,44(3),258-275.
  62. Taft, M.,Van Graan, F.(1998).Lack of phonological mediation in a semantic categorization task.Journal of Memory and Language,38(2),203-224.
  63. Takeuchi, O.,Ikeda, M.,Mizumoto, A.(2012).Reading aloud activity in L2 and cerebral activation.RELC Journal,43(2),151-167.
  64. Tan, L.-H.,Hoosain, R.,Peng, D.-L.(1995).Role of early presemantic phonological code in Chinese character identification.Journal of Experimental Psychology: Learning, Memory, and Cognition,21(1),43-54.
  65. Toh, S. C.,Munassar, W. A.,Yahaya, W. A.(2010).Redundancy effect in multimedia learning: A closer look.Proceedings ascilite Sydney 2010
  66. Traxler, M. J.(Ed.),Gernsbacher, M. A.(Ed.)(2006).Handbook of psycholinguistics.Elsevier.
  67. Van Orden, G. C.,Johnston, J. C.,Hale, B. L.(1988).Word identification in reading proceeds from spelling to sound to meaning.Journal of Experimental Psychology: Learning, Memory, and Cognition,14(3),371-386.
  68. Verlaan, W.,Ortlieb, E.(2012).Improvin.2012 yearbook: A combined yearbook of the specialized literacy professionals and Texas association for literacy education (TALE)
  69. Woodall, B.(2010).Simultaneous listening and reading in ESL: Helping second language learners read (and enjoy reading) more efficiently.TESOL Journal,1(2),186-205.
  70. Zhang, S.,Perfetti, C. A.(1993).The tongue-twister effect in reading Chinese.Journal of Experimental Psychology: Learning, Memory, and Cognition,19(5),1082-1093.
  71. Zhou, X.,Marslen-Wilson, W.(2000).The relative time course of semantic and phonological activation in reading Chinese.Journal of Experimental Psychology: Learning, Memory, and Cognition,26(5),1245-1265.
  72. 丁錦紅, J.-H.,王麗燕, L.-Y.(2006)。語音回路與閱讀理解關係的眼動研究。心理學報，38(5)，694-701。
  73. 魯忠義, Z.-Y.,張亞靜, Y.-J.(2007)。工作記憶中的語音回路對漢語閱讀理解的影響。心理學報，39(5)，768-776。
被引用次数
  1. 簡郁芩,郭品纖(2022)。中學生閱讀科學圖文與不同語意透明度之學術詞彙的認知處理策略－眼動追蹤研究。教育心理學報，53(4)，949-977。
  2. 簡郁芩,王孜甯(2022)。科學圖文閱讀眼動研究之系統回顧。教育心理學報，53(4)，773-799。
  3. (2024)。韻律線索對輕度自閉症和一般兒童理解非字面語言之諷刺意涵的影響。教育心理學報，55(3)，431-457。
print cancel