以眼動型態和閱讀測驗表現探討箭頭在科學圖文閱讀中的圖示效果

The Effect of Arrows in an Illustration When Reading Scientific Text: Evidence from Eye Movements and Reading Tests

10.6129/CJP.2012.5403.07

簡郁芩(Yu-Cin Jian)；吳昭容(Chao-Jung Wu)

科學閱讀 ； 眼動型態 ； 圖文整合 ； 箭頭 ； arrow ； eye movements ； integration of illustration and text ； scientific reading

中華心理學刊

54卷3期（2012 / 09 / 01）

385 - 402

繁體中文

前人的研究顯示箭頭在讀圖理解上扮演重要角色。從功能性的角度來看，箭頭提供部件之間的方向關係與序列訊息，使得讀者能形成較佳的圖像表徵，對閱讀產生助益；相反的，在圖上呈現多個箭頭也可能使得知覺複雜性太高，以致於分散讀者的注意力而得到反效果。本研究藉由眼球追蹤技術記錄大學生閱讀圖文並置的科學文章，探討箭頭對讀者在科學圖文整合認知歷程的影響，並以閱讀測驗檢視箭頭的圖示效益。實驗操弄圖示箭頭的有無，兩種版本的圖都搭配相同的文章。受試者被隨機分派去讀其中一種版本，讀完文章後須回答閱讀測驗題。研究結果顯示：一、在測驗題的表現上，有箭頭組在序列題與統整題的答題正確率都高於無箭頭組；二、在眼動資料的分析上，有箭頭組僅在圖上的平均跳視距離較無箭頭組短，其餘包括總凝視時間、圖凝視時間、圖佔總凝視時間比、圖文之間移動次數均無差異；三、兩組在三種閱讀軌跡的比率差異僅邊緣顯著。本研究的閱讀測驗結果雖然支持箭頭的正向功能，但眼動指標上並無一致的效果，本文透過與文獻的比較，以閱讀材料特性與測驗性質來討論兩類結果不一致的可能意義。文末討論眼動指標即使未顯現兩組的差異，仍提供了圖文閱讀歷程的訊息及指出未來可能的研究方向。

Previous researches have shown that the use of arrows can aid the comprehension of graphical information. From the functional perspective, arrows can provide useful information about sequential relations between graphical components and indicate pathway directions. However, the presence of excessive arrows in an illustration may produce negative effects related to perceptual complexity and division of attention. In this study we investigated the effect of using arrows in an illustration when reading scientific text by recording viewers' eye movements and obtaining their reading test scores. The participants first read a scientific text that included an illustration either with or without arrows (arrow group versus nonarrow group), and then they completed a reading test. The accuracy on the ”sequential items” and ”integrative items” was higher and the mean saccade length on an illustration was shorter for the arrow group than for the nonarrow group, but there were no differences between the groups in total fixation duration, fixation duration on an illustration, the ratio of the total fixation duration on an illustration, and the number of saccades between text and an illustration. Although the results of the reading test supported that arrows have a positive effect on the reading of illustrations, the results for eye movements were inconsistent. Alternative explanations are discussed based on comparing the types of materials and reading tests between our and previous studies. The indicators of eye movements that reflect possible processes involved when reading illustrations and text are also discussed.

1. 柯華葳、陳明蕾、廖家寧(2005)。詞頻、詞彙類型與眼球運動型態：來自篇章閱讀的證據。中華心理學刊，47，381-398。
   連結：
2. Barr, R.(Ed.),Kamil, M. L.(Ed.),Mosenthal, P. B.(Ed.),Pearson, P. D.(Ed.)(1991).Handbook of reading research: Volume II.New York:Longman.
3. Boucheix, J.-M.,Lowe, R. K.(2010).An eye tracking comparison of external pointing cues and internal continuous cues in learning with complex animations.Learning and Instruction,20,123-135.
4. Canham, M.,Hegarty, M.(2010).Effects of knowledge and display design on comprehension of complex graphics.Learning and Instruction,20,155-166.
5. Carney, R. N.,Levin, J. R.(2002).Pictorial illustrations still improve students' learning from text.Educational Psychology Review,14,5-26.
6. Carpenter, P. A.,Shah, P.(1998).A model of the perceptual and conceptual processes in graph comprehension.Journal of Experimental Psychology: Applied,4,75-100.
7. Chandler, P.,Sweller, J.(1996).Cognitive load while learning to use a computer program.Applied Cognitive Psychology,10,151-170.
8. Chen, M. L.,Ko, H. W.(2011).Exploring the eyemovement patterns as Chinese children reading texts: A developmental perspective.Journal of Research in Reading,34,232-246.
9. Coltheart, M.(Ed.)(1987).Attention and performance XII: The psychology of reading.London:Lawrence Erlbaum Associates.
10. de Koning, B. B.,Tabbers, H. K.,Rikers, R. M. J. P.,Paas, F.(2010).Attention guidance in learning from a complex animation: Seeing is understanding?.Learning and Instruction,20,111-122.
11. de Koning, B. B.,Tabbers, H. K.,Rikers, R. M. J. P.,Paas, F.(2007).Attention cueing as a means to enhance learning from an animation.Applied Cognitive Psychology,21,731-746.
12. Evans, K.,Rotello, C. M.,Li, X.,Rayner, K.(2009).Scene perception and memory revealed by eye movements and receiver-operating characteristic analyses: Does a cultural difference truly exist?.Quarterly Journal of Experimental Psychology,62,276-285.
13. Goldberg, J. H.,Kotval, X. P.(1999).Computer interface evaluation using eye movements: Methods and constructs.International Journal of Industrial Ergonomics,24,631-645.
14. Hannus, M.,Hyönä, J.(1999).Utilization of illustrations during learning of science textbook passages among low- and high-ability children.Contemporary Educational Psychology,24,95-123.
15. Hegarty, M.(1992).Mental animation: Inferring motion from static displays of mechanical systems.Journal of Experimental Psychology: Learning, Memory, and Cognition,18,1084-1102.
16. Hegarty, M.,Canham, M. S.,Fabrikant, S. I.(2010).Thinking about the weather: How display salience and knowledge affect performance in a graphic inference task.Journal of Experimental Psychology: Learning, Memory, and Cognition,36,37-53.
17. Hegarty, M.,Just, M. A.(1993).Constructing mental models of machines from text and diagrams.Journal of Memory and Language,32,717-742.
18. Heiser, J.,Tversky, B.(2006).Arrows in comprehending and producing mechanical diagrams.Cognitive Science,30,581-592.
19. Holsanova, J.,Holmberg, N.,Holmqvist, K.(2009).Reading information graphics: The role of spatial contiguity and dual attentional guidance.Applied Cognitive Psychology,23,1215-1226.
20. Hyönä, J.(2010).The use of eye movements in the study of multimedia learning.Learning and Instruction,20,172-176.
21. Inhoff, A. W.,Wu, C.(2005).Eye movements and the identification of spatially ambiguous words during Chinese sentence reading.Memory & Cognition,33,1345-1356.
22. Jian, Y.-C.,Ko, H. W.(2007).Investigating the effects of background knowledge on Chinese word recognition: Evidence from eye movements.ECEM 14th European Conference on Eye Movements,Potsdam, Germany:
23. Jian, Y.-C.,Wu, C.-J.,Su, J.-H.(2011).Eye movements when integrating scientific text and graphics information: The effect of sequential layouts on graphics.the 16th European Conference on Eye Movements,Marseille, France:
24. Just, M. A.,Carpenter, P. A.(1980).A theory of reading: From eye fixations to comprehension.Psychological Review,87,329-354.
25. Kalyuga, S.,Chandler, P.,Sweller, J.(1998).Levels of expertise and instructional design.Human Factors: The Journal of the Human Factors and Ergonomics Society,40,1-17.
26. Kriz, S.,Hegarty, M.(2007).Top-down and bottom-up influences on learning from animations.International Journal of Human-Computer Studies,65,911-930.
27. LeDoux, J. E.(1994).Emotion, memory and the brain.Scientific American,270,50-57.
28. Lowe, R. K.(1999).Extracting information from an animation during complex visual learning.European Journal of Psychology of Education,14,225-244.
29. Lowe, R. K.(2003).Animation and learning: Selective processing of information in dynamic graphics.Learning and Instruction,13,157-176.
30. Lowe, R. K.,Schnotz, W.(2008).Learning with animation: Research implications for design.New York:Cambridge University Press.
31. Mautone, P. D.,Mayer, R. E.(2007).Cognitive aids for guiding graph comprehension.Journal of Educational Psychology,99,640-652.
32. Mayer, R. E.(2001).Multimedia learning.Cambridge,UK:Cambridge University Press.
33. Mayer, R. E.(Ed.)(2005).The Cambridge handbook of multimedia learning.New York:Cambridge University Press.
34. Mayer, R. E.,Gallini, J. K.(1990).When is an illustration worth ten thousand words?.Journal of Educational Psychology,82,715-726.
35. Mayer, R. E.,Moreno, R.(2003).Nine ways to reduce cognitive load in multimedia learning.Educational Psychologist,38,43-52.
36. Paivio, A.(Ed.)(1990).Mental representations: A dual coding approach.New York:Oxford University Press.
37. Rayner, K.(Ed.)(1992).Eye movements and visual cognition: Scene perception and reading.New York:Springer-Verlag.
38. Rayner, K.,Juhasz, B. J.(2004).Eye movement in reading: Old questions and new directions.European Journal of Cognitive Psychology,16,340-352.
39. Rayner, K.,Rotello, C. M.,Stewart, A. J.,Keir, J.,Duffy, S. A.(2001).Integrating text and pictorial information: Eye movements when looking at print advertisements.Journal of Experimental Psychology: Applied,7,219-226.
40. Rayner, K.,Smith, T. J.,Malcolm, G. L.,Henderson. J. M.(2009).Eye movements and visual encoding during scene perception.Psychological Science,20,6-10.
41. Sanchez, C. A.,Wiley, J.(2006).An examination of the seductive details effect in terms of working memory capacity.Memory and Cognition,34,344-355.
42. Schmidt-Weigand, F.,Kohnert, A.,Glowalla, U.(2010).A closer look at split visual attention in system- and self-paced instruction in multimedia learning.Learning and Instruction,20,100-110.
43. Schmidt-Weigand, F.,Kohnert, A.,Glowalla, U.(2009).Explaining the modality and contiguity effects: New insights from investigating students' viewing behaviour.Applied Cognitive Psychology,24,226-237.
44. Schnotz, W.,Bannert, M.(2003).Construction and interference in learning from multiple representation.Learning and Instruction,13,141-156.
45. Shah, P.,Mayer, R. E.,Hegarty, M.(1999).Graphs as aids to knowledge construction: Signaling techniques for guiding the process of graph comprehension.Journal of Educational Psychology,91,690-702.
46. Sweller, J.,van Merrienboer, J. J. G.,Paas, F. G. W. C.(1998).Cognitive architecture and instructional design.Educational Psychology Review,10,251-296.
47. Tversky, B.,Morrison, J. B.,Betrancourt, M.(2002).Animation: Can it facilitate?.International Journal of Human-Computer Studies,57,247-262.
48. Underwood, G.,Jebbett, L.,Roberts, K.(2004).Inspecting pictures for information to verify a sentence: Eye movements in general encoding and in focused search.The Quarterly Journal of Experimental Psychology: Section A,57,165-182.
49. Unsworth, L.(2001).Teaching multiliteracies across the curriculum: Changing contexts of text and image in classroom practice.Buckingham, UK:Open University Press.
50. Yen, M.-H.,Tsai, J.-L.,Tzeng, O. J.-L.,Hung, D. L.(2008).Eye movements and parafoveal word processing in reading Chinese.Memory & Cognition,36,1033-1045.
51. 李竇、洪蘭譯(2001)。腦中有情─奧妙的理性與感性。台北=Taipei:遠流= Yuan-Liou。
52. 簡郁芩、吳昭容(2011)。以眼球追蹤技術探討科學文章閱讀中圖的功能。中華民國第二十七屆科學教育學術研討會發表，高雄市=Kaohsiung, Taiwan:

1. 王孜甯(2022)。文本連貫效果在大學生閱讀科學文章之角色。臺灣師範大學教育心理與輔導學系學位論文。2022。1-232。