時間次序與空間位置訊息於記憶運作中的運用：以失聰手語使用者為例

Temporal order and spatial information in short-term memory: Evidence from deaf Taiwanese signers

10.6172/BSE.201711_42(3).0004

邱倚璿(Yi-Shiuan Chiu)

手語 ； 失聰／聾人／聽障 ； 空間位置 ； 時間次序 ； 短期記憶 ； deaf ； sign language ； temporal order ； short-term memory ； spatial location

特殊教育研究學刊

42卷3期（2017 / 11 / 30）

93 - 117

繁體中文

失聰手語使用者短期記憶能力較弱原因，可能是手語視覺空間形式不擅於時間次序的記憶運作所致。本研究欲探討短期記憶，失聰手語者與聽力正常非手語者於時間次序運作的異同，以及時間次序與空間位置對其短期記憶的影響。實驗一比較失聰手語者與聽常非手語者於三種不同時間空間一致性下，兩種刺激（數字、中文雙字詞）之項目再認表現。時間空間一致性包含時間空間一致（刺激依序由左至右呈現）、時間空間不一致（數字刺激隨機出現）與僅有時間次序（刺激依序呈現於螢幕中央）等，此效果可反映出內在時間次序與空間位置之整合運作狀況；實驗二探討不同時間空間一致性下，數字刺激的項目與位置再認表現；實驗三中，運用兩種隨機出現作業（25%項目及位置再認，75%項目再認），探討在偶發性的位置判斷作業時，時間空間一致性之影響。本研究結果為：實驗一發現兩族群都出現序列位置效果，於時間空間一致情境優於僅有時間次序；實驗二發現兩族群僅在正確率中有一致性優勢；實驗三發現失聰手語者於項目與位置再認表現明顯劣於聽常非手語者，但於項目再認中相對差異較小。除了時間次序外，同時提供有規律的空間位置可以協助短期記憶表現；時間次序與空間位置整合是於作業要求下發生，符合時間次序與空間位置兩者平行但可彙整的論點。失聰手語者與聽常非手語者有相似的內隱時間次序運作，但被要求回憶位置時，失聰手語者整合時間次序與空間位置運作，會需要耗費較多的認知資源。

In working and short-term memory processes, to-be-remembered items and their temporal orders can be more accurately maintained by an auditory system than a visual system. Thus, previous studies have reported that deaf signers have poorer memory performance or digit span than nondeaf people. By contrast, deaf signers showed more favorable performance with respect to visuospatial processes and mental image operations. We hypothesized that deaf signers benefit from the short-term memory condition with spatial location cues. Purpose: This research investigated the processing and organization of temporal order and spatial location in short-term memory among deaf people. Methods: Experiment 1 explored item recognition performance (digits and Chinese two-character words) when the temporal and spatial order had varying levels of consistency. This consistency was categorized under three conditions: temporal-spatial consistent, temporal-spatial inconsistent, and temporal order only. In the temporalspatial consistent condition, items were sequentially presented from left to right; in the temporal-spatial inconsistent condition, items were presented sequentially in random locations. In the third condition, the items were sequentially presented in the center of the screen. In Experiment 2, participants were requested to recognize items and their corresponding locations during consistent and inconsistent temporal and spatial orders. In Experiment 3, the independent variables included not only the consistency of the temporal and spatial orders but also the tasks (item and location recognition task and item recognition task). Participants' tasks comprised 25% item and location recognition task and 75% item-only task. Results/Findings: In Experiment 1, we observed the recency effect and superiority of the temporal-spatial consistent condition in addition to that of the temporal-order-only condition, reflecting the similar nature of implicit processing in the temporal order among deaf signers and nondeaf people. Both groups also organized temporal and spatial orders in a similar manner. In Experiment 2, both groups had more accurate memory in the temporal-spatial consistent condition. In Experiment 3, the deaf signers had significantly lower accuracy than the nondeaf people with respect to the item and location tasks as compared to the item-only task. Conclusions/Implications: Both groups reorganized temporal order and spatial locations only when location recognition was required. In addition, deaf signers benefitted from short-term memory tasks with spatial location cues and conducted order processes in a manner similar to that of nondeaf people, although with less efficient retrieval. In conclusion, providing appropriate spatial locations for deaf signers can improve their memory performance.

1. Baddeley, A.(2000).The episodic buffer: A new component of working memory?.Trends in Cognitive Sciences,4(11),417-423.
2. Baddeley, A.(2012).Working memory: Theories, models, and controversies.Annual Review of Psychology,63(1),1-29.
3. Baddeley, A.,Hitch, G.(1974).Working memory.Psychology of Learning and Motivation,8,47-89.
4. Baddeley, A.,Thomson, N.,Buchanan, M.(1975).Word length and the structure of short-term memory.Journal of Verbal Learning and Verbal Behavior,14(6),575-589.
5. Bavelier, D.,Newman, A. J.,Mukherjee, M.,Hauser, P.,Kemeny, S.,Braun, A.,Boutla, M.(2008).Encoding, rehearsal, and recall in signers and speakers: Shared network but differential engagement.Cerebral Cortex,18(10),2263-2274.
6. Bavelier, D.,Newport, E. L.,Hall, M.,Supalla, T.,Boutla, M.(2008).Ordered shortterm memory differs in signers and speakers: Implications for models of shortterm memory.Cognition,107(2),433-459.
7. Bellugi, U.,Klima, E. S.,Siple, P.(1974).Remembering in signs.Cognition,3(2),93-125.
8. Bjork, E. L.,Healy, A. F.(1974).Short-term order and item retention.Journal of Verbal Learning and Verbal Behavior,13(1),80-97.
9. Boutla, M.,Supalla, T.,Newport, E. L.,Bavelier, D.(2004).Short-term memory span: Insights from sign language.Nature Neuroscience,7(9),997-1002.
10. Bruyer, R.,Scailquin, J.-C.(1998).The visuospatial sketchpad for mental images: Testing the multicomponent model of working memory.Acta Psychologica,98(1),17-36.
11. Conrad, R.(1965).Order error in immediate recall of sequences.Journal of Verbal Learning and Verbal Behavior,4(3),161-169.
12. Corballis, M. C.(1967).Serial order in recognition and recall.Journal of Experimental Psychology,74(1),99-105.
13. Dell, G. S.,Burger, L. K.,Svec, W. R.(1997).Language production and serial order: A functional analysis and a model.Psychological Review,104(1),123-147.
14. Emerson, M. J.,Miyake, A.(2003).The role of inner speech in task switching: A dualtask investigation.Journal of Memory and Language,48(1),148-168.
15. Emmorey, K.,Wilson, M.(2004).The puzzle of working memory for sign language.Trends in Cognitive Sciences,8(12),521-523.
16. Estes, W. K.(1997).Processes of memory loss, recovery, and distortion.Psychological Review,104(1),148-169.
17. Estes, W. K.(1972).The associative basis of stimulus coding.Coding processes in human memory,Washington, DC:
18. Gathercole, S. E.(Ed.)(1996).Models of shortterm memory.Hove, England:Psychology Press.
19. Geraci, C.,Gozzi, M.,Papagno, C.,Cecchetto, C.(2008).How grammar can cope with limited short-term memory: Simultaneity and seriality in sign languages.Cognition,106(2),780-804.
20. Gozzi, M.,Geraci, C.,Cecchetto, C.,Perugini, M.,Papagno, C.(2011).Looking for an explanation for the low sign span. Is order involved?.Journal of Deaf Studies and Deaf Education,16(1),101-107.
21. Gupta, P.,MacWhinney, B.(1997).Vocabulary acquisition and verbal short-term memory: Computational and neural bases.Brain and Language,59(2),267-333.
22. Haist, F.,Shimamura, A. P.,Squire, L. R.(1992).On the relationship between recall and recognition memory.Journal of Experimental Psychology: Learning, Memory, and Cognition,18(4),691-702.
23. Hall, M. L.,Bavelier, D.(2011).Shortterm memory stages in sign vs. speech: The source of the serial span discrepancy.Cognition,120(1),54-66.
24. Hanson, V. L.,Lichtenstein, E. H.(1990).Short-term memory coding by deaf signers: The primary language coding hypothesis reconsidered.Cognitive Psychology,22(2),211-224.
25. Healy, A. F.(1975).Short-term retention of temporal and spatial order.Bulletin of the Psychonomic Society,5(1),57-58.
26. Healy, A. F.(1975).Coding of temporal-spatial patterns in short-term memory.Journal of Verbal Learning and Verbal Behavior,14(5),481-495.
27. Henson, R.,Hartley, T.,Burgess, N.,Hitch, G.,Flude, B.(2003).Selective interference with verbal short-term memory for serial order information: A new paradigm and tests of a timing-signal hypothesis.The Quarterly Journal of Experimental Psychology Section A,56(8),1307-1334.
28. Hirshorn, E. A.,Fernandez, N. M.,Bavelier, D.(2012).Routes to short-term memory indexing: Lessons from deaf native users of American sign language.Cognitive Neuropsychology,29(1-2),85-103.
29. Jacoby, L. L.,Toth, J. P.,Yonelinas, A. P.(1993).Separating conscious and unconscious influences of memory: Measuring recollection.Journal of Experimental Psychology: General,122(2),139-154.
30. Klima, E. S.,Bellugi, U.(1979).The signs of language.Cambridge, MA:Harvard University Press.
31. Kubovy, M.(1988).Should we resist the seductiveness of the space:time::vision: audition analogy?.Journal of Experimental Psychology: Human Perception and Performance,14(2),318-320.
32. Lechelt, E. C.(1975).Temporal numerosity discrimination: Intermodal comparisons revisited.British Journal of Psychology,66(1),101-108.
33. Lewis, R. L.,Vasishth, S.,Van Dyke, J. A.(2006).Computational principles of working memory in sentence comprehension.Trends in Cognitive Sciences,10(10),447-454.
34. Liu, H.-T.,Tseng, C.-H.,Liu, C.-J.(2008).A comparison of Taiwanese sign language and manually coded Chinese: Word length and short-term memory capacity.International Speech Communication Association Tutorial and Research Workshop on Experimental Linguistics,Athen, Greece:
35. Loftus, G. R.(1974).Acquisition of information from rapidly presented verbal and nonverbal stimuli.Memory and Cognition,2(3),545-548.
36. Logie, R.(1995).Visuo-spatial working memory.Hove, Sussex:Lawrence Erlbaum Associates.
37. Luck, S. J.,Vogel, E. K.(1997).The capacity of visual working memory for features and conjunctions.Nature,390(6657),279-281.
38. Marshuetz, C.,Smith, E. E.,Jonides, J.,DeGutis, J.,Chenevert, T. L.(2000).Order information in working memory: fMRI evidence for parietal and prefrontal mechanisms.Journal of Cognitive Neuroscience,12(supplement 2),130-144.
39. Matthews, M. L.,Henderson, L.(1970).Fast presentation rates and the recall of item and order information.Nature,226(5243),374-376.
40. McElree, B.,Dosher, B. A.(1993).Serial retrieval processes in the recovery of order information.Journal of Experimental Psychology: General,122(3),291-315.
41. Oberauer, K.(2003).Understanding serial position curves in short-term recognition and recall.Journal of Memory and Language,49(4),469-483.
42. O'Connor, N.,Hermelin, B. M.(1973).The spatial or temporal organization of shortterm memory.Quarterly Journal of Experimental Psychology,25(3),335-343.
43. Penney, C. G.(1989).Modality effects and the structure of short-term verbal memory.Memory and Cognition,17(4),398-422.
44. Rönnberg, J.,Rudner, M.,Ingvar, M.(2004).Neural correlates of working memory for sign language.Cognitive Brain Research,20(2),165-182.
45. Smyrnis, N.,d'Avossa, G.,Theleritis, C.,Mantas, A.,Ozcan, A.,Evdokimidis, I.(2005).Parallel processing of spatial and serial order information before moving to a remembered target.Journal of Neurophysiology,93(6),3703-3708.
46. Tzeng, S. J.(2002).Working memory, language production rate, and reading comprehension of Chinese deaf readers.Belletin of Special Education,22,155-169.
47. Wang, J.,Napier, J.(2013).Signed language working memory capacity of signed language interpreters and deaf signers.Journal of Deaf Studies and Deaf Education,18(2),271-286.
48. Watkins, M. J.,LeCompte, D. C.,Elliott, M. N.,Fish, S. B.(1992).Short-term memory for the timing of auditory and visual signals.Journal of Experimental Psychology: Learning, Memory, and Cognition,18(5),931-937.
49. Wilson, M.(2001).The case for sensorimotor coding in working memory.Psychonomic Bulletin and Review,8(1),44-57.
50. Wilson, M.,Emmorey, K.(1997).Working memory for sign language: A window into the architecture of the working memory system.Journal of Deaf Studies and Deaf Education,2(3),121-130.
51. Wilson, M.,Emmorey, K.(1998).A "word length effect" for sign language: Further evidence for the role of language in structuring working memory.Memory and Cognition,26(3),584-590.

1. 謝承佑,鄭澈,劉佩艷,楊同榮,黃思婧,彭昭英,陳奕凱,江宇珊,丁麒文,Li-Ting Chen(2020)。效果量在臺灣心理與教育期刊的應用：回顧與再思。中華心理學刊，62(4)，553-592。