A Comparison of Identity and Emotional Expression Processing between Real and Line-Drawn Faces

辨識真實臉孔與圖形化臉孔情緒表達之差異性探討

10.6129/CJP.20170517

陳雅韵(Ya-Yun Chen)；襲充文(Gary C.-W. Shyi)

emotion ； eye movements ； facial expression ； face recognition ； line-drawn faces ； 情緒 ； 眼動 ； 臉孔表情 ； 臉孔辨識 ； 圖形化臉孔

中華心理學刊

59卷2期（2017 / 06 / 01）

105 - 123

英文

Face processing and recognition has been one of the most productive research areas in cognitive science over the past four decades, and in most studies images of real faces are the focus of inquiry. Owing to the proliferation of technology in social media in recent years, we have witnessed a significant surge of using line-drawn faces and expressions along with their real-face counterparts for purpose of communication. Here in two experiments we examined how line-drawn faces may differ from real faces in terms of identity and emotional expression processing. In Experiment 1, we used the part-whole task and showed that, compared to real faces, line-drawn faces were processed in a more part-based manner similar to non-face objects (i.e., houses). In Experiment 2, we tracked participants' eye movements while they performed a delayed matching-to-sample task, in terms of expressed emotion, where images of either real or line-drawn faces were used as the sample. In addition, we also examined the role a verbal label may play in identifying the facial expression that matched the description. We did this to test the idea whether facial expressions of line-drawn face were in general more symbolically coded than real faces such that a verbal label would be more effective in retrieving those expressed by line-drawn faces. The results indicated that while line-drawn faces differed from real faces in terms of identity processing, they may be quite similar in terms of expression processing. Furthermore, compared to real faces, providing a verbal label failed to offer any additional help locating the matched expression from line-drawn faces, after controlling for the potential speed-accuracy tradeoff with inverse efficiency scores. This might explain why it has become a common practice to exaggerate portrayed expression in line-drawn faces: To overcome the inherently vague signals of emotional expression.

拜科技之賜，人們的社交活動早已不限於面對面的交流，而吾人經常使用的各類通訊軟體皆包含豐富的表情圖案，為冰冷文字添上生動的情緒。在過去，人們的社交活動大多藉由實際的接觸來辨別彼此的情緒狀態，因此以往的研究亦多著重於辨識真實臉孔的情緒表達。本研究利用兩個實驗探討吾人辨識真實臉孔與圖形化臉孔在情緒表達歷程上可能存在的差異。實驗一比較真實臉孔、圖形化臉孔及物體在整體辨識及部件辨識上正確率的差異，發現圖形化臉孔的辨識已脫離辨識真實臉孔的範疇，而與物體辨識較為相近。實驗二則藉由眼動儀的紀錄，檢驗臉孔部件在真實臉孔與圖形化臉孔情緒表達上權重的差異性，並進一步探討語意訊息是否會改變吾人對不同臉孔部件在情緒表達上的權重結果顯示雖然真實臉孔與圖形化臉孔在辨識歷程上有所差異，情緒辨識上圖形化臉孔的正確率較低、反應時間較長，但在眼動儀的資料當中卻發現兩者擁有相似的情緒辨識歷程。再者，提供語意線索並無法提高圖形化臉孔的情緒辨識正確率。以上結果部分解釋了何以現行通訊軟體中的表情圖案需要放大表情特徵以可服圖形化臉孔所造成的訊息減損。

1. Shyi, G. C.-W.,Huang, S.-T. T.,Yeh, C.-Y.(2013).Taiwan corpora of Chinese emotions and relevant psychophysiological data - A College-Student database of facial expression for basic emotions.Chinese Journal of Psychology,55,455-475.
   連結：
2. Yang, J.,Shyi, G. C.-W.(2010).Face recognition and its developmental differences: A multi-level review of literature.Applied Psychology Research,46,153-230.
   連結：
3. Fahlman, S. E. (n.d.). Smiley Lore :-). Retrieved from https://www.cs.cmu.edu/~sef/sefSmiley.htm
4. Aldunate, N.,González-Ibáñez, R.(2016).An integrated review of emoticons in computer-mediated communication.Frontiers in Psychology,7,2061.
5. Basbaum, A.(Ed.),Kaneko, A.(Ed.),Sheperd, G. M.(Ed.),Westheimer, G.(Ed.)(2008).The senses: A comprehensive reference (Vol. 2).New York, NY:Academic Press.
6. Beaudry, O.,Roy-Charland, A.,Perron, M.,Cormier, I.,Tapp, R.(2014).Featural processing in recognition of emotional facial expressions.Cognition & Emotion,28,416-432.
7. Biederman, I.(1987).Recognition-by-components: A theory of human image understanding.Psychological Review,94,115-147.
8. Bindemann, M.,Scheepers, C.,Burton, A. M.(2009).Viewpoint and center of gravity affect eye movements to human faces.Journal of Vision,9(7),1-16.
9. Blais, C.,Jack, R. E.,Scheepers, C.,Fiset, D.,Caldara, R.(2008).Culture shapes how we look at faces.PLoS One,3,e3022.
10. Bruce, V.,Langton, S.(1994).The use of pigmentation and shading information in recognizing the sex and identities of faces.Perception,23,803-822.
11. Bruce, V.,Young, A.(1986).Understanding face recognition.British Journal of Psychology,77,305-327.
12. Byron, K.(2008).Carrying too heavy a load? The communication and miscommunication of emotion by email.Academy of Management Review,33,309-327.
13. Calvo, M. G.,Fernández-Martín, A.,Nummenmaa, L.(2013).A smile biases the recognition of eye expressions: Configural projection from a salient mouth.The Quarterly Journal of Experimental Psychology,66,1159-1181.
14. Calvo, M. G.,Nummenmaa, L.(2009).Eye-movement assessment of the time course in facial expression recognition: Neurophysiological implications.Cognitive, Affective & Behavioral Neuroscience,9,398-411.
15. Coltheart, V.(Ed.)(2010).Tutorials in Visual Cognition.New York, NY:Psychology Press.
16. Gauthier, I.,Bukach, C.(2007).Should we reject the expertise hypothesis?.Cognition,103,322-330.
17. Harris, R. J.,Young, A.W.,Andrews, T. J.(2014).Brain regions involved in processing facial identity and expression are differentially selective for surface and edge information.NeuroImage,97,217-223.
18. Jack, R. E.,Blais, C.,Scheepers, C.,Schyns, P. G.,Caldara, R.(2009).Cultural confusions show that facial expressions are not universal.Current Biology,19,1543-1548.
19. Jack, R. E.,Caldara, R.,Schyns, P. G.(2012).Internal representations reveal cultural diversity in expectations of facial expressions of emotion.Journal of Experimental Psychology: General,141,19-25.
20. Kanwisher, N.,McDermott, J.,Chun, M. M.(1997).The fusiform face area: A module in human extrastriate cortex specialized for face perception.Journal of Neuroscience,17,4302-4311.
21. Kanwisher, N.,Yovel, G.(2006).The fusiform face area: a cortical region specialized for the perception of faces.Philosophical Transactions of the Royal Society B: Biological Sciences,361,2109-2128.
22. Kemp, R.,Pike, G.,White, P.,Musselman, A.(1996).Perception and recognition of normal and negative faces: The role of shape from shading and pigmentation cues.Perception,25,37-52.
23. McKone, E.,Yovel, G.(2009).Why does picture-plane inversion sometimes dissociate perception of features and spacing in faces, and sometimes not? Toward a new theory of holistic processing.Psychonomic Bulletin & Review,16,778-797.
24. Peterson, M. A.(Ed.),Rhodes, G.(Ed.)(2003).Perception of faces, objects, and scenes: Analytic and holistic processes.New York, NY:Oxford University Press.
25. Piepers, D. W.,Robbins, R. A.(2012).A review and clarification of the terms "holistic," "configural," and "relational" in the face perception literature.Frontiers in Psychology,3,559.
26. Pomerantz, J. R.(1983).Global and local precedence: Selective attention in form and motion perception.Journal of Experimental Psychology: General,112,516-540.
27. Richler, J. J.,Palmeri, T. J.,Gauthier, I.(2012).Meanings, mechanisms, and measures of holistic processing.Frontiers in Psychology,3,553.
28. Ross, D. A.,Richler, J. J.,Gauthier, I.(2015).Reliability of composite task measurements of holistic processing.Behavior Research Methods,47,736-743.
29. Rossion, B.(2013).The composite face illusion: A whole window into our understanding of holistic face perception.Visual Cognition,21,139-253.
30. Rossion, B.(2008).Picture-plane inversion leads to qualitative changes of face perception.Acta Psychologica,128,274-289.
31. Shyi, G. C.-W.,Yeh, C.-Y.(2011).An investigation of the standardized affective stimuli and response norms: Constructing Taiwanese face database of basic emotional expression with college students.the 7th Conference of Chinese Psychologists,Taipei, Taiwan:
32. Steinmetz, S.(2014).It's not just a smiley face. How the emoji boom is changing the way we communicate.Time,184(5),48-49.
33. Tanaka, J. W.,Farah, M. J.(1993).Parts and wholes in face recognition.The Quarterly Journal of Experimental Psychology,46,225-245.
34. Tanaka, J. W.,Sengco, J. A.(1997).Features and their configuration in face recognition.Memory & Cognition,25,583-592.
35. Tanaka, J. W.,Wolf, J. M.,Klaiman, C.,Koenig, K.,Cockburn, J.,Herlihy, L,Schultz, R. T.(2012).The perception and identification of facial emotions in individuals with autism spectrum disorders using the Let's Face It! Emotion Skills Battery.Journal of Child Psychology and Psychiatry,53,1259-1267.
36. Townsend, J. T.,Ashby, F. G.(1983).Stochastic modeling of elementary psychological processes.Cambridge, UK:Cambridge University Press.
37. Vuong, Q. C.,Peissig, J. J.,Harrison, M. C.,Tarr, M. J.(2005).The role of surface pigmentation for recognition revealed by contrast reversal in faces and Greebles.Vision Research,45,1213-1223.
38. Yankouskaya, A.,Humphreys, G. W.,Rotshtein, P.(2014).Differential interactions between identity and emotional expression in own and other-race faces: Effects of familiarity revealed through redundancy gains.Journal of Experimental Psychology: Learning, memory, and cognition,40,1025-1038.
39. Yuasa, M.,Saito, K.,Mukawa, N.(2011).Brain activity when reading sentences and emoticons: An fMRI study of verbal and nonverbal communication.Electronics and Communications in Japan,94,17-24.