邁向社會化的設計－探討語音和表情符號對兒童參與數位學習的影響

Towards a More Sociable Design: The Effects of Speech and Emoticon on Children in E-Learning

10.6381/JD.200712.0043

董芳武(Fang-Wu Tung)；鄧怡莘(Yi-Shin Deng)

互動設計 ； 語音 ； 表情符號 ； 兒童 ； 數位學習 ； 社會臨場感 ； Interaction Design ； Speech ； Emoticon ； Children ； E-Learning ； Social Presence

設計學報

12卷4期（2007 / 12 / 01）

43 - 57

繁體中文

許多研究證實將社會線索置入使用者介面可使電腦產生社會成員之社會臨場感，有助於提升人們對電腦的認同，而產生愉悅的互動經驗，增進人們對電腦的參與動機提出了有潛力的應用性。本研究旨在了解將語音、靜態和動態表情符號，做為社會線索置入數位學習環境，影響兒童參與學習活動時，對電腦的態度與學習動機之差異。本研究執行兩個完全受試者間實驗設計法，控制因子為社會線索，各有兩個水準－語音/靜態表情符號、語音/動態表情符號，利用國小六年級學生（173人）進行電腦輔助學習活動，使用社會臨場感、相似吸引，及學習動機問卷收集相關資料。資料分析結果發現，在提升兒童參與學習所衍生之社會臨場感、對電腦之相似吸引、學習動機之影響力，語音顯著地勝於靜態表情符號；語音和動態表情符號並無明顯差異，基於本研究結果建議開發數位學習之互動設計時，採用語音和動態表情回饋，可促使兒童與電腦的關係邁向具有情感與社會層面的互動經驗，有效地提昇學生對電腦的偏好與參與學習之動機。語音和動態表情符號各為語言和非語言溝通形式，聽覺和視覺的刺激媒介，兩者在引發兒童的社會回應與學習動機具有等同的效果，將有助於設計者彈性運用這兩種社會線索，發展友善具激勵性的互動設計。

Researchers have shown that incorporating social cues into a user-interface enables computers to create social presence, which helps people better identify with the computer and results in a more enjoyable experience. It shows a potential for improving engagement and motivation. This study aimed to make use of speech, static emoticons, and dynamic emoticons as social cues to create a sociable human-computer relationship and explore how the management of those social cues affects children's attitudes towards computers as well as their learning motivation in e-learning environments. Two sets of one factor experiment under two levels (speech/static emoticons, and speech/animated emoticons) were conducted in this study. 173 sixth-graders participated in the test. Data were collected via questionnaire regarding the perceived social presence, similar attraction towards computers, and motivation with learning. It was found that speech was superior to static emoticon while having no significant difference with dynamic emoticon to increase the perceived social presence, similar attraction towards computers, and motivation with learning. These findings recommend that designers of educational technology could use speech or dynamic emoticons in e-learning environments so as to build the social relationship between children and computers that could boost their motivation with learning. Besides, the speech is a verbal cue and an audio modality while the dynamic emoticon is non-verbal and visual. The study has provided evidence for a fact that children’s social responses and learning motivations are triggered equally strongly by the two social cues. Therefore, designers can flexibly use speech or dynamic emoticons to create a sociable and inspiring interaction design.

1. 董芳武、鄧怡莘(2006)。人機互動中之社會線索－語音與互動形式對兒童參與數位學習的影響。設計學報，11(4)，81-95。
   連結：
2. Ambadar, Z.,Schooler, J. W.,Cohn, J. F.(2005).Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions.Psychological Science,16(5),403-410.
3. Aragon, S. R.,S. R. Aragon (Ed.)(2003).Facilitating learning in online environments.San Francisco:Jossey-Bass.
4. Bartneck, C.,Reichenbach, J.(2005).Subtle emotional expressions of synthetic characters.The International Journal of Human-Computer Studies,62(2),179-192.
5. Biele, C.,Grabowska, A.(2006).Sex differences in perception of emotion intensity in dynamic and static facial expressions.Exponential Brain Reticuloendothelia System,171(1),1-6.
6. Bracken, C. C.,Lombard, M.(2004).Social presence and children: Praise, intrinsic motivation, and learning with computers.Journal of Communication,54(1),22-37.
7. Bruckman, A.,Bandlow, A.(2003).Human-computer interaction handbook.New Jersey:Hillsdale, Lawrence Erlbaum.
8. Burgoon, J. K.,Buller, D. B.,Woodall, W. G.(1996).Nonverbal-communication: The unspoken dialogue.New York:McGraw-Hill.
9. Chalfonte, B. L.,Fish, R. S.,Kraut, R. E.,Robertson, S. P.(Eds.),Olson, G. M.(Eds.),Olson, J. S.(Eds.)(1991).Expressive richness: A comparison of speech and text as media for revision.Proceedings of the SIGCHI Conference on Human Factors in Computing Systems,New York:
10. Chiasson, S.,Gutwin, C.(2005).Testing the Media Equation with Children.Proceedings of the SIGCHI Conference on Human Factors in Computing Systems,New York:
11. Clark, H. H.(1996).Using language.Cambridge:Cambridge University Press.
12. De Saussure, F.(1959).Course in general linguistics.New York:McGraw-Hill.
13. Druin, A.,Inkpen, K.(2001).When are personal technologies for children?.Personal and Ubiquitous Computing,5(3),191-194.
14. Ekman, P.(1993).Facial expression and emotion.American Psychologist,48(4),384-392.
15. Ekman, P.(1994).The nature of emotion: Fundamental questions.New York:Oxford University.
16. Ekman, P.,Friesen, W. V.(1975).A guide to recognizing emotions from facial clues.New Jersey:Prentice-Hall, Englewood Cliffs.
17. Extejt, M.(1998).Teaching students to correspond effectively electronically.Business Communication Quarterly,61(2),57-67.
18. Ferdig, R.,Mishra, P.(2004).Emotional responses to computers: Experiences in unfairness, anger, and spite.Journal of Educational Multimedia and Hypermedia,13(2),143-161.
19. Fogg, B. J.(2002).Persuasive technology: Using computers to change what we think and do.San Francisco:Morgan Kaufmann.
20. Fogg, B. J.,Nass, C.(1997).Silicon sycophants: Effects of computers that flatter.International Journal of Human-Computer Studies,46(5),551-561.
21. Harwood, N. K.,Hall, L. J.,Shinkfield, A. J.(1999).Recognition of facial emotional expressions from moving and static displays by individuals with mental retardation.American Journal on Mental Retardation,104(3),270-278.
22. Hess, U.,Kleck, R. E.(1994).The cues decoders use in attempting to differentiate emotion-elicited and posed facial expressions.European Journal of Social Psychology,24(3),367-381.
23. Jensen, C.,Farnham, S. D.,Drucker, S. M.,Kollock, P.(2000).The effect of communication modality on cooperation in online environments.Proceedings of the SIGCHI Conference on Human Factors in Computing Systems,New York:
24. Keil, M.,Johnson, R. D.(2002).Feedback Channels: Using Social Presence Theory to Compare Voice Mail to Email.Journal of Information Systems Education,13(4),295-302.
25. Keller, J. M.(1997).Motivational design and multimedia: Beyond the novelty effect.Strategic Human Resource Development Review,1(1),188-302.
26. Lajoie, S. P.,Derry, S. J.(1993).Computers as cognitive tools.Hillsdale, NJ:Erlbaum.
27. Journal of Computer-Mediated-Communication
28. Marakas, G.,Johnson, R.,Palmer, J. W.(2000).A theoretical model of differential social attributions toward computing technology: When the metaphor becomes the model.International Journal of Human-Computer Studies,52(4),719-750.
29. Moon, Y.,Morkes, J.,Kim, E. Y.,Fogg, B. J.,B. Friedman (Ed.)(1997).Human values and the design of computer technology.Stanford, California:CSLI Press.
30. Moon, Y.,Nass, C.(1998).Are computers scapegoats? Attributions of responsibility in human-computer interaction.International Journal of Human-Computer Studies,49(1),79-94.
31. Nass, C.,Brave, S.(2005).Wired for speech: How voice activates and advances the human-computer relationship.Cambridge, Massachusetts:MIT Press.
32. Nass, C.,Foehr, U.,Brave, S.,Somoza, M.(2001).The effects of emotion of voice in synthesized and recorded speech.Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI) Symposium Emotional and Intelligent II: The Tangled Knot of Social Cognition,Massachusetts:
33. Nass, C.,Gong, L.(2000).Social aspects of speech interfaces from an evolutionary perspective: Experimental research and design implications.Communications of the Association for Computing Machinery,43(9),36-43.
34. Nass, C.,Moon, Y.(2000).Machines and mindlessness: Social responses to computers.Journal of Social Issues,56(1),81-103.
35. Nass, C.,Moon, Y.,Green, N.(1997).Are computers gender-neutral? Gender stereotypic responses to computers.Journal of Applied Social Psychology,27(10),864-876.
36. Nass, C.,Steuer, J.,Tauber, E.(1994).Computers are social actors.Proceedings of the SIGCHI Conference on Human Factors in Computing Systems,New York:
37. Newberry, B.,W. Fowler(Eds.),J. Hasebrook(Eds.)(2001).Raising student social presence in online classes.Proceedings of the Association for the Advancement of Computing in Education (AACE)WebNet 2001 World Conference on the WWW and the Internet,Norfolk, Orlando, Florida:
38. Norman, D.(2004).Emotional design: Why we love (or hate) everyday things.New York:Basic Books.
39. Pearson, B. L.(1977).Introduction to Linguistic Concepts.New York:Knopf.
40. Picard, R.,Wexelblat, A.,Nass, C.(2002).Future interfaces: Social and emotional.The Extended Abstracts of CHI 2002 Conference on Human Factors in Computer Systems,New York:
41. Posner, M. I.,Nissen, M. J.,Klein, R. M.(1976).Visual dominance: An information-processing account of its origins and significance.Psychological Review,83(2),157-171.
42. Reeve, J.,Sickenius, B.(1994).Development and validation of a brief measure of the three psychological needs underlying intrinsic motivation: The AFS scales.Educational Psychological measurement,54(2),506-515.
43. Reeves, B.,Nass, C.(1996).Media equation: How people treat computer, television, and new media like real people and places.New York:Cambridge University Press.
44. Rivera, K.,Cooke, N.,Bauhs, J.(1996).The effects of emotional icons on remote communication.Proceedings of the SIGCHI Conference on Human Factors in Computing Systems,New York:
45. Scherer, K. R.,Banse, R.,Wallbott, H. G.(2001).Emotional interferences from vocal expression correlate across languages and cultures.Journal of Cross-cultural Psychology,32(1),76-92.
46. Short, J.,Williams, E.,Christie, B.(1976).The social psychology of telecommunications.London:John Willey & Sons.
47. Singh, R.,Ho S. Y.(2000).Attitudes and attraction: A new test of the attraction, repulsion and similarity-dissimilarity asymmetry hypotheses.British Journal of Social Psychology,39(2),197-211.
48. Sproull, L.,Subramani, M.,Kiesler, S.,Walker, J. H.,Waters, K.(1996).When the interface is a face.Human-Computer Interaction,11(2),97-124.
49. Takeuchi, A.,Nagao, K.(1993).Communicative facial displays as a new conversational modality.Proceedings of the SIGCHI Conference on Human Factors in Computing Systems,New York:
50. Thompson, P. A.,Foulger, D. A.(1996).Effects of pictographs and quoting on flaming in electronic mail.Computers in Human Behavior,12(2),225-243.
51. Tu, C. H.(2001).How Chinese perceive social presence? An examination of interaction in an online learning environment.Educational Media International,38(1),45-60.
52. Tu, C. H.,McIsaac, M. S.(2002).An examination of social presence to increase interaction in online classes.American Journal of Distance Education,16(2),131-150.
53. Turkle, S.(1984).The second self: Computers and the human spirit.New York:Simon and Schuster.
54. Turkle, S.(1980).Computer as rorschach.Society,17(2),15-24.
55. Turkle, S.,M. C. Roco(Eds.),W. S. Bainbridge(Eds.)(2003).Converging technologies for improving human performance.Boston:Kluwer Academic.
56. Walker, J. H.,Sproull, L.,Subramani, R.(1994).Using a human face in an interface.Proceedings of the SIGCHI Conference on Human Factors in Computing Systems,New York:
57. Walther, J. B.(1992).Interpersonal effects in computer-mediated interaction: A relational perspective.Communication Research,19(1),52-90.
58. 董芳武、鄧怡莘(2006)。電腦輔助學習環境中社會成員臨場感呈現之研究－檢視語音回饋對兒童的影響。教學科技與媒體，76，32-45。