閱聽人跨媒介詮釋圖像敘事之美感傳播芻議：以繪本、iPad互動電子繪本為例

Preliminary Analyses of the Effect of Readers' Transmedia Interpretation of Pictorial Narratives on Aesthetic Communication: Picturebooks and Interactive e-Picturebooks as Examples

10.6195/cjcr.201806_33.0005

賴玉釵(Yu-Chai Lai)

互媒詮釋 ； 美感傳播 ； 跨媒介敘事 ； 圖像敘事 ； 繪本 ； Intermedial interpreation ； aesthetic communication ； transmedia narrative ； pictorial narrative ； picture book

中華傳播學刊

33期（2018 / 06 / 01）

181 - 215

繁體中文

本文以繪本、改編之iPad互動電子繪本為例，初探閱聽人跨媒介詮釋圖像敘事之美感傳播歷程。跨媒介參與和互媒詮釋相繫，含既定視域（類型互文、相互指涉互文）及想像。閱聽人因原作之互媒詮釋而形成預期，與改編文本互動後體現不確定感、否定性，引發驚奇及探索興趣。閱聽人需逐頁賞析繪本而視點游移，藉想像而弭合圖文間隙。閱聽人可因互動電子繪本之觸控設計而點擊畫面、開啟閱讀起點，藉主動參與而引導敘事邏輯，賦予視點游移新義。

In the study, picture books and interactive e-book adaptations of picture books were used to explore readers’ transmedia interpretations of the same pictorial narrative. Transmedia participation and intermedia interpretation are related, regarding generic intertextuality, referential intertextuality and imagination. Intermedia interpretation occurs when a reader familiar with the traditional form of a certain picture book is presented with an interactive electronic version. The reader experiences negation and becomes fascinated by the interactive design of the e-picture book. The new form stimulates the reader's interest in further interpreting and exploring the narrative. When a reader interprets a picture book, the wandering viewpoint is based on page-by-page reading, and the reader's imagination bridges gaps between pictures and texts. When a reader engages with an interactive e-book, the experience is initiated through indications to touch and click the screen. The reader ascertains the narrative logic of e-picture books, and their wandering viewpoint is redefined.

1. Adobe Creative Team(2013).Design with adobe creative cloud classroom in a book: Basic projects using Photoshop, InDesign, Muse, and more.Berkeley, CA:Adobe.
2. Bircher, K.(2012).What makes a good picture book app?.The Horn Book Magazine,88,72-78.
3. Cahill, M.,McGill-Franzen, A.(2013).Selecting 'app" ealing and "app" ropriate book apps for beginning readers.The Reading Teacher,67,30-39.
4. Das, R.(2012).Children reading an online genre: Heterogeneity in interpretive work.Popular Communication,10,269-285.
5. de Jong, M. T.,Bus, A. G.(2002).Quality of book-reading matters for emergent readers: An experiment with the same book in a regular or electronic format.Journal of Educational Psychology,94,145-155.
6. Demaria, C.(2014).True detective stories: Media textuality and the anthology format between remediation and transmedia narratives.Between,4(8),1-25.
7. Dewdney, A.(2011).Transmediation: Tracing the social aesthetic.Philosophy of Photography,2,97-113.
8. Elleström, L.(Ed.)(2010).Media borders, multimodality and intermediality.New York:Palgrave Macmillan.
9. Grishakova, M.(Ed.),Ryan, M.-L.(Ed.)(2010).Intermediality and storytelling.New York:De Gruyter.
10. Harvey, C. B.(2015).Fantastic transmedia: Narrative, play and memory across science fiction and fantasy storyworlds.New York:Palgrave Macmillan.
11. Ingarden, R.(1973).The cognition of the literary work of art.Evanston, IL:Northwestern University Press.
12. Iser, W.(1978).The act of reading: A theory of aesthetic response.Baltimore, MD:Johns Hopkins University Press.
13. Jauss, H. R.(1982).Aesthetic experience and literary hermeneutics.Minneapolis, MN:University of Minnesota Press.
14. Jewitt, C.(Ed.)(2009).The Routledge handbook of multimodal analysis.London:Routledge.
15. Korat, O.,Shamir, A.(2014).Do Hebrew electronic books differ from Dutch electronic books? A replication of a Dutch content analysis.Journal of Computer Assisted Learning,20,257-268.
16. Kress, G.(2010).Multimodality: A social semiotic approach to contemporary communication.London:Routledge.
17. Kustritz, A.(2014).Seriality and transmediality in the fan multiverse: Flexible and multiple marrative structures in fan fiction, art, and vids.TV Series,6,225-261.
18. Nodelman, P.(1988).Words about pictures: The narrative art of children's picture books.Athens, GA:University of Georgia Press.
19. O'Flynn, S.(2012).Documentary's metamorphic form: Webdoc, interactive, transmedia, participatory and beyond.Studies in Documentary Film,6,141-157.
20. Page, R.(Ed.)(2010).New perspectives on narrative and multimodality.London:Routledge.
21. Painter, C.,Martin, J. R.,Unsworth, L.(2013).Reading visual narratives: Image analysis of children's picture books.London:Equinox.
22. Paskin, J.(2013).Digital publishing in children's literature: A hindrance or a help to reluctant readers?.Logos,24(3),30-37.
23. Pearson, R.(Ed.),Smith, A. N.(Ed.)(2015).Storytelling in the media convergence age: Exploring screen narratives.New York:Palgrave Macmillan.
24. Perron, B.,Wolf, M. J. P.(2009).The video game theory reader 2.New York:Routledge.
25. Petöfi, J. S.(Ed.),Olivi, T.(Ed.)(1994).Approaches to poetry: Some aspects of textuality, intertexuality and intermediality.New York:Palgrave Macmillan.
26. Phillips, A.(2012).A creator's guide to transmedia storytelling: How to captivate and engage audiences across multiple platforms.New York:McGraw-Hill.
27. Rowsell, J.(2014).Toward a phenomenology of contemporary reading.Australian Journal of Language and Literacy,37,117-127.
28. Sangalang, A.,Johnson, J. M. Q.,Ciancio, K. E.(2013).Exploring audience involvement with an interactive narrative: Implications for incorporating transmedia storytelling into entertainment-education campaigns.Critical Arts,7,127-146.
29. Schugar, H. R.,Simith, C. A.,Schugar, J. T.(2013).Teaching with interactive picture e-books in grades K-6.The Reading Teacher,66,615-624.
30. Scolari, C. A.(Ed.),Bertetti, P.(Ed.),Freeman, M.(Ed.)(2014).Transmedia archaeology: Storytelling in the borderlines of science fiction, comics and pulp magazines.New York:Palgrave Macmillan.
31. Segal-Drori, O.,Korat, O.,Shamir, A.,Klein, P. S.(2010).Reading electronic and printed books with and without adult instruction: Effects on emergent reading.Reading and Writing,23,913-930.
32. Serafini, F.(2010).Reading multimodal texts: Perceptual, structural and ideological perspectives.Children's Literature in Education,41,85-104.
33. Szczepanik, P.(2002).Intermediality and (inter) media reflexivity in contemporary cinema.Convergence: The International Journal of Research into New Media Technologies,8(4),29-36.
34. Thorburn, D.(Ed.),Jenkins, H.(Ed.)(2004).Rethinking media change: The aesthetic of transition.New York:Routledge.
35. Tymieniecka, A.(Ed.)(1976).Ingardeniana: A spectrum of specialized studies establishing the field of research.Boston, MA:D. Riedel.
36. Voigts-Virchow, E.(2009).Metadaptation: Adaptation and intermediality -Cock and Bull.Journal of Adaptation in Film & Performance,2,137-152.
37. von Stackelberg, P.,Jones, R. E.(2014).Tales of our tomorrows: Transmedia storytelling and communicating about the future.Journal of Futures Studies,18(3),57-76.
38. Weedon, A.,Miller, D.,Franco, C. P.,Moorhead, D.,Pearce, S.(2014).Crossing media boundaries: Adaptations and new media forms of the book.Convergence: The International Journal of Research into New Media Technologies,20,108-124.
39. 林敏宜(2000)。圖畫書的欣賞與應用。台北市:心理。
40. 陳向明(2009)。社會科學質的研究。台北市:五南。
41. 戴孟宗、吳宏信、黃千玳(2014)。Adobe Dps 輕鬆學！多媒體App 電子書製作與上架。台北市:松崗。

1. 陳雅惠(2019)。新聞網摘型懶人包超文本敘事新方向初探。資訊社會研究，37，87-119。