使用UEQ評估中文適性閱讀診斷網站設計之使用者體驗

Using UEQ to Evaluate the User Experience of SmartReading

張丹(Dan Zhang)；梁桂嘉(Kuei-Chia Liang)；宋曜廷(Yao-Ting Sung)

電腦輔助評量 ； SR中文閱讀診斷評量 ； 使用者體驗設計 ； UEQ使用者體驗問卷 ； computer-aided assessment ； SmartReading ； user experience design ； UEQ

商業設計學報

26期（2023 / 03 / 01）

66 - 84

繁體中文;英文

與傳統測驗相比，電腦輔助適性評量是更快捷、高效、高準確度的檢驗體系。國立臺灣師範大學華語文與科技研究中心研發設計了「SmartReading」—中文適性閱讀診斷評量網站。使用者透過線上測驗後，SR可根據使用者訊息及作答狀況，準確診斷出使用者的閱讀能力表現。SR團隊對網站進行重新改版設計後，採用UEQ（使用者體驗問卷）進行成效評估。UEQ是判斷SR使用者體驗設計的有效工具，它以專業的技術通過簡單、高效的計算方法剖析產品特質，為產品提供有效的評估結果。本研究於2022年5月至6月間收集SR用戶（臺灣國中小、高中一至十二年級學生）的體驗數據。結果顯示，使用者認為SR在吸引力（Attractiveness）、效率（Efficiency）、促進（Stimulation）、新奇（Novelty）方面具有高於評估基準的使用者體驗，同時在明晰（Perspicuity）與可靠性（Dependability）方面未達到平均基準。總體表明，SR網站的使用者體驗設計處於中上水準，對SR的產品定位、內容設計相關與豐富性、使用流程及操作模式認可且支援，但同時SR對於新手及不熟悉產品的使用者而言，呈現不夠友善的情形。

Compared with traditional tests, computer-aided fitness assessment is a faster, more efficient and more accurate test system. The Chinese Language and Technology Research Center of National Taiwan Normal University has developed and designed "SmartReading" - Chinese adaptive reading diagnostic assessment website. After the user passes the online test, SR can accurately diagnose the user's reading ability performance based on the user's information and answering status. After the SR team redesigned the website, it used UEQ (User Experience Questionnaire) to evaluate the effectiveness. UEQ is an effective tool for judging SR user experience design. It uses professional technology to analyze product characteristics through simple and efficient calculation methods, and provides effective evaluation results for products. The author collected the experience data of SR users (Taiwanese elementary and high school students in grades 1 to 12) from May to June 2022. The results show that users believe that SR has a higher user experience than the evaluation benchmark in terms of Attractiveness, Efficiency, Stimulation, Novelty, and in terms of Perspicuity and Dependability. Average benchmark not met. Overall, the user experience design of the SR website is at an upper-middle level. Users recognize and support SR's product positioning, content design relevance and richness, usage process and operation mode, but at the same time, SR is not friendly enough for novice users and users who are not familiar with the product.

1. Kuo, Bor-Che(2018).Using LSA-based tools to enhance students’ Chinese reading ability.International Journal on Digital Learning Technology,10(1),31-55.
   連結：
2. 李奕璇,周業太,宋曜廷(2021)。中文閱讀能力適性診斷評量編製研究。教育心理學報，533(2)，285-305。
   連結：
3. 李漢岳,楊介銘,宋曜廷(2017)。數位學習實驗研究品質評估與現況分析：以行動學習為例。教育科學研究期刊，62(2)，31-60。
   連結：
4. 張世彗(2014)。閱讀理解量表建製之探究。特殊教育發展期刊，58，1-12。
   連結：
5. 趙子揚,宋曜廷(2019)。中學生考試壓力與個人特性：潛在類別分析。教育科學研究期刊，64(3)，203-235。
   連結：
6. Bloomfield, B. P.,Latham, Y.,Vurdubakis, T.(2010).Bodies, technologies and action possibilities: When is an affordance?.Sociology,44(3),415-433.
7. Bonnardelab, Nathalie(2011).The impact of colour on website appeal and users’ cognitive processes.Displays,32(2),69-80.
8. Desmet, P.M.A.,Fokkinga, S.F.(2020).Thirteen Fundamental Psychological Needs.Delft:Delft University of Technology.
9. DeStefano, Diana(2005).Cognitive load in hypertext reading. A review.Computers in Human Behavior,23,1616-1641.
10. Dianat, Iman,Adeli, Pari(2019).User-centred web design, usability and user satisfaction: The case of online banking websites in Iran.Applied Ergonomics,81,102892.
11. Flavián, Carlos(2006).The role played by perceived usability, satisfaction and consumer trust on website loyalty.Information & Management,43,1-14.
12. Hassenzahl, Marc(2004).User Experience and Experience Design.The Encyclopedia of Human-Computer Interaction,2(3)
13. Laksono, M.,Kusumawardani, S.,Ferdiana, R.(2019).Evaluating user experience on E-learning using the user experience questionnaire (UEQ) with Additional Functional Scale.Proceedings of the International Conferences on Information System and Technology
14. Laugwitz, B.,Schrepp, M.,Held, T.(2008).Construction and evaluation of a user experience questionnaire.Symposium of the Austrian HCI and Usability Engineering Group
15. Lawa, Rob,Qi, Shanshan,Buhalis, Dimitrios(2010).Progress in tourism management: A review of website evaluation in tourism research.Tourism Management,31,297-313.
16. Lyubomirsky, S.,King, L.,Diener, E.(2005).The Benefits of Frequent Positive Affect: Does Happiness Lead to Success?.Psychological Bulletin,131(6),803-855.
17. Ma, Jia Yang(2021).Evaluating user perception and emotion of microinteractions using a contradictory semantic scale.Society for Information Display,103-113.
18. McCormack, D.,Jones, D.(1997).Building a Web-Based Education System.N.Y.:Wiley.
19. Novabosa, C. Ruel,Matiasa, A.,Menab, M.(2015).How good is this destination website: A user-centered evaluation of provincial tourism websites.Procedia Manufacturing,3,3478-3485.
20. Pelet, Jean Éric,Papadopoulou, P.(2011).The effect of e-commerce websites' colors on customer trust.International Journal of E-Business Research,7(3),1-18.
21. Peters, D,Calvo, RA,Ryan, RM(2018).Designing for motivation,engagement and wellbeing in digital experience.Front Psychol,9,1-15.
22. Rohlesa, B,Susanne, B,Antoine, F,Franck, A,Vincent, K(2022).Creating positive learning experiences with technology: A field study on the effects of user experience for digital concept mapping.Heloyon,8(4)
23. Saleh, A.M.,Addous, H. A.,Alansari, I.S.,Enaizan, O.(2022).The evaluation of user experience on learning management systems using UEQ.International Journal of Emerging Technologies in Learning,17(07),145-162.
24. Schrepp, M.,Hinderks, A.,Thomaschewski, J.(2014).Applying the user experience questionnaire (UEQ) in Different Evaluation Scenarios.Design, User Experience, and Usability. Theories, Methods, and Tools for Designing the User Experience,Berlin:
25. Schrepp, M.,Hinderks, A.,Thomaschewski, J.(2017).Design and evaluation of a short version of the user experience questionnaire(UEQ-S).IJIMAI,4(6),103-108.
26. Swaminathan, V.,Lepkowska-White, E.,Rao, B.P.(1999).Browsers or buyers in cyberspace? An investigation of factors influencing electronic exchange.Journal of Computer-Mediated Communication,5(2)
27. 朱森楠(2013)。臺北市，國立臺灣師範大學教育心理與輔導學系。
28. 吳丹,冉愛華(2015)。移動閱讀應用的用戶體驗比較研究。現代圖書情報技術，31(7-8)，73-79。
29. 林寶貴,綺寶香(1999).中文閱讀理解測驗指導手冊.臺北市:教育部.
30. 楊亨利,應鳴雄(2005)。線上測驗是否有可能具備與紙筆測驗相同評分效力？。師大學報，科學教育類，50(2)，85-107。

1. (2023)。全景古蹟虛擬導覽之虛擬化身設計與評估：使用者經驗探索。文化資產保存學刊，66，7-26。