Using a Holistic Approach to Evaluate the Digital Humanities System for Parliamentary Information

利用整體性評估法進行議事資訊數位人文系統評估

10.30177/JLISR.202306_17(2).0004

Shu-Lai Chou(周澍來)；Yu-Jung Cheng(鄭有容)

Digital Humanities ； Google Analytics ； Parliamentary Information ； Usability Assessment ； User Perspectives ； 數位人文 ； Google分析 ； 議事資訊 ； 好用性評估 ； 使用者觀點

圖書資訊學研究

17卷2期（2023 / 06 / 01）

109 - 141

英文;繁體中文

In recent years, legislatures worldwide have promoted projects for constructing digital humanities systems for parliamentary information. However, studies have yet to perform in-depth investigations on the overall effectiveness of such systems from a user perspective. Therefore, this study used a holistic approach and chose the "Taipei in the Making," maintained by the Taipei City Council, to evaluate its performance. Specifically, Google Analytics (GA) was used to collect statistics on website use and user participation from 2016 to 2021. A usability assessment questionnaire was distributed randomly to different user groups, including councilors, to perform a usability and satisfaction survey. The results revealed that the website's user base grew from 2016 and peaked in 2018 but decreased precipitously after 2018, and the returning users only comprised ≈ 25% of users, indicating that user engagement could be enhanced through a strategy such as interface improvements. In addition, the results of the usability assessment among respondents revealed that the satisfaction construct had the highest score, followed by memorability and learnability constructs, indicating that the system can satisfy the respondents' search for parliamentary information needs. In conclusion, the Taipei City Council and government departments are recommended to combine various assessment methods to devise a holistic approach to develop the system further and facilitate public use of parliamentary information.

近年來世界各國民意機關均推動議事資訊數位人文計畫，然尚未有研究深入調查議事資訊數位人文系統效益。因此本研究選擇臺北市議會的「Taipei in the Making」進行整體性評估，除採用Google分析（Google Analytics）蒐集系統網站於2016年至2021年間的使用者使用紀錄，另透過好用性評估問卷調查系統好用性滿意度。研究結果顯示，系統網站使用量從2016年逐年增長，於2018年達到高峰，之後急劇下降，且回訪客比例僅約25%，表示系統介面設計在提升使用者參與度上有待改善；而好用性評估結果顯示填答的使用者對系統整體表現感到滿意，表示系統能滿足其議事資訊搜尋需求。本研究結果建議未來臺北市議會及政府部門可嘗試結合不同評估方法，建立完整的系統評估機制，據以改善系統讓議事資訊廣為大眾利用。

1. Chang, S.-J. L.(1999)。Digital libraries for humanities scholars: An empirical study of users’ information behaviors。Journal of Library and Information Studies，14，33-48。
   連結：
2. Ku, K. M.(2001).The website library and its parliamentary information & dissemination service.Journal of Library and Information Studies,16,161-169.
   連結：
3. Lin, C.-M.,Fan, W.-Y.(2013).Usability test for a digital archival system in Taiwan: A case of the Humanities and Social Sciences (HSS) information system.Journal of Library and Information Science,39(1),46-63.
   連結：
4. Brown, A.(2003).Preserving the digital heritage: Building a digital archive for UK government records.Online Information-International Meeting,2003,65-68.
5. Cohen, R. A.,Thorpe, A.(2015).Discovering user behavior: Applying usage statistics to shape frontline services.The Serials Librarian,69(1),29-46.
6. Covey, D. T.(2002).Usage and usability assessment: Library practices and concerns.Washington, DC:Digital Library Federation.
7. Desmarais, N.(2011).A century of lawmaking for a new nation: US congressional documents and debates.Reference Reviews,25(8),55-56.
8. Digital Taiwan. (n.d.). The “Taipei in the making” project: Taipei city parliamentary information. Retrieved from https://culture.teldap.tw/culture/index.php?option=com_content&view=article&id=1848%3Athe-taipei-in-the-making-project-taipei-city-%20parliamentary-information&catid=158%3Aarchives-and-databases&Itemid=210
9. Eschenfelder, K. R.,Miller, C. A.(2007).Examining the role of web site information in facilitating different citizen–government relationships: A case study of state Chronic Wasting Disease web sites.Government Information Quarterly,24(1),64-88.
10. Fagan, J. C.(2014).The suitability of web analytics key performance indicators in the academic library environment.The Journal of Academic Librarianship,40(1),25-34.
11. Fagan, J. C.,Fagan, B. D.(2001).Citizens’ access to on-line state legislative documents.Government Information Quarterly,18(2),105-121.
12. Gibbs, F.,Owens, T.(2012).Building better digital humanities tools: Toward broader audiences and user-centered designs.Digital Humanities Quarterly,6(2)
13. Gooding, P.(2016).Exploring the information behaviour of users of Welsh Newspapers Online through web log analysis.Journal of Documentation,72(2),232-246.
14. Hsiang, J.,Peng, H.-H.,Tung, C.-E.,Hsiao, I.-L.(2010)。Taiwan fa zhan de li shi mai luo-Jian zhi Taiwan sheng zi yi hui shi liao zhi zong guan。Taiwan Sheng Zi Yi Hui Hui Xun，18，34-41。
15. Huang, Z.,Benyoucef, M.(2014).Usability and credibility of e-government websites.Government Information Quarterly,31(4),584-595.
16. Kaiser, H. F.,Rice, J.(1974).Little Jiffy, mark IV.Educational and Psychological Measurement,34(1),111-117.
17. Kelly, E. J.(2014).Assessment of digitized library and archaterials: A literature review.Journal of Web Librarianship,8(4),384-403.
18. Khoo, M.,Pagano, J.,Washington, A. L.,Recker, M.,Palmer, B.,Donahue, R. A.(2008).Using web metrics to analyze digital libraries.Proceedings of the 8th ACM/IEEE-CS Joint Conference on Digital Libraries,New York, NY:
19. Krug, S.(2000).Don’t make me think! A common sense approach to web usability.Indianapolis, IN:New Riders.
20. Lu, H.-P.,Liang, S.-W.(2014).Global development of parliamentary websites and key factors of influence.Journal of Internet Technology,15(5),733-749.
21. Mooi, E.,Sarstedt, M.,Mooi-Reci, I.(2018).Principal component and factor analysis.Market Research: The process, data, and methods using stata,Singapore:
22. Nielsen, J. (2020). 10 Usability heuristics for user interface design. Retrieved from https://www.nngroup.com/articles/ten-usability-heuristics/
23. Nielsen, J.(1993).Usability engineering.San Francisco, CA:Morgan Kaufmann.
24. Ridgway, W. H.(2011).A century of lawmaking for a new nation: U.S. congressional documents and debates, 1774–1875.The Journal of American History,97(4),1196-1197.
25. Su, S.-F.,Chiu, Y.,Xi, D.-L.,Chen, Y.-H.(2012)。,未出版
26. Taipei City Council. (n.d.). Taipei in the making. Retrieved from http://taipeiinthemaking.tcc.gov.tw/cgi-bin/gs32/gsweb.cgi/login?o=dwebmge&cache=1553221726637 (in Chinese)
27. The Library of Congress. (n.d.). National Digital Library Program. Retrieved from https://memory.loc.gov/ammem/dli2/html/lcndlp.html
28. Vecchione, A.,Brown, D.,Allen, E.,Baschnagel, A.(2016).Tracking user behavior with Google Analytics events on an academic library web site.Journal of Web Librarianship,10(3),161-175.
29. Wusteman, J.(2017).Usability testing of the letters of 1916 digital edition.Library Hi Tech,35(1),120-143.
30. Yang, L.,Perrin, J. M.(2014).Tutorials on Google Analytics: How to craft a web analytics report for a library web site.Journal of Web Librarianship,8(4),404-417.
31. Zavalina, O.,Vassilieva, E. V.(2014).Understanding the information needs of large-scale digital library users.Library Resources & Technical Services,58(2),84-99.
32. Zha, X.,Wang, W.,Yan, Y.,Zhang, J.,Zha, D.(2015).Understanding information seeking in digital libraries: Antecedents and consequences.Aslib Journal of Information Management,67(6),715-734.
33. Zhang, Y.(2010).Developing a holistic model for digital library evaluation.Journal of the American Society for Information Science and Technology,61(1),88-110.