運用Kirkpatrick模式評估資訊法律課程在數位學習環境之學習成效

Evaluating Learning Effectiveness of an Information Law Course in a Blended Learning Environment Based on the Kirkpatrick Model

10.6120/JoEMLS.2015.524/0026.RS.CM

張迺貞(Nai-Cheng Chang)；周天(Jason Tien Chou)

資訊法律 ； 資訊素養 ； Kirkpatrick模式 ； 混成式學習 ； 數位學習 ； 通識教育 ； Information law ； Information literacy ； Kirkpatrick model ； Blended learning ； E-Learning ； General education

教育資料與圖書館學

52卷4期（2015 / 12 / 01）

417 - 450

繁體中文

本研究運用Kirkpatrick四層次評估模式，反應（reaction）、學習（learning）、行為（behavior）、成果（result），為探究的主軸，以修習通識教育「資訊法律」數位教材的學生為研究對象，透過結構式問卷調查，進行系統性資料蒐集與分析。同時，配合深度訪談質性分析，探討資訊法律數位學習課程之學習成效。研究結果顯示，學生對資訊法律課程有極高的整體滿意度（反應層次）、學生在資訊法律課程有正向的學習成果（學習層次）、學生學習資訊法律課程有立即性或經過一段時間後的正向行為轉移（行為層次）、學生學習資訊法律課程對組織社會有極高的正向效益與貢獻（結果層次）。透過Kirkpatrick模式的評估結果，肯定資訊法律課程在數位學習環境之正面學習成效和課程的價值。

The purpose of this study was to apply the Kirkpatrick four-level model (reaction, learning, behavior, result) to evaluate the learning effectiveness of those students who studied the general education digital materials of ＂Information Law＂ in a blended learning environment. The study used a mixed-method approach, including a mainly quantitative online questionnaire, followed by semi-structured interviews. The results demonstrated that the students had a high overall satisfaction towards the course (reaction level), positive learning outcomes (learning level), and a positive behavior transfer after learning, which could occur either immediately or after a period of time (behavior level). The students had high efficiency and a positive contribution to their organizations and the information society after learning information law (result level). Based on the Kirkpatrick model, the results provided favorable evidence for the students' learning effectiveness and the course's value.

1. Paliwala, A.、施慧玲(2005)。法律 e化教學之發展與應用：Iolis教學軟體之經驗分享。國立中正大學法學集刊，19，201-246。
   連結：
2. 方瑀紳、李隆盛(2014)。臺灣數位學習的成效與研究：2000-2011年間國內外研究文獻的回顧與綜整。教育資料與圖書館學，51(特刊=S)，27-56。
   連結：
3. 林菁(2009)。資訊素養融入大學生主題探究之研究。教育資料與圖書館學，46(2)，233-266。
   連結：
4. 林進財、陳瑞全、陳啟斌、歐陽玉萍(2007)。E-learning學習績效運用模糊法評估。資訊管理學報，14(2)，247-271。
   連結：
5. 邱弘昇、趙貞怡(2012)。應用網路實況平臺進行自主學習之學習成效研究。資訊傳播研究，2(2)，59-75。
   連結：
6. 張如瑩(2010)。台北市=Taipei，國立政治大學圖書資訊與檔案學研究所=Graduate Institute of Library, Information & Archival Studies, National Chengchi University。
   連結：
7. 劉靜怡(1998)。網路社會規範模式初探。國立臺灣大學法學論叢，28(1)，1-45。
   連結：
8. American Society of Training and Development. (2013). Education programs: E-learning/Online earning. Retrieved from http://www.astd.org/Education/Programs/All?filter=ed_subject%3aE-Learning%2fOnline+Learning
9. International Federation of Library Associations and Institutions. (2014). IFLA media and information literacy recommendations. Retrieved from http://www.ifla.org/publications/ifla-media-and-information-literacy-recommendations
10. IT Law Wiki. (2014). IT law wiki. Retrieved from http://itlaw.wikia.com
11. Kirkpatrick Partners. (2015). The new world Kirkpatrick model. http://www.kirkpatrickpartners.com/OurPhilosophy/TheNewWorldKirkpatrickModel/ tabid/303/
12. Lau, J. (2006). Guidelines on information literacy for lifelong learning. Veracruz, Mexico: International Federation of Library Associations and Institutions. Retrieved from http://archive.ifla.org/VII/s42/pub/IL-Guidelines2006.pdf
13. New York University School of Law. (2015). Information Law Institute. Retrieved from http://www.law.nyu.edu/centers/ili
14. Oxford Internet Institute University of Oxford. (2015). Oxford Internet Institute. Retrieved from http://www.oii.ox.ac.uk
15. President & Fellows of Harvard College. (2015). Program in general education. Retrieved from http://www.generaleducation.fas.harvard.edu/icb/icb.do
16. Standler, R. B. (1999). What is computer law? Retrieved from http://www.rbs2.com/cdefn.htm
17. Stanford University. (2015). Undergraduate degrees and programs. Retrieved from http://exploredegrees.stanford.edu/undergraduatedegreesandprograms/#gerstex
18. United States Office Personnel Management. (2011). Field guide to training evaluation: Demonstrating the value of training at every level. Retrieved from http://www.opm.gov/policy-data-oversight/training-and-development/reference-materials/training_evaluation.pdf
19. 財團法人台灣網路資訊中心（2015）。「台灣無線網路使用調查」結果公布，熟齡上網正夯，行動連網民眾滿意。檢索自http://www.twnic.net.tw/NEWS4/137.pdf 【Taiwan Network Information Center. (2015). “Taiwan wuxian wanglu shiyong diaocha” jie guo gongbu, Shouling shangwang zheng hang, xingdong lianwang minzhong manyi. Retrieved from http://www.twnic.net.tw/NEWS4/137.pdf (in Chinese)】
20. 國立交通大學科技法律研究所（2015）。國立交通大學科技法律研究所。檢索自http://www.itl.nctu.edu.tw/【Institute of Technology Law, National Chiao Tung University. (2015). Institute of Technology Law, National Chiao Tung University. Retrieved from http://www.itl.nctu.edu.tw/ (in Chinese)】
21. 教育部（2015）。教育部大學院校課程資源網。檢索自http://ucourse-tvc.yuntech.edu.tw/web_nu/search_general.aspx【Ministry of Education. (2015). Course information. Retrieved from http://ucourse-tvc.yuntech.edu.tw/web_nu/search_general.aspx (in Chinese)】
22. 網路資訊法律實務（2015）。檢索自http://homepage.ttu.edu.tw/blanca/doc/G4290courseOutline.htm【Wanglu zixun falu shiwu. (2015). Retrieved from http://homepage.ttu.edu.tw/blanca/doc/G4290courseOutline.htm (in Chinese)】
23. Allen, M.(2003).The lessons of e-learning.Optimize Magazine,26,51.
24. American Society of Training and Development(2006).American Society of Training and Development's annual review of trends in workplace learning and performance.Author:Alexandria, VA.
25. Beniger, J. R.(1986).The control revolution: Technological and economic origins of the information society.Cambridge, MA:Harvard University Press.
26. Black, S. K.(2002).Telecommunications law in the Internet age.San Francisco, CA:Morgan Kaufmann.
27. Cavazos, E. A.,Morin, G.(1994).Cyberspace and law: Your rights and duties in the on-line world.Cambridge, MA:MIT Press.
28. Chang, N.,Chen, H.(2014).Motivational analysis of digital information literacy materials in a blended e-learning environment.World Library and Information Congress: 80th IFLA General Conference and Assembly,Lyon, France:
29. Chang, N.,Chen, L.(2014).Evaluating the learning effectiveness of an online information literacy class based on the Kirkpatrick framework.Libri: International Journal of Libraries and Information Services,64(3),211-223.
30. Chrysafiadi, K.,Virvou, M(2013).PeRSIVA: An empirical evaluation method of a student model of an intelligent e-learning environment for computer programming.Computers & Education,68,322-333.
31. Drucker, P. F.(1967).The effective executive.New York, NY:Harper & Row.
32. Galloway, D. L.(2005).Evaluating distance delivery and e-learning: Is Kirkpatrick's model relevant?.Performance Improvement,44(4),21-27.
33. Gharechedaghi, N. N.,Fartash, A.,Ghotbi, A.(2012).Evaluating the effectiveness of e-learning courses based on the Kirkpatrick model.Journal of Basic and Applied Scientific Research,2(6),5636-5643.
34. Hamtini, T. M.(2008).Evaluating e-learning programs: An adaptation of Kirkpatrick's model to accommodate e-learning environments.Journal of Computer Science,4(8),693-698.
35. Horton, W.(2001).Evaluating e-learning.Alexandria, VA:ASTD.
36. Jankowich, A. E.(2005).Property and democracy in virtual worlds.Boston University Journal of Science and Technology Law,11(2)
37. Johnston, N.(2010).Is an online learning module an effective way to develop information literacy skills?.Australian Academic & Research Libraries,41(3),207-218.
38. Kirkpatrick, D. L.(Ed.)(1998).Another look at evaluating training programs: Fifty articles from training & development and technical training: Magazines cover the essentials of evaluation and return-on-investment.Alexandria, VA:ASTD.
39. Kirkpatrick, D. L.(Ed.)(1975).Evaluating training programs: A collection of articles from the Journal of the American Society for Training and Development.Madison, WI:ASTD.
40. Kirkpatrick, D. L.,Kirkpatrick, J. D.(2006).Evaluating training programs: The four levels.San Francisco, CA:Berrett-Koehler.
41. Kling, R.(2007).What is social informatics and why does it matter?.Information Society,23(4),205-220.
42. Lavender, D. T.,Omoni, G.,Lee, K.,Wakasiaki, S.,Campbell, M.,Watiti, J.,Mathai, M.(2013).A pilot quasi-experimental study to determine the feasibility of implementing a partograph e-learning tool for student midwife training in Nairobi.Midwifery,29(8),876-884.
43. Lessig, L.(1999).The law of the horse: What cyberlaw might teach.Harvard Law Review,113,501-546.
44. Lloyd, I. J.(2008).Information technology law.New York, NY:Oxford University Press.
45. Machlup, F.(1962).The production and distribution of knowledge in the United State.Princeton, NJ:Princeton University Press.
46. Nimmer, R. T.(2004).Information law.St. Paul, MN:West.
47. Nimmer, R. T.(2004).Information law.St. Paul, MN:West.
48. Nora, S.,Minc, A.(1980).The computerization of society: A report to the president of France.Cambridge, MA:MIT Press.
49. Phillips, J.,Phillips, P.,Zuniga, L.(2000).Evaluating the effectiveness and the return on investment of e-learning.Alexandria, VA:ASTD.
50. Powell, W. W.,Snellman, K.(2004).The knowledge economy.Annual Review of Sociolog,30(1),199-220.
51. Reeves, T. C.,Hedberg, J. G.(2003).Interactive learning systems evaluation.Englewood Cliffs, NJ:Educational Technology.
52. Ruiz, J. G.,Mintzer, M. J.,Leipzig, R. M.(2006).The impact of e-learning in medical education.Academic Medicine,81(3),207-212.
53. Scott, M. D.(2007).Scott on information technology law.Austin, TX:Aspen.
54. Small, R. V.,Zakaria, N.,El-Figuigui, H.(2004).Motivational aspects of information literacy skills instruction in community college libraries.College & Research Libraries,65(2),96-121.
55. Sommer, J. H.(2000).Against cyberlaw.Berkeley Technology Law Journal,15(3),1145-1232.
56. Sookman, B. B.(2009).Computer, Internet, and electronic commerce terms: Judicial, legislative and technical definition.Toronto, ON:Carswell.
57. Walsh, A.(2009).Information literacy assessment: Where do we start?.Journal of Librarianship and Information Science,41(1),19-28.
58. Webster, F.(2009).Theories of the information society.London, UK:Routledge.
59. Werner, J. M.,DeSimone, R. L.(2009).Human resource development.Mason, OH:South-Western Cengage Learning.
60. Yin, R. K.(2014).Case study research: Design and methods.Los Angeles, CA:Sage.
61. 吳茂昆(2002)。因應知識經濟世代之科技發展政策。國家政策季刊，1(1)，167-182。
62. 李隆盛編、黃同圳編(2000)。人力資源發展。台北市=Taipei:師大書苑=Shtabook。
63. 李隆盛(2008)。向企業學習：克伯屈的四層次評鑑。評鑑雙月刊，13，45-48。
64. 周天(2011)。網路時代我國數位出版產業面臨的著作權挑戰。檢察新論，10，2-19。
65. 周天、戴豪君、李科逸、方翊人、郭佳玫、綦冠婷、林育廷(2002)。網路法律高手。台北市=Taipei:書泉=Shuquan。
66. 周天、戴豪君、林育廷、李科逸、方翊人、洪麗玲、蔡美智(2000)。數位科技與法律。台北市=Taipei:書泉=Shuquan。
67. 周倩、陳茵嵐、蔡政宏(2010)。培育網路世代的優質數位公民。研習資訊，27(5)，13-21。
68. 林品村(2005)。台南市=Tainan，國立臺南大學資訊教育研究所=Graduate Institute of Information and Computer Education, National University of Tainan。
69. 徐振雄(2011)。資訊網路法導論。台北市=Taipei:藍海文化=Lanhai。
70. 徐振雄(2012)。從科技與倫理的跨域對話談道德的基本認知：以「網路法與網路倫理」課程為例。止善，13，191-218。
71. 張迺貞(2014)。運用「資訊法律」數位教材融入通識教育數位學習環境。大同大學通識教育年報，10，115-139。
72. 張迺貞(2010)。數位學習應用於圖書館利用教育：以數位學習教材「圖書資訊應用」為例。大同大學通識教育年報，6，187-204。
73. 張瑞星、周天、程法彰(2008)。科技與法律。台北市=Taipei:元照=Angle。
74. 許梅芳(2011)。台中市=Taichung，國立臺中教育大學區域與社會發展學系=Department of Regional and Social Development, National Taichung University of Education。
75. 郭振昌(2012)。柯氏（Kirkpatrick）訓練評估模式的修正與反省。台灣勞工季刊，29，115-124.。
76. 陳人傑、郭佳玫、黃大洲、朱世霓、吳兆琰、林煒鎔、郭戎晉(2005)。數位法律時代。台北市=Taipei:書泉=Shuquan。
77. 陳怡吟(2010)。台北市=Taipei，國立臺灣師範大學政治學研究所在職進修碩士班=Graduate Institute of Political Science, National Taiwan Normal University。
78. 陳櫻琴、葉玟妤、錢世傑、黃于玉(2004)。資訊法律。台北市=Taipei:華立=WahLee。
79. 黃玉雯(2011)。台北市=Taipei，世新大學資訊管理學研究所=Institute of Information Management, Shih Hsin University。
80. 黃俊傑(2004)。全球化時代大學通識教育的新挑戰。高雄市=Kaohsiung:中華民國通識教育學會=Chinese Association of General Education。
81. 楊智傑(2013)。資訊法。台北市=Taipei:五南=WuNan。
82. 戴錫瑩、孫躍東、李岩(2009)。基於Kirkpatrick評估模式的網路學習績效評價模式設計。中國遠程教育，2009(1)，45-48。
83. 謝文英(2001)。通識教育：理論與實務。台北市=Taipei:五南=WuNan。

1. 蔡淑瑤,林哲瑩(2020)。個案教學法應用於社會學科與自然學科課程之比較研究。發展與前瞻學報，27，45-62。
2. 鄭琨鴻,黃筠珊,黃雅玲,黃仙惠,莊昀蒨,李雅筑,李佳宇,石謙慧(2021)。以系統性內容分析探究2015－2019年圖書資訊TSSCI期刊之研究趨勢。圖資與檔案學刊，99，147-177。
3. (2021)。建構大學通識教育資訊素養課程模型之研究。圖書資訊學研究，16(1)，37-76。
4. (2021)。幼教系師資生於海外見習實施桌遊教學之歷程與成效。樹德科技大學學報，23(1)，75-93。