應用網路形成性評量求助策略於數位學習環境之效益評估

Study the Effectiveness of Implementing Web-based Formative Assessment 'Ask-Hint Strategy' in e-Learning Environment

10.6384/CIQ.200801.0021

王子華(Tzu-Hua Wang)

WATA Web-based Assessment and Test Analysis system ； GAM-WAIA ； 數位學習 ； 網路形成性評量 ； 求助策略 ； WATA Web-based Assessment and Test Analysis system ； GAM-WATA ； e-Learning ； Web-based formative assessment ； Ask-Hint Strategy

課程與教學

11卷1期（2008 / 01 / 01）

21 - 46

繁體中文

本研究旨在探究一具有答題遊戲(quiz game)機制之選擇題型式的網路形成性評量系統－「Game Assessment Module of the web-based Assessment and Test Analysis system (GAM-WAIA)」，應用於國中自然與生活科技網路教學環境之效益情形。GAM-WATA可以模擬答題遊戲，並提供作答提示「Ask-Hint策略（求助策略）」，本研究希望藉由GAM-WATA來營造一個具有答題遊戲特色的選擇題式網路形成性評量環境，並藉以促進學習者主動參與網路形成性評量。本研究採用準實驗研究設計，將參與研究的十六個班級共494位國中一年級學生，以隨機的方式，以班級為單位分配進入五個分別包含不同「Ask-Hint策略組合模式」的網路教學環境進行學習，研究發現在不同「Ask-Hint策略組合模式」下學習的學生，其學習效益有顯著的差異，且對於「Ask-Hint策略」之使用時機與使用心態亦有差異。

This research aimed to investigate the effectiveness of implementing the Game Assessment Module of the Web-based Assessment and Test Analysis system (GAM-WATA) in an e-Learning environment of junior high school Nature and Science Technology Curriculum. The unique feedback strategy in the GAM-WATA was named 'Ask-Hint Strategy'. This research tried to use the GAM-WATA to construct a Web-based formative assessment environment in which the tests are quiz-game-like and contains multiple-choice items. Its design aimed to motivate students to participate in Web-based formative assessment. Quasi-experimental design was adopted in this research and 494 seventh grade students from 12 classes were involved. We constructed five different types of Web-based formative assessment, including the two different designs of 'Ask-Hint Strategy'. Each class as a unit was randomly assigned to the five different groups. The results concluded that students in five different groups have different learning effectiveness and have different options about when and how they use 'Ask-Hint Strategy'.

1. 王子華、王國華、王瑋龍、黃世傑(2004)。網路評量系統融入師資培育之探究。資訊管理學報，11，121-154。
   連結：
2. Barron, B. J. S.,Schwartz, D. L.,Vye, N. J.,Moore, A.,Petrosino, A.,Zech, L.,Bransford, J.,The Cognition and Technology Group at Vanderbilt(1998).Doing with understanding: Lessons from research on problem-and project-based learning.Journal of the Learning Sciences,7(3&4),271-311.
3. Bell, B.,Cowie, B.(2001).The characteristics of formative assessment in science education.Science Education,85(5),536-553.
4. Black, P.,Wiliam, D.(1998).Assessment and classroom learning.Assessment in Education,5(1),7-74.
5. Bransford, J. D.,Brown, A.,Cocking, R.(2000).How people learn: mind, brain, experience and school, expanded edition.Washington, DC:National Academy Press.
6. Brown, S.,Knight, P.(1994).Assessing learners in higher education.London:Kogan Page.
7. Buchanan, T.(2000).The efficacy of a World-Wide Web mediated formative assessment.Journal of Computer Assisted Learning,16(3),193-200.
8. Burrow, M.,Evdorides, H.,Hallam, B.,Freer-Hewish, R.(2005).Developing formative assessments for postgraduate students in engineering.European Journal of Engineering Education,30(2),255-263.
9. Clarke, D.,A. Richardson (Ed.)(1995).AAMT Proceedings.Adelaide:AAMT.
10. Gardner, L.,Sheridan, D.,White, D.(2002).A web-based learning and assessment system to support flexible education.Journal of Computer Assisted Learning,18(2),125-136.
11. Gipps, C.(1994).Beyond testing: Towards a theory of educational assessment.London:The Falmer Press.
12. Henly, D. C.(2003).Use of Web-based formative assessment to support student learning in a metabolism/nutrition unit.European Journal of Dental Education,7(3),116-122.
13. Hoffman, J. L.,Wu, H. K.,Krajcik, S. E.(2003).The nature of middle school learners’ science content understandings with the use of on-line resources.Journal of Research in Science Teaching,40(3),323-346.
14. Hopkins, K. D.(1998).Educational and psychological measurement and evaluation.Needham Heights, MA:Allyn & Bacon.
15. Khan, K. S.,Davies, D. A.,Gupta, J. K.(2001).Formative self-assessment using multiple true-false questions on the Internet: feedback according to confidence about correct knowledge.Medical Teacher,23(2),158-163.
16. Orsmond, P.,Merry, S.,Callaghan, A. C.(2004).Implementation of a formative assessment model incorporating peer and self assessment.Innovations in Education and Training International,41(3),273-290.
17. Peat, M.,Franklin, S.(2002).Supporting student learning: the use of computer-based formative assessment modules.British Journal of Educational Technology,33(5),515-523.
18. Perrenoud, P.(1998).From formative evaluation to a controlled regulation of learning processes, Towards a wider conceptual field.Assessment in Education,5(1),85-102.
19. Rodriguez, M. C.(2005).Three options are optimal for multiple-choice items: A meta-analysis of 80 years of research.Educational Measurement: Issues and Practice,24(2),3-13.
20. Sadler, D. R.(1989).Formative assessment and the design of instructional systems.Instructional Science,18(2),119-144.
21. Velan, G. M.,Kumar, R. K.,Dziegielewski, M.,Wakefield, D.(2002).Web-based self-assessments in pathology with Questionmark Perception.Pathology,34(3),282-284.
22. Vogel, J. J.,Greenwood-Ericksen, A.,Cannon-Bower, J.,Bowers, C. A.(2006).Using Virtual Reality with and without Gaming Attributes for Academic Achievement.Journal of Research on Technology in Education,39(1),105-118.
23. Wang, T. H.(2007).What strategies are effective for formative assessment in an e-Learning environment?.Journal of Computer Assisted Learning,23(3),171-186.
24. Wang, T. H..Web-based quiz-game-like formative assessment: Development and evaluation.Computers & Education.
25. Wang, T. H.,Wang, K. H.,Wang, W. L.,Huang, S. C.,Chen, S. Y.(2004).Web-based Assessment and Test Analyses (WATA) system: development and evaluation.Journal of Computer Assisted Learning,20(1),59-71.