题名

從教師自編科學成就測驗之Rasch分析看教與學

并列篇名

Glimpse Into Teaching and Learning Using Rasch Analyses of a Teacher-Made Science Achievement Test

DOI

10.6209/JORIES.2017.62(3).01

作者

陳映孜(Ying-Tze Chen)；何曉琪(Hsiao-Chi Ho)；劉昆夏(Kun-Hsia Liu)；林煥祥(Huann-Shyang Lin)；鄭英耀(Ying-Yao Cheng)

关键词

Rasch測量 ； 教師自編成就測驗 ； 評量回饋 ； 學習可能發展區 ； 學習進程 ； assessment feedback ； learning progression ； Rasch model ； teacher-made achievement test ； zone of proximal learning development

期刊名称

教育科學研究期刊

卷期/出版年月

62卷3期（2017 / 09 / 01）

页次

1 - 23

内容语文

繁體中文
中文摘要

本研究採Rasch測量模式，分析教師自編科學成就測驗，以檢驗測驗試題的品質，並提供有用的評量回饋訊息，作為教師調整教學與修正評量之參考。研究對象為高雄市8,936位（男生4,617位、女生4,319位）七年級學生。研究工具為教師自編生物科成就測驗。測驗資料採試題反應理論的Rasch模式進行分析。結果發現：整體而言，教師自編科學成就測驗能區分出學生的能力程度。然而，有些試題的內容對女生較不公平。本研究也發現，教師對於部分試題難易度的認知與學生實際的作答反應存有若干差異。最後，本研究透過評量回饋圖表，包含學生能力與試題難度對照圖、學生作答診斷圖等，提出辨識學習基礎發展區和學習可能發展區的範圍之方式，作為教師規劃學生學習進程之參考。
英文摘要

This study examined the quality of a teacher-made achievement test using Rasch analyses and provided useful assessment feedback information for improving teaching and testing. The participants were 8,936 seventh-grade students (4,617 boys and 4,319 girls) from the Kaohsiung area in Taiwan. Data were collected through a teacher-made biology achievement test and analyzed using the Rasch model. The results indicated that the test clearly discriminated students' abilities. Some questions, however, were found to have unfair content for girls. Additionally, some mismatches were identified between teachers' expectations and students' assessments of question difficulty. This paper also provides assessment feedback diagrams, including a person-item map and diagnostic map, and a method of identifying ＂the zone of fundamental learning development＂ and ＂the zone of proximal learning development＂ is proposed to enable teachers to plan students' learning progression.
主题分类 社會科學 > 教育學
参考文献
  1. 王子華、范雅晴、王國華(2008)。數理科在職教師評量素養培育模式之探究。科學教育學刊，16(1)，25-51。
    連結：
  2. 教育部（2008）。教育部補助辦理精進教學要點修正規定。行政院公報，014（215）。取自https://gazette.nat.gov.tw/EG_FileManager/eguploadpub/eg014215/ch05/type2/gov40/num12/Eg.pdf【Ministry of Education. (2008). Revised regulations governing Ministry of Education subsidies for instruction improvement. The Executive Yuan Gazatte Online, 014(215). Retrieved from https://gazette.nat.gov.tw/EG_FileManager/eguploadpub/eg014215/ch05/type2/gov40/num12/Eg.pdf】
  3. Kennedy, C. A., Wilson, M., & Draney, K. (2008). ConstructMap [Computer Program]. UC Berkeley, CA: BEAR Center..
  4. Abell, S. K.(Ed.),Lederman, N. G.(Ed.)(2007).Handbook of research on science education.Mahwah, NJ:LEA.
  5. Allal, L.,Ducrey, G. P.(2000).Assessment of-or in-the zone of proximal development.Learning and Instruction,10(2),137-152.
  6. Alonzo, A.,Steedle, J. T.(2009).Developing and assessing a force and motion learning progression.Science Education,93(3),389-421.
  7. Bell, B.,Cowie, B.(2001).The characteristics of formative assessment in science education.Science Education,85(5),536-553.
  8. Bertenthal, M. W.,Wilson, M. R.(2006).Systems for state science assessment.Washington, DC:National Academy Press.
  9. Black, P.,Harrison, C.,Lee, C.,Marshall, B.,Wiliam, D.(2004).Working inside the black box: Assessment for learning in the classroom.Phi Delta Kappan,86(1),8-21.
  10. Black, P.,Wiliam, D.(2010).Inside the black box: Raising standards through classroom assessment.Phi Delta Kappan,92(1),81-90.
  11. Black, P.,Wiliam, D.(1998).Assessment and classroom learning.Assessment in Education,5(1),7-74.
  12. Boone, W. J.,Scantlebury, K.(2006).The role of Rasch analysis when conducting science education research utilizing multiple-choice tests.Science Education,90(2),253-269.
  13. Boone, W. J.,Townsend, J. S.,Staver, J.(2011).Using Rasch theory to guide the practice of survey development and survey data analysis in science education and to inform science reform efforts: An exemplar utilizing STEBI self-efficacy data.Science Education,95(2),258-280.
  14. Briggs, D. C.,Alonzo, A. C.,Schwab, C.,Wilson, M.(2006).Diagnostic assessment with ordered multiple-choice items.Educational Assessment,11(1),33-63.
  15. Cakmakci, G.(Ed.),Tasar, M. F.(Ed.)(2010).Contemporary science education research: Learning and assessment.Ankara, Turkey:Pegem Akademi.
  16. Claesgens, J.,Scalise, K.,Wilson, M.,Stacy, A.(2009).Mapping student understanding in chemistry: The perspectives on chemists.Science Education,93(1),56-85.
  17. Duncan, R. G.,Gotwals, A. W.(2015).A tale of two progressions: On the benefits of careful comparisons.Science Education,99(3),410-416.
  18. Duncan, R. G.,Hmelo-Silver, C. E.(2009).Learning progressions: Aligning curriculum, instruction, and assessment.Journal for Research in Science Teaching,46(6),606-609.
  19. Duncan, R. G.,Reiser, B. J.(2007).Reasoning across ontologically distinct levels: Students' understandings of molecular genetics.Journal of Research in Science Teaching,44(7),938-959.
  20. Fulmer, G. W.(2014).Validating proposed learning progressions on force and motion using the force concept inventory: Findings from Singapore secondary schools.International Journal of Science and Mathematics Education,13(6),1235-1254.
  21. Furtak, E. M.,Morrison, D.,Kroog, H.(2014).Investigating the link between learning progressions and classroom assessment.Science Education,98(4),640-673.
  22. Gioka, O.(2009).Teacher or examiner? The tensions between formative and summative assessment in the case of science coursework.Research in Science Education,39(4),411-428.
  23. Graham, P.(2005).Classroom-based assessment: Changing knowledge and practice through preservice teacher education.Teaching and Teacher Education,21(6),607-621.
  24. Griffin, P.(2007).The comfort of competence and the uncertainty of assessment.Studies in Educational Evaluation,33(1),87-99.
  25. Hamers, J. H. M.(Ed.),Sijtsma, K.(Ed.)(1993).Learning potential assessment: Theoretical, methodological and practical issues.Amsterdam, The Netherland:Swets & Zeitlinger.
  26. Hammer, D.,Sikorski, T. R.(2015).Implications of complexity for research on learning progressions.Science Education,99(3),424-431.
  27. Hattie, J.,Timperley, H.(2007).The power of feedback.Review of Educational Research,77(1),81-112.
  28. Holland, P. W.(Ed.),Wainer, H.(Ed.)(1993).Differential item functioning.Hillsdale, NJ:Lawrence Erlbaum Associates.
  29. Kluger, A. N.,DeNisi, A.(1996).The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory.Psychological Bulletin,119(2),254-284.
  30. Lee, H.-S.,Liu, O. L.(2010).Assessing learning progression of energy concepts across middle school graded: The knowledge integration perspective.Science Education,94(4),665-688.
  31. Lidz, C. S.(Ed.)(1987).Dynamic assessment: An interactional approach to evaluating learning potential.New York, NY:Guilford Press.
  32. Linacre, J. M.,Wright, B. D.(1994).Chi-square fit statistics.Rasch Measurement Transactions,8(2),350.
  33. Lipnevich, A. A.,Smith, J. K.(2009).Effects of differential feedback on students' examination performance.Journal of Experimental Psychology: Applied,15(4),319-333.
  34. Maclellan, E.(2004).Initial knowledge states about assessment: Novice teachers' conceptualisations.Teaching and Teacher Education,20(5),523-535.
  35. Mertler, C. A.(2009).Teachers' assessment knowledge and their perceptions of the impact of classroom assessment professional development.Improving Schools,12(2),101-113.
  36. Mertler, C. A.(2004).Secondary teachers' assessment literacy: Does classroom experience make a difference?.American Secondary Education,33(1),49-64.
  37. Mohan, L.,Chen, J.,Anderson, C. W.(2009).Developing a multi-year learning progression for carbon cycling in socio-ecological systems.Journal of Research in Science Teaching,46(6),675-698.
  38. Neumann, I.,Fulmer, G. W.,Liang, L. L.(2013).Analyzing the FCI based on a force and motion learning progression.Science Education Review Letters,2013,8-14.
  39. Ogan-Bekiroglu, F.(2009).Assessing assessment: Examination of pre-service physics teachers' attitudes towards assessment and factors affecting their attitudes.International Journal of Science Education,31(1),1-39.
  40. Otero, V. K.,Nathan, M. J.(2008).Preservice elementary teachers' views of their students' prior knowledge of science.Journal of Research in Science Teaching,45(4),497-523.
  41. Phye, G.(Ed.)(1996).Handbook of classroom assessment.San Diego, CA:Academic Press.
  42. Plummer, J. D.,Palma, C.,Flarend, A.,Rubin, K.,Ong, Y. S.,Botzer, B.,Furman, T.(2015).Development of a learning progression for the formation of the solar system.International Journal of Science Education,37(9),1381-1401.
  43. Rasch, G.(1960).Probabilistic models for some intelligence and attainment tests.Copenhagen, Danmark:Institute of Educational Research.
  44. Sato, M.,Wei, R. C.,Darling-Hammond, L.(2008).Improving teachers' assessment practices through professional development: The case of National Board Certification.American Educational Research Journal,45(3),669-700.
  45. Shepard, L. A.(2005).Linking formative assessment to scaffolding.Educational Leadership,63(3),66-70.
  46. Shouse, A. W.,Schweingruber, H. A.,Duschl, R. A.(2007).Taking science to school: Learning and teaching science in grades K-8.Washington, DC:National Academy Press.
  47. Shute, V. J.(2008).Focus on formative feedback.Review of Educational Research,78(1),153-189.
  48. Songer, N. B.,Kelcey, B.,Gotwals, A. W.(2009).How and when does complex reasoning occur? Empirically driven development of a learning progression focused on complex reasoning about biodiversity.Journal of Research in Science Teaching,46(6),610-631.
  49. Steedle, J. T.,Shavelson, R. J.(2009).Supporting valid interpretations of learning progression level diagnoses.Journal of Research in Science Teaching,46(6),699-715.
  50. Taylor, C. S.,Nolen, S. B.(2008).Classroom assessment: Supporting teaching and learning in real classroom.Upper Saddle River, NJ:Pearson Education.
  51. Testa, I.,Galano, S.,Leccia, S.,Puddu, E.(2015).Development and validation of a learning progression for change of seasons, solar and lunar eclipses, and moon phases.Physical Review Special Topics-Physics Education Research,11(2),020102-1-020102-22.
  52. Treagust, D. F.,Jacobwitz, R.,Gallagher, J. L.,Parker, J.(2001).Using assessment as a guide in teaching for understanding: A case study of a middle school science class learning about sound.Science Education,85(2),137-157.
  53. Vygotsky, L. S.,Cole, M.(Ed. Trans.),John-Steiner, V.(Ed. Trans.),Scribner, S.(Ed. Trans.),Souberman, E.(Ed. Trans.)(1978).Mind in society: The development of higher psychological processes.Cambridge, MA:Harvard University Press.
  54. Wang, J.-R.,Kao, H.-L.,Lin, S.-W.(2010).Preservice teachers' initial conceptions about assessment of science learning: The coherence with their views of learning science.Teaching and Teacher Education,26(3),522-529.
  55. Wang, T.-H.,Wang, K.-H.,Huang. S.-C.(2008).Designing a web-based assessment environment for improving pre-service teacher assessment literacy.Computers & Education,51(1),448-462.
  56. Wang, T.-H.,Wang, K.-H.,Wang, W.-L.,Huang, S.-C.,Chen, S.-Y.(2004).Web-based assessment and test analyses (WATA) system: Development and evaluation.Journal of Computer Assisted Learning,20(1),59-71.
  57. Wang, W.-C.(2008).Assessment of differential item functioning.Journal of Applied Measurement,9(4),387-408.
  58. Wilson, M.(2008).Cognitive diagnosis using item response models.Journal of Psychology,216(2),74-88.
  59. Wilson, M.,Carstensen, C.(2005).Assessment to improve learning in mathematics: The BEAR assessment system.Journal of Educational Research and Development,1(3),27-50.
  60. Wilson, M.,Scalise, K.(2006).Assessment to improve learning in higher education: The BEAR assessment system.Higher Education,52(4),635-663.
  61. Wilson, M.,Scalise, K.,Reitze, A. M. A.,Bein, E.,Bousselot, T.,Gochyyev, P.,Vorp, R.(2010).Progress monitoring for real classroom contexts: The formative assessment delivery system.annual meeting of the American Educational Research Association,Denver, CO.:
  62. Wu, M. L.,Adams, R. J.,Wilson, M. R.(2007).ConQuest [Computer software and manual].Camberwell, Australia:Australian Council for Educational Research.
被引用次数
  1. 許婉儀,張惠環,何德華(2023)。對話者之語言能力與評分嚴苛度對印尼語口語評量成績之影響。教育心理學報，55(1)，25-46。
  2. 楊凱琳,陳建亨(2021)。題型對學生數學表現水準之影響－以相似形為例。教育科學研究期刊，66(3)，247-277。
  3. (2023)。國中綜合活動領域教師學科教學知識量表編製暨效度分析。教育心理學報，55(2)，401-424。
print cancel