中學科學教師評量素養量表發展之信效度與恆等性分析

Examining the Validity and Measurement Invariance of an Assessment Literacy Inventory for Secondary Science Teachers

10.6173/CJSE.202212_30(4).0002

張仁誠(Ren-Cheng Zhang)；洪菁穗(Ching-Sui Hung)；吳心楷(Hsin-Kai Wu)

信效度 ； 恆等性分析 ； 科學教師評量素養 ； 量表發展 ； Reliability and Validity ； Measurement Invariance Analysis ； Teacher Assessment Literacy ； Instrument Development

科學教育學刊

30卷4期（2022 / 12 / 01）

309 - 333

繁體中文;英文

本研究目的在發展一份適用於臺灣國高中科學教師評量素養之量表，並進行量表信效度與恆等性之分析。此量表基於Abell與Siegel（2011）評量素養模型之構念與架構所編製，本研究檢驗量表之信效度，並檢驗跨性別與教育階段群體之測量恆等性，以確保在不同群體間皆能測量到相同的評量素養之構念組成。本研究的預試資料來自100位北部國高中科學教師，而正式施測收集到北部地區140所學校，872位中學科學教師之量表資料。本研究使用預試資料進行項目分析和探索性因素分析，正式施測資料則以驗證性因素分析與測量恆等性分析來處理。全部量表題項經分析刪減後，共包含35題。項目分析、探索性因素分析與驗證性因素分析結果支持Abell與Siegel評量素養模型架構。經刪題後，各構念題項呈現良好的信效度，且透過恆等性分析顯示量表具優良的跨性別群組及跨國高中階段測量的穩定性。

The purpose of this study was to develop an inventory for measuring secondary science teachers' assessment literacy and to examine its validity and measurement invariance across gender and educational levels (i.e., junior and senior high schools). The inventory was developed based on a model for science teacher assessment literacy proposed by Abell and Siegel (2011). The inventory was piloted with 100 secondary science teachers in Northern Taiwan. The pilot data were used to conduct the item analysis and exploratory factor analysis. For the main study, data were collected from 872 science teachers teaching at 140 secondary schools in Northern Taiwan. The data collected from the main study were examined by confirmatory factor analysis, and the measurement invariance across gender and educational levels was tested. As a result of the analyses, the inventory was trimmed to 35 items. The results showed good reliability and validity of the items and confirmed the constructs and structure of Abell and Siegel's model. Additionally, the results of measurement invariance testing indicate that this inventory measured the same constructs in the same way across different groups. The factor structure of the model was stable across gender and educational levels.

1. 李俊賢, C.-H.,黃芳銘, F.-M.,李孟芳, M.-F.(2016)。年輕族群男女在消費型態量表的測量恆等性研究。管理與系統，23(2)，273-302。
   連結：
2. Abell, S. K.,Siegel, M. A.(2011).Assessment literacy: What science teachers need to know and be able to do.The professional knowledge base of science teaching
3. Alkharusi, H.(2011).Psychometric properties of the teacher assessment literacy questionnaire for preservice teachers in Oman.Procedia—Social and Behavioral Sciences,29,1614-1624.
4. American Federation of Teachers,National Council on Measurement in Education,National Education Association(1990).Standards for teacher competence in educational assessment of students.Educational Measurement: Issues and Practice,9(4),30-32.
5. Arrindell, W. A.,van der Ende, J.(1985).An empirical test of the utility of the observations-to-variables ratio in factor and components analysis.Applied Psychological Measurement,9(2),165-178.
6. Black, P.,Wiliam, D.(1998).Assessment and classroom learning.Assessment in Education: Principles, Policy & Practice,5(1),7-74.
7. Brookhart, S. M.(2011).Educational assessment knowledge and skills for teachers.Educational Measurement: Issues and Practice,30(1),3-12.
8. Chan, K.-W.,Elliott, R. G.(2004).Relational analysis of personal epistemology and conceptions about teaching and learning.Teaching and Teacher Education,20(8),817-831.
9. Cheung, G. W.,Rensvold, R. B.(2002).Evaluating goodness-of-fit indexes for testing measurement invariance.Structural Equation Modeling: A Multidisciplinary Journal,9(2),233-255.
10. DeLuca, C.,LaPointe-McEwan, D.,Luhanga, U.(2016).Teacher assessment literacy: A review of international standards and measures.Educational Assessment, Evaluation and Accountability,28(3),251-272.
11. DeLuca, C.,LaPointe-McEwan, D.,Luhanga, U.(2016).Approaches to classroom assessment inventory: A new instrument to support teacher assessment literacy.Educational Assessment,21(4),248-266.
12. Demirdöğen, B.,Korkut, H. M.(2021).Does teacher education matter? Comparison of education and science major teachers’ assessment literacy.Eğitimde Nitel Araştırmalar Dergisi,26,23-52.
13. Dyer, W. J.(2015).The vital role of measurement equivalence in family research.Journal of Family Theory & Review,7(4),415-431.
14. Fornell, C.,Larcker, D. F.(1981).Structural equation models with unobservable variables and measurement error: Algebra and statistics.Journal of Marketing Research,18(3),382-388.
15. Gotch, C. M.,French, B. F.(2014).A systematic review of assessment literacy measures.Educational Measurement: Issues and Practice,33(2),14-18.
16. Gottheiner, D. M.,Siegel, M. A.(2012).Experienced middle school science teachers’ assessment literacy: Investigating knowledge of students’ conceptions in genetics and ways to shape instruction.Journal of Science Teacher Education,23(5),531-557.
17. Grob, R.,Holmeier, M.,Labudde, P.(2021).Analysing formal formative assessment activities in the context of inquiry at primary and upper secondary school in Switzerland.International Journal of Science Education,43(3),407-427.
18. Hair, J. F.,Black, W. C.,Babin, B. J.,Anderson, R. E.(2019).Multivariate data analysis.Cengage.
19. Izci, K.,Siegel, M. A.(2019).Investigation of an alternatively certified new high school chemistry teacher’s assessment literacy.International Journal of Education in Mathematics, Science and Technology,7(1),1-19.
20. Jarr, K. A.(2012).University of Iowa.
21. Kline, P.(2014).An easy guide to factor analysis.Routledge.
22. Latif, M. W.(2021).Exploring tertiary EFL practitioners’ knowledge base component of assessment literacy: Implications for teacher professional development.Language Testing in Asia,11(1),Article 19.
23. Magnusson, S.,Krajcik, J.,Borko, H.(1999).Nature, sources, and development of pedagogical content knowledge for science teaching.Examining pedagogical content knowledge
24. McMillan, J. H.(2001).Secondary teachers’ classroom assessment and grading practices.Educational Measurement: Issues and Practice,20(1),20-32.
25. Means, B.,Chen, E.,DeBarger, A.,Padilla, C.(2011).,未出版
26. Ogan-Bekiroglu, F.,Suzuk, E.(2014).Pre-service teachers’ assessment literacy and its implementation into practice.The Curriculum Journal,25(3),344-371.
27. Pajares, M. F.(1992).Teachers’ beliefs and educational research: Cleaning up a messy construct.Review of Educational Research,62(3),307-332.
28. Pastore, S.,Andrade, H. L.(2019).Teacher assessment literacy: A three-dimensional model.Teaching and Teacher Education,84,128-138.
29. Popham, W. J.(2009).Assessment literacy for teachers: Faddish or fundamental?.Theory into Practice,48(1),4-11.
30. Quilter, S. M.,Gallini, J. K.(2000).Teachers’ assessment literacy and attitudes.The Teacher Educator,36(2),115-131.
31. Siegel, M. A.,Wissehr, C.(2011).Preparing for the plunge: Preservice teachers’ assessment literacy.Journal of Science Teacher Education,22(4),371-391.
32. Starck, J. R.,Richards, K. A. R.,O’Neil, K.(2018).A conceptual framework for assessment literacy: Opportunities for physical education teacher education.Quest,70(4),519-535.
33. Stiggins, R. J.(1995).Assessment literacy for the 21st century.Phi Delta Kappan,77(3),238-245.
34. Stiggins, R. J.(1991).Assessment literacy.Phi Delta Kappan,72(7),534-539.
35. Talanquer, V.,Tomanek, D.,Novodvorsky, I.(2013).Assessing students’ understanding of inquiry: What do prospective science teachers notice?.Journal of Research in Science Teaching,50(2),189-208.
36. Vandenberg, R. J.,Lance, C. E.(2000).A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research.Organizational Research Methods,3(1),4-70.
37. Vogt, K.,Tsagari, D.,Csépes, I.,Green, A.,Sifakis, N.(2020).Linking learners’ perspectives on language assessment practices to Teachers’ Assessment Literacy Enhancement (TALE): Insights from four European countries.Language Assessment Quarterly,17(4),410-433.
38. Wang, J.-R.,Kao, H.-L.,Lin, S.-W.(2010).Preservice teachers’ initial conceptions about assessment of science learning: The coherence with their views of learning science.Teaching and Teacher Education,26(3),522-529.
39. Xu, Y.,Brown, G. T. L.(2016).Teacher assessment literacy in practice: A reconceptualization.Teaching and Teacher Education,58,149-162.
40. Yan, Z.,Pastore, S.(2022).Are teachers literate in formative assessment? The development and validation of the Teacher Formative Assessment Literacy Scale.Studies in Educational Evaluation,74,Article 101183.
41. 吳明隆, M.-L.(2007).SPSS操作與應用：問卷統計分析實務.五南=Wu-Nan.
42. 吳明隆, M.-L.(2009).結構方程模式：方法與實務運用.麗文文化=Liwen Cultural.