研究生評鑑教師教學的結果真的可以與大學生一起比較嗎？多群祖混合MIMIC-DIF分析

Graduate Student in SRI can Really Compare with the University Student? Multi-Group Mixture MIMIC-DIF Analysis

曾明基(Ming-Chi Tseng)；邱皓政(Haw-Jeng Chiou)

多群組混合MIMIC-DIF ； 學生評鑑教師教學 ； Multi-group Mixture MIMIC-DIF ； Student Ratings of Instruction

測驗學刊

62卷1期（2015 / 03 / 01）

1 - 23

繁體中文

本研究主要探討研究生在「學生評鑑教師教學量表」的結果是否可以與大學生一起比較。研究對象為東部某大學大學部以及研究所的學生，總樣本數為6,958人，其中大學生為6,604人，研究生為354人。研究結果顯示，東部某大學的「學生評鑑教師教學量表」確實在研究生以及大學生之間存在DIF現象：無論是外顯組別比較，或是學生的潛在異質差異比較，以及進一步在多群組架構下考慮學生的潛在異質差異，皆顯示「學生評鑑教師教學量表」存在DIF。當學生評鑑教師教學同時採計研究生以及大學生的分數時，將產生評鑑不公平的結果，因在研究所開課數較多的老師較容易通過評鑑。針對上述結果，本研究對學生評鑑教師教學提出相關的建議。

The purpose of this study was to investigate graduate student in SRI can really compare with the university student. The total number of samples was 6,958 students in a university on the east coast of Taiwan. The results show that between graduate student and university student in SRI, the item have DIF. Whether explicit comparison groups, or student's potential heterogeneity differ and further considered in the framework of multi-group heterogeneity of student potential differences in student ratings are displayed scale exist DIF. It will produce unfair results evaluation, at the Institute commenced a few more easier through teacher evaluation. Based on the results from this study, the recommendations for university teaching and student ratings of instruction are made.

1. 曹嘉秀、魏孟雪(2003)。影響學生評鑑教學之背景因素探討。測驗學刊，50(1)，143-161。
   連結：
2. 曾明基、邱于真、張德勝、羅寶鳳(2013)。以學生評鑑教師教學量表決定教師開課或去留可行嗎？混合 IRT 分析取向。教育科學研究，58(1)，91-116。
   連結：
3. 曾明基、邱于真、張德勝、羅寶鳳(2011)。學生認知歷程對學生評鑑教師教學的影響：階層線性模型分析。課程與教學季刊，14(3)，157-180。
   連結：
4. 黃瓊蓉(2004)。使用階層線性模型分析學生評量教學績效之資料。測驗學刊，51(2)，163-184。
   連結：
5. Clark, S. L., Muthén, B., Kaprio, J., D'Onofrio, B. M., Viken, R., Rose, R. J., Smalley, S. L. (2009). Models and strategies for factor mixture analysis: Two examples concer-ning the structure underlying psychological disorders. (Manuscript submitted for pub-lication).
6. Asparouhov, T.,Muthén, B.(2006).Mplus Web Notes, 10Mplus Web Notes, 10,未出版
7. Asparouhov, T.,Muthén, B.(2012).Mplus Web Notes, 15.Mplus Web Notes, 15.,未出版
8. Bakk, Z.,Tekle, F.,Vermunt, J. K..Estimating the association between latent class membership and external variables using bias adjusted three-step approaches.Sociological Methodology
9. Bilir, M. K.(2009).Tallahassee, FL,Florida State University.
10. Bollen, K.A.(Ed.),Long, J. S.(Ed.)(1993).Testing structural equation models.Newbury Park, CA:Sage.
11. Bolt, D. M.,Cohen, A. S.,Wollack, J. A.(2001).A mixture item response model for mul-tiple-choice data.Journal of Educational and Behavioral Statistics,26,381-409.
12. Celeux, G.,Soromenho, G.(1996).An entropy criterion for assessing the number of clusters in a mixture model.Journal of Classification,13,195-212.
13. Centra, J. A.(1993).Reflective faculty evaluation.San Francisco, CA:Jossey-Bass.
14. Chang, T.(2001).Student ratings: What teachers college students telling us about them?.Journal of Jinan University,5(2),169-192.
15. Cho, S. J.,Cohen, A. S.(2010).A multilevel mixture IRT model with applications to DIF.Journal of Educational and Behavioral Statistics,35,336-370.
16. Clark, S. L.(2010).Los Angeles, CA,University of California.
17. De Ayala, R. J.,Kim, S. H.,Stapleton, L. M.,Dayton, C. M.(2002).Differential item functioning: A mixture distribution conceptualization.International Journal of Testing,2,243-276.
18. Frühwirth-Schnatter, S.(2006).Finite mixture and markov switching models.New York, NY:Springer.
19. Hancock, G. R.(Ed.),Samuelsen, K. M.(Ed.)(2008).Advances in latent variable mixture models.Charlotte, NC:Information Age Publishing.
20. Lo, Y.,Mendell, N. R.,Rubin, D. B.(2001).Testing the number of components in a normal mixture.Biometrics,88,767-778.
21. Lubke, G. H.,Muthén, B.(2007).Performance of factor mixture models as a function of model size, covariate effects, and class-specific parameters.Structural Equation Modeling: A Multidisciplinary Journal,14,26-47.
22. McLachlan, G.,Peel, D.(2000).Finite mixture models.New York, NY:John Wiley & Sons.
23. Muthen, L. K.,Muthen, B. O.(2006).Mplus user's guide.Los Angeles, CA:Author.
24. Nylund, K. L.,Asparouhov, T.,Muthén, B.(2006).Deciding on the number of classes in latent class analysis and growth mixture modeling: A monte carlo simulation study.Structural Equation Modeling,14(4),535-569.
25. Rost, J.(1990).Rasch models in latent classes: An integration of two approaches to item analysis.Applied Psychological Measurement,14,271-282.
26. Samuelsen, K.(2005).College Park, MD,University of Maryland.
27. Vermunt, J. K.(2010).Latent class modeling with covariates: Two improved three-step ap-proaches.Political Analysis,18(4),450-469.
28. Wang, W. C.,Shih, C. L.,Sun, G. W.(2012).The DIF-free-then-DIF strategy for the assessment of differential item functioning.Educational and Psychological Measurement,72(4),687-708.
29. 黃毅志、巫有鎰(2003)。影響教學評鑑得分因素之探討：以臺東師院為例。臺東師院學報，14(1)，347-370。

1. 陳承德、孫國瑋、施慶麟(2018)。DIF成因之初探：試題特徵與差異試題功能之關聯。教育心理學報，50(2)，167-188。
2. 羅恩冕、郭昭佑(2018)。我國大學學生評鑑教師教學指標之研究：概念構圖法的調整應用。教育研究與發展期刊，14(1)，1-33。
3. 邱皓政、林碧芳(2016)。孰優、孰弱？臺灣學生學習成就軌跡之異質性分析。當代教育研究季刊，24(1)，033-079。
4. (2022)。研究生和大學生的學生評鑑教師教學分數真的要一起比較嗎？傾向值結構方程模型分析。教育與心理研究，45(2)，35-57。
5. (2024)。東部某大學的「學生評鑑教師教學量表」分數之排序：貝氏多層次隨機效果模型分析。測驗學刊，71(1)，95-117。