競技運動評分者系統性偏誤之探查

A Detecting of the Systemic Bias of Rater in Sports

10.6194/SCS.2014.34.02

姚漢禱(Han-Dau Yau)

多層面Rasch測量 ； 評分者差異函數 ； 個人差異函數 ； 評分者趨中效應 ； many-facet Rasch measurement ； differential rater functioning ； differential person functioning ； rater centrality effect

運動教練科學

34期（2014 / 06 / 01）

11 - 21

繁體中文

本研究目的在於探查評分者的系統性偏誤。研究資料是標槍投擲技術測驗，共有18名選手，每人試擲三次，由五位評分者針對十三項投擲技術，給予三個等級的評定。研究方法採用多層面Rasch測量（Many-Facet Rasch Measurement, MFRM），利用Facets程式交叉分析個人和評分者、試題和評分者的測量差異，探查評分者系統性偏誤。研究結果：一、個人層面和評分者層面、試題層面和評分者層面的交叉分析，發現都是隨機性偏誤。二、評分者在個人的系統性偏誤：（一）A評分者對8號個人的評分高估。（二）A評分者對11號和17號個人的評分低估。三、評分者在試題的系統性偏誤為A評分者在第5題的評分高估。結論：MFRM能夠探查競技運動主觀評分之評分者系統性偏誤。

The purpose of this study was to detect the systemic bias of raters. The data was a Javelin throwing skills testing. The subjects were 18 javelin players that each player threw the javelin three times. Then five raters gave each trial a three-grade assessment in the thirteen skills of Javelin throwing. The Many-Facet Rasch Measurement (MFRM) was applied to the research method. The method was to use Facets program to cross analyze the measured differences between the persons and raters, items and raters. It detected the systemic bias of rater in sports. The Results were: 1. the cross-analysis between the persons and raters, items and raters of inter facets existed randomness bias. 2. The systemic bias of the raters for each person: (1) the rater A rated higher bias measure for No. 8 person. (2) The rater A rated lower bias measure for No. 11 and No. 17 person. 3. The systemic bias of the raters for each item was that rater A was rating higher bias measure for the 5th item. The conclusion: using the MFRM can be detected the rater's systemic bias in the subjective rate of sports.

1. 姚漢禱、邱炳坤、陳詩園(2009)。反曲弓射箭競賽項目技術表現分析。測驗統計年刊，17(1)，23-38。
   連結：
2. Arvey, R. D.,Murphy, K. R.(1998).Performance evaluation in work settings.Annual Review of Psychology,49,141-168.
3. Brennan, R. L.(2001).Generalizability theory.New York:Springer-Verlag.
4. Christ, T. J.,Riley-Tillman, T. C.,Chafouleas, S.,Jaffery, R.(2011).Direct behavior rating: An evaluation of alternate definitions to assess classroom behaviors.School Psychology Review,40(2),181-199.
5. Feldman, J.(1981).Beyond attribution theory: Cognitive processes in performance appraisal.Journal of Applied Psychology,66(2),127-148.
6. Latham, G. P.,Wexley, K. N.(1994).Increasing productivity through performance appraisal.Reading, MA:Addison-Wesley.
7. Linacre, J. M.(1989).Many-facet Rasch measurement.Chicago, IL:MESA Press.
8. Linacre, J. M.(2002).Judging debacle in pairs figure skating.Rasch Measurement Transactions,15(4),839-840.
9. Looney, M. A.(2004).Evaluating judge performance in sport.Journal of Applied Measurement,5(1),31-47.
10. Lynch, B. K.,McNamara, T. F.(1998).Using G-theory and many-facet rasch measurement in the development of performance assessments of the ESL speaking skills of immigrants.Language Testing,15(2),158-180.
11. Nunnally, J. C.,Bernstein, I. H.(1994).Psychometric theory.New York:McGraw-Hill.
12. Riley-Tillman, T. C.,Chafouleas, S. M.,Christ, T.,Briesch, A. M.,LeBel, T. J.(2009).The impact of item wording and behavioral specificity on the accuracy of Direct Behavior Ratings (DBRs).School Psychology Quarterly,24(1),1-12.
13. Ure, A. C.(2011).Provo, Utah,Brigham Young University.
14. Wolfe, E. W.(2004).Identifying rater effects using latent trait models.Psychology Science,46(1),35-51.
15. Yue, X.(2011).Blacksburg, VA,Virginia Polytechnic Institute.
16. 彭恒利、俞韞燁(2012)。主觀性試題網上評閱趨中評分控制研究初探。第十屆海峽兩岸心理與教育測驗學術研討會，江西:
17. 曾盟堡(2001)。碩士論文(碩士論文)。桃園縣，國立體育學院體育研究所。

1. 陸雲鳳(2016)。利用評分者差異函數偵測主觀評分之議題。運動教練科學，43，17-24。