內外注意係數異常作答診斷空間的建立與探證

Establishing and Examining the Diagnostic Space of Two New Developed Person-Fit Indices: The W(superscript *) and the B(superscript *) Indices

10.7108/PT.201103.0001

黃財尉(Tsai-Wei Huang)

內注意係數 ； 外注意係數 ； 異常作答組型 ； 診斷空間 ； Aberrant Response Patterns ； Beyond-Ability-Surprise Index B(superscript *) ； Diagnostic Space ； Within-Ability-Concern Index W(superscript *)

測驗學刊

58卷1期（2011 / 03 / 01）

1 - 27

繁體中文

本研究旨在探討內外注意係數的診斷空間關係，利用群集分析技術，以內注意係數(W(上標 *))與外注意係數(B(上標 *))的指標值作為區別受試群診斷空間的空間軸向，並以指標各自均差比(M/SD)作為異常作答歸群的依據，分為內顯、內偏、均等、外偏，與外顯等異常作答類型，最後則配合W(上標 *)與B(上標 *)第90、95與99的百分位數平均決斷值，作為國小數常識測驗實徵資料在指標診斷空間的參照依據。研究結論如下：(1)高能力群偏向於能力內該對卻錯的異常作答，易產生較多內偏型與內顯型的異常作答分配；而低能力群偏向該錯卻對的異常作答，易產生外偏型與外顯型的異常作答分配；至於中能力群則分布在內偏型、均等型與外偏型之間；(2)在與真實資料（高難度試題集）比對的結果顯示，高能力群資料組比較適合二個與四個群集數，低能力群的資料組適合三個群集數的分類，而中能力群資料組則皆適合這三種群集數；(3)結合指標決斷值互相配合解釋，可以進一步有效檢視不同分群類型的異常作答情形的嚴重程度。文末並提供異常作答類型的歸類與使用內外注意係數時的實務應用建議。

The main purpose of this study was to establish and examine the diagnostic-space relationships of two new developed indices, the within-ability-concern index (W(superscript *)) and the beyond-ability-surprise index (B(superscript *)). The diagnostic space expanded by the W(superscript *) and B(superscript *) coordinate axes were established after two runs of cluster analyses. Also after the proportions of mean to standard deviation of W(superscript *) and B(superscript *) indices were calculated, respectively, a ratio of the B(superscript *) proportion to the W(superscript *) proportion were calculated again for setting the five aberrant response patterns (manifest W(superscript *), slight W(superscript *), equal-aberrance, slight B(superscript *), manifest B(superscript *)) on the ratio line from left to right. Finally, combining the 90th, 95th, and 99th percentiles of W(superscript *) and B(superscript *) cutoff scores as the referred points of aberrant response patterns were set for interpreting an empirical data set from the number sense test for elementary school students. Findings showed that (1) high ability students leaned to be classified as the aberrant response clusters of ”slight W(superscript *)” and ”manifest W(superscript *)”; low ability students tended to be clustered as the patterns of ”slight B(superscript *)” and ”manifest B(superscript *)”; as the medium ability students, a distribution of the aberrant response patterns of ”slight W(superscript *)”, ”equal-strength”, and ”slight B(superscript *)” were found; (2) in the empirical comparisons, high-ability-high-difficulty (Hh) students were suited for being clustered into 2 or 4 groups, 3 groups were adequate low-ability-high-difficulty students (Lh), but middle-ability-high-difficulty students (Mh) were suited for all these three groups; (3) it is effective to examine individuals' aberrant response clusters by interpreting the percentiles of W(superscript *) and B(superscript *) cutoff scores. Finally, many suggestions about the classification of aberrant response patterns and the use of the two indices were also provided in text.

1. 郭伯臣(2005)。統計樣式辨認於測驗資料的應用。測驗統計年刊，13，146-170。
   連結：
2. 黃財尉(2008)。不同資料結構下異常作答指標決斷的探討。輔導與諮商學報，30，1-6。
   連結：
3. 盧志明、黃財尉、方將任(2007)。Guttman型異常作答指標偵測例的研究。測驗學刊，54，147-174。
   連結：
4. 盧志明、黃財尉（2004）。內外注意係數指標虛擬排序程式（Visual Basic 6.0）。未出版程式。
5. Birenbaum, M.,Tatsuoka, K. K.(1993).Applied an IRT-based cognitive diagnostic model to diagnose students' knowledge states in multiplication and division with exponents.Applied Measurement in Education,6(4),225-268.
6. Buck, G.,Tatsuoka, K. K.(1998).Application of the rule-space procedure to language testing: Examining attributes of a free response listening test.Language Testing,15(2),119-157.
7. Cramer, K. A.,Post, T. R.,delMas, R. C.(2002).Initial fraction learning by fourth-and fifth-grade students: A comparison of the effects of using commercial curricula with the effects of using the rational number project curriculum.Journal for Research in Mathematics Education,33(2),111-144.
8. D''Costa, A.(1993).Extending the Sato caution index to define the within and beyond ability caution indexes.convention of National Council for Measurement in Education,Atlanta, GA.:
9. Edgington, E. S.(1995).Randomization tests.NY:Marcel Dekker.
10. Good, P.(1994).Permutation tests.NY:Springer.
11. Hair, J. F.,Anderson, R. E.,Tatham, R. L.,Black, W. C.(2006).Multivariate data analysis.NJ:Prentice-Hall.
12. Huang, T. W.(2002).OH,The Ohio State University.
13. Huang, T. W.(2006).Aberrant response diagnoses by the Beyond-Ability-Surprise Index (B*) and the Within-Ability-Concern Index (W*).Proceedings of 2006 Hawaii International Conference on Education
14. Kenney, P. A.(ed.),Silver, E. A.(ed.)(1997).Results from the sixth mathematics assessment of the National Assessment of Education Progress.Reston, VA:NCTM.
15. Linacre, J. M.,Wright, B. D.(2000).A user's guide to WINSTEPS: Rasch-model computer program.Chicago, IL:MESA Press.
16. Pohlmann, J. M.,Perkins. K.,Brutten, S.(1999).meeting of the Mid-Western Education Researcher Association.Chicago, IL:
17. Rodgers, J. L.(1999).The bootstrap, the jackknife, and the randomization test: A sampling taxonomy.Multivariate Behavioral Research,34,441-456.
18. Tatsuoka, K. K.(1985).A probabilistic model for diagnosing misconceptions by the pattern classification approach.Journal of Educational Statistics,50,55-73.
19. Tatsuoka, K. K.(1990).Toward an integration of item response theory and cognitive analysis.Diagnostic monitoring of skill and knowledge acquisition,Hillsdale, NJ:
20. Tatsuoka, K. K.(1983).Rule-space: An approach for dealing with misconceptions based on item response theory.Journal of Educational Measurement,20,34-38.
21. Tatsuoka, K. K.(1984).Caution indices based on item response theory.Psychometrika,49,95-110.
22. Tatsuoka, K. K.,Coter, J. E.,Tatsuoka, C.(2004).Patterns of diagnosed mathematical content and process skills in TIMSS-R across a sample of 20 countries.American Educational Research Journal,41(4),901-926.
23. Tatsuoka, K. K.,Linn, R. L.(1983).Indices for detecting unusual patterns: Links between two general approaches and potential applications.Applied Psychological Measurement,7,81-96.
24. Tatsuoka, K. K.,Tatsuoka, M. M.(1992).Research ReportResearch Report,Princeton, NJ:Educational Testing Services.
25. Tatsuoka, K. K.,Tatsuoka, M. M.(1987).Bug distribution and statistical pattern classification.Psychometrika,52,193-206.
26. Timm, N. H.(2002).Applied multivariate analysis.New York:Springer-Verlag Inc..
27. 余民寧(2002)。教育測驗與評量─成就測驗與教學評量。台北市:心理。
28. 林姿飴(2005)。碩士論文(碩士論文)。嘉義縣，國立嘉義大學數學教育研究所。
29. 林震岩(2006)。多變量分析─SPSS的操作與應用。台北市:智勝文化。
30. 郭伯臣(1998)。從S-P表到規則空間。測驗與輔導，146，3016-3018。
31. 黃財尉(2005)。內外注意係數指標決斷值的建立與檢視。嘉義市:濤石文化。
32. 黃財尉(2004)。國科會研究成果報告國科會研究成果報告,國科會。
33. 葉俊谷、楊德清、黃財尉(2006)。國小六年級學童在數常識異常作答之探究。數學教育研究與發季刊，44，58-77。

1. 黃財尉,沈采瑱(2019)。二元計分的BW作答機率模式精確度研究：蒙地卡羅法。測驗學刊，66(4)，347-375。