以a-鄰近法為選題策略之電腦化適性測驗系統

A Computerized Adaptive Test System Based on a-Nearest-Neighbor Strategy

10.6773/JRMS.200812.0003

陳世銘(Shih-Ming Chen)；張俊欽(Chun-Chin Chang)；郭伯臣(Bor-Chen Kuo)

電腦適性測驗 ； 試題反應理論 ； 選題策略 ； 曝光率控制 ； Computerized Adaptive Testing ； Item Response Theory ； Selection criterion ； Item exposure control

測驗統計年刊

16期_上（2008 / 12 / 01）

33 - 54

繁體中文

本研究主要目的是以王淑卿(2005)三年級數學領域能力指標為基礎之題庫，匯集測驗理論、曝光率控制與電腦網際網路等相關技術，建置一套三年級數學科能力指標為基礎的電腦適性測驗評量系統。 在研究方法上，結合試題反應理論和a-鄰近選題法之電腦適性測驗評量模式，在適性測驗系統施測時，即進行試題曝光率的控制以及受試者能力值的精確估計，並將所有學生的答題歷程記錄彙整成為曝光率控制的數據。 研究結果發現： 一、以試題反應理論為基礎的電腦適性測驗評量系統，可以快速且正確將學生作答情形分析，達成受試者能力值的估計。 二、透過以a-鄰近法為選題策略之電腦適性測驗評量模式，可以有效達成曝光率控制的目的。 三、以a-鄰近法為選題策略之電腦適性測驗評量模式，可以有效節省時間和試題。

Computerized adaptive test can be used to test the students in accordance with their capabilities, which not only shorten the testing time but also accurately evaluate the performance of the students. The successful elements of CAT are defined by the accuracy of traits estimation and the control of testing items exposure rate. To date, the study in the controlling item exposure rate is conducted by the computerized simulation system, which was not an actual system available for testers. The purpose of the study is to develop an online Computerized Adaptive Testing System for testing the primary school-the third grade on their mathematics competence. The system is building upon the testing item bank of ”Mathematics Competence Indicators for primary school third grade”, Shu-Ching Wang (2005), and incorporating the techniques of testing theory, the controlling of testing item exposure rate and the Internet network. Regarding the research methods, the Computerized Adaptive Testing System, which is incorporated with the Item Response Theory and a-Nearest-Neighbor Strategy, proceeds with controlling the testing item exposure rate and can accurately estimate testers competences. Furthermore, the records of response procedures of all students are collected as the data for controlling exposure rate. The research results are as follows: 1. The Computerized Adaptive Testing System, building upon Testing Item response theory, can be used to analyze students problem solving and responding capabilities in an instant and accurate manner. 2. The Computerized Adaptive Testing System, building upon a-Nearest-Neighbor Strategy for testing item selection, can be used as an efficient approach to control item exposure rate. 3. The Computerized Adaptive Testing System, building upon a-Nearest-Neighbor Strategy for testing item selection, can effectively shorten the testing time and decrease the quantity of testing items.

1. 謝友詩、劉湘川、郭伯臣(2006)。台中市，國立台中師範學院教育測驗統計研究所。
   連結：
2. Birnbaum, A.,F. M. Lord,M. R. Novick(1968).Statistical theories of mental test scores (chapter 17-20).Reading, Mass:Addison-Wesley.
3. Chang, H. H.,Qian, J.,Ying, Z.(2001).A-Stratified Multistage Computerized Adaptive Testing with b Blocking.Applied Psychological Measurement,25,333-341.
4. Chang, H. H.,Ying, Z.(1999).A-Stratified Multistage Computerized Adaptive Testing.Applied Psychological Measurement,23,211-222.
5. Chang, S. W.(1998).Iowa City,University of Iowa.
6. Chang, S. W.,Ansley, T. N.(2003).A Comparative study of item exposure control methods in Computerized Adaptive Testing.Joural of Educational Measurement,40,71-103.
7. Cheng, P. E.,Liou, M.(2003).Computerized Adaptive Testing Using the Nearest-Neighbors Criterion.Applied Psychological Measurement,27,204-216.
8. Hambleton, R. K.,waminathan, H.(1985).Item response theory: Principles and applications.Hingham, MA:Kluwer Boston, Inc.
9. Hau, K. T.,Chang, H. H.(2001).Item Selection in Computerized Adaptive Testing: Should More Discriminating Items be Used First?.Journal of Educational Measurement,38,249-266.
10. Hung, P. H.(1988).R. O. C. unpublished doctoral dissertation.Minnesota:University of Minnesota.
11. Leung, C.K.,Chang, H. H.,Hau, K. T.(2002).Item Selection in Computerized Adaptive Testing: Improving the a-stratified design with the Sympson-Hetter algorithm.Applied Psychological Measurement,26,376-392.
12. Lord, F. M.(1980).Applications of item response theory to practional testing problems.Hillsdale, NJ:Lawrence Erlbawn Associates.
13. Lord, F. M.(1977).A broad-range tailored test of verbal ability.Applied Psychological Measurement,1(1),95-100.
14. McBride, J. R.,Martin, J. T.,D. J. Weiss (ED.)(1983).Reliability and validity of adaptive ability tests in a military setting.New horizons in testing.
15. Mills, C. N.,Stocking, M. L.(1996).Practical issues in large-scale computerized adaptive testing.Applied Psychological Measurement,9(4),287-304.
16. Stocking, M. L.(1994).Three practical issues for modern adaptive testing item pools.Princeton, NJ:Educational Testing Service.
17. Sympson, J. B.,Hetter, R. D.(1985).Proceeding of the 27th Annual meeting of the Military Testing Association.San Diego, CA:Navy Personnel Research and Development Center.
18. Wang, T.,Vispoel, W. P.(1998).Properties of ability estimation methods in computerized adaptive testing.Journal of Educational Measurement,35,109-135.
19. Weiss, D. J.(1974).Research Report 74-5, Psychometric Methods Program, Department of Psychology.Minneapolis:University of Minnesota.
20. 王淑卿(2005)。台中縣，臺中健康暨管理學院資訊工程學系。
21. 古松民(2001)。線上適性測驗系統。資訊與教育雜誌，84，61-69。
22. 何榮桂(1991)。題庫中項目參數分配型態對電腦化適性測驗選題的影響。測驗年刊，38，71-96。
23. 余民寧(1992)。試題反應理論的介紹（十二）：電腦化適性測驗。研習資訊，10(5)，5-9。
24. 余民寧(1992)。試題反應理論的介紹（三）：試題反應模式及其特性。研習資訊，9(2)，6-10。
25. 李信宏、陳建榮(2002)。行政院國家科學委員會專題研究計畫行政院國家科學委員會專題研究計畫,未出版
26. 陳俊宏(2004)。台中市，國立台中師範學院教育測驗統計研究所。
27. 陳建榮(2001)。彰化市，國立彰化師範大學數學系。
28. 陳淑英(2004)。行政院國家科學委員會專題研究計畫行政院國家科學委員會專題研究計畫,未出版
29. 鄧景麟(2005)。台中縣，臺中健康暨管理學院資訊工程學系。
30. 錢永財、劉家惠、郭伯臣(2005)。a-鄰近法選題對電腦適性測驗試題曝光率之比較。2005年教育與心理測驗學術研討會