90-93年度國中基測量尺及等化程序之個案研究

Scaling and Equating Problems of the Basic Competence Test for Junior High School Students

10.29973/JCSA.200712.0005

林妙香(Miao-Hsiang Lin)

量尺分數 ； 測驗量化 ； IRT模式 ； 測驗等化 ； 連結 ； 強真分數理論 ； 均等測量標準誤量尺分數形態 ； beta-binomial貝氏模式 ； Rasch模式 ； Test scaling and equating ； IRT-Rasch model ； the BCT ； score scale ； beta-binomial model ； arcsin transformation ； compound binomial error model ； strong-true score theory

中國統計學報

45卷4期（2007 / 12 / 01）

402 - 436

繁體中文

基测實施六年來，公眾隱約可感受到基測計算方式可模糊前段及後段學生差距：一般大眾在艱澀學理如同黑箱作業下，無法判斷中段學生差距是否也被模糊了。由分發結果而言，中段學生差距之模糊可造成公、私立學校分發落差，連帶地使家長承擔不同對等的經濟負擔。 鑑於一般大眾無法針砭基测量尺分數計算方式是否影響考生及家長權益，本文檢驗及分析基測量尺分數是否滿足程序正義的計算方式。此程序正義包括三個參照基準點：一爲正確的學理應用：二爲內部計分流程應與公佈於大眾的「計分遊戲規則」相符相合；三爲擇優政策隱含的名次排擠效應的資訊應該透明化。 本文主要的發現：師大心理與測驗發展中心（心測中心）在計算量尺分數的過程中，存在著一些不尋常的地方：一是各個考科在計分過程中的最高分並非設定在60分，且各個科目在各個年度都不相同：二是第二次測驗量尺並無等化(equating)步驟，只是單純進行分數連結(linking)。本文依據此二不尋常的地方質疑心測中心計算量尺分數的缺失。

The Basic Competence Test (BCT) for junior high school students was developed and administered in 2001 by the research center for psychological and educational testing of the National Taiwan Normal University. The BCT is a test battery consisting of tests in five areas: Chinese, English, math, natural science, and social science. The BCT is administered twice annually. In the admissions to the post secondary high schools, students are ranked from high to low based on the composite scores of the BCT. The research center adopted the ACT scaling procedure for converting test raw scores to scale scores (1-60) and used IRT-Rasch method for equating scores on two forms of each test area. This study assesses the fairness of the scaling and equating procedures by the research center. The main findings of this study are: 1) the range used for the raw-to-scale conversions is not consistent across five test areas; 2) it is a linking procedure rather than an equating procedure that is used for transforming scores on two test forms. This study showed the negative impacts resulting from the unjust procedures carried out by the research center. Suggestions are presented as well.

1. Brennan, R. L.,Kolen, M. J.,R.L. Brennan (Ed.)(1989).Methodology used in scaling the ACT Assessment and P-ACT+.Iowa City, IA:ACT, Inc.
2. Carlin, J. B.,Rubin, D. B.(1991).Summarizing multiple-choice tests using three informative statistics.Psychological Bulletin,110(2),338-349.
3. Freeman, M. F.,Tukey, J. W.(1950).Transformations related to the angular and square root.The Annals of Mathematical Statistics,21,607-611.
4. Holland, P. W.,Rubin, D. B.(1982).Test Equating.London/ New York:Academic Press.
5. Kolen, M. J.(1988).Defining Score Scales in Relation to Measurement Error.Journal of Educational Measurement,25(2),97-110.
6. Kolen, M. J.,Brennan, R. L.(1995).Test Equating-Methods and Practices.New York:Springer Series in Statistics.
7. Kolen, M. J.,Hanson, B. A.,Brennan, R. L.(1992).Conditional standard errors of measurement for scale scores.Journal of Educational Measurement,29,285-307.
8. Kolen, M. J.,Hanson, B. A.,R. L. Brennan (Ed.)(1989).Methodology used in scaling the ACT Assessment and P-ACT+.Iowa City, IA:ACT, Inc.
9. Lord, F. M(1980).Applications of item response theory to practical testing problems.Hillsdale, NJ:Erlbaum.
10. Lord, F. M.(1965).A strong true-score theory, with applications.Psychometrika,30(3),239-270.
11. Lord, F. M.,Novick, M.R.(1968).Statistical theories of mental test scores.Reading, Mass:Addison-Wesley.
12. Lord, F. M.,Wingersky, M.S.(1984).Comparison of IRT true-score and equipercentile observed-score `equating`.Applied Psychological Measurement,8,452-461.
13. Maritz, J. S.,Lwin, T.(1989).Empirical Bayes Methods.London/ New York:Chapman and Hall.
14. Petersen, N. S.,Kolen, M. J.,Hoover, H. D.,Linn, R. L . (edited.)(1989).Theory and General Principles-chapter 6 in Educational Measurement.National Council on Measurement in Education.
15. von Davier, A. A.,Holland, P.W.,Thayer, D. T.(2004).The kernel method of test equating.Springer-Verlag New York, Inc.
16. 量尺分數問與答
17. 國中基測量尺及等化程序缺失
18. 林妙香(2004)。國中二次基測成績等化程序之探研。
19. Extended Four-Parameter Beta-Binomial Model as a Mental Testing Model-Theoretical Development and Case Study
20. 涂柏原(2002)。國中基本學力測驗量尺分數的說明（上）。飛揚，17
21. 涂柏原、陳柏熹、章舜雯、林世華(2000)。基本學力分數的建立。國民中學學生基本學力測驗推動工作委員會。
22. 國民中學學生基本學力測驗推動工作委員會(2002)。國民中學學生基本學力則驗專輯：柒、九十年「國民中學學生基本學力測驗」答客問。
23. 國民中學學生基本學力測驗推動工作委員會(2002)。國民中學學生基本學力測驗專輯：伍、「國民中學學生基本學力測驗」分數。
24. 國民中學學生基本學力題庫發展組(2006)。國中基本學力測驗量尺分數的計算。飛揚，38
25. 曾尹俊、涂柏原、陳柏熹、張道行、林世華(2001)。A Brief Introduction of the Scale Planning System Designed for Taiwan`s Baisc Competency Test 2001。師大心理與測驗發展中心。

1. 黃國清(2010)。有關98年國中基測新制度議題之研究。中等教育，61(1)，124-133。
2. (2010)。從難度觀點探討國中基測新制量尺。教育研究與發展期刊，6(4)，81-104。