An Application of Multidimensional IRT to the Assessment of Taiwanese Students' English Pragmatic Competence

使用多項度IRT評估台灣學生英語務實能力的應用研究

10.7108/PT.200512.0095

周東山(Tung-Shan Chou)；包傑恩(Jonathan Park)

多項度題目反應理論 ； 語言溝通能力測驗 ； 務實能力 ； NOHARM ； Multidimensional IRT ； communicative language testing ； pragmatic competence ； NOHARM

測驗學刊

52卷2期（2005 / 12 / 01）

95 - 118

英文

本研究使用McDonald在二○○○年所提出的多向度題目反應模式來檢驗將英語溝通能力分解成語意能力與務實能力的可行性。本研究設計出一份評估英語溝通能力的傳統二元計分測驗，內含三個互為獨立的工作情境，取三四一名國中及大學學生進行施測，MIRT的分析採用Fraser和McDonald在二○○三年所發展出的NOHARM電腦程式。在題目向度層面的分析上，傳統測驗理論與MIRT有相當程度的類似。本研究結果顯示，語意能力與務實能力的確在計量特性上具有可分辨性，而台灣學生的英語務實能力遠低於使用英語作為溝通工具所需能力的水準。

McDonald's 2000 Multidimensional IRT was applied to assess the appropriateness of breaking English communicative ability into two dimensions: semantic competence and pragmatic competence. A test containing three work samples designed to measure communicative ability was given to 341 middle school and college students. The MIRT analysis was performed using NOHARM program developed by Fraser and McDonald in 2003. Both CTT and MIRT analyses showed similar dimensionality of the test. The results indicated that semantic competence and pragmatic competence are psychometrically differentiable, and that Taiwanese students' English communicative ability is well below the functional level of using English as a second language.

1. Ackerman, T. A.,Gierl, M. J.,Walker, C. M.(2003).Using multidimensional item response theory to evaluate educational and psychological tests.Educational Measurement: Issues and Practice,Fall,37-51.
2. Aitchison, J.(1999).Linguistics.Chicago:NTC/Contemporary Publishing.
3. Bachman, L. F.(1991).Fundamental considerations in language testing.Hong Kong:Oxford University Press.
4. Brindley, G.(1995).Language Assessment in Action Research Series 8.Sydney:NCELTR Macquarie University.
5. Canale, M.,Swain, M.(1980).Theoretical bases of communicative approaches to second language teaching and testing.Applied Linguistics,1,1-47.
6. Fraser, C.(1988).NOHARM: An IBM PC computer program for fitting both unidimensional and multidimensional normal ogive models of latent trait theory.Armidale, Australia:The University of New England.
7. Fraser, C.,McDonald, R. P.(2003).NOHARM: A Windows program for fitting both unidimensional and multidimensional normal ogive models of latent trait theory.Armidale, Australia:The University of New England.
8. Kasper, G.,Rose, K.(2001).Pragmatics in Language Teaching.Cambridge:Cambridge University Press.
9. Lado, R.(1961).Language testing.London:Longman.
10. McDonald, R. P.(2000).A basis for multidimensional item response theory.Applied Psychological Measurement,24,99-114.
11. McNamara, T. F.(1996).Measuring second language performance.London:Longman.
12. Reckcase, M. D.(1985).The difficulty of test items that measure more than one ability.Applied Psychological Measurement,9,401-412.
13. Reckcase, M. D.,McKinley, R. L.(1991).The discrimination power of items that measure more than one dimension.Applied Psychological Measurement,14,361-373.