Language Reduced Redundancy Tests: A Reexamination of Cloze Test and C-test

贅詞減量的語言測驗：克漏字與C測驗的重新檢驗

10.6384/CIQ.201004.0189

林文鶯(Wen-Ying Lin)；袁曉青(Hsiao-Ching Yuan)；馮和平(Ho-Ping Feng)

贅詞減量的語言測驗 ； 克漏字 ； 挖空比例 ； language reduced redundancy test ； cloze test ； deletion rate

課程與教學

13卷2期（2010 / 04 / 01）

189 - 214

英文

本研究的主要目的：(1)探究採用由Farhady與Keramatic(1996)兩位學者所提出的由文本決定挖空方法(text-driven method)的克漏字測驗，與標準克漏字測驗(standard cloze test)比較起來，前者是否會產生較好的測量特質(psychometric propenies)；(2)比較克漏字測驗和C-test的測量特質；(3)探究採用不同的挖空比例是否會導致考生的考試成績表現高低不同；(4)驗證「考生不會因採用不同文本而產生不同的考試成績表現」(test-takers' performance invariance across different texts)這個假定(assumption)是否適用於克漏字測驗和C-test。本研究的受試者是來自北臺灣一所大學的二百三十七位大一學生。本研究的結果顯示從信、效度的層面來看，由文本決定挖空方法的三個克漏字測驗版本及C-test，並沒有比標準克漏字測驗版本來得好。針對不同的挖空比例是否會導致考生的考試成績表現高低不同這個研究問題，本研究似乎未能得到具有結論性的證據。本研究也未得到強而有力的證據來支持「考生不會因採用不同文本而產生不同的考試成績表現」這個假定。

The purposes of this study are: (1) to investigate whether cloze forms with text-driven deletion method, proposed by Farhady and Keramati (1996), will produce better psychometric properties than the standard cloze form; (2) to compare the psychometric properties of cloze test and C-test, both of which belong to the family of language reduced redundancy test; (3) to examine whether different deletion rates lead to difference in test-takers' performance; and (4) to test whether the assumption of test-takers' performance invariance across different texts hold for both cloze test and C-test. Based on two authentic texts with different rhetoric modes, three cloze forms with text-driven deletion method, along with one standard cloze and one form of C-test, were constructed and randomly administered to 237 student subjects at one private university in northern Taiwan. Furthermore, each subject was required to take three subtests (from a sample TOEFL test) as criterion measures for empirical validity. The results of the study indicated that neither the three cloze forms nor the C-test was substantially superior to the standard cloze in terms of reliability and validity. In addition, the findings of the study were inconclusive with regard to whether different deletion rates result in different test-takers' performance. Finally, no strong evidence was found to substantiate the claim that both cloze test and C-test meet the assumption of test-takers' performance invariance across different texts.

1. Alderson, J. C.(1979).The cloze procedure and proficiency in English s a foreign language.TESOL Quarterly,13
2. Bailey, K. M.(1998).Learning about language assessment: Dilemmas, decisions, and directions.New York:Heinle & Heinle Publishers.
3. Bormuth, J. R.(1967).Comparable cloze and multiple choice comprehension tests scores.Journal of Reading,10
4. Carroll, J. B.(1987).Review of Klein-Braley, C. and Raatz, E., editors. 1985. C-Tests in der Praxis. In Fremdsprachen und Hochschule, AKS-Rundbrief 13/14. Bochum: Arbeitskreis Sprachenzentrum (AKS).Language Testing,4
5. Chapelle, C. A.,Abraham, R. G.(1990).Cloze method: What difference does it make?.Language Testing,7
6. Cohen, A. D.,Segal, M.,Weiss, R.(1984).The C-test in Hebrew.Language Testing,1
7. Crawford, A.(1970).Los Angeles, California,University of California.
8. Culhane, T.(ed.),Klein-Braley, C.(ed.),Stevenson, D. K.(ed.)(1981).Practice and problems in language testing.Colchester:University of Essex.
9. Dornyei, Z.,Katona, L.(1992).Validation of the C test amongst Hungarian EFL learners.Language Testing,9
10. Farhady, H.,Jafarpur, A.,Birjandi, P.(1994).Testing language skills from theory to practice.Tehran:SAMT Publication.
11. Farhady, H.,Keramati, M. N.(1996).A text driven method for the deletion procedure in cloze passages.Language Testing,13
12. Figurel, J. A.(ed.)(1965).Reading and inquiry.Newark, DE:International Reading Associates.
13. Gamarra, A. G.,Jonz, J.(1987).Cloze procedure and the sequence of text.Research in literacy: Merging perspectives,Rochester, NY:
14. Glasnapp, D. R.,Poggio, J. P.(1985).Essentials of statistical analysis for the behavioral sciences.Columbus, OH:A Bell & Howell Company.
15. Grotjahn, R.(1986).Test validation and cognitive psychology: Some methodological considerations.Language Testing,2
16. Grotjahn, R.(ed.),Klein-Braley, C.(ed.),Stevenson, D. K.(ed.)(1987).Taking their measure: The validity and validation of language tests.Bochum:Brockmeyer.
17. Halliday, M. A. K.(1985).An introduction to functional grammar.Melbourne:Edward Arnold.
18. Halliday, M. A. K.,Hassan, R.(1976).Cohesion in English.London:Longman.
19. Henning, G..(1987).A guide to language testing.Cambridge, MA:Newbury House.
20. Hughes, A.(2003).Testing for language teachers.Cambridge:Cambridge University Press.
21. Hughes, A.(1989).Testing for language teachers.Cambridge:Cambridge University Press.
22. Jafarpur, A.(1995).Is C-testing superior to cloze?.Language Testing,11
23. Jafarpur, A.(1996).Native speaker performance validity: In vain or for gain?.System,24
24. Jonz, J.(1989).Textual cohesion and second language comprehension.Language Learning,37
25. Klein-Braley, C.(1981).Duisburg, Germany,University of Duisburg.
26. Klein-Braley, C.(1997).C-Tests in the context of reduced redundancy testing: An appraisal.Language Testing,14
27. Lee, P. T.(1988).A reader for writers.Taipei:Bookman Books Ltd..
28. Madsen, H. S.(1983).Techniques in testing.New York:Oxford University Press, USA.
29. Ohnmacht, F. W.,Weaver, W. W.,Kohler, E. T.(1970).Cloze and closure: A factorial study.The Journal of Psychology,74
30. Oller, J. W. Jr.(1979).Language tests at school: A pragmatic approach.London:Longman.
31. Oller, J. W. Jr.(1973).Cloze tests of second language proficiency and what they measure.Language Learning,23
32. Oller, J. W. Jr.(ed.)(1983).Issues in language testing research.Rowley, MA:Newbury House.
33. Oller, J. W. Jr.(ed.),Perkins, K.(ed.)(1980).Research in language testing.Rowley, MA:Newbury House.
34. Ruddell, R. B.(1964).A study of the cloze comprehension technique in relation to structurally controlled reading material.Improvement of Reading through Classroom Practice,9
35. Sasaki, M.(2000).Effects of cultural schemata on students' test taking processes for cloze tests: A multiple data source approach.Language Testing,17
36. Steig, W.(1969).Sylvester and the magic pebble.NY:Simon & Schuster Children's Publishing Division.
37. Storey, P.(1997).Examining the test taking process: A cognitive perspective on the discourse cloze test.Language Testing,14
38. Taylor, W. L.(1953).Cloze procedure: A new tool for measuring readability.Journalism Quarterly,30
39. Upshur, J. A.(ed.),Fata, J.(ed.)(1968).Problems in foreign language testing, language learning special issue.Ann Arbor, MI:Language Learning Research Club, University of Michigan.
40. Weaver, W. W.,Kingston, A. J.(1963).A factor analysis of cloze procedure and other measures of reading and language ability.The Journal of Communication,13
41. Weir, F. J.(1988).Communicative language testing.Exeter:University of Exeter.
42. Yamashita, J.(2003).Processes of taking a gap filling test: Comparison of skilled and less skilled EFL readers.Language Testing,20
43. Zarrabi, A.(1988).Tehran, Tehran, Iran,Allameh Tabatabai University.