Evaluating the Appropriateness, Rigour and Trustworthiness of a Mixed-Method Design: A Study of Collaborative Strategic Reading

評析混合研究方法設計之適切性、嚴謹性與可信賴度：以合作策略閱讀教學法之研究為例

10.30165/JHSS.200801.0007

范燕姬(Yen-Chi Fan)

適切性 ； 嚴謹性 ； 可信賴度 ； 混合研究方法設計 ； 合作策略閱讀教學法 ； Appropriateness ； Rigour ； Trustworthiness ； Mixed-Method Design ； Collaborative Strategic Reading

人文與社會學報

2卷1期（2008 / 01 / 01）

143 - 167

英文

合作策略閱讀(CSR)是一個結合小組討論及閱讀策略教學以便增進學生策略閱讀能力之閱讀教學法。本研究的目的在於評析CSR原始提倡者克林格內等人(Klingner et al., 1998)之混合研究方法設計的適切性、嚴謹性與可信賴度。在他們的研究中，量化研究方法之準實驗設計用來分析合作策略閱讀對ESL學習者的閲讀理解及社會課程學習成效之影響；而質性研究方法之言談分析則用於了解學習者如何運用閱讀策略來理解文章的意義。 首先，本文探討量化與質性研究方法之特色並檢視克林格內等人的研究提問與研究設計之間是否相符。再者，與研究方法有關的一些議題包含三角檢驗法、取樣、研究倫理、效度及信度則用來評析該研究的嚴謹性及可信賴度。本文指出其研究的優缺點最後並提出有關CSR未來的研究方向盼能對日後從事該閱讀策略教學法之教學與研究的學者有所助益。

Collaborative Strategic Reading (CSR) is a model of reading comprehension instruction which combines the principles of group work and reading strategy instruction to facilitate students' strategic reading abilities. The purpose of this paper is to evaluate the appropriateness, rigour and trustworthiness of the mixed-method design adopted in the study conducted by CSR’s original proponents-Klingner et al. (1998). In their study, the quantitative quasi-experiment is designed to investigate the effect of CSR on ESL learners' reading comprehension and social studies learning; the qualitative discourse analysis is used to understand how learners apply reading strategies to construct meaning from the text. This critical analysis starts from the examination of the characteristics of the quantitative and qualitative methods and then evaluates if there is a fit between the research questions and design in Klingner et al.'s study. Furthermore, the rigour and trustworthiness of the study are examined by discussing several methodological issues including triangulation, sampling, ethnics, validity and reliability. The strengths and weaknesses of the study are pointed out and the future direction related to CSR research is proposed at the end of the paper. It is hoped that this critical analysis will be beneficial to those who are interested in the teaching and research of CSR in the future.

1. Bernard, H. R.(2000).Social research methods: Quantitative and qualitative approaches.Thousand Oaks:Sage Publications.
2. Brannen, J.(Ed.)(1992).Mixing methods: Qualitative and quantitative research.Aldershot:Ashgate.
3. Brewer, J.,Hunter, A.(1989).Multimethod research: A synthesis of styles.Newbury Park:Sage Publications, Inc..
4. Bryman, A.(1988).Quantity and quality in social research.London:Routledge.
5. Bryman, A.(2001).Social research methods.Oxford:Oxford University Press.
6. Bryman, A.(Ed.)(2006).Mixed Methods.London:Sage Publications Ltd.
7. Cohen, L.,Manion, L.,Morrison, K.(2000).Research methods in education.London:RoutledgeFalmer.
8. Cook, T. D.,Campbell, D. T.(1979).Quasi-experimentation: Design & analysis issues for field settings.Boston:Houghton Mifflin Co.
9. Creswell, J. W.(1994).Research design: Qualitative and quantitative approaches.Thousand Oaks:Sage Publications.
10. Denzin, N. K.(Ed.),Lincoln, Y. S.(Ed.)(1994).Handbook of qualitative research.London:Sage Publications.
11. Flick, U.(1998).An introduction to qualitative research.London:Sage Publications.
12. Fraenkel, J. R.,Wallen, N. E.(1993).How to design and evaluate research in education.Singapore:McGraw-Hill Inc.
13. Hardy, M.(Ed.),Bryman, A.(Ed.)(2004).Handbook of data analysis.Thousand Oaks:Sage Publications, Inc..
14. Klingner, J. K.,Vaughn, S.,Schumm, J. S.(1998).Collaborative Strategic Reading during social studies in heterogeneous fourth-grade classrooms.The Elementary School Journal,99(1),3-22.
15. Lincoln, Y. S.,Guba, E. G.(1985).Naturalistic inquiry.London:Sage Publications.
16. Lomax, R. G.(2004).Whither the future of quantitative literacy research?.Reading Research Quarterly,39(1),107-112.
17. Miles, M.,Huberman, M.(1994).Qualitative data analysis: An expanded source-book.Thousand Oaks:Sage Publications.
18. Newman, I.,Benz, C. R.(1998).qualitative-quantitative research methodology: Exploring the interactive continuum.Carbondale:Southern Illinois University Press.
19. Patton, M. Q.(2002).Qualitative research & evaluation methods.Thousand Oaks:Sage Publications, Inc..
20. Punch, K. F.(1998).Introduction to social research: Quantitative & qualitative approaches.London:Sage Publications.
21. Richardson, J. T. E.(Ed.)(1996).Handbook of qualitative research methods for psychology and the social science.Leicester:The British Psychological Society.
22. Seale, C.(1999).The quality of qualitative research.London:Sage Publications.
23. Silverman, D.(2001).Interpreting qualitative data: Method for analyzing talk, text and interaction.London:Sage Publications.
24. Strauss, A.,Corbin, J.(1990).Basics of qualitative research: Grounded theory procedures and techniques.Newbury Park:Sage Publications, Inc..