網路問卷與傳統問卷之比較：多樣本均等性方法學之應用

Comparison of Internet and Paper-and-pencil Questionnaires in Taiwan Using Multi-sample Invariance Approach

10.7108/PT.200606.0103

游森期(Sen-Chi Yu)；余民寧(Min-Ning Yu)

網路問卷 ； 憂鬱 ； 結構方程式模式 ； 多樣本均等性 ； Internet questionnaire ； depression ； structural equation modeling ； multi-sample invariance

測驗學刊

53卷1期（2006 / 06 / 01）

103 - 127

繁體中文

This study examines whether Internet questionnaires are as psychometrically invariant as traditional mailed questionnaires. A random sample of 2400 teachers in Taiwan was divided into experimental and control groups. The experimental group was asked to complete the electronic version of the CES-D (Center for Epidemiologic Studies Depression Scale) placed on the internet, whereas the control group was invited to complete the traditional paper-based CES-D. The multi-sample invariance approach derived from structural equation modeling (SEM) was applied to analyze the collected data. The analytical results show that the two groups have equivalent factor structures. That is, the two groups exhibit equal factor loadings, covariance matrix for latent factors and measurement errors. The results also show that the items in CES-D function equivalently in the two groups. That is, the instrument exhibits equal validity and reliability when administrated to the two groups. Moreover, the cross validation was also approved by the results. These findings demonstrate that the Internet questionnaires and traditional mailed questionnaires had equal factor structures. Given that the factor structures were found to be equivalent, the equal latent mean test was then performed. The analytical results demonstrate that the four latent means in CESD are riot totally equal between two groups. Concerning the four latent factors in CES-D, the latent means of ”depressed mood”, ”positive affect” and ”interpersonal problems” are not significantly different between these two groups. However, the difference between the ”somatic symptoms” latent means of these two groups is statistically significant at a=.01. To investigate the effect size of such difference, Cohen d statistics was utilized. However, Cohen d statistics was only .172, indicating a small effect size. That is, the minor difference in somatic symptoms, 0.19 point, albeit statistically significant, does not apparently lead to meaningful clinical significances (effect size) in practice. Analytical results indicate that Internet questionnaires and traditional mailed questionnaires have equal factor structures to. Both CES-D questionnaires exhibit equal reliability, validity and factor structure, and similar latent means. In conclusion, internet questionnaires represent a promising alternative to traditional paper-based questionnaires.

This study examines whether Internet questionnaires are as psychometrically invariant as traditional mailed questionnaires. A random sample of 2400 teachers in Taiwan was divided into experimental and control groups. The experimental group was asked to complete the electronic version of the CES-D (Center for Epidemiologic Studies Depression Scale) placed on the internet, whereas the control group was invited to complete the traditional paper-based CES-D. The multi-sample invariance approach derived from structural equation modeling (SEM) was applied to analyze the collected data. The analytical results show that the two groups have equivalent factor structures. That is, the two groups exhibit equal factor loadings, covariance matrix for latent factors and measurement errors. The results also show that the items in CES-D function equivalently in the two groups. That is, the instrument exhibits equal validity and reliability when administrated to the two groups. Moreover, the cross validation was also approved by the results. These findings demonstrate that the Internet questionnaires and traditional mailed questionnaires had equal factor structures. Given that the factor structures were found to be equivalent, the equal latent mean test was then performed. The analytical results demonstrate that the four latent means in CESD are riot totally equal between two groups. Concerning the four latent factors in CES-D, the latent means of ”depressed mood”, ”positive affect” and ”interpersonal problems” are not significantly different between these two groups. However, the difference between the ”somatic symptoms” latent means of these two groups is statistically significant at a=.01. To investigate the effect size of such difference, Cohen d statistics was utilized. However, Cohen d statistics was only .172, indicating a small effect size. That is, the minor difference in somatic symptoms, 0.19 point, albeit statistically significant, does not apparently lead to meaningful clinical significances (effect size) in practice. Analytical results indicate that Internet questionnaires and traditional mailed questionnaires have equal factor structures to. Both CES-D questionnaires exhibit equal reliability, validity and factor structure, and similar latent means. In conclusion, internet questionnaires represent a promising alternative to traditional paper-based questionnaires.

1. 張德勝(2005)。「學生評鑑教師教學」信效度之探討：紙筆和網路調查之比較。中華心理學刊，47(2)，113-125。
   連結：
2. Alreck, R. L.(1995).The survey research handbook.Chicago:Irwin.
3. American Psychiatric Association(1994).Diagnostic and statistical manual of mental disorders (Fourth Edition).Washington D.C:American Psychiatric Association.
4. Birnbaum, M. H.(2004).Human research and data collection via the Internet.Annual Review of Psychology,55,803-822.
5. Bollen, K.A.(1989).Structural equations with latent variables.New York:John Wiley & Sons.
6. Browne, M. W.,Cudeck, R.,K. A. Bollen,J. S. Long (Eds.)(1993).Testing structural equation models.Newbury Park, CA:Sage.
7. Buchanan, T.,Smith, J. L.(1999).Using the Internet for psychological research: Personality testing on the World Wide Web.British Journal of Psychology,90,125-144.
8. Byrne, B. M.(1998).Structural equation modeling with LISREL, PRELIS, and SIMPUS: Basic concepts, applications, and programming.Mahwah, NJ:Lawrence Erlbaum Associates.
9. Cheung C. K.,Bagley, C.(1998).Validating an American scale in Hong Kong: The Center of Epidemiological Study Depression Scale.The Journal of Psychology,132(2),169-186.
10. Cohen, J.(1992).A power primer.Psychological Bulletin,112,155-159.
11. Couper, M. P.(2000).Web survey: A review of issue and approaches.Public Opinion Quarterly,64(4),464-495.
12. Dillman, D.(2000).Mail and Internet survey: The total design method.New York:Wiley.
13. Hu, L.,Bentler, P. M.(1999).Cutoff criteria for fit indices in covariance.Structural Equation Modeling,6(1),1-55.
14. Joreskong, K. G.,Sorborm, D.(1993).LISERAL 8: Structural equation modeling with the SIMPLIS command language.Mooresville, IN:Scientific Software Inc.
15. Kaplowitz, M. D.,Hadlock, T. D.,Levine, R.(2004).A comparison of web and mail survey response rates.Public Opinion Quarterly,68(1),94-101.
16. Kohurt, F. J.,Beckman, L. F.,Evans, D.A.,Coroni-Huntley, J.(1993).Two short forms of the CES-D depression symptoms index.Journal of Aging and Health,5,179-193.
17. Marsh, D.(1982).The survey method.London:George Allen.
18. Mueller, R. O.(1996).Basic principles of structural equation modeling: An introduction to LISREL and EQS.New York:Springer Verlag.
19. Radloff L. S.(1997).The CES-D scale: A self-report depression scale for research in the general population.Applied Psychological Measurement,1,385-401.
20. Riva, G.,Teruzzi, T.,Anolli, L.(2003).The use of the internet in psychological research: Comparison of online and offline questionnaires.Cyberpsychology and Behavior,6(1),73-80.
21. Schmidt, W.(1997).World-Wide Web survey research: Benefits, potential problems and solutions.Behavior Research Methods, Instruments, and Computers,29,274-279.
22. Shaver, P. R.,Brennan, K. A.,J. P. Robinson,L. S. Wrightsman (Eds.)(1991).Measurement of personality and social psychological attitudes.New York:Academic Press.
23. Tabachnick, B. G.,Fidell, L.(2001).Using Multivariate statistics.Boston:Allyn & Bacon.
24. How to calculate effect sizes from published research articles: A simplified methodology
25. What is depression
26. 余民寧(2006)。潛在變項模式：SIMPLIS的應用。台北市:高等教育。
27. 邱皓政(2003)。結構方程模式：LISREL的理論、技術與應用。台北市:雙葉。
28. 游森期(2003)。台灣地區大學生人格特質、網路成癮、憂鬱與焦慮之結構方程式模式檢定。教育與心理研究，26(3)，501-525。
29. 游森期(2005).University of National Chcngchi, Taipei, Taiwan.
30. 程炳林(1995)。博士論文(博士論文)。台北市，國立台灣師範大學教育心理輔導研究所。
31. 黃芳銘(2002)。結構方程模式理論與應用。台北市:五南。
32. 資策會(2005)。經濟部技術處創新資訊應用研究計畫。台北市:資策會。

1. 陳柏霖(Po-Lin Chen);沈妙珊(Mao-Shan Shen);許雅涵(Ya-Han Hsu)(2021)。以心理資本為中介角色：讀經志工教師教學信念與班級經營效能之關係。教育科學研究期刊。66(2)。207-239。