調查方式與議題熟悉度對問卷回收率與內容的影響

The Effects of Survey Modes and Issue-Familiarity of Questionnaire on the Response Rates and the Surveyed Contents

10.6450/ER.200806.0101

余民寧(Min-Ning Yu)；李仁豪(Ren-Hau Li)

網路問卷 ； 調查方式效果 ； 議題熟悉度 ； Rasch模式 ； web-based questionnaire ； survey mode effects ； issue-familiarity ； Rasch model

教育學刊

30期（2008 / 06 / 01）

101 - 140

繁體中文

本研究旨在探討網路與紙本兩種問卷調查方式及對問卷所調查議題的熟悉度兩個變項，對問卷回收率及問卷調查內容是否有顯著差異的影響存在。本研究以分層隨機取樣方式抽取臺灣地區l,200位中小學教師進行研究，實際回收425份問卷，整體回收率35.4%。其中網路組195人（佔45.9%），紙本組230人（佔54.1%）。本研究以卡方檢定來進行回收率的比較，並且使用Rasch模式，將李克特式評定量尺資料轉換成具連續量尺資料後，再進行問卷內容的分析。結果發現：(1)在問卷回收率上，調查方式與議題熟悉度之間並無交互作用效果存在，也無主要效果存在；(2)在問卷內容上，調查方式與議題熟悉度之間有交互作用效果存在，其中，針對差異試題功能(DIF)的單純主要效果檢定發現，在高議題熟悉組或低議題熟悉組中，網路組與紙本組之間幾乎沒有出現DIF的試題；但是就高低議題熟悉組之間的比較而言，在網路組出現DIF的試題與在紙本組出現DIF的試題有較大的不同；(3)調查方式的DIF主要效果顯示，網路組與紙本組在各試題上並無DIF現象；而議題熟悉度的DIF主要效果顯示，高低議題熟悉組之間出現許多DIF試題，且高議題熟悉組的反應較低議題熟悉組極端；(4)未來的問卷調查方式，似乎可以考慮使用網路問卷來取代紙本問卷，或者是兩者並行，因爲，其效果是相同的。最後，本研究亦提出許多建議，供未來研究時參考。

The main purpose of this study was to investigate the effects of survey modes and is sue-familiarity of questionnaires on the response rates and the surveyed contents. The questionnaires were administered to a stratified sample of 1,200 teachers who were randomly selected from elementary and secondary schools in Taiwan. The overall returned samples were 425 teachers and the response rate was 35.4%. Of the returned samples, the Web-based questionnaire group had 195 teachers (45.9%), and the paper-based questionnaire group bad 230 teachers (54.1%). This study not only used the chi-square test on the comparison of response rates, but also used the Rasch model converting Likert-type scale into continuous scale data and followed by analyses on surveyed content. This study found that: (1) there were neither interaction effects nor main effects on the response rates between the survey modes and issue-familiarity of questionnaires; (2) there were interactions on surveyed content between survey modes and issue-familiarity of questionnaire; yet, by simple main effect tests of differential item functioning (DIF), no matter in high or low issue-familiarity group, there was almost no DIF item appearing between Web-based group and paper-based group, but items that appeared differences between high issue-familiarity group and low issue-familiarity group in Web-based group were much more different from those in paper-based group; (3) main effect test of DIF for survey modes showed that there was no DIF between Web-based group and paper-based group. However, there was serious DIF phenomenon between high issue-familiarity group and low issue-familiarity group, and responses in high issue-familiarity group were more extreme than in low issue-familiarity group, (4) in sum, Web-based questionnaires could be suggested for substitution for paper-based questionnaires or for using them both together on the future researches, because they almost have the same effects Finally, some suggestions for future studies were also proposed.

1. Bandilla, W.,Bosnjak, M.,Altdorfer, P.(2003).A comparison of web-based and traditional written self-administered surveys using the ISSP environment module.Social Science Computer Review,21,235-243.
2. Bason, J. J.(2000).Paper presented at the American Association of Public Opinion Research, Portland.Oregon:
3. Birnbaum, M. H.(2004).Human research and data collection via the internet.Annual Review of Psychology,55,803-822.
4. Bond, T. G.,Fox, C. M.(2001).Applying the Rose/s model: Fundamental measurement in the human sciences.Mahwah, NJ:Lawrence Erlbaum Associates.
5. Buchanan, T.,Smith, J. L.(1999).Using the Internet for psychological research: Personality testing on the World Wide Web.British Journal of Psychology,90,125-144.
6. Couper, M, P.(2000).Web survey: A review of issue and approaches.Public Opinion Quarterly,64,464-495.
7. Curtin, R.,Presser, S.,Singer, E.(2000).The effects of response rate changes on the index of consumer sentiment.Public Opinion Quarterly,64,413-428.
8. Denscombe, M.(2006).Web-based questionnaires and the mode effect: An evaluation based on completion rates and data contents of near-identical questionnaires delivered in different modes.Social Science Computer Review,24(2),246-254.
9. Dillman, D. A.(2000).Mail and internet surveys: The tailored design method.New York:John Wiley.
10. The Web questionnaire challenge to survey methodologists
11. Goho, J.(2002).Paper presented at the 42nd Annual Forum of the Association for Institutional Research, Toronto.Canada:
12. Grandcolas, U.,Rettie, R.,Marusenko, K.(2003).Web survey bias: Sample or mode effect.Journal of Marketing Management,19,541-561.
13. Groves, R. M.(1989).Survey errors and survey costs.New York:John Wiley and Sons.
14. Groves, R. M.,Presser, S.,Dipko, S.(2004).The role of topic interest in survey participation decisions.Public Opinion Quarterly,68,2-31.
15. Groves, R. M.,Singer, E.,Corning, A.(2000).Leverage-Salience theory of survey participation: Description and an illustration.Public Opinion Quarterly,64,299-308.
16. Hayslett, M. M.,Wildemuth, B. M.(2004).Pixels or pencils? The relative effectiveness of web-based versus paper surveys.Library & Information Science Research,26,73-93.
17. Huang, H. M.(2006).Do print and Web surveys provide the same results.Computers in Human Behavior,22,334-350.
18. Katja, L. M.,Vasja, V.(2004).Paper presented at American Association for Public Opinion Research Annual Meeting.Phoenix, AZ:
19. Keeter, S.,Miller, C.,Kohut, A.,Groves, R. M.,Presser, S.(2000).Consequences of reducing nonresponse in a national telephone survey.Public Opinion Quarterly,64,125-148.
20. Leung, D. Y. P.,Kember, D.(2005).Comparability of data gathered from evaluation questionnaires on paper and through the internet.Research in Higher Education,46(5),571-591.
21. Linacre, J. M.(1989).Many-facet Rasch measurement.Chicago:MESA.
22. A user`s guide to FACETS
23. Linacre, J. M.,Wright, B. D.(1994).Reasonable mean-square fit values.Rasch Measurement Transcations,8(3),370.
24. McCabe, S. E.(2004).Comparison of web and mail surveys in collecting illicit drug use data: A randomized experiment.Journal of Drug Education,34(1),61-72.
25. Morrel-Samuels, P.(2003).Web surveys` hidden hazards.Harvard Business Review,81(7),16-18.
26. Newell, C. E.,Rosenfeld. P.,Harris, R. N.,Hindelang, R. L.(2004).Reasons for nonresponse on U.S. Navy Surveys: A closer look.Military Psychology,16(4),265-276.
27. Rasch, G.(1960).Probabilistic models for some intelligence and attainment tests.Chicago:University of Chicago Press.
28. Riva, G.,Teruzzi, T.,Anolli, L.(2003).The use of the internet in psychological research: Comparison of online and offline questionnaires.Cyberpsychology and Behavior,6,73-80.
29. Shaw, D.,Davis, C. H.(1996).The Modem Language Association: Electronic and paper surveys of computer-based tool use.Journal of the American Society for Information Science,47,932-940.
30. Synodinos, N. E.,Papacostas, C. S.,Okimoto, G. M.(1994).Computer administered versus paper-and-pencil surveys and the effect of sample selection.Behavior Research Methods, Instruments and Computers,26,395-401.
31. Tse, A. C. B.(1998).Comparing the response rate, response speed and response quality of two methods of sending questionnaires: E-mail vs. mail.Journal of the Market Research Society,40(4),353-361.

1. 陳柏霖、許嘉家、余民寧(2010)。中小學教師工作時數與憂鬱的關係：主觀幸福感的觀點。教育心理學報，42(2)，229-252。
2. 陳柏霖、余民寧(2010)。健康促進與憂鬱之關係。高雄師大學報：教育與社會科學類，29，73-99。
3. 廖怡茹、翁楊絲茜、周彥孜、李慧珍(2011)。影響學生使用網路教學評鑑意願之研究─以國立臺灣科技大學為例。人文社會學報，7(3)，1-24。
4. 林燕卿,李新民,余沛玲,朱元祥(2020)。大學生多向度浪漫忌妒量表的發展與心理計量品質分析。性學研究，11(1)，21-44。
5. 湯雅芬,陳柏霖,余民寧(2012)。大學生心理資本量表編製及其相關因素之研究。教育研究與發展期刊，8(4)，19-52。
6. 蕭惠文,張東生,吳肇展,伍玥(2023)。推廣教育品質之研究－以大學推廣教育為例。商管科技季刊，24(1)，41-73。
7. 謝進昌、曾筱婕、陳柏霖、林士郁、余民寧(2011)。教師主觀幸福感模式建構與驗證之研究。測驗學刊，58(1)，55-85。
8. 謝進昌、李仁豪、余民寧(2008)。以試題反應理論分析CES-D量表不同調查方式的差異效果。教育心理學報，39(S)，21-42。
9. 鍾珮純、趙珮晴、陳柏霖、許嘉家、余民寧(2012)。教師心理健康狀態類型之初探。學校衛生，60，31-59。
10. 鐘珮純、趙珮晴、陳柏霖、許嘉家、余民寧(2012)。自覺健康狀態、健康責任、情緒幸福感及憂鬱關係之調查。屏東教育大學學報，38(教育)，199-226。
11. 鐘珮純、趙珮晴、陳柏霖、許嘉家、余民寧(2013)。從幽谷邁向巔峰:教師的心理健康狀態類型與促進因子之探索。教育心理學報，44(3)，629-646。
12. (2010)。網路與紙本調查方式、網路問卷長短、網路問卷議題熟悉度高低的DIF分析及潛在平均數差異。教育與心理研究，33(2)，111-139。
13. (2015)。從幽谷邁向巔峰：臺灣民眾心理健康的分布。成人及終身教育學刊，24，35-65。
14. (2018)。以全心學習為中介角色：僑生與本地生的生活目標與品味之關係。教育與心理研究，41(2)，29-58。
15. (2018)。圓滿人生量表測量恆等性考驗及其不同成年期之差異。教育學刊，50，69-108。
16. (2023)。國小高年級學生本土語文核心素養量表之發展。教育學刊，60，51-93。
17. (2023)。應急遠距教學期間國小教師之科技壓力：以高雄市為例。教育心理學報，55(2)，319-343。