题名

大學生基本素養測驗的發展及信度效度分析

并列篇名

Evaluation of the Psychometric Properties of the General Literacy Test for University

DOI

10.6209/JORIES.2015.60(3).04

作者

陳柏熹(Po-Hsi Chen)；黃馨瑩(Hsin-Ying Huang)；陳郁欣(Yu-Hsin Chen)；葉泰廷(Tai-Ting Yeh)；蘇少祖(Shao-Tsu Su)

关键词

信度 ； 效度 ； 素養評量 ； 情境式測驗 ； 線上測驗 ； reliability ； validity ； literacy assessment ； scenario based test ； online test

期刊名称

教育科學研究期刊

卷期/出版年月

60卷3期（2015 / 09 / 01）

页次

95 - 126

内容语文

繁體中文
中文摘要

本研究目的旨在發展大學生基本素養測驗並進行信度與效度評估。藉由分析國內大專院校的通識教育目標和核心素養，並參考ATC21S提出的21世紀現代學生需具備的10項基本素養，歸納出大學生基本素養測驗的九項素養，分別為：溝通合作、美感素養、科學思辨、資訊素養、終身學習、創新領導、問題解決、公民社會及生涯發展。測驗形式為線上多媒體情境式題型，每個題本均包含九項素養的內容，每項素養皆有二至三個題組。研究對象為全國大專校院一至四年級學生，研究樣本來自20校10,958名大學生。由效度評估結果可知，大學生基本素養測驗的題組效果不大，可以忽略，並採用部分計分模式來估計，幾乎所有試題與模式都能適配，顯示建構效度良好。試題發展過程均歷經嚴謹修審題程序，取得良好專家效度證據。此外，不同性別和年級的學生在各素養的表現上差異不大，和過去的文獻相符合，具有良好的效標關聯效度。信度證據方面，各素養能力估計誤差約在 .20～.60 logit之間，單一題本的信度高於.69，顯示本測驗題數雖少，但信度大致良好。整體而言，大學生基本素養測驗具良好的信度與效度。
英文摘要

This study evaluated the psychometric properties of the General Literacy Test for University Students. To develop the assessment framework, the educational objectives of general literacy courses of universities in Taiwan as well as the core competencies of Assessment and Teaching of 21st Century Skills were all reviewed and considered. The general literacy test is composed of nine literacy domains: communication and collaboration, esthetics, information, lifelong learning, career, leadership, problem solving, social concerns and citizenship, and scientific thinking. The items of the general literacy test were developed into a multimedia assessment. In addition, booklets including two to three testlets on each of the nine literacy domains were organized. Overall, 10,958 students from 20 universities participated. The results demonstrated that testlet effect could be ignored and the partial credit model could be used to analyze data. In addition, the items fit the partial credit model closely and the test demonstrated favorable construct validity. In addition, small differences existed between gender and grades. The results were consistent with those of previous studies and showed that the test's criterion-related validity was acceptable. Furthermore, the standard error of ability ranged from .20 to .60 logit and the reliabilities of the booklets were more than .69 in the nine literacy domains. The evidence supports the high degree of reliability and validity of basic literacy assessment.
主题分类 社會科學 > 教育學
参考文献
  1. 陳儀蓉、黃芳銘(2006)。組織公民行為量表在男女員工群體上之測驗恆等性檢定。測驗學刊，53(2)，297-326。
    連結：
  2. European Association for Quality Assurance. (2009b). The Bologna process 2020 － The European higher education area in the new decade. Retrieved from http://www.enqa.eu/files/Leuven_ Louvain-la-Neuve_ Communique_ April_2009.pdf
  3. 國立臺灣師範大學雲端測驗中心（ 2014 ）。大學生基本素養指導手冊。取自 http://140.122.69.221/ntnucit/index.php/services-mainnav/testing-of-students-literacy-mainnav 【 National Taiwan Normal University Research Center for Internet Testing. (2014). Guilds for basic literacy test for university students. Retrieved from http://140.122.69.221/ntnucit/index.php/services-mainnav/testing-of-students-literacy-mainnav 】
  4. Assessment & Teaching of 21st Century Skills. (2010). 21st century skills white paper. Retrieved from http://atc21s.org/index.php/resources/white-papers/
  5. 國家教育研究院（ 2014 ）。教育部提升國民素養專案辦公室。取自 http://literacytw.naer.edu.tw/index.php?REFDOCID=0m8mptc3ioz0a9z8 【 National Acedemy of Educational Research. (2014). Office of enhancing the basic literacy of people. Retrieved from http://literacytw.naer.edu.tw/index.php?REFDOCID=0m8mptc3ioz0a9z8 】
  6. European Association for Quality Assurance. (2009a). ENQA position paper on quality assurance in the EHEA － In view of the leuven and louvainla-neuve meeting of ministers responsible for higher education of 28-29 April 2009. Retrieved from http://www.enqa.eu/files/ENQA_position_ paper%20(3).pdf
  7. Aiken, L. R.,Groth-Marnat, G.(2005).Psychological testing and assessment.Boston, MA:Pearson Education.
  8. Bock, R. D.,Mislevy, R. J.(1982).Adaptive EAP estimation of ability in a microcomputer environment.Applied Psychological Measurement,6(4),431-444.
  9. Chen, P.-H.,Kuo, J.-W.,Sung, Y.-T.(2011).Influence of pre-test design on the precision of the parameters estimation in the multidimensional items bank.IMPS 2011, the 76rd annual meeting of the Psychometric Society,Hong Kong, China:
  10. Cohen, J.(1992).A power primer.Psychological Bulletin,112(1),155-159.
  11. Cohen, J.(1988).Statistical power analysis for the behavioral sciences.New Jersey, NY:Lawrence Erlbaum Associates.
  12. Gardner, H.(1983).Frames of mind.New York, NY:Basic Books.
  13. Holland, J. L.(1973).Making vocational choices: A theory of careers.Upper Saddle River, NJ:Prentice Hall.
  14. Liu, T.-T.,Sun, H.-B.(2012).Gender differences on information literacy of science and engineering undergraduates.International Journal of Modern Education and Computer Science,4(2),23-30.
  15. Lord, F. M.(Ed.),Novick, M. R.(Ed.)(1968).Statistical theories of mental test scores.Reading, MA:Addison-Wesley.
  16. Ma, F.-C.、Ding, R.、Li, Z.-Z.(2009)。Case study: An analysis of information literacy competence of university students in Wuhan area。Document, Information & Knowledge，1，24-29。
  17. Masters, M. S.,Sanders, B.(1993).Is the gender difference in mental rotation disappearing?.Behavior Genetics,23(4),337-341.
  18. McManus, I. C.,Furnham, A.(2006).Aesthetic activities and aesthetic attitudes: Influences of education, background and personality on interest and involvement in the arts.British Journal of Psychology,97(4),555-587.
  19. Organization for Economic Co-operation and Development(2007).PISA 2006: Science competencies for tomorrow's world, volume I analysis.Paris, France:Author.
  20. Organization for Economic Co-operation and Development(2007).PISA 2007: Science competencies for tomorrow's world, volume II analysis.Paris, France:Author.
  21. Pope-Davis, D. B.,Twing, J. S.(1991).The effects of age, gender, and experience on measures of attitude regarding computers.Computers in Human Behavior,7(4),333-339.
  22. Raju, N. S.,Price, L. R.,Oshima, T. C.,Nering, M. L.(2007).Standardized conditional SEM: A case for conditional reliability.Applied Psychological Measurement,31(3),169-180.
  23. Rasch, G.(1960).Probabilistic models for some intelligence and attainment tests.Copenhagen, Denmark:Danish Institute for Educational Research.
  24. Rottinghaus, P. J.,Day, S. X.,Borgen, F. H.(2005).The career futures inventory: A measure of career-related adaptability and optimism.Journal of Career Assessment,13(1),3-24.
  25. Rowland, K. D.(2004).Career decision-making skills of high school students in the Bahamas.Journal of Career Development,31(1),1-13.
  26. Schmidt, W. H.,Raizen, S. A.,Britton, E. D.,Bianchi, L. J.,Wolfe, R. G.(1997).Many visions, many aims: A cross-national investigation of curricular intentions in school science.Dordrecht, the Netherlands:Kluwer Academic.
  27. Scott, B. P.(1998).Just what in a competency?.Training Minneapolis,35(6),58-64.
  28. Sypher, H. E.,Applegate, J. L.,Church, S. L.(1981).Cognitive differentiation and verbal intelligence: Clarifying relationships.annual conference of the International Communication Association,Minneapolis, MN:
  29. Verderber, R. F.,Verderber, K. S.(1995).Inter-act: Using interpersonal communication skills/voices: A selection of multicultural readings.Belmont, CA:Wadsworth.
  30. Wang, W.-C.,Wilson, M.(2005).The Rasch testlet model.Applied Psychological Measurement,29(2),126-149.
  31. Wright, B. D.(Ed.),Linacre, J. M.(Ed.)(1994).Rasch measurement transactions.Chicago, IL:MESA.
  32. Yip, D.-Y.,Chiu, M.-M.,Ho, E. S.-C.(2004).Hong Kong student achievement in OECD-PISA study: Gender differences in science content, literacy skills, and test item formats.International Journal of Science and Mathematics Education,2(1),91-106.
  33. 王保進(2011)。以學生學習成效品質保證為核心之第二週期系所評鑑作業規範。評鑑雙月刊，33，7-11。
  34. 林煥祥、劉聖忠、林素微、李暉(2008)。科技部專題研究計畫成果報告科技部專題研究計畫成果報告,花蓮市=Hualien, Taiwan:國立花蓮教育大學=National Hualien University of Education。
  35. 郭生玉(2012)。心理與教育研究法。新北市=New Taipei City, Taiwan:精華=Jin-Hua。
  36. 陳柏熹(2011)。心理與教育測驗：測驗編製理論與實務。新北市=New Taipei City, Taiwan:精策教育=Kinetics。
  37. 廖添富、黃景裕(1995)。我國大學生公民態度之研究－樣本取自北部地區。公民訓育學報，4，109-127。
被引用次数
  1. 陳彥君,洪素蘋(2019)。中學生現代公民核心素養之測驗編製。教育實踐與研究，32(2)，39-79。
  2. 葛惠敏、李隆盛、王玫婷(2017)。普通大學校訂基本素養與學生養成能力之契合度分析。課程與教學，20(1)，73-104。
  3. 洪瑞兒,洪振方,林煥祥,吳枚瑛(2022)。探討實證知情實務教學介入對國中生食安素養的成效。教育科學研究期刊，67(3)，113-146。
  4. 洪瑞兒,吳枚瑛(2020)。探討高雄市青少年健康知識、態度及行為素養。教育科學研究期刊，65(3)，187-223。
  5. 李松濤(2017)。大學生對於科學研究資訊的閱讀表現探究：以網路科學新聞為例。中華傳播學刊，32，91-128。
  6. 廖珮妏(2020)。體驗教育培養大專生帶得走的品格信念指標之建構。當代教育研究季刊，28(3)，29-33+35。
  7. 蘇容梅(2020)。美、英、澳、星四國中小學師資生遴選標準及對我國啟示之探討。教育科學研究期刊，65(2)，135-166。
  8. 蘇少祖、潘昌志、陳柏熹、林蓓伶(2018)。十二年國教國中階段自然科學領域素養導向評量試題之開發與初探。教育科學研究期刊，63(4)，295-337。
  9. 楊登順、洪瑞兒(2016)。探討大學生空間自我效能、畫地圖能力與地圖素養之相關性與中介效果。教育科學研究期刊，61(4)，121-146。
  10. (2017)。大學生角色期望量表的編製與層面建構。教育學刊，48，1-43。
  11. (2018)。領域特定詞彙知識的測量：三至八年級學生數學詞彙能力。教育研究與發展期刊，14(4)，1-40。
print cancel