十二年國教國中階段自然科學領域素養導向評量試題之開發與初探

Development of Assessments for Scientific Literacy Based on Curriculum Guidelines for 12-Year Basic Education in Science Domains

10.6209/JORIES.201812_63(4).0010

林蓓伶(Pei-Ling Lin)；潘昌志(Chang-Chih Pan)；蘇少祖(Shao-Zu Su)；陳柏熹(Po-Hsi Chen)

十二年國民基本教育 ； 科學素養 ； 科學素養導向試題 ； 12-year basic education ； assessment for scientific literacy ； scientific literacy

教育科學研究期刊

63卷4期（2018 / 12 / 01）

295 - 337

繁體中文

為承接十二年國教自然科學領域課程綱要素養導向精神，此研究目的為研發與初探具信、效度之自然科學領域素養導向評量試題。本研究歷程包含三大部分：一、梳理與歸納文獻中科學素養之意涵；二、細緻化編碼自然科學領域課程綱要中國民中學階段核心素養具體內涵，以自然科學領域課程綱要國民中學階段核心素養具體內涵為架構，建立科學素養導向題型命題參考架構；三、以自然科學領域課程綱要國民中學階段核心素養具體內涵編碼表及命題參考架構，研發自然科學素養導向題型，並根據科學素養導向試題命題參考架構，針對鑑別度欠佳之試題，進行後設分析，進而達到試題修正之功效。由結果分析得知，依此科學素養導向試題命題參考架構所命之試題，除能明確對應自然科學領域課程綱要中之國民中學階段核心素養具體內涵與學習重點，大致有良好之品質。對於品質待改進之試題，科學素養導向命題參考架構亦能提供明確之修改方向，協助命題者進一步檢視與修正。本研究所提出之科學素養導向命題參考架構，可供未來作為命題時梳理課程綱要內涵與學習重點之清晰分類架構，並確保試題所欲評量之能力與內容呼應課程綱要素養精神。同時，亦能作為後續試題修改分析之明確參考方向，用以整體系統性開發、修正並歸類各式評量工具，以期作為未來相關領域學者及教師發展評量工具與進行教學設計之參考。

The purpose of this research is to analyse the curriculum guidelines in science domains within the 12-year basic education and to explore and develop a reliable and valid assessment model for scientific literacy. This study is conducted in three parts: First, the definitions of scientific literacy that are established in the literature are classified and examined. Second, a coding list is established by decoding the implications of the curriculum guidelines in the science domains, and this decoded result is supported by examining the definitions of scientific literacy from the literature. A unified assessment framework is established for drafting scientific literacy-oriented exam questions. Third, the coding list and assessment framework are used to develop scientific literacy-oriented exam questions, and based on this framework, a meta-analysis of unqualified exam questions is conducted to revise these exam questions. The aforementioned coding list and assessment framework are used to develop and test the scientific literacy-oriented exam questions. The results indicates that most of the scientific literacy-oriented exam questions developed in this study have good quality and follow the curriculum guidelines of the 12-year basic education in science domains. Regarding the unqualified exam questions, the assessment framework for scientific literacy developed in this study provides recommendations for revision, which can help draft and correct exam questions. In sum, the proposed assessment framework for scientific literacy can be used to further develop, modify, and classify various assessment tools and as a reference for future teachers and researchers.

1. 宋曜廷、周業太、曾芬蘭(2014)。十二年國民基本教育的入學考試與評量變革。教育科學研究期刊，59(1)，1-32。
   連結：
2. 林宜平、吳亭亭、黎雅如、周桂田、鄭尊仁(2010)。台灣成年民眾對奈米產品與科技的公眾感知。台灣公共衛生雜誌，29(5)，431-439。
   連結：
3. 施琮仁(2015)。不同媒體平台對公眾參與科學決策能力之影響：以奈米科技為例。新聞學研究，124，165-213。
   連結：
4. 張欣怡、張淑苑、羅慶璋、洪振方(2015)。知識整合數位課程促進學生科學素養：以化學反應概念為例。教育科學研究期刊，60(3)，153-181。
   連結：
5. 陳冠利、劉湘瑤、陳柏熹、黃書涵(2015)。以情境式試題評量中學生能源素養。教育科學研究期刊，60(2)，167-196。
   連結：
6. 陳柏熹、黃馨瑩、陳郁欣、葉泰廷、蘇少祖(2015)。大學生基本素養測驗的發展及信度效度分析。教育科學研究期刊，60(3)，95-126。
   連結：
7. 靳知勤(2002)。效化「基本科學素養」問卷。科學教育學刊，10(3)，287-308。
   連結：
8. 靳知勤(2007)。科學教育應如何提升學生的科學素養─台灣學術精英的看法。科學教育學刊，15(6)，627-646。
   連結：
9. American Association for the Advancement of Science(1989).Project 2061. Science for all American.New York, NY:Oxford University Press.
10. Bauer, M. W.(2009).The evolution of public understanding of science - Discourse and comparative evidence.Science, Technology and Society,14(2),221-240.
11. Beck, U.,Ritter, M.(Trans.)(2012).Risk society: Towards a new modernity.London, UK:Sage.
12. Bloom, B. S.,Engelhart, M. D.,Furst, E. J.,Hill, W. H.,Krathwohl, D. R.(1956).Taxonomy of educational objectives: The classification of educational goals.New York, NY:David McKay.
13. Brossard, D.,Shanahan, J.(2006).Do they know what they read? Building a scientific literacy measurement instrument based on science media coverage.Science Communication,28(1),47-63.
14. Bucchi, M.,Saracino, B.(2016)."Visual science literacy": Images and public understanding of science in the digital age.Science Communication,38(6),812-819.
15. Cohen, J.(1960).A coefficient of agreement for nominal scales.Educational and Psychological Measurement,20(1),37-46.
16. de Ayala, R. J.(2009).The theory and practice of item response theory.New York, NY:Guilford.
17. Deboer, G. E.(2000).Scientific literacy: Another look at its historical and contemporary meanings and its relationship to science education reform.Journal of Research in Science Teaching,37(6),582-601.
18. Durant, J. R.,Evans, G. A.,Thomas, G. P.(1989).The public understanding of science.Nature,340(6228),11-14.
19. Eivers, E.,Kennedy, D.(2006).The PISA assessment of scientific literacy.The Irish Journal of Education,37,101-119.
20. Eshach, H.,Hwang, F.-K.,Wu, H.-K.,Hsu, Y.-S.(2013).Introducing Taiwanese undergraduate students to the nature of science through Nobel Prize stories.Physical Review Special Topics -Physics Education Research,9(1)
21. Fang, S.-C.,Hsu, Y.-S.,Chang, H.-Y.,Chang, W.-H.,Wu, H.-K.,Chen, C.-M.(2016).Investigating the effects of structured and guided inquiry on students' development of conceptual knowledge and inquiry abilities: A case study in Taiwan.International Journal of Science Education,38(12),1945-1971.
22. Graber, W.(Ed.),Bolte, C.(Ed.)(1997).Scientific literacy.Kiel, Germany:IPN.
23. Hsin, M.-C.,Chien, S.,Hsu, Y.-S.,Lin, C.-Y.,Yore, L.-D.(2016).Development and validation of a Taiwanese communication progression in science education.International Journal of Science and Mathematics Education,14(1),125-143.
24. Huang, H.-Y.,Wang, W.-C.,Chen, P.-H.,Su, C.-M.(2013).Higher-order item response models for hierarchical latent traits.Applied Psychological Measurement,37(8),619-637.
25. Hurd, P. D.(1958).Science literacy: Its meaning for American schools.Educational Leadership,16(1),13-16.
26. Khine, M. S.(Ed.)(2014).Science education in East Asia pedagogical innovations and research-informed practices.Cham, Switzerland:Springer.
27. Kolstø, S. D.(2001).Scientific literacy for citizenship: Tools for dealing with the science dimension of controversial socioscientific issues.Science Education,85(3),291-310.
28. Kuo, C.-Y.,Wu, H.-K.,Jen, T.-H.,Hsu, Y.-S.(2015).Development and validation of a multimedia-based assessment of scientific inquiry abilities.International Journal of Science Education,37(14),2326-2357.
29. Landis, J. R.,Koch, G. G.(1977).The measurement of observer agreement for categorical data.Biometrics,33(1),159-174.
30. Laugksch, R. C.,Spargo, P. E.(1996).Construction of a paper-and-pencil test of basic scientific literacy based on selected literacy goals recommended by the american association for the advancement of science.Public Understanding of Science,5(4),331-359.
31. Lin, H.,Hong, Z.-R,Huang, T.-C.(2012).The role of emotional factors in building public scientific literacy and engagement with science.International Journal of Science Education,34(1),25-42.
32. Lin, P.-L.,Tseng, Y.-H.,Liu, H.-H.,Chang, C.-Y.(2012).What the media wants us to believe: Investigating Taiwan media attitudes towards nanotechnology.12th International Public Communication of Science and Technology Conference,Florence, Italy:
33. Linacre, J. M.,Wright, B. D.(1994).Reasonable mean-square fit values.Rasch Measurement Transactions,8(3),370.
34. Miller, J. D.(1998).The measurement of civic scientific literacy.Public Understanding of Science,7(3),203-223.
35. Miller, J. D.(1983).Scientific literacy: A conceptual and empirical review.Daedalus,112(2),29-48.
36. Mullis, I. V. S.(Ed.),Martin, M. O.(Ed.)(2015).TIMSS 2015 assessment frameworks.Chestnut Hill, MA:TIMSS & PIRLS International Study Center, Boston College.
37. National Research Council(1996).National science education standards.Washington, DC:National Academy Press.
38. Organisation for Economic Co-operation and Development. (2013). PISA 2015 draft science framework. Retreived from https://www.oecd.org/pisa/pisaproducts/Draft%20PISA%202015%20Science%20Framework%20.pdf
39. Organisation for Economic Co-operation and Development. (2012). PISA 2015 item submission guidelines: Scientific literacy. Retreived from https://www.oecd.org/pisa/pisaproducts/Submission-Guidelines-Science.pdf
40. Peters, H. P.,Brossard, D.,de Cheveigné, S.,Dunwoody, S.,Kallfass, M.,Miller, S.,Tsuchida, S.(2008).Science-media interface: It's time to reconsider.Science Communication,30(2),266-276.
41. Pidgeon, N.,Fischhoff, B.(2011).The role of social and decision sciences in communicating uncertain climate risks.Nature Climate Change,1(1),35-41.
42. Priest, S. H.(Ed.)(2010).Encyclopedia of science and technology communication.Thousand Oaks, CA:Sage.
43. Rasch, G.(1960).Studies in mathematical psychology: I. probabilistic models for some intelligence and attainment tests.Copenhagen, Denmark:Danish Institute for Educational Research.
44. Rundgren, C.-J.,Rundgren, S.-N. C.,Tseng, Y.-H.,Lin, P.-L.,Chang, C.-Y.(2010).Are you SLiM? Developing an instrument for civic scientific literacy measurement (SLiM) based on media coverage.Public Understanding of Science,21(6),759-773.
45. Shamos, M. H.(1995).The myth of scientific literacy.New Brunswick, NJ:Rutgers University Press.
46. Shih, T.-J.,Lin, C.-Y.(2017).Developing communication strategies for mitigating actions against global warming: Linking framing and a dual processing model.Environmental Communication,11(6),840-858.
47. Stewart, C. O.,McConnell, J. R.,Dickerson, D. L.(2017).Socioscientific and epistemic dimensions of support for science: Associations with science education and religiosity.International Journal of Science Education, Part B,7(1),1-13.
48. Sturgis, P.,Allum, N.(2004).Science in society: Re-evaluating the deficit model of public attitudes.Public Understanding of Science,13(1),55-74.
49. Wu, H.-K.,Kuo, C.-Y.,Jen, T.-H.,Hsu, Y.-S.(2015).What makes an item more difficult? Effects of modality and type of visual information in a computer-based assessment of scientific inquiry abilities.Computers & Education,85,35-48.
50. Wu, H.-L.,Weng, H.-L.,She, H.-C.(2016).Effects of scaffolds and scientific reasoning ability on web-based scientific inquiry.International Journal of Contemporary Educational Research,3(1),12-24.
51. Yang, F.-Y.,Chang, C.-C.,Chen, L.-L.,Chen, Y.-C.(2016).Exploring learners' beliefs about science reading and scientific epistemic beliefs, and their relations with science text understanding.International Journal of Science Education,38(10),1591-1606.
52. Yang, F.-Y.,Chen, Y.-H.,Tsai, M.-J.(2013).How university students evaluate online information about a socio-scientific issue and the relationship with their epistemic beliefs.Educational Technology & Society,16(3),385-399.
53. Yang, F.-Y.,Liu, S.-Y.,Hsu, C.-Y.,Chiou, G.-L.,Wu, H.-K.,Wu, Y.-T.,Tsai, C.-C.(2018).High-school students' epistemic knowledge of science and its relation to learner factors in science learning.Research in Science Education,48(2),325-344.
54. Yang, W.-T.,Lin, Y.-R.,She, H.-C.,Huang, K.-Y.(2015).The effects of prior-knowledge and online learning approaches on students' inquiry and argumentation abilities.International Journal of Science Education,37(10),1564-1589.
55. 李文旗、張俊彥(2005)。中學生應達到的地球科學素養？─中學地科老師的觀點。師大學報：科學教育類，50(2)，1-27。
56. 國立臺灣師範大學心理與教育測驗研究發展中心(2016)。,未出版
57. 國立臺灣師範大學心理與教育測驗研究發展中心(2015)。106年國中教育會考問與答。臺北市=Taipei, Taiwan:作者=Author。
58. 國家教育研究院(2018)。國家教育研究院（2018）。素養導向「紙筆測驗」要素與範例試題（定稿版）。臺北市：作者。【National Academy for Educational Research. (2018). The elements and samples for literacy-oriented “paper and pencil test” (Final version). Taipei, Taiwan: Author.】。
59. 張俊彥編(2007)。TIMSS 2007國際數學與科學教育成就趨勢調查。臺北市=Taipei, Taiwan:國立臺灣師範大學=National Taiwan Normal University。
60. 教育部編、國立臺灣師範大學編(2006)。九年一貫課程自然與生活科技學習領域─科學素養的內涵與解析。臺北市=Taipei, Taiwan:作者=Author。
61. 教育部（2014）。十二年國民基本教育課程綱要─總綱。臺北市：作者。【Ministry of Education. (2014). Twelve years of national basic education curriculum outline in general. Taipei, Taiwan: Author.】
62. 教育部(2016)。教育部（2016）。十二年國民基本教育課程綱要（國民中小學暨普通型高級中等學校）─自然科學領域（草案）。臺北市：作者。【Ministry of Education. (2016). The draft of twelve years of national basic education curriculum outline (national primary and secondary schools and ordinary high school ) - Natural sciences. Taipei, Taiwan: Author.】。
63. 陳柏熹、宋曜廷(2017)。十二年國教新課綱素養評量實踐：從定義到評量配套。12 年國教新課綱素養評量的實踐研討會，臺北市=Taipei, Taiwan:
64. 臺灣2015 PISA 國家研究中心（2016）。2015 學生能力國際排名。取自http://pisa2015.nctu.edu.tw/pisa/index.php/tw/rank/41-2015-rank【Taiwan 2015 PISA National Research Center. (2016). 2015 International ranking of PISA students' ability. Retrieved from http://pisa2015.nctu.edu.tw/pisa/index.php/tw/rank/41-2015-rank】

1. 林小慧(Hsiao-Hui Lin);郭哲宇(Che-Yu Kuo);吳心楷(Hsin-Kai Wu)(2021)。學生學習投入、好奇心、教師集體層級變項與科學探究能力的關係：跨層級調節式中介效果之探討。教育科學研究期刊。66(2)。75-110。