教師情境判斷測驗之編製

Construction of the Teacher Situational Judgment Test

10.6209/JORIES.2016.61(2).04

趙子揚(Tzu-Yang Chao)；黃嘉莉(Jia-Li Huang)；宋曜廷(Yao-Ting Sung)；郭蕙寧(Hui-Ning Kuo)；許明輝(Ming-Huei Shiu)

信度 ； 效度 ； 教師情境判斷測驗 ； 試題反應理論 ； 質性分析 ； reliability ； validity ； teacher situational judgment test ； item response theory ； qualitative analysis

教育科學研究期刊

61卷2期（2016 / 06 / 01）

85 - 117

繁體中文

為提供師資培育單位在甄選師資培育學生時，更多元的參考依據，本研究建置教師情境判斷測驗，並進行信度及效度之檢驗。研究一自2010年起，進行教師情境判斷測驗的建置，並蒐集3,133位實習教師及正式教師之施測資料，以試題反應理論(item response theory, IRT)進行分析，檢驗測驗之信度及效度。研究一共建置75題試題，且試題之中有90.67%與Rasch模式適配。研究二自2014年起，進行試題的擴充，並蒐集了3,039位大學生之施測資料。經由試題分析，研究二共建置105題試題，總題數為180題。除試題分析外，研究二亦分析修習不同教育學程的學生，檢驗其在測驗分數之差異，提供已知團體差異之效度證據。此外，研究二利用資深教師團隊座談會之質性資料，進行內容分析，探討資深教師在面對教師工作上問題時，其作法判斷背後之意涵，提供更多的建構效度證據。本研究將就教師情境判斷測驗的概念、試題特性，以及編製實務等議題進行討論。

According to the ideal of having multiple measures of teacher education, this study developed the teacher situational judgment test (TSJT) for selecting student teachers. The TSJS was based on the hypothesis that the more similar a student’s thinking is to senior and high-performing teachers, the more likely that student is to become an effective teacher. In Study 1, we collected data from 3,133 intern-teachers and teachers to determine the reliability and validity of the TSJT. On the basis of the analysis of the pilot test and formal test, we retained 75 items. Furthermore, the internal consistency reliability of three of the TSJT booklets was exceeded .7. Additionally, the Rasch model analysis showed that 90.67% of the TSJT items fit the Rasch model. In Study 2, we developed 150 new items to expand the TSJT item bank, and recruited 3,039 college students for an item analysis. Subsequently, we further retained 105 items for the TSJT item bank, totaling 180. The reliability of each booklet was between .47 and .74. For the test validity, the analysis of variances indicated that the TSJT scores of student teachers were significantly higher than those of nonstudent teachers. This provided known-group differences validity for the TSJT. Furthermore, in Study 2, we also conducted a qualitative content analysis to provide additional evidence of the construct validity. This present study discusses the development and practical applications of the TSJT.

1. 徐靜嫻(2013)。PBL 融入師資培育教學實習課程之個案研究。教育科學研究期刊，58(2)，91-121。
   連結：
2. 陳美玉(2005)。師資生個人知識管理及其對專業學習與發展影響之研究。師大學報：教育類，50(2)，181-202。
   連結：
3. 黃源河、符碧真(2009)。一樣軌跡兩樣情：美國與我國師資培育機構轉型與教師質量之比較。教育科學研究期刊，54(4)，171-200。
   連結：
4. 黃嘉莉、武佳瀅(2015)。我國教育實習學生知覺教師專業知能習得、運用與重要之研究。教育科學研究期刊，60(2)，1-32。
   連結：
5. 楊國樞、陸洛(2005)。社會取向自我實現者與個人取向自我實現者的心理特徵：概念分析與實徵衡鑑。本土心理學研究，23，71-143。
   連結：
6. 歐宗霖、邱皓政、孫國勛(2013)。當測驗碰上情境：情境判斷測驗與自陳量表在量表發展上之比較。測驗學刊，60(2)，239-262。
   連結：
7. 鄭育文、陳柏熹、宋曜廷、陳信豪、蕭孟莛(2014)。電腦化適性職涯性向測驗編製研究。教育心理學報，46(2)，271-288。
   連結：
8. Educational Testing Service. (2009). 2009—10 The Praxis SeriesTM Bulletin. Retrieved from http://www.ets.org/praxis
9. Arenson, E. A.(1999).Statistical linkages between state education assessments and the national assessment of educational progress.annual meeting of the Sacramento Statistical Association,Sacramento, CA.:
10. Chan, D.,Schmitt, N.(1997).Video-based versus paper-and-pencil method of assessment in situational judgment tests: Subgroup differences in test performance and face validity perceptions.Journal of Applied Psychology,82(1),143-159.
11. Chan, D.,Schmitt, N.(2002).Situational judgment and job performance.Human Performance,15(3),233-254.
12. Cheng, C.-S.,Bailey, R. A.(1991).Optimality of some two-associate-class partially balanced incomplete-block designs.The Annals of Statistics,19(3),1667-1671.
13. Clevenger, J.,Pereira, G. M.,Wiechmann, D.,Schmitt, N.,Harvey, V. S.(2001).Incremental validity of situational judgment tests.Journal of Applied Psychology,86(3),410-417.
14. Cohen, D. K.,Raudenbush, S. W.,Ball, D. L.(2003).Resources, instruction, and research.Educational Evaluation and Policy Analysis,25(2),119-142.
15. Cohen, J.(1977).Statistical power analysis for the behavioral sciences.New York, NY:Academic Press.
16. Conner, L. A.(2007).TX.,University of North Texas.
17. de Meijer, L. A. L.,Born, M. Ph.,van Zielst, J.,van der Molen, H. T.(2010).Construct-driven development of a video-based situational judgment test for integrity: A study in a muilti-Ethnic polic setting.European Psychologist,15(3),229-236.
18. Fenstermacher, G. D.,Richardson, V.(2005).On making determinations of quality in teaching.Teachers College Record,107(1),186-213.
19. Hoban, G. F.(2000).Using a reflective framework to study teaching-learning relationships.Reflective Practice,1(2),165-182.
20. Inglis, F.(Ed.)(2004).Education and the good society.London, UK:Palgrave Macmillan.
21. Kennedy, M. M.(2006).From teacher quality to quality teaching.Educational Leadership,63(6),14-19.
22. Koster, B.,Dengerink, J.,Korthagen, F.,Lunenberg, M.(2008).Teacher educators working on their own professional development: Goals, activities and outcomes of a project for the professional development of teacher educators.Teachers and Teaching: Theory and Practice,14(5-6),567-587.
23. Labaree, D. F.(2000).On the nature of teaching and teacher education: Difficult practices that look easy.Journal of Teacher Education,51(3),228-233.
24. Layne, H. B.,Boyles, R. D.(1997).Characteristics of 'good' teachers.Research and Reflections,3(2),17-39.
25. Lievens, F.,Peeters, H.,Schollaert, E.(2008).Situational judgment tests: A review of recent research.Personnel Review,37(4),426-441.
26. Lievens, F.,Sackett, P. R.(2006).Video-based versus written situational judgment tests: A comparison in terms of predictive validity.Journal of Applied Psychology,91(5),1181-1188.
27. Lievens, F.,Sackett, P. R.,Buyse, T.(2009).The effect of response instructions on situational judgment test performance and validity in a high-stakes context.Journal of Applied Psychology,94(4),1095-1101.
28. Masters, G.(1982).A Rasch model for partial credit scoring.Psychometrika,47(2),149-174.
29. McDaniel, M. A.,Morgeson, F. P.,Finnegan, E. B.,Campion, M. A.,Braverman, E. P.(2001).Use of situational judgement tests to predict job performance: A clarification of the literature.Journal of Applied Psychology,86(4),730-740.
30. McDaniel, M. A.,Nguyen, N. T.(2001).Situational judgment tests: A review of practice and constructs assessed.International Journal of Selection and Assessment,9(1&2),103-113.
31. McDaniel, M. A.,Whetzel, D. L.(2005).Situational judgment test research: Informing the debate on practical intelligence theory.Intelligence,33(5),515-525.
32. Miller, W. L.,Crabtree, B. F.(1999).Doing qualitative research.London, UK:Sage.
33. Motowidlo, S. J.,Dunnette, M. D.,Carter, G. W.(1990).An alternative selection procedure: The low-fidelity simulation.Journal of Applied Psychology,75(6),640-647.
34. Nguyen, N. T.,McDaniel, M. A.(2003).Response instructions and racial differences in a situational judgment test.Applied H.R.M. Research,8(1),33-44.
35. O'Connell, M. S.,Hartman, N. S.,McDaniel, M. A.,Grubb, W. L.,Lawrence, A.(2007).Incremental validity of situational judgment tests for task and contextual job performance.International Journal of Selection and Assessment,15(1),19-29.
36. Ogden, D. H.(1994).Characteristics of good/effective teachers: Gender differences in student descriptors.Annual Meeting of the Mid-South Educational Research Association,Nashville, TN:
37. Olson-Buchanan, J. B.,Drasgow, F.,Moberg, P. J.,Mead, A. D.,Keenan, P. A.,Donovan, M. A.(1998).Interactive video assessment of conflict resolution skills.Personnel Psychology,51(1),1-24.
38. Ployhart, R. E.,Porr, W.,Ryan, A. M.(2004).New development in SJTs: Scoring, coaching and incremental validity.19th annual convention of the Society for Industrial and Organizational Psychology,Chicago, IL.:
39. Shanoski, L. A.,Hranitz, J. R.(1991).A foundation for excellence in teaching.Annual Meeting of the Association of Teacher Educators (71st),New Orleans, LA:
40. Shulman, L. S.(1987).Sounding an alarm: A reply to Sockett.Harvard Educational Review,57(4),473-484.
41. Speicher, A. D.,Schurter, W. A.(1981).,未出版
42. Verhelst, N. D.,Verstralen, H. H. F. M.(2008).Some considerations on the partial credit model.Psicológica: Revista de metodología y psicología experimental,29(2),229-254.
43. Wagner, R. K.,Sternberg, R. J.(1985).Practical intelligence in real-world pursuits: The role of tacit knowledge.Journal of Personality and Social Psychology,49(2),436-458.
44. Weekley, J. A.,Jones, C.(1997).Video-based situational testing.Personnel Psychology,50(1),25-49.
45. Weekley, J. A.,Jones, C.(1999).Further studies of situational tests.Personnel Psychology,52(3),679-700.
46. Wenzlaff, T. L.(1998).Dispositions and portfolio development: Is there a connection?.Education,118(4),564-572.
47. Whetzel, D. L.,McDaniel, M. A.(2009).Situational judgment tests: An overview of current research.Human Resource Management Review,19(3),188-202.
48. Wright, B. D.,Linacre, J. M.(1994).Reasonable mean-square fit values.Rasch Measurement: Transactions of the Rasch Measurement SIG,8(3),370.
49. Wu, M. L.,Adams, R. J.,Wilson, M. R.(1998).ConQuest.Camberwell, AU:Australian Council for Educational Research.
50. 王文中(2004)。Rasch測量理論與其在教育與心理之應用。教育與心理研究，27(4)，637-694。
51. 吳清基編、黃嘉莉編(2013)。雲端時代的師資培育。臺北市=Taipei, Taiwan:中華民國師範教育學會=Teacher Education Society of R.O.C.。
52. 張芬芬(2010)。質性資料分析的五步驟：在抽象階梯上爬升。初等教育期刊，35，87-120。
53. 教育部(2012)。中華民國師資培育白皮書。臺北市=Taipei, Taiwan:作者=Author。
54. 黃嘉莉(2013)。標準本位師資培育理念與實踐。臺北市=Taipei, Taiwan:國立臺灣師範大學出版中心=National Taiwan Normal University Press。
55. 賴保禎、賴美玲(2003)。賴氏人格測驗。臺北市=Taipei, Taiwan:千華=Chien Hua。

1. 陳彥君,洪素蘋(2019)。中學生現代公民核心素養之測驗編製。教育實踐與研究，32(2)，39-79。
2. 洪瑞兒,洪振方,林煥祥,吳枚瑛(2022)。探討實證知情實務教學介入對國中生食安素養的成效。教育科學研究期刊，67(3)，113-146。
3. 劉怡薰,宋曜廷(2020)。中等學校師資生任教學科專門知識檢測機制之探討。教育科學研究期刊，65(2)，167-194。
4. 蘇容梅(2020)。美、英、澳、星四國中小學師資生遴選標準及對我國啟示之探討。教育科學研究期刊，65(2)，135-166。
5. 謝名娟(2020)。從多層面Rasch模式來檢視不同的評分者等化連結設計對參數估計的影響。教育心理學報，52(2)，415-436。
6. 楊凱琳,陳建亨(2021)。題型對學生數學表現水準之影響－以相似形為例。教育科學研究期刊，66(3)，247-277。
7. 趙子揚、許明輝、宋曜廷(2018)。教師工作價值觀量表之編製。教育科學研究期刊，63(3)，163-196。
8. 鄭英耀、何曉琪、王佳琪(2016)。科學想像力圖形測驗之發展。教育科學研究期刊，61(4)，177-204。
9. (2023)。國中綜合活動領域教師學科教學知識量表編製暨效度分析。教育心理學報，55(2)，401-424。
10. (2024)。「師資生潛能測驗組合」與現職中學教師工作表現之相關研究。測驗學刊，71(1)，119-147。