Construction and Validation of a Teacher Self-evaluation Scale to Measure Teaching Performance in a Medical University

10.6145/jme.202012_24(4).0001

Chien-Feng Wang；Ruey-Hsia Wang；Po-Yu Yen；Shu-Ling Huang；Yaw-Bin Huang；Yu-Chih Lin

medical university ； self-evaluation ； teaching performance

Journal of Medical Education

24卷4期（2020 / 12 / 01）

195 - 208

英文

Purpose: The evaluation of teaching performance should be multidimensional, and a validated self-evaluation scale is lacking. This study aimed to construct and validate a self-evaluation scale of teaching performance in a medical university. Methods: A 5-dimensional teaching performance framework and an initial pool of 129 items were generated through literature reviews, eight rounds of expert panel discussions, external expert reviews, and a survey with open-ended questions. A pool of 46 items was extracted through the Delphi method and administered to 153 faculty members of a medical university. Item analysis and exploratory factor analysis were performed, and 27 valid items were retained. Results: The 27-item, 5-dimensional scale developed to measure teaching performance in a medical university shows evidence of reliability, validity, and utility for further research. Contrary to our initial conceptualization, the findings reveal that teaching performance comprised five dimensions: 'Clarity of information', 'Facilitation', 'Curriculum planning', 'Enthusiasm', and 'Resource development'. All participants had positive perceptions of their teaching performance, with a mean score of 5.12 out of 6. Female faculty members had significantly higher scores for 'Facilitation' and 'Curriculum planning' than male faculty members. Assistant professors and lecturers had significantly higher scores than professors for 'Resource development'. Conclusions: This study provides a new insight into dimensions and items of teaching behaviour for self-evaluation of teaching performance that would be applied to medical universities. This validated instrument is suitable for medical teachers to self-evaluate their teaching performance.

1. Adams, NB(2002).Educational computing concerns of postsecondary faculty.J Res Technol Educ,34(3),285-303.
2. Airasian, PW,Gullickson, AR(1996).Teacher Selfevaluation Tool Kit.USA:Corwin.
3. Akram, M,Zepeda, S(2016).Development and validation of a teacher self-assessment instrument.J Res Refl ection Educ,9,134-148.
4. Alhija, FN-A(2017).Teaching in higher education: Good teaching through students’ lens.Stud Educ Evaluation,54,4-12.
5. Avalos, B(2011).Teacher professional development in teaching and teacher education over ten years.Teach Teach Educ,27(1),10-20.
6. Azizi, K,Aghamolaei, T,Parsa, N(2014).Comparison of differences in performance evaluation of faculty by students with faculty’s self-assessment.J Adv Med Educ Prof,2(3)
7. Bartlett, MS(1950).Tests of significance in factor analysis.Br J Stat Psychol,3(2),77-85.
8. Burke, LM(1994).Teacher self-evaluation: An assessment using delamont’s ‘beyond flanders’ fi elds’ technique.Nurse Educ Today,14(3),194-202.
9. Catalano, MG,Perucchini, P,Vecchio, GM(2014).The quality of teachers’ educational practices: Internal validity and applications of a new self-evaluation questionnaire.Soc Behav Sci,141,459-464.
10. Chang, TS,Lin, HH,Song, MM(2011).University faculty members’ perceptions of their teaching efficacy.Innov Educ Teach Int,48(1),49-60.
11. Chaudhary, G,Rathore, MS(2018).A critical study of teacher educators teaching eff ectiveness in relation to their teaching subjects and teaching experience.Int J Adv Res Ideas Innovations Technol,3(5)
12. Chen, JF,Hsieh, HN,Do, QH(2015).Evaluating teaching performance based on fuzzy ahp and comprehensive evaluation approach.Appl Soft Comput,28,100-108.
13. Cheong, G(2017).Developing an instrument for selfevaluation of teaching and learning competencies: A review of faculty professional development and the changing higher education landscape in Singapore.Educ Res Perspect,44,1-20.
14. Crumbley, L,Henry, BK,Kratchman, SH(2001).Students’ perceptions of the evaluation of college teaching.Qual Assur Educ,9(4),197-207.
15. Gul, F,Masood, N,Ahmad, F(2019).Perceptions of basic medical sciences faculty towards various educational roles in medical schools.J Med Sci,27(3),230-234.
16. Harden, RM,Crosby, J(2000).Amee guide no 20: The good teacher is more than a lecturer - the twelve roles of the teacher.Med Teach,22(4),334-347.
17. Harden, RM,Lilley, P(2018).The Eight Roles of the Medical Teacher: The Purpose and Function of a Teacher in the Healthcare Professions.Edinburgh:Elsevier.
18. Hassanzadeh Taheri, MM,Ryasi, H,Afshar, M(2014).Comparison between student rating, faculty self-rating and evaluation of faculty members by heads of respective academic departments in the school of medicine in birjand university of medical sciences in Iran.J Educ Health Promot,3
19. Howard, MC(2016).A review of exploratory factor analysis decisions and overview of current practices: What we are doing and how can we improve?.Int J Hum Comput Interact,32(1),51-62.
20. Hsu, CC,Sandford, BA(2007).The delphi technique: Making sense of consensus.Pract Assess Res Evaluation,12(10)
21. Ingersoll, GM,Kinman, D(2002).Development of a teacher candidate performance self-assessment instrument.Action Teach Educ,23(4),4-9.
22. Irby, DM(1978).Clinical teacher effectiveness in medicine.J Med Educ,53(10),808-815.
23. Iwanicki, EF,McEachern, L(1984).Using teacher self-assessment to identify staff development needs.J Teach Educ,35(2),38-41.
24. Jani, HS,Shahid, SA,Thomas, M(2018).Using teaching eff ectiveness scale as measurement for quality teaching.Int J Acad Res Bus Soc Sci,8(9),1394-404.
25. Johnson, BL(1997).An organizational analysis of multiple perspectives of effective teaching: Implications for teacher evaluation.J Pers Eval Educ,11(1),69-87.
26. Jones, AM,Airasian, PW(1996).Through their eyes: Teacher self-assessment.Midwest Educ Res,9(1),12-16.
27. Kaiser, HF(1960).The application of electronic computers to factor analysis.Educ Psychol Meas,20(1),141-151.
28. Kalaian, HA,Freeman, DJ(1994).Gender diff erences in self-confidence and educational beliefs among secondary teacher candidates.Teach Teach Educ,10(6),647-658.
29. Kang, H(2013).A guide on the use of factor analysis in the assessment of construct validity.J Korean Acad Nurs,43(5),587-594.
30. Karsenti, T,Charlin, B(2008).Information and communication technologies (ict) in medical education and practice: The major challenges.Int J Technol Higher Educ,5(2),68-81.
31. Kim, BH,Kim, J(2016).Development and validation of evaluation indicators for teaching competency in steam education in Korea.EURASIA J Math Sci Technol Educ,12(7),1909-1924.
32. Klassen, RM,Yerdelen, S,Durksen, TL(2013).Measuring teacher engagement: Development of the engaged teacher scale (ets).Frontline Learn Res,1(2)
33. Kumar, MK(2016).Challenges of implementing studentcentered strategies in classrooms.Int Res J Eng Technol,3(12),1224-1227.
34. Kunter, M,Frenzel, A,Nagy, G(2011).Teacher enthusiasm: Dimensionality and context specificity.Contemp Educ Psychol,36(4),289-301.
35. Kyrgiridis, P,Derri, V,Emmanouilidou, K(2014).Development of a questionnaire for self-evaluation of teacher effectiveness in physical education (seteq-pe).Meas Phys Educ Exerc Sci,18(2),73-90.
36. Ljubetić, M(2012).Self-evaluation of pre-school teacher competences - check lists for self-evaluation.J Educ Soc Res,2(2),11-20.
37. Lunenburg, FC(2011).Key components of a curriculum plan: Objectives, content, and learning experiences.Schooling,2(1),1-4.
38. McCombs, BL(1997).Self-assessment and reflection: Tools for promoting teacher changes toward learner-centered practices.NASSP Bulletin,81(587),1-14.
39. Mehrparvar, F,Karimnia, A(2018).Second language teaching effectiveness from the perspective of university students: A case study of departments of applied linguistics.Discourse Commun Sustainable Educ,9(1),64-78.
40. Mohammed, TA,Pandhiani, SM(2017).Analysis of factor affecting student evaluation of teaching eff ectiveness in Saudi higher education: The case of jubail university college.Am J Educ Res,5(5),464-475.
41. Moreno-Murcia, JA,Silveira Torregrosa, Y,Belando Pedreño, N(2015).Questionnaire evaluating teaching competencies in the university environment. Evaluation of teaching competencies in the university.J New Approaches Educ Res,4(1),54-61.
42. Nawabi, S,Khan, RA,Yasmin, R(2014).Teachers’ perceptions of their roles in medical colleges.Adv Health Prof Educ,1
43. Petty, T,Good, A,Putman, SM(2016).Handbook of Research on Professional Development for Quality Teaching and Learning.USA:IGI Global.
44. Pyörälä, E(2014).How we developed a role-based portfolio for teachers’ professional development.Med Teach,36(9),765-768.
45. Rama, S(2011).Professor’s performance for effective teaching (kosovo case).Procedia Soc Behav Sci,2011(12),117-121.
46. Ross, JA,Bruce, CD(2007).Teacher self-assessment: A mechanism for facilitating professional growth.Teach Teach Educ,23(2),146-159.
47. Sanchez-Escobedo, P,Lavadores, AKC(2018).Studentcentred teaching strategies by gender, grade level, and teacher’s self-concept in Mexico.Indonesian Res J Educ,2(1)
48. Sargeant, J(2008).Toward a common understanding of self-assessment.J Contin Educ Health Prof,28(1),1-4.
49. Sargeant, J,Armson, H,Chesluk, B(2010).The processes and dimensions of informed self-assessment: A conceptual model.Acad Med,85(7),1212-1220.
50. Shahzad, S,Mahmood, N(2019).Development of teaching effectiveness scale for university teachers.J Res Soc Sci,7(2)
51. Stalmeijer, RE,Dolmans, DHJM,Wolfhagen, IHAP(2010).Combined student ratings and selfassessment provide useful feedback for clinical teachers.Adv Health Sci Educ,15(3),315-328.
52. Stoddard, HA,Borges, NJ(2016).A typology of teaching roles and relationships for medical education.Med Teach,38(3),280-520.
53. Stronge, JH(2018).Qualities of Effective Teachers.USA:ASCD.
54. Suarman, S,Hendripides, H,Hikmah, N(2018).Development of innovative teaching materials through scientifi c approach.J Educ Sci,2(2),14-22.
55. Taber, KS(2018).The use of cronbach’s alpha when developing and reporting research instruments in science education.Res Sci Educ,48(6),1273-1296.
56. Taherdoost, H,Sahibuddin, S,Jalaliyoon, N(2014).Exploratory factor analysis; concepts and theory. Advances in Applied and Pure Mathematics.WSEAS,375-82.
57. Taheri, MM,Ryasi, HR,Afshar, M(2014).Comparison between student rating, faculty selfrating and evaluation of faculty members by heads of respective academic departments in the school of medicine in birjand university of medical sciences in Iran.J Educ Health Promot,3,34.
58. Thompson, B.(2004).Exploratory and Confirmatory Factor Analysis: Understanding Concepts and Applications.USA: Washington:American Psychological Association.
59. Tigelaar, DEH,Dolmans, DHJM,Wolfhagen, IHAP(2004).The development and validation of a framework for teaching competencies in higher education.High Educ,48(2),253-268.
60. Trigwell, K,Prosser, M,Waterhouse, F(1999).Relations between teachers’ approaches to teaching and students’ approaches to learning.High Educ,37(1),57-70.
61. Wojcicki, TP(2003).Implementing teacher competencies as a professional development activity.PAACE J Lifelong Learn,12,59-67.