A Comprehensive Electronic Platform for EPA Evaluation: Comparison of Design, Efficiency and Efficacy

10.6145/jme.202206_26(2).0002

I-Hung Ho；Wei-Hsiu Huang；Sing-Ong Lee；Chih-Shung Wong

entrustable professional activity ； digital evaluation platform

Journal of Medical Education

26卷2期（2022 / 06 / 01）

71 - 77

英文

Background: In recent years, medical institutions have been adapting the entrustable professional activities (EPAs) framework in medical education. Due to the large amount of data EPA generates, the technical support and digitalization tools will be essential for practitioners. Thus, we developed a digitalized EPA system for teachers and students. Objectives: Comparing the degree of user satisfaction between the old EPAs evaluation approach, and the new EPA platform, and discuss whether the implementation is beneficial towards clinical medical education. Methods: Six residents and 6 attending physicians fill out the user satisfaction questionnaire regarding the old EPA evaluation and the new EPA platform respectively. The two questionnaires were then analyzed, comparing the differences in degree of satisfaction of system design, system efficiency and system efficacy. Results: The main effect of satisfaction of design (F (1,20) = 22.73, P ＜ 0.05), efficiency (F (1,20) = 7.372, P ＜ 0.05) and efficacy (F (1,20) = 21.846, P ＜ 0.05) were all significant. The main effect of candidate categories was insignificant in all dependent variables. Upon three dependent variables, system design (F (1,20) = 0.909, p ＞ 0.05), system efficiency (F (1,20) = 0.583, p ＞ 0.05), system efficacy (F (1,20) = 0.218, p ＞ 0.05), they all indicated no difference between raters and trainees. Conclusion: The new evaluation platform can already improve upon the inadequacies of the old protocol. It is important to develop a single, digital, and comprehensive evaluation system.

1. Swing S: ACGME launches outcomes assessment project. JAMA 1998; 279: 1492.
   連結：
2. ten Cate O: Entrustability of professional activities and competency-based training. Med Educ 2005; 39: 1176-7.
   連結：
3. J.R. Frank: Competency-based medical education: theory to practice. Med Teach 2010; 32: 638-45.
   連結：
4. ten Cate O: Entrustment Decision Making: Extending Miller’s Pyramid. Acad Med 2021; 96: 199-204.
   連結：
5. Alan B, Cramer D: Quantitative: Data Analysis for Social Scientists. Can J Sociol 1997; 4: 434-5.
6. Yang CW: Translating competency-based medical education (CBME) into clinical practice: application of Entrustable Professional Activities (EPAs) in Medical Education. J Healthc Qual 2016; 10: 32-3.