The Implementation of ACGME ＂Reporting Milestones＂ in Internal Medicine Postgraduate Year Training Program - Experience Sharing and Preliminary Outcome

10.6145/jme.202009_24(3).0005

Hsiao-Ju Lin；Jhong-Han Wu；Chia-Yu Lu；Pei-Jen Tsai；Chiung-Yu Chen

competency-based medical education ； reporting milestones

Journal of Medical Education

24卷3期（2020 / 09 / 01）

161 - 172

英文

Purpose: Competency-based medical education has been the current trend of education, and milestones assessment is one of the means to practice it. We hereby shared our experience and preliminary results in applying reporting milestones in our postgraduate year (PGY) training program. Methods: We translated the English version of ＂reporting milestones＂ to Chinese one and built the electronic report worksheets on our web-system. Milestones assessments were conducted at the end of every month since August 2018. We analyzed the completion rate and the results of the assessments in the 2018 academic year by using IBM SPSS Statistics version 23. Results: The completion rate of milestones assessments was 96.7% (175/181), of which the most frequent unassessed subcompetencies were patient care (PC)-4 and PC-5 (both n = 9). The mean levels of the subcompetencies ranged from 3.5 to 4 on a scale of 1-5. Our PGY physicians demonstrated better in subcompetencies systems-based practice (SBP)-1, practice-based learning and improvement (PBLI)-1, and PBLI-3 (mean levels 4.0 ± 0.4, 4.0 ± 0.4, 4.0 ± 0.5, respectively), and worse in subcompetence SBP-3 (mean levels 3.5 ± 0.6) (p ＜ 0.05 by ANOVA). The progress of all subcompetencies between the first and third months of rotation course was insignificant. Conclusions: We accomplished the reporting milestones assessments in our hospital. Our experience in implementing milestones can be as a reference for other hospitals. The learning outcomes from milestones assessments may be helpful to improve our PGY program.

1. Accreditation Council for Graduate Medical Education and American Board of Internal Medicine: The internal medicine milestone project. Retrieved from: http://www.acgme.org/portals/0/pdfs/milestones/internalmedicinemilestones.pdf Accessed July 2015.
2. Boucher A, Frank JR, Melle EV, et al.: Competency-based medical education in Canada: A white paper commissioned by the AFMC board of directors. Retrieved from: https://mededconference.ca/sites/default/files/AFMCCompetencyBasedMedicalEducation_en.pdf Accessed 18 August 2018.
3. Carraccio, C,Iobst, WF,Philibert, I(2014).Milestones: Not millstones but stepping stones.J Grad Med Educ,6(3),589-590.
4. Carraccio, C,Wolfsthal, SD,Englander, R(2002).Shifting paradigms: From flexner to competencies.Acad Med,77(5),361-367.
5. Carter, WA(2014).Milestone myths and misperceptions.J Grad Med Educ,6(1),18-20.
6. Caverzagie, KJ,Iobst, WF,Aagaard, EM(2013).The internal medicine reporting milestones and the next accreditation system.Ann Intern Med,158(7),557-559.
7. Elshami, WE,Abuzaid, MM,Guraya, SS(2018).Acceptability and potential impacts of innovative e-portfolios implemented in e-learning systems for clinical training.J Taibah Univ Med Sci,13(6),521-527.
8. Friedman, KA,Balwan, S,Cacace, F(2014).Impact on house staff evaluation scores when changing from a dreyfus- to a milestone-based evaluation model: One internal medicine residency program’s findings.Med Educ Online,19(1),25185.
9. Green, ML,Aagaard, EM,Caverzagie, KJ(2009).Charting the road to competence: Developmental milestones for internal medicine residency training.J Grad Med Educ,1(1),5-20.
10. Hall, AK,Rich, J,Dagnone, JD(2020).It’s a marathon, not a sprint: Rapid evaluation of competency-based medical education program implementation.Acad Med,95(5),786-793.
11. Hauer, KE,Clauser, J,Lipner, RS(2016).The internal medicine reporting milestones: Crosssectional description of initial implementation in U.S. residency programs.Ann Intern Med,165(5),356-362.
12. Hauer, KE,Vandergrift, J,Hess, B(2016).Correlations between ratings on the resident annual evaluation summary and the internal medicine milestones and association with ABIM certification examination scores among US internal medicine residents, 2013-2014.JAMA,316(21),2253-2262.
13. Hauer, KE,Vandergrift, J,Lipner, RS(2018).National internal medicine milestone ratings: Validity evidence from longitudinal three-year follow-up.Acad Med,93(8),1189-1204.
14. Hawkins, RE,Welcher, CM,Holmboe, ES(2015).Implementation of competency-based medical education: Are we addressing the concerns and challenges?.Med Educ,49(11),1086-1102.
15. Heath, JK,Dine, CJ(2019).ACGME milestones within subspecialty training programs: One institution’s experience.J Grad Med Educ,11(1),53-59.
16. Holmboe, ES,Call, S,Ficalora, RD(2016).Milestones and competency-based medical education in internal medicine.JAMA Intern Med,176(11),1601-1602.
17. Holmboe ES, Edgar L, Hamstra S, et al.: The milestones guidebook. Retrieved from: http://www.acgme.org/Portals/0/MilestonesGuidebook.pdf Accessed 2016.
18. Holmboe, ES,Yamazaki, K,Edgar, L(2015).Reflections on the first 2 years of milestone implementation.J Grad Med Educ,7(3),506-511.
19. Iobst, W,Aagaard, E,Bazari, H(2013).Internal medicine milestones.J Grad Med Educ,5(1s1),14-23.
20. Iobst, WF,Caverzagie, KJ(2013).Milestones and competency-based medical education.Gastroenterology,145(5),921-924.
21. Li, ST,Tancredi, DJ,Schwartz, A(2017).Competent for unsupervised practice: Use of pediatric residency training milestones to assess readiness.Acad Med,92(3),385-393.
22. Mohammed, A,Mohssine, B,M’hammed, EK(2015).Eportfolio as a tool of learning, presentation, orientation and evaluation skills.Procedia Soc Behav Sci,197,328-333.
23. Sklar, DP(2015).Competencies, milestones, and entrustable professional activities: What they are, what they could be.Acad Med,90(4),395-397.
24. Teherani, A,Chen, HC(2014).The next steps in competency-based medical education: Milestones, entrustable professional activities and observable practice activities.J Gen Intern Med,29(8),1090-1092.
25. Tekian, A,Hodges, BD,Roberts, TE(2015).Assessing competencies using milestones along the way.Med Teach,37(4),399-402.
26. ten Cate, O,Scheele, F(2007).Competency-based postgraduate training: Can we bridge the gap between theory and clinical practice?.Acad Med,82(6),542-527.
27. Van Melle, E,Frank, JR,Holmboe, ES(2019).A core components framework for evaluating implementation of competency-based medical education programs.Acad Med,94(7),1002-1009.
28. Warm, EJ,Held, JD,Hellmann, M(2016).Entrusting observable practice activities and milestones over the 36 months of an internal medicine residency.Acad Med,91(10),1398-1405.
29. Weinberger, SE,Pereira, AG,Iobst, WF(2010).Competency-based education and training in internal medicine.Ann Intern Med,153(11),751-756.
30. Yastibas, AE,Yastibas, GC(2015).The use of e-portfolio-based assessment to develop students’ selfregulated learning in english language teaching.Procedia Soc Behav Sci,176,3-13.

1. Wei-Hung Lin,Pei-Jen Tsai,Kai-Wen Nien,Jhong-Han Wu,Huei-Ting Wang,Hsiao-Ju Lin,Chiung-Yu Chen(2021)。The Effects of Duty Hours Reform on Internal Medicine: Views from Different Levels of Practicing Medicine and Changes in Milestones Assessment Outcomes。醫學教育，25(1)，24-34。