Feasibility of Using Standardized Patients as Examiners in an Objective Structured Clinical Examination (OSCE) of Medical Students

10.6145/jme.202103_25(1).0001

Sheng-Po Kao；Ling-Yi Wang；Pao-Hui Tseng；Ming-Chen Hsieh；Shao-Yin Chu

standardized patient ； OSCE (Objective Structured Clinical Examination) ； SP examiners ； physician examiners ； hybrid form of OSCE assessment

Journal of Medical Education

25卷1期（2021 / 03 / 01）

8 - 15

英文

Purpose: An OSCE (Objective Structured Clinical Examination) is an assessment of medical school graduates' skills through multiple timed stations in which the graduates are assessed by one or more examiners. Due to the design of the OSCE, the demand for physician examiners is intense. The objective of this study is to confirm the feasibility of training standardized patients (SP) as OSCE examiners to alleviate the burden on physicians. Methods: Sixty SPs and 30 medical school graduates participated in a five-station OSCE at a medical center in Eastern Taiwan. Thirteen physicians participated as examiners, assessing the graduates' performance during the OSCE. All scenarios contained a content-specific checklist, with no patient note test. Every graduate was simultaneously scored by a physician examiner and an SP examiner using the same checklist. We used a paired t-test to evaluate the score difference between physician and SP examiners. Results: The SP examiners scored graduates higher than physician examiners in all scenarios except the history-taking station. Three scenarios testing patient condition explanations and physical examination revealed a statistically significant difference between SP and physician examiners. The other two scenarios, history taking and doctor-patient communication, showed no significant difference. Conclusions: Our study suggests that SPs could be trained as examiners if OSCE stations contain checklist items recommending generic concepts and not requiring medical knowledge or clinical experience of SPs. Using SPs as examiners would partially alleviate the demand for physician examiners. Further studies are needed to assess whether additional training for SP examiners can improve unbiased evaluations.

1. Adamo, G(2003).Simulated and standardized patients in OSCEs: Achievements and challenges 1992-2003.Med Teach,25(3),262-270.
2. Boulet, JR,McKinley, DW,Norcini, JJ(2002).Assessing the comparability of standardized patient and physician evaluations of clinical skills.Adv Health Sci Educ,7(2),85-97.
3. Dillon, G,Boulet, J,Hawkins, R(2004).Simulations in the United States Medical Licensing Examination™ (USMLE™).BMJ Qual Saf,13(suppl 1),i41-i45.
4. Furman, GE(2008).The role of standardized patient and trainer training in quality assurance for a high‐stakes clinical skills examination.Kaohsiung J Med Sci,24(12),651-655.
5. Harden, RM,Stevenson, M,Downie, WW(1975).Assessment of clinical competence using objective structured examination.Br Med J,1(5955),447-451.
6. Lee, KT,Liu, WT,Yen, JH(2008).The experience of an objective, structured clinical examination at Kaohsiung Medical University.Kaohsiung J Med Sci,24(12),624-626.
7. Martin, JA,Reznick, RK,Rothman, A(1996).Who should rate candidates in an objective structured clinical examination?.Acad Med,71(2),170-175.
8. McLaughlin, K,Gregor, L,Jones, A(2006).Can standardized patients replace physicians as OSCE examiners?.BMC Med Educ,6(1),1-5.
9. Rothman, AI,Cusimano, M(2000).A comparison of physician examiners’, standardized patients’, and communication experts’ ratings of international medical graduates’ English proficiency.Acad Med,75(12),1206-1211.
10. Stillman, P,Swanson, D,Regan, MB(1991).Assessment of clinical skills of residents utilizing standardized patients. A follow-up study and recommendations for application.Ann Intern Med,114(5),393-401.
11. Stillman, PL,Swanson, DB,Smee, S(1986).Assessing clinical skills of residents with standardized patients.Ann Intern Med,105(5),762-771.
12. Taşdelen Teker, G,Odabaşı, O(2019).Reliability of scores obtained from standardized patient and instructor assessments.Eur J Dent Educ,23(2),88-94.
13. Vleuten, CVD,Luyk, SV,Ballegooijen, AV(1989).Training and experience of examiners.Med Educ,23(3),290-296.
14. Whelan, GP,Boulet, JR,McKinley, DW(2005).Scoring standardized patient examinations: Lessons learned from the development and administration of the ECFMG Clinical Skills Assessment (CSA®).Med Teach,27(3),200-206.

1. Yu-Han Hsu;Yu-Chin Lily Wang;Pao-nan chou;Chia-Chen Wang;Shu-Chen Liu;Te-Chuan Chen;Ru-Chu Shih;Shi-Jer Lou;Cheng-Chih Wu(2023)。Pharmacists' Perceptions of Objective Structured Clinical Examination (OSCE) Educational Training: A Survey Research。Journal of Medical Education。27(2)。97-104。