Using Direct Observation of Procedural Skills (DOPS) and Online Learning Materials in Teaching Orthotic Fabrication: Improving Occupational Therapy Students' Competency

10.6145/jme.202303_27(1).0003

Kuan-Yi Li；Hwei-Tau Huang；Chung-Hsien Chaou；Ching-Kai Huang；Yi-Hui Wu；Chiu-Wen Chen

clinical competence ； occupational therapy student ； DOPS ； online learning ； orthotic fabrication

Journal of Medical Education

27卷1期（2023 / 03 / 01）

41 - 56

英文

Background: Direct Observation of Procedural Skills (DOPS) is a widely used competency-based assessment tool for evaluating clinical procedural skill learning and competency among clinical trainees. In the clinical teaching of orthotic fabrication, the online learning materials and the application of DOPS for assessment have been sporadically investigated. Objectives: This study examined the effect of online learning materials and using DOPS for the assessment of the orthotic fabrication-related learning outcomes of occupational therapy students. Methods: We conducted a retrospective review of data from 39 occupational therapy students relating to their clinical fieldwork. The self-developed DOPS for Orthotic Fabrication was used to assess students before and after a three-week training period. All participants completed pretest and posttest assessments to measure their learning in three domains: "choosing and measuring the proper materials," "fitting and fabricating orthotics on the client," and "communicating with and educating the client and their family." Five clinical educators performed DOPS assessments. A paired sample t-test was used to test the data for measurable learning effects. Results: A significant improvement was observed from pretest to posttest in the total mean score (p = .001) as well as the "choosing and measuring the proper materials" (p = .02) and "fitting and fabricating orthotics on the client" (p = .004) content areas. However, no significant improvement was seen in "communicating with and educating the client and their family" (p = .23). Conclusions: The current study demonstrated the utility of DOPS for assessing orthotic fabrication when combined with online learning materials.

1. : Impact of outcome-based assessment on student learning and faculty instructional practices. J Vet Med Educ 2013; 40: 128-38.
   連結：
2. : The role of assessment in competency-based medical education. Med Teach 2010; 32: 676-82.
   連結：
3. J Hand Ther 2020; 33: 119–26.
   連結：
4. Physiother Theory Pract 2022; 38: 2160–9.
   連結：
5. Do its benefits outweigh its disadvantages? Med Teach 2008; 30, e95–9.
   連結：
6. : DOPS assessment: A study to evaluate the experience and opinions of trainees and assessors. Med Teach 2013; 35: e1230-4.
   連結：
7. Med J Islam Repub Iran 2018; 32: 45.
   連結：
8. Teach Teach Educ 2017; 23: 239-50.
   連結：
9. : What clinical instructors want: Perspectives on a new assessment tool for students in the clinical environment. Physiother Can 2014; 66: 322-8. doi:10.3138/ptc.2013-27
   連結：
10. : Reconceptualizing variable rater assessments as both an educational and clinical care problem. Acad Med 2014; 89: 721-7. doi:10.1097/ACM.0000000000000221
    連結：
11. : The effect of applying direct observation of procedural skills (DOPS) on nursing students' clinical skills: A randomized clinical trial. Glob J Health Sci 2015; 7(7 Spec No): 17-21.
    連結：
12. Nurse Educ Today 2013; 33(5): 492-7. doi:10.1016/j.nedt.2012.05.028
    連結：
13. : Development of a direct observation of procedural skills rubric for fourth-year pharmacy students in ambulatory care rotations. Am J Health Syst Pharm 2017; 74(5 Supplement 1): S17-23. doi:10.2146/ajhp150940
    連結：
14. : Development and validation of tools for evaluation of orthosis fabrication. Am J Occup Ther 2012; 66: 739-46. doi:10.5014/ajot.2012.005553
    連結：
15. : Application of direct observation of procedural skills (DOPS) in occupational therapy internship in mental health. J Taiwan Occup Ther Res Prac 2018; 14: 1-10.
    連結：
16. 3rd Edition. London: Routledge; 1996.
    連結：
17. Occup Ther Int 2006; 13: 61-78. doi:10.1002/oti.209
    連結：
18. : A supplemental video teaching tool enhances splinting skills. Clini Orthop Relat Res 2013; 471(2), 649–54. https://doi.org/10.1007/s11999-012-2638-3
    連結：
19. Ann Emerg Med 2007; 49: 505-7.
    連結：
20. In Radomski MV, Trombly LCA eds. Occupational Therapy for Physical Dysfunction. 7th ed. USA: Lippincott Williams & Wilkins, 2014; 428-71.
21. GMS Z Med Ausbild 2015; 32: Doc 45. doi:10.3205/zma000987
22. :The effect of formative evaluation using “direct observation of procedural skills” (DOPS) method on the extent of learning practical skills among nursing students in the ICU. IJNMR 2013; 18(4): 290-3.
23. : Comparison of midwifery students’ satisfaction with direct observation of procedural skills and current methods in evaluation of procedural skills in Mashhad Nursing and Midwifery School. Iran J Nurs Midwifery Res 2013; 18: 94-100.
24. : Perception of the use of the DOPS in occupational therapy PGY training in Taiwan: The perspectives of trainees and supervisors; 2022. Preprint at https://doi.org/10.21203/rs.3.rs-1245634/v1
25. Released 2013. IBM SPSS Statistics for Windows, Version 22.0. Armonk, NY: IBM Corp.; Released 2013.