Rating Inter-rater Reliability of Shih-Hsu Test of Attention between an Experienced Psychiatric Occupational Therapist and an Occupational Therapy Student: A Pilot Study

10.4103/TPSY.TPSY_26_22

Yi-Nuo Shih；Chia-Chun Wu；Pei-Yun Shih；Jia-Lien Hsu；Yin-Huang Liao

auditory attention ； musical stimuli ； occupational therapy trainees ； psychiatric occupational therapy

台灣精神醫學

36卷3期（2022 / 09 / 01）

138 - 141

英文

Objective: The ＂Shih-Hsu Test of Attention＂ (SHTA) is an iPad-based attention assessment tool developed by occupational therapists in recent years, and has acceptable criterion-related validity and high test-retest reliability in preliminary application. In this study, we intended to explore the inter-rater reliability of SHTA between experienced and inexperienced occupational therapists. Methods: We recruited 24 voluntary study participants aged 20-24 years in this study. The participants completed twice the SHTA by an experienced occupational therapist and an occupational therapy student. Results: Analytical results showed that the inter-rater reliability between experienced and inexperienced occupational therapists using SHTA had satisfactory reliability (intraclass correlation coefficient = 0.65). Conclusion: Our preliminary findings showed that the new attention assessment tool, SHTA, had satisfactory inter-rater reliability between experienced and occupational therapy students. We need to wait for a future study with more numbers of study participants in both groups to strengthen the study finding of this pilot study. At this moment, we suggest improving the guidance and training for inexperienced occupational therapists to improve accuracy, and reducing the gap when testing with experienced occupational therapists in future.

1. Hofauer, B,Mansour, N,Heiser, C(2016).Reproducibility of acoustic radiation force impulse imaging in thyroid and salivary glands with experienced and inexperienced examiners.Ultrasound Med Biol,42,2545-2552.
2. Hoonakker, M,Doignon-Camus, N,Bonnefond, A(2017).Sustaining attention to simple visual tasks: a central deficit in schizophrenia? A systematic review.Ann N Y Acad Sci,1408,32-45.
3. Kahraman, D,Eggers, C,Holstein, A(2012).123I-FP-CIT SPECT imaging of the dopaminergic state: visual assessment of dopaminergic degeneration patterns reflects quantitative 2D operator-dependent and 3D operator-independent techniques.Nuklearmedizin,51,244-251.
4. Koo, SK,Lee, SH,Koh, TK(2019).Inter-rater reliability between experienced and inexperienced otolaryngologists using Koo’s drug-induced sleep endoscopy classification system.Eur Arch Otorhinolaryngol,276,1525-1531.
5. Mcgraw, KO,Wong, SP(1996).Forming inferences about some intraclass correlation coefficients.Psychological Methods,1,30-46.
6. Shih, YN,Chen, CS,Chiang, HY(2015).Influence of background music on work attention in clients with chronic schizophrenia.Work,51,153-158.
7. Shih, YN,Hsu, JL,Wang, YC(2022).Test-retest reliability and criterion-related validity of Shih-Hsu Test of Attention (SHTA) between people with and without schizophrenia.Br J Occup Ther,85,23-28.
8. Shih, YN,Hsu, JL,Wu, CC(2020).Development of an iPad-based assessment tool for measuring attention and validation in older employees.Work,67,811-815.
9. Shrout, PE,Fleiss, JL(1979).Intraclass correlations: Uses in assessing rater reliability.Psychol Bull,86,420-428.
10. Weeks, BK,Carty, CP,Horan, SA(2012).Kinematic predictors of single-leg squat performance: a comparison of experienced physiotherapists and student physiotherapists.BMC Musculoskelet Disord,13,207.