题名

建構及檢測護理客觀結構式臨床技能測驗考題之信效度、鑑別度及難易度

并列篇名

The Establishment and Examination of the Reliability, Validity, Discrimination, and Difficulty of Nursing Objective Structured Clinical Examination (OSCE)

DOI

10.6224/JN.000084

作者

黃湘萍(Hsiang-Ping Huang);趙莉芬(Li-Fen Chao);王瑜欣(Yu-Hsin Wang);劉英妹(Ying-Mei Liu);倪麗芬(Lee-Fen Ni);簡淑慧(Sui-Whi Jane)

关键词

客觀結構式臨床技能測驗 ; 信度 ; 效度 ; 鑑別度 ; 難易度 ; objective structured clinical examination (OSCE) ; reliability ; validity ; difficulty ; discrimination

期刊名称

護理雜誌

卷期/出版年月

64卷6期(2017 / 12 / 01)

页次

67 - 76

内容语文

繁體中文

中文摘要

背景:客觀結構式臨床技能測驗(objective structured clinical examination, OSCE)是目前評估護理學生專業臨床能力的方式之一,其標準化流程之考題發展與考題信效度檢測值得關注。目的:本研究旨在,依標準化流程建構護理OSCE考站;分析OSCE考站專家效度及預測效度、評分者間一致性、內在一致性、考題相關性、鑑別度與難易度。方法:以描述性、橫斷式研究設計,自2015年9月至2016年10月依測驗藍圖發展8站式OSCE考試,應用於北部某科技大學207位四技四年級臨床選習前的護理系學生,並且測試OSCE考題的信效度、鑑別度與難易度。結果:本研究共建構8站OSCE考題, 各題的專家效度指標為.85-1.0,評分者間一致性為.80-1.0,Cronbach's alpha為.53-82,考題相關性為.36-.63,鑑別度多為優良或非常優良,難易度多為容易到適中,且OSCE成績對臨床選習成績具良好的預測效度。結論/實務應用:透過標準化的考題建置流程,發展的8站式護理OSCE考題具良好的信效度、難易度適中及良好的鑑別度,並可做為檢測學生最後一哩專業技能的方法,期許本研究的結果提供護理教育者於發展OSCE評量之參考。

英文摘要

Background: The objective structured clinical examination (OSCE) is one of the evaluation strategies used to examine the clinical competence of nursing students. More attention needs to be paid to establishing an examination that is based on the standardized protocol and on reliability and validity. Purposes: The aims of this study were to develop an OSCE that is based on a standardized protocol and to analyze the content validity and predictive validity, inter-rater consistency, internal consistency, item-to-total correlation, and the degree of discrimination and difficulty of this OSCE. Methods: Based on the blueprint for OSCEs that use an 8-station format, this study used a descriptive, cross-sectional design and a sample population of 207 senior students who were preparing for their last-mile practicum at a nursing technology university in northern Taiwan. The study period lasted from September 2015 to October 2016. Furthermore, the validity, reliability, degree of discrimination, and difficulty of the OSCE were examined. Results: An OSCE with an eight-station format was developed. The content validity index (CVI) was .85-1.0, inter-rater reliability was .80-1.0, Cronbach' alpha internal consistency was .53-.82, and item-to-total correlation was .36-.63. In addition, the level of difficulty of the OSCE was easy to moderate and the discrimination of the OSCE ranged from fair to excellent. Meanwhile, the OSCE scores of the participants appeared to be a valid predictor of scores on the last mile practicum. Conclusion/Implications for Practice: According to the standardized protocol of OSCE development, an 8- station nursing OSCE format is reliable and valid, providing fair levels of difficulty and discrimination. The developed OSCE may be applied to evaluate the clinical competence of nursing students prior to beginning their last mile practicum. The results from the present study may provide a reference for nursing educators who are responsible for developing OSCE evaluation strategies.

主题分类 醫藥衛生 > 預防保健與衛生學
醫藥衛生 > 社會醫學
参考文献
  1. 王秀禾、孫嘉玲、陳美慧、洪兆嘉、周培萱、賴玉敏、陳櫂豐(2015)。客觀性結構式臨床測驗(OSCE)應用於護理系課程之成效。技術及職業教育學報,6(2),1-15。
    連結:
  2. Kelley, T. L. (1939). The selection of upper and lower groups for the validation of test items. Journal of Educational Psychology, 30(1), 17-24. doi:10.1037/h0057123
  3. Bartfay, W. J.,Rombough, R.,Howse, E.,Leblanc, R.(2004).Evaluation. The OSCE approach in nursing education.The Canadian Nurse,100(3),18-23.
  4. Brighton, R.,Mackay, M.,Brown, R. A.,Jans, C.,Antoniou, C.(2017).Introduction of undergraduate nursing students to an objective structured clinical examination.Journal of Nursing Education,56(4),231-234.
  5. Byrne, G.、蔡淳娟審閱、陳德芳審閱、廖翊舒編譯(2008)。外科OSCE 臨床技能實戰測驗。台北市=Taipei City, Taiwan, ROC:江山=Jiangshan。
  6. Dornan, T.、O'Neill, P.、簡竹君審閱、張亦嚴編譯(2008)。內科OSCE 臨床技能實戰測驗。台北市=Taipei City, Taiwan, ROC:江山=Jiangshan。
  7. Downing, S. M.(2004).Reliability: On the reproducibility of assessment data.Medical Education,38(9),1006-1012.
  8. Fan, J. Y.,Chao, L. F.,Jane, S. W.(2014).Application of the objective structure clinical evaluation in evaluating clinical competence for a BSN program.Open Journal of Nursing,4(12),868-877.
  9. Fan, J. Y.,Wang, Y. H.,Chao, L. F.,Jane, S. W.,Hsu, L. L.(2015).Performance evaluation of nursing students following competence-based education.Nurse Education Today,35(1),97-103.
  10. Fuller, R.,Pell, G.,Homer, M.,Roberts, T.(2012).Comments on 'A systematic review of the reliability of objective structured clinical examination scores'.Medical Education,46(3),337.
  11. Hodges, B.,Turnbull, J.,Cohen, R.,Bienenstock, A.,Norman, G.(1996).Evaluating communication skills in the objective structured clinical examination format: Reliability and generalizability.Medical Education,30(1),38-43.
  12. Khattab, A. D.,Rawlings, B.(2008).Use of a modified OSCE to assess nurse practitioner students.British Journal of Nursing,17(12),754-759.
  13. Lauder, W.,Holland, K.,Roxburgh, M.,Topping, K.,Watson, R.,Johnson, M.,Behr, A.(2008).Measuring competence, self-reported competence and self-efficacy in preregistration students.Nursing Standard,22(20),35-43.
  14. Miller, G. E.(1990).The assessment of clinical skills/competence/ performance.Academic Medicine,65(9, Suppl.),S63-S67.
  15. Mitchell, M. L.,Jeffrey, C. A.,Henderson, A.,Glover, P.,Nulty, D. D.,Kelly, M. A.,Knight, S.(2014).Using an objective structured clinical examination for bachelor of midwifery students' preparation for practice.Women and Birth,27(2),108-113.
  16. Polit, D. F.,Beck, C. T.,Owen, S. V.(2007).Is the CVI an acceptable indicator of content validity? Appraisal and recommendations.Research in Nursing & Health,30(4),459-467.
  17. Rentschler, D. D.,Eaton, J.,Cappiello, J.,McNally, S. F.,McWilliam, P.(2007).Evaluation of undergraduate students using objective structured clinical evaluation.Journal of Nursing Education,46(3),135-139.
  18. Roberts, C.,Newble, D.,Jolly, B.,Reed, M.,Hampton, K.(2006).Assuring the quality of high-stakes undergraduate assessments of clinical competence.Medical Teacher,28(6),535-543.
  19. Rushforth, H. E.(2007).Objective structured clinical examination (OSCE): Review of literature and implications for nursing education.Nurse Education Today,27(5),481-490.
  20. Selim, A. A.,Ramadan, F. H.,El-Gueneidy, M. M.,Gaafer, M. M.(2012).Using objective structured clinical examination (OSCE) in undergraduate psychiatric nursing education: Is it reliable and valid?.Nurse Education Today,32(3),283-288.
  21. Silva, C. C. B. M.,Lunardi, A. C.,Mendes, F. A. R.,Souza, F. F. P.,Carvalho, C. R. F.(2011).Objective structured clinical evaluation as an assessment method for undergraduate chest physical therapy students: A cross-sectional study.Brazilian Journal of Physical Therapy,15(6),481-486.
  22. Sturpe, D. A.,Huynh, D.,Haines, S. T.(2010).Scoring objective structured clinical examinations using video monitors or video recordings.American Journal of Pharmaceutical Education,74(3),44.
  23. Swift, M.,Spake, E.,Gajewski, B. J.(2013).Student performance and satisfaction for a musculoskeletal objective structured clinical examination.Journal of Allied Health,42(4),214-222.
  24. Tavakol, M.,Dennick, R.(2011).Making sense of Cronbach's alpha.International Journal of Medical Education,2,53-55.
  25. Wessel, J.,Williams, R.,Finch, E.,Gémus, M.(2003).Reliability and validity of an objective structured clinical examination for physical therapy students.Journal of Allied Health,32(4),266-269.
  26. 余民寧(2011)。教育測驗與評量:成就測驗與教學評量。台北市=Taipei City, Taiwan, ROC:心理=Psychological。
  27. 李石增編(2012)。客觀結構式臨床測驗—從基礎建立到執行與品質監測。台北市=Taipei City, Taiwan, ROC:台灣愛思唯爾=Elsevier Taiwan。
  28. 李國箴(2014)。臨床護理技術能力—OSCE 之應用。台北市=Taipei City, Taiwan, ROC:華杏=Farseeing。
  29. 李選、張婷、顏文娟、王郁琇(2011)。由全球人才競爭思維探討護理師教考用制度之現況、困境與趨勢。國家菁英季刊,6(4),29-45。
  30. 范君瑜編(2015)。護理客觀結構式臨床技能測驗。台北市=Taipei City, Taiwan, ROC:台灣愛思唯爾=Elsevier Taiwan。
  31. 高聖博(2013)。精通標準化病人。台北市=Taipei City, Taiwan, ROC:力大圖書=Leader Book。
  32. 楊政議、李麗紅、楊惠娟、陳淑齡(2016)。台灣護理專科學校OSCE之發展現況與困境。澄清醫護管理雜誌,12(1),40-47。
  33. 蔡秀鸞校閱(2009)。身體評估之OSCE 臨床能力鑑定。台北市=Taipei City, Taiwan, ROC:台灣愛思唯爾=Elsevier Taiwan。
  34. 盧瑞華、王瑜欣(2014)。客觀結構式臨床測試於護理教育之應用。長庚護理,25(3),274-282。
被引用次数
  1. 黃惠珠,黃平芳,游鄉柔,陳文鈴,林瑞香,吳佩蓉(2020)。提升整形外科護理人員計價完整率。志為護理-慈濟護理雜誌,19(5),97-109。
  2. 簡淑慧,樓迎統,趙莉芬,黃湘萍,范君瑜(2020)。從實證觀點談OSCE於護理教育之應用。長庚護理,31(4),476-487。
  3. 簡淑慧,鍾芬芳,劉英妹,趙莉芬,黃湘萍,陳美燕,陳妙絹,范君瑜(2020)。護理實習於新型冠狀病毒肺炎疫情之挑戰。護理雜誌,67(6),25-31。
  4. 蕭雅竹,蔣宜倩,張媚,周汎澔,李香君,朱宗藍(2021)。護理學校客觀結構式臨床測驗資源分析。長庚護理,32(2),1-13。
  5. 鍾芬芳,曾明晰,林淑君(2021)。某科大二年制護理系學生OSCE後設認知策略之詮釋現象學探究。源遠護理,15(3),45-53。