Interrater Reliability and Usability of a Nurse Anesthesia Clinical Evaluation Instrument

Background: No Student Registered Nurse Anesthetist (SRNA) clinical evaluation instrument (CEI) has undergone interrater reliability or usability testing, to the authors' knowledge. This project determined the interrater reliability and usability of a new SRNA CEI. Method: This was a prospective, mixed qualitative and quantitative, fully crossed observational design with a usability survey. SRNAs' recorded performance during simulation was evaluated by participants, who also completed a usability survey. Results: Interrater reliability is high, intraclass correlation coefficient = .982, 95% CI [.884,.960], indicating strong agreement of SRNA clinical performance among participants (n = 10). Internal consistency is excellent (Cronbach's alpha =.943), indicating the CEI is constructed appropriately and participants found it easy to use. Conclusion: This CEI may advance the aim of impartiality in the evaluation of SRNA clinical performance through an instrument that is reliable, with good construct, and ease of use.