Clinical nurse educators in a BSN program developed the SIM-PLE (Simulation-Positive Learning Evaluation) rubric to evaluate student performance in simulation. A pilot study was conducted over two semesters with junior level medical-surgical classes made up of approximately 110-130 students each semester, and the tool was revised and re-evaluated. Inter-rater reliability testing utilized 69 SIM-PLE rubric student evaluations (N = 69). Inter-rater reliability was assessed with comparison of lead faculty with three other instructors utilizing two raters for each simulation experience. The intraclass correlation coefficient (ICC) suggested high inter-rater reliability. The t-test difference was not significant. One-way analysis of variance (ANOVA) showed a significant difference in the Collaboration subcategory score. Univariate ANOVA indicated both raters scored consistently with each other overall and that they both scored JR1 differently than JR2. The pilot study and testing of interrater reliability of the rubric revealed positive findings. The role of the rubric in providing formative feedback during debrief sessions empowered students to analyze their own performance and/or experience to self-correct or improve their future practice based on these experiences.