(1089) Student Self and Preceptor Final Evaluation Alignment on Critical Care Pharmacy Practice Experiences

Introduction: The purpose of this study was to assess student performance self-awareness on critical care Advanced Pharmacy Practice Experiences (APPEs) through a comparison of end-of-rotation student self and preceptor final evaluations. Secondary objectives were to determine if self- awareness differed between critical care rotations and rotations in general and if it differed between students categorized as at risk or not at risk for poor performance based on a dashboard tool.

Methods: Student end of rotation self- and preceptor final evaluations for all APPEs during the 2022-2023 academic year were evaluated. The percentage difference in evaluation scores where both a student self-evaluation and preceptor evaluation were present was used to assess alignment of evaluation scores and make comparisons by risk status.

Results: Evaluations of 213 students across 1103 APPEs and 89 students across 107 critical care APPEs completed during the 2022-2023 academic year were analyzed. Overall, there was no significant difference in student self- and preceptor evaluation scores for critical care experiences with mean scores of 93.4% versus 94.1%. The mean score difference between student self- and preceptor evaluation score was significantly larger for those who were deemed at risk versus not at risk (3.60% versus 1.06%). Preceptor evaluation mean scores were significantly lower in critical care (94.1%) versus other APPE experiences (96.1%, mean difference = 2.0%) as were student self-evaluation scores with mean 93.4% versus 94.8%, mean difference = 1.4%). Finally, preceptor final evaluation scores were significantly lower in at risk versus not at-risk students (mean= 87.3% versus 94.7%, mean difference = 7.4%) but student self-evaluation scores were similar (mean = 91.7% versus 94.3% mean difference = 2.6%) in those at risk and not at risk.

Conclusions: Overall alignment between student and preceptor critical care experience evaluation scores was not statistically different but there were differences seen in the at-risk cohort. This suggests the at-risk cohort had lower performance during critical care electives and less self-awareness of that lower performance. Further evaluation to elucidate if this finding is unique to critical care experiences or is associated with lower preceptor evaluation scores overall.