Interrater reliability of the Australasian Triage Scale for mental health patients

To evaluate interrater reliability of the Australasian Triage Scale (ATS) for mental health patients in ED. In a prospective descriptive study, triage nurses were shown video vignettes of simulated scenarios of mental health presentations. Trieurs (raters) were asked to allocate an ATS category (rating) to each case. The primary outcome was the degree of interrater reliability for each simulated case. Also assessed were differences between raters or settings, grouped by level of ED activity, state of origin, hospital type and familiarity with appropriate guidelines. Chi-squared analysis was used for independent categorical variables; the Friedman test was used to compare the triage scores between busy and quiet ED scenarios. Ordinal data results were compared using opartchi. All 90 eligible participants were enrolled. The highest interrater concordance was 65.6% whereas the lowest interrater concordance was 53.3%. Significant association occurred between the distribution of triage ratings, ED activity level and the state of origin. A busy ED resulted in the assignment of a more urgent ATS category and decrease in concordance. There is a need to develop and implement a validated, standardized national triage tool for mental health patients. The ATS per se is insufficient to ensure acceptable interrater reliability, particularly during busy periods in the ED, and between states. Given the influence the ATS has on key outcomes, it is imperative for this tool to be robust.