Reliability of Perceptual Judgments of Phonetic Accuracy and Hypernasality Among Speech-Language Pathologists for Children With Dysarthria

Purpose: The objectives of this study were to: (a) compare interrater reliability of practicing speech-language pathologists' (SLPs) perceptual judgments of phonetic accuracy and hypernasality between children with dysarthria and those with typical development, and (b) to identify speech factors that influence reliability of these perceptual judgments for children with dysarthria. Method: Ten SLPs provided ratings of speech samples from twenty 5-year-old children with dysarthria and twenty 5-year-old children with typical development on two tasks via a web-based platform: a hypernasality judgment task and a phonetic accuracy judgment task. Interrater reliability of SLPs' ratings on both tasks was compared between children with dysarthria and children with typical development. For children with dysarthria, four acoustic speech measures, intelligibility, and a measure of phonetic accuracy (percent stops correct) were examined as predictors of reliability of SLPs' perceptual judgments. Results: Reliability of SLPs' phonetic accuracy judgments and hypernasality ratings was significantly lower for children with dysarthria than for children with typical development. Among children with dysarthria, interrater reliability of perceptual judgments ranged from strong to weak. Percent stops correct was the strongest predictor of interrater reliability for both phonetic accuracy judgments and hypernasality ratings. Conclusions: Reliability of perceptual phonetic accuracy judgments and hypernasality ratings among practicing SLPs for children with dysarthria is reduced compared to ratings for children with typical development. Findings underscore the need for more reliable methods to assess phonetic accuracy and hypernasality for children with dysarthria.