Advanced grad-CAM extensions for interpretable aphasia speech keyword classification: Bridging the gap in impaired speech with XAI

被引:0
|
作者
Usha, Gowri Prasood [1 ]
Alex, John Sahaya Rani [1 ]
机构
[1] Vellore Inst Technol Chennai, Sch Elect Engn, Chennai 600127, India
关键词
Aphasia; Grad-CAM; Explainable AI; XAI; Speech recognition; Spoken keyword classification; Impaired speech; Deep learning; RECOGNITION;
D O I
10.1016/j.rineng.2024.103414
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Aphasia, a language disorder caused by brain injury, presents significant speech recognition and classification challenges due to irregular speech patterns. While the standard Grad-CAM (Gradient-weighted Class Activation Mapping) technique is widely used for model interpretation, its application to impaired speech remains largely unexplored. To address this gap, we introduce a set of extension studies of enhanced Grad-CAM techniques, namely Enhanced Directional Grad-CAM (ED-GCAM), Multi-Scale Channel-wise Grad-CAM (MSCW-GCAM), Stochastic Gradient-Dropout Integrated Grad-CAM (SGD-GCAM), and Enhanced Hierarchical Filtered Grad-CAM (EH-FCAM) to improve interpretability and performance in aphasia speech keyword classification. When applied to attention-based CNN models, these techniques generate more focused, class-specific heatmaps, providing a deeper understanding of model behaviour, particularly in noisy and impaired speech. Our results demonstrate that these enhanced Grad-CAM methods outperform the standard Grad-CAM by offering more detailed and meaningful explanations, which is critical for interpreting models applied to aphasia speech. We compare our approach using qualitative and perturbation-based trustworthiness, infidelity and sufficiency scores as quantitative metrics. Among the techniques, ED-GCAM outperformed all others. The proposed methods significantly improve the accuracy and transparency of speech processing models, with potential suggestions for clinical applications.
引用
收藏
页数:25
相关论文
empty
未找到相关数据