The spiking neural network based on fMRI for speech recognition

被引:3
|
作者
Song, Yihua [1 ,2 ]
Guo, Lei [1 ,2 ]
Man, Menghua [3 ]
Wu, Youxi [4 ]
机构
[1] Hebei Univ Technol, Sch Hlth Sci & Biomed Engn, Hebei Key Lab Bioelectromagnet & Neuroengn, Tianjin 300131, Peoples R China
[2] Hebei Univ Technol, State Key Lab Reliabil & Intelligence Elect Equipm, Tianjin 300401, Peoples R China
[3] Army Engn Univ PLA, Shijiazhuang Campus, Shijiazhuang 050000, Hebei, Peoples R China
[4] Hebei Univ Technol, Sch Artificial Intelligence, Tianjin 300401, Peoples R China
关键词
functional Magnetic Resonance Imaging; Functional brain network; Spiking neural network; Speech recognition; Neuronal firing activity; Neural information transmission; LIQUID-STATE-MACHINE; MODEL; CLASSIFICATION; ROBUSTNESS; PLASTICITY;
D O I
10.1016/j.patcog.2024.110672
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The structure of the human brain has evolved to achieve extraordinary computing power through continuous refinement by natural selection. At present, the topology of brain -like model lacks biological plausibility. In this paper, a new brain -like model is proposed, called fMRI-SNN, which is a spiking neural network (SNN) constrained by the topology of a functional brain network from human functional Magnetic Resonance Imaging (fMRI) data. To verify its performance, this fMRI-SNN is applied to speech recognition. Our results indicate that the recognition accuracy of fMRI-SNN is superior to that of other SNNs and reported methods, and exhibits stronger performance on more difficult speech recognition tasks. Our discussion on recognition mechanism finds the advantage of fMRI-SNN is that the differences in its neuronal firing patterns are greater than those of other SNNs, since it has better information transmission ability.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Donggan speech recognition based on deep neural network
    Xu, Haiyan
    Yang, Hongwu
    You, Yuren
    PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019), 2019, : 354 - 358
  • [22] Spiking neural network-based control chart pattern recognition
    Awadalla, Medhat H. A.
    Sadek, M. Abdellatif
    ALEXANDRIA ENGINEERING JOURNAL, 2012, 51 (01) : 27 - 35
  • [23] Continuous Speech Recognition based on Convolutional Neural Network
    Zhang, Qing-qing
    Liu, Yong
    Pan, Jie-lin
    Yan, Yong-hong
    SEVENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2015), 2015, 9631
  • [24] An Optimal Method for Speech Recognition Based on Neural Network
    Ishak, Mohamad Khairi
    Madsen, Dag oivind
    Al-Zahrani, Fahad Ahmed
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 36 (02): : 1951 - 1961
  • [25] Primi Speech Recognition Based on Deep Neural Network
    Hu, Wenjun
    Fu, Meijun
    Pan, Wenlin
    2016 IEEE 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS (IS), 2016, : 667 - 671
  • [26] Indonesian speech recognition based on Deep Neural Network
    Yang, Ruolin
    Yang, Jian
    Lu, Yu
    2021 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP), 2021, : 36 - 41
  • [27] A Neural Network based on Sequence Learning for Speech Recognition
    Elmisery, Fathy A.
    Starzyk, Janusz A.
    ICCES: 2008 INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING & SYSTEMS, 2007, : 139 - +
  • [28] Deep Convolutional Spiking Neural Network Based Hand Gesture Recognition
    Ke, Weijie
    Xing, Yannan
    Di Caterina, Gaetano
    Petropoulakis, Lykourgos
    Soraghan, John
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [29] Noisy Speech Recognition Based On RBF Neural Network
    Yan Gang
    Kong Haidong
    Yu Yang
    Zheng Xiaoxia
    ADVANCED MATERIALS AND INFORMATION TECHNOLOGY PROCESSING, PTS 1-3, 2011, 271-273 : 597 - 602
  • [30] Speech Emotion Recognition Based on Deep Neural Network
    Zhu, Zijiang
    Hu, Yi
    Li, Junshan
    Li, Jianjun
    Wang, Junhua
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2020, 126 : 154 - 154