Transfer Learning of Fuzzy Spatio-Temporal Rules in a Brain-Inspired Spiking Neural Network Architecture: A Case Study on Spatio-Temporal Brain Data

被引:4
|
作者
Kasabov, Nikola K. [1 ,2 ,3 ]
Tan, Yongyao [1 ]
Doborjeh, Maryam [1 ]
Tu, Enmei [4 ]
Yang, Jie [4 ]
Goh, Wilson [5 ]
Lee, Jimmy [5 ]
机构
[1] Auckland Univ Technol, Sch Engn Comp & Math Sci, Knowledge Engn & Discovery Res Inst, Auckland 1010, New Zealand
[2] Univ Ulster, Intelligent Syst Res Ctr, Belfast BT15 1ED, North Ireland
[3] Bulgarian Acad Sci, Inst Informat & Commun Technol, Sofia 1000, Bulgaria
[4] Shanghai Jiao Tong Univ, Inst Image Proc & Pattern Recognit, Shanghai 200240, Peoples R China
[5] Nanyang Technol Univ, Nanyang 639798, Singapore
关键词
EEG data; explainable AI; fuzzy spatio-temporal rules; neucube; spatio-temporal learning; spiking neural networks; transfer learning; EEG SIGNALS;
D O I
10.1109/TFUZZ.2023.3292802
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The article demonstrates for the first time that a brain-inspired spiking neural network (SNN) architecture can be used not only to learn spatio-temporal data, but also to extract fuzzy spatio-temporal rules from such data and to update these rules incrementally in a transfer learning mode. We propose a method, where a SNN model learns incrementally new time-space data related to new classes/tasks/categories, always utilizing some previously learned knowledge, and presents the evolved knowledge as fuzzy spatio-temporal rules. Similarly, to how the brain manifests transfer learning, these SNN models do not need to be restricted in number of layers and neurons in each layer as they adopt self-organizing learning principles. The continuously evolved fuzzy rules from spatio-temporal data are interpretable for a better understanding of the processes that generate the data. The proposed method is based on a brain-inspired SNN architecture NeuCube, which is structured according to a brain three-dimensional structural template. It is illustrated on tasks of incremental and transfer learning and knowledge transfer using spatio-temporal data measuring brain activity, when subjects are performing tasks in space and time. The method is a general one and opens the field to create new types of adaptable and explainable spatio-temporal learning systems across domain areas.
引用
收藏
页码:4542 / 4552
页数:11
相关论文
共 50 条
  • [21] Interactive Visualization for Brain Spatio-Temporal Networks
    Purgato, Andrea
    Santambrogio, Marco D.
    Berger-Wolf, Tanya
    Forbes, Angus G.
    2017 IEEE EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL & HEALTH INFORMATICS (BHI), 2017, : 21 - 24
  • [22] Spatio-temporal EEG models for brain interfaces
    Gonzalez-Navarro, P.
    Moghadamfalahi, M.
    Akcakaya, M.
    Erdogmus, D.
    SIGNAL PROCESSING, 2017, 131 : 333 - 343
  • [23] SPATIO-TEMPORAL ANALYSIS OF EARLY BRAIN DEVELOPMENT
    Sadeghi, Neda
    Prastawa, Marcel
    Gilmore, John H.
    Lin, Weili
    Gerig, Guido
    2010 CONFERENCE RECORD OF THE FORTY FOURTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS (ASILOMAR), 2010, : 777 - 781
  • [24] Spatio-temporal modeling of localized brain activity
    Bowman, FD
    BIOSTATISTICS, 2005, 6 (04) : 558 - 575
  • [25] An Extended Evolving Spiking Neural Network Model for Spatio-Temporal Pattern Classification
    Hamed, Haza Nuzly Abdull
    Kasabov, Nikola
    Shamsuddin, Siti Mariyam
    Widiputra, Harya
    Dhoble, Kshitij
    2011 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2011, : 2653 - 2656
  • [26] Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance
    Wen, Xianglan
    Gu, Pengjie
    Yan, Rui
    Tang, Huajin
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [27] A Biologically Inspired Approach to Learning Spatio-Temporal Patterns
    Rekabdar, Banafsheh
    Nicolescu, Monica
    Nicolescu, Mircea
    Kelley, Richard
    5TH INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING AND ON EPIGENETIC ROBOTICS (ICDL-EPIROB), 2015, : 291 - 297
  • [28] Skydiver: A Spiking Neural Network Accelerator Exploiting Spatio-Temporal Workload Balance
    Chen, Qinyu
    Gao, Chang
    Fang, Xinyuan
    Luan, Haitao
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2022, 41 (12) : 5732 - 5736
  • [29] Learning expectation in insects: A recurrent spiking neural model for spatio-temporal representation
    Arena, Paolo
    Patane, Luca
    Termini, Pietro Savio
    NEURAL NETWORKS, 2012, 32 : 35 - 45
  • [30] Dynamic spatio-temporal pruning for efficient spiking neural networks
    Gou, Shuiping
    Fu, Jiahui
    Sha, Yu
    Cao, Zhen
    Guo, Zhang
    Eshraghian, Jason K.
    Li, Ruimin
    Jiao, Licheng
    FRONTIERS IN NEUROSCIENCE, 2025, 19