Transfer Learning of Fuzzy Spatio-Temporal Rules in a Brain-Inspired Spiking Neural Network Architecture: A Case Study on Spatio-Temporal Brain Data

被引:4
|
作者
Kasabov, Nikola K. [1 ,2 ,3 ]
Tan, Yongyao [1 ]
Doborjeh, Maryam [1 ]
Tu, Enmei [4 ]
Yang, Jie [4 ]
Goh, Wilson [5 ]
Lee, Jimmy [5 ]
机构
[1] Auckland Univ Technol, Sch Engn Comp & Math Sci, Knowledge Engn & Discovery Res Inst, Auckland 1010, New Zealand
[2] Univ Ulster, Intelligent Syst Res Ctr, Belfast BT15 1ED, North Ireland
[3] Bulgarian Acad Sci, Inst Informat & Commun Technol, Sofia 1000, Bulgaria
[4] Shanghai Jiao Tong Univ, Inst Image Proc & Pattern Recognit, Shanghai 200240, Peoples R China
[5] Nanyang Technol Univ, Nanyang 639798, Singapore
关键词
EEG data; explainable AI; fuzzy spatio-temporal rules; neucube; spatio-temporal learning; spiking neural networks; transfer learning; EEG SIGNALS;
D O I
10.1109/TFUZZ.2023.3292802
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The article demonstrates for the first time that a brain-inspired spiking neural network (SNN) architecture can be used not only to learn spatio-temporal data, but also to extract fuzzy spatio-temporal rules from such data and to update these rules incrementally in a transfer learning mode. We propose a method, where a SNN model learns incrementally new time-space data related to new classes/tasks/categories, always utilizing some previously learned knowledge, and presents the evolved knowledge as fuzzy spatio-temporal rules. Similarly, to how the brain manifests transfer learning, these SNN models do not need to be restricted in number of layers and neurons in each layer as they adopt self-organizing learning principles. The continuously evolved fuzzy rules from spatio-temporal data are interpretable for a better understanding of the processes that generate the data. The proposed method is based on a brain-inspired SNN architecture NeuCube, which is structured according to a brain three-dimensional structural template. It is illustrated on tasks of incremental and transfer learning and knowledge transfer using spatio-temporal data measuring brain activity, when subjects are performing tasks in space and time. The method is a general one and opens the field to create new types of adaptable and explainable spatio-temporal learning systems across domain areas.
引用
收藏
页码:4542 / 4552
页数:11
相关论文
共 50 条
  • [41] Spatio-temporal sequence processing with the counterpropagation neural network
    Wang, LP
    INFORMATION INTELLIGENCE AND SYSTEMS, VOLS 1-4, 1996, : 831 - 835
  • [42] Learning Dynamic Graph Representation of Brain Connectome with Spatio-Temporal Attention
    Kim, Byung-Hoon
    Ye, Jong Chul
    Kim, Jae-Jin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [43] FEST: LEARNING SPATIO-TEMPORAL PRIORS FOR FETAL BRAIN MRI SEGMENTATION
    Penuela, Maria F.
    Vargas, Luisa
    Usma, Santiago
    Escobar, Maria
    Castillo, Angela
    Arbelaez, Pablo
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [44] Hybrid neural network for spatio-temporal pattern recognition
    Beijing Univ of Technology, Beijing, China
    Zhongguo Shengwu Yixue Gongcheng Xuebao, 2 (1-6):
  • [45] A neural network filter for complex spatio-temporal patterns
    Ma, JW
    Huang, DZ
    PROCEEDING OF THE 2002 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-3, 2002, : 1028 - 1033
  • [46] STNN: A Spatio-Temporal Neural Network for Traffic Predictions
    He, Zhixiang
    Chow, Chi-Yin
    Zhang, Jia-Dong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (12) : 7642 - 7651
  • [47] Spatio-temporal brain dynamics during card sorting
    Pozo, MA
    INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 1998, 30 (1-2) : 148 - 148
  • [48] STAB: a spatio-temporal cell atlas of the human brain
    Song, Liting
    Pan, Shaojun
    Zhang, Zichao
    Jia, Longhao
    Chen, Wei-Hua
    Zhao, Xing-Ming
    NUCLEIC ACIDS RESEARCH, 2021, 49 (D1) : D1029 - D1037
  • [49] A novel method for spatio-temporal pattern analysis of brain fMRI data
    Liu, YD
    Zhou, ZT
    Hu, DW
    Yan, LR
    Tan, CL
    Wu, DX
    Yao, SQ
    SCIENCE IN CHINA SERIES F-INFORMATION SCIENCES, 2005, 48 (02): : 151 - 160
  • [50] A Neural Network Model for a Hierarchical Spatio-temporal Memory
    Ramanathan, Kiruthika
    Shi, Luping
    Li, Jianming
    Lim, Kian Guan
    Li, Ming Hui
    Ang, Zhi Ping
    Chong, Tow Chong
    ADVANCES IN NEURO-INFORMATION PROCESSING, PT I, 2009, 5506 : 428 - +