Multi-View Broad Learning System for Primate Oculomotor Decision Decoding

被引:23
|
作者
Shi, Zhenhua [1 ]
Chen, Xiaomo [2 ]
Zhao, Changming [1 ]
He, He [1 ]
Stuphorn, Veit [3 ,4 ]
Wu, Dongrui [1 ]
机构
[1] Huazhong Univ Sci & Technol, Minist Educ Key Lab Image Proc & Intelligent Cont, Sch Artificial Intelligence & Automat, Wuhan 430074, Peoples R China
[2] Johns Hopkins Univ, Sch Med, Zanvyl Krieger Mind & Brain Inst, Baltimore, MD 21205 USA
[3] Johns Hopkins Univ, Dept Neurosci, Baltimore, MD 21218 USA
[4] Johns Hopkins Univ, Sch Med, Baltimore, MD 21205 USA
基金
中国国家自然科学基金; 美国国家卫生研究院;
关键词
Feature extraction; Decoding; Learning systems; Computer architecture; Sparse matrices; Data mining; Biological neural networks; Broad learning system; local field potentials; action potentials; multi-view learning; primate oculomotor decision; LOCAL-FIELD POTENTIALS; GRASP KINEMATICS; SPIKING ACTIVITY; HYBRID SIGNALS; PRIMARY MOTOR; SPIKES; REACH; CLASSIFICATION; PERFORMANCE; CORTEX;
D O I
10.1109/TNSRE.2020.3003342
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Multi-view learning improves the learning performance by utilizing multi-view data: data collected from multiple sources, or feature sets extracted from the same data source. This approach is suitable for primate brain state decoding using cortical neural signals. This is because the complementary components of simultaneously recorded neural signals, local field potentials (LFPs) and action potentials (spikes), can be treated as two views. In this paper, we extended broad learning system (BLS), a recently proposed wide neural network architecture, from single-view learning to multi-view learning, and validated its performance in decoding monkeys' oculomotor decision from medial frontal LFPs and spikes. We demonstrated that medial frontal LFPs and spikes in non-human primate do contain complementary information about the oculomotor decision, and that the proposed multi-view BLS is a more effective approach for decoding the oculomotor decision than several classical and state-of-the-art single-view and multi-view learning approaches.
引用
收藏
页码:1908 / 1920
页数:13
相关论文
共 50 条
  • [1] Multi-view broad learning system for electricity theft detection
    Yang, Kaixiang
    Chen, Wuxing
    Bi, Jichao
    Wang, Mengzhi
    Luo, Fengji
    [J]. APPLIED ENERGY, 2023, 352
  • [2] Stacking multi-view broad learning system with residual structures for classification
    Huang, Tao
    Li, Hua
    Zhou, Gui
    Li, Shaobo
    [J]. INFORMATION SCIENCES, 2024, 669
  • [3] Decoding Path Selection for Multi-view Video System
    Yu, Mei
    He, Renlong
    Jiang, Gangyi
    Fu, Randi
    Wang, Yigang
    [J]. 2010 6TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS NETWORKING AND MOBILE COMPUTING (WICOM), 2010,
  • [4] Multi-view daily action recognition based on Hooke balanced matrix and broad learning system
    Liu, Zhigang
    Lu, Bingshuo
    Wu, Yin
    Gao, Chunlei
    [J]. IMAGE AND VISION COMPUTING, 2024, 143
  • [5] Multi-view representation learning for multi-view action recognition
    Hao, Tong
    Wu, Dan
    Wang, Qian
    Sun, Jin-Sheng
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 48 : 453 - 460
  • [6] MULTI-VIEW METRIC LEARNING FOR MULTI-VIEW VIDEO SUMMARIZATION
    Wang, Linbo
    Fang, Xianyong
    Guo, Yanwen
    Fu, Yanwei
    [J]. 2016 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW), 2016, : 179 - 182
  • [7] Rendering-oriented decoding for distributed multi-view coding system
    Taguchi, Yuichi
    Naemura, Takeshi
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 213 - 216
  • [8] Auditory Attention Decoding with Task-Related Multi-View Contrastive Learning
    Chen, Xiaoyu
    Du, Changde
    Zhou, Qiongyi
    He, Huiguang
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 6025 - 6033
  • [9] Multi-view dreaming: multi-view world model with contrastive learning
    Kinose, Akira
    Okumura, Ryo
    Okada, Masashi
    Taniguchi, Tadahiro
    [J]. Advanced Robotics, 2023, 37 (19) : 1212 - 1220
  • [10] Unsupervised Multi-view Learning
    Huang, Ling
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 6442 - 6443