Bio-Inspired Small Target Motion Detection With Spatio-Temporal Feedback in Natural Scenes

被引:2
|
作者
Wang, Hongxin [1 ]
Zhong, Zhiyan [2 ]
Lei, Fang [3 ]
Peng, Jigen [1 ]
Yue, Shigang [4 ]
机构
[1] Guangzhou Univ, Machine Life & Intelligence Res Ctr, Sch Math & Informat Sci, Guangzhou 510006, Peoples R China
[2] Guangdong Polytech Normal Univ, Sch Automat, Guangzhou 510665, Peoples R China
[3] Guangdong Univ Petrochem Technol, Sch Elect & Informat Engn, Maoming 525000, Peoples R China
[4] Univ Leicester, Sch Comp & Math Sci, Leicester LE1 7RH, England
基金
中国国家自然科学基金;
关键词
Visualization; Visual systems; Motion detection; Neurons; Insects; Feature extraction; Dynamics; Biologically inspired visual system; small target motion detection; natural scenes; spatio-temporal feedback; population coding; VISUAL-MOTION; NETWORK;
D O I
10.1109/TIP.2023.3345153
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Small moving objects at far distance always occupy only one or a few pixels in image and exhibit extremely limited visual features, which bring great challenges to motion detection. Highly evolved visual systems endow flying insects with remarkable ability to pursue tiny mates and prey, providing a good template to develop image processing method for small target motion detection. The insects' excellent sensitivity to small moving objects is believed to come from a class of specific neurons called small target motion detectors (STMDs). However, existing STMD-based methods often experience performance degradation when coping with complex natural scenes. In this paper, we propose a bio-inspired visual system with spatio-temporal feedback mechanism (called Spatio-Temporal Feedback STMD) to suppress false positive background movement while enhancing system responses to small targets. Specifically, the proposed visual system is composed of two complementary subnetworks and a feedback loop. The first subnetwork is designed to extract spatial and temporal movement patterns of cluttered background by neuronal ensemble coding. The second subnetwork is developed to capture small target motion information where its output and signal from the first subnetwork are integrated together via the feedback loop to filter out background false positives in a recurrent manner. Experimental results demonstrate that the proposed spatio-temporal feedback visual system is more competitive than existing methods in discriminating small moving targets from complex natural environments.
引用
收藏
页码:451 / 465
页数:15
相关论文
共 50 条
  • [1] Bio-inspired Target Detection in Natural Scenes: Optimal Thresholds and Ego-motion
    Wiederman, Steven D.
    Brinkworth, Russell S. A.
    O'Carroll, David C.
    [J]. BIOSENSING, 2008, 7035
  • [2] Bio-inspired Motion Attention for Gist Perception under Spatio-Temporal Dimension
    Xu, Jiawei
    Yue, Shigang
    [J]. 2013 AASRI CONFERENCE ON PARALLEL AND DISTRIBUTED COMPUTING AND SYSTEMS, 2013, 5 : 243 - 248
  • [3] Bio-Inspired Small Target Discrimination in High Dynamic Range Natural Scenes
    Wiederman, Steven. D.
    Brinkworth, Russell S. A.
    O'Carroll, David C.
    [J]. 2008 THIRD INTERNATIONAL CONFERENCE ON BIO-INSPIRED COMPUTING: THEORIES AND APPLICATIONS, 2008, : 109 - 116
  • [4] A Bio-inspired System for Boundary Detection in Color Natural Scenes
    Komati, Karin S.
    Salles, Evandro O. T.
    Sarcinelli-Filho, Mario
    [J]. COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2012, PT II, 2012, 7334 : 739 - 752
  • [5] A bio-inspired system for spatio-temporal recognition in static and video imagery
    Khosla, Deepak
    Moore, Christopher K.
    Chelian, Suhas
    [J]. INTELLIGENT COMPUTING: THEORY AND APPLICATIONS V, 2007, 6560
  • [6] Design of bio-inspired network models for spatio-temporal pattern identification
    Corinto, Fernando
    Lanza, Valentina
    Gilli, Marco
    [J]. 2007 EUROPEAN CONFERENCE ON CIRCUIT THEORY AND DESIGN, VOLS 1-3, 2007, : 292 - +
  • [7] Bio-inspired visual neural network on spatio-temporal depth rotation perception
    Hu, Bin
    Zhang, Zhuhong
    [J]. NEURAL COMPUTING & APPLICATIONS, 2021, 33 (16): : 10351 - 10370
  • [8] Bio-inspired visual neural network on spatio-temporal depth rotation perception
    Bin Hu
    Zhuhong Zhang
    [J]. Neural Computing and Applications, 2021, 33 : 10351 - 10370
  • [9] Bio-Inspired Video Enhancement for Small Moving Target Detection
    Uzair, Muhammad
    Brinkworth, Russell S. A.
    Finn, Anthony
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 1232 - 1244
  • [10] Bio-inspired analog parallel array processor chip with programmable spatio-temporal dynamics
    Carmona, R
    Jiménez-Garrido, F
    Domínguez-Castro, R
    Espejo, S
    Rodríguez-Vázquez, A
    [J]. 2002 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL V, PROCEEDINGS, 2002, : 613 - 616