A bio-inspired motion sensitive model and its application to estimating human gaze positions under classified driving conditions

被引:19
|
作者
Xu, Jiawei [1 ]
Park, Seop Hyeong [2 ]
Zhang, Xiaoqin [3 ]
机构
[1] Newcastle Univ, Sch Comp, Newcastle Upon Tyne NE4 5TG, Tyne & Wear, England
[2] Hallym Univ, Dept Elect Engn, Chunchon 200702, South Korea
[3] Wenzhou Univ, Dept Comp Sci, Wenzhou 325035, Peoples R China
基金
中国国家自然科学基金;
关键词
Human gaze positions in driving; Sensitivity on motion cues; Biological motion vision; Spatio-temporal regularity; VISUAL-ATTENTION; DIRECTION SELECTIVITY; CONTOURLET TRANSFORM; GANGLION-CELLS; SALIENCY; INHIBITION; MECHANISMS; EXTRACTION; DROSOPHILA; DETECTORS;
D O I
10.1016/j.neucom.2018.09.093
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human visual attention performs the spatio-temporal regularity, an inherent regularity in dynamic vision, for the natural visual tasks. However, recent computational visual attention models still have deficiency to reflect the spatio-temporal regularity thoroughly. Motivated by this, we propose a bio-inspired motion sensitive model to estimate human gaze positions in driving. The proposed model has four key advantages. First, inspired by two types of motion sensitive neurons, this model can perceive the motion cues from different directions spatially and temporally. Second, compared to conventional deep learning based models, this model does not rely on expensive training samples with gaze annotations. Third, the proposed model is based upon the visual signal processing without constructing a complex deep neural network architecture, which enables this model to be implemented with low-cost hardware. Fourth, inspired by the visual pathway in drosophila motion vision, the visual signal processing on directional and depth motion sensitive map largely enhances this model's competence in a similar way of human gaze positions in driving. To test this proposed model, we collect a driving scene dataset from the perspective of egocentric vision that aims to systematically evaluate the performance of spatio-temporal visual attentional models. The video clips in the dataset are categorized into ten popular driving conditions. The proposed model is evaluated by comparing with the human baseline of the gaze positions. Experimental results demonstrate that the proposed model can effectively estimate the human gaze positions in driving and consistently outperforms traditional visual attention models as well as the deep learning based model. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:23 / 35
页数:13
相关论文
共 11 条
  • [1] Bio-Inspired Model for Robust Motion Detection Under Noisy Conditions
    Brinkworth, Russell S. A.
    O'Carroll, David C.
    2010 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS IJCNN 2010, 2010,
  • [2] A new bio-inspired model for network security and its application
    Wang, HQ
    Wang, J
    Zhao, GS
    ADVANCED WEB AND NETWORK TECHNOLOGIES, AND APPLICATIONS, PROCEEDINGS, 2006, 3842 : 756 - 759
  • [3] A bio-inspired contrast adaptation model and its application for automatic lane marks detection
    Hardzeyeu, Valiantsin
    Klefenz, Frank
    BIOSIGNALS 2008: PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON BIO-INSPIRED SYSTEMS AND SIGNAL PROCESSING, VOL II, 2008, : 513 - 520
  • [4] A Phase Model of the Bio-Inspired NbOx Local Active Memristor under Weak Coupling Conditions
    Ma, Xuetiao
    Shen, Yiran
    MICROMACHINES, 2024, 15 (03)
  • [5] Classifying Bio-Inspired Model of Point-Light Human Motion Using Echo State Networks
    Tanisaro, Pattreeya
    Lehman, Constantin
    Suetfeld, Leon
    Pipa, Gordon
    Heidemann, Gunther
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2017, PT I, 2017, 10613 : 84 - 91
  • [6] Application of bio-inspired algorithms in maximum power point tracking for PV systems under partial shading conditions - A review
    Li, Guiqiang
    Jin, Yi
    Akram, M. W.
    Chen, Xiao
    Ji, Jie
    RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2018, 81 : 840 - 873
  • [7] Computational Multi-scale Constitutive Model for Wood Cell wall and its Application to the Design of Bio-inspired Composites
    Flores, E. I. Saavedra
    Murugan, M. S.
    Friswell, M. I.
    Neto, E. A. de Souza
    BIOINSPIRATION, BIOMIMETICS, AND BIOREPLICATION, 2011, 7975
  • [8] Empowering human-like walking with a bio-inspired gait controller for an under-actuated torque-driven human model
    Amini, Samane
    Kardan, Iman
    Seth, Ajay
    Akbarzadeh, Alireza
    BIOINSPIRATION & BIOMIMETICS, 2025, 20 (02)
  • [9] Design of a Novel Bio-Inspired Three Degrees of Freedom (3DOF) Spherical Robotic Manipulator and Its Application in Human-Robot Interactions
    Soltanov, Suleyman
    Roberts, Rodney
    ROBOTICS, 2025, 14 (02)
  • [10] MODEL SIMULATION OF SOLUTE LEACHING AND ITS APPLICATION FOR ESTIMATING THE NET RATE OF NITRATE FORMATION UNDER FIELD CONDITIONS
    OTOMA, S
    KUBOI, T
    JOURNAL OF HYDROLOGY, 1985, 82 (3-4) : 193 - 209