Attending to motion: Localizing and classifying motion patterns in image sequences

被引:0
|
作者
Tsotsos, JK [1 ]
Pomplun, M
Liu, YJ
Martinez-Trujillo, JC
Simine, E
机构
[1] York Univ, Ctr Vis Res, N York, ON M3J 1P3, Canada
[2] Univ Massachusetts, Dept Comp Sci, Boston, MA 02125 USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Selective Tuning Model is a proposal for modelling visual attention in primates and humans. Although supported by significant biological evidence, it is not without its weaknesses. The main one addressed by this paper is that the levels of representation on which it was previously demonstrated (spatial Gaussian pyramids) were not biologically plausible. The motion domain was chosen because enough is known about motion processing to enable a reasonable attempt at defining the feedforward pyramid. The effort is unique because it seems that no past model presents a motion hierarchy plus attention to motion. We propose a neurally-inspired model of the primate visual motion system attempting to explain how a hierarchical feedforward network consisting of layers representing cortical areas V1, MT, MST, and 7a detects and classifies different kinds of motion patterns. The STM model is then integrated into this hierarchy demonstrating that successfully attending to motion patterns, results in localization and labelling of those patterns.
引用
收藏
页码:439 / 452
页数:14
相关论文
共 50 条
  • [1] Attending to visual motion: Localizing and classifying affine motion patterns
    Tsotsos, JK
    Pomplun, M
    Martinez-Trujillo, JC
    Zhou, KH
    [J]. 1ST CANADIAN CONFERENCE ON COMPUTER AND ROBOT VISION, PROCEEDINGS, 2004, : 452 - 462
  • [2] MOTION TUBES FOR THE REPRESENTATION OF IMAGE SEQUENCES
    Urvoy, M.
    Cammas, N.
    Pateux, S.
    Deforges, O.
    Babel, M.
    Pressigout, M.
    [J]. ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 105 - +
  • [3] On the motion and appearance of specularities in image sequences
    Swaminathan, R
    Kang, SB
    Szeliski, R
    Criminisi, A
    Nayar, SK
    [J]. COMPUTER VISON - ECCV 2002, PT 1, 2002, 2350 : 508 - 523
  • [4] A Survey of Motion Detection in Image Sequences
    Arora, Ishita
    Gangadharappa, M.
    [J]. PROCEEDINGS OF THE 2019 6TH INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT (INDIACOM), 2019, : 215 - 223
  • [5] Analysis of motion and curvature in image sequences
    Barth, E
    Stuke, I
    Mota, C
    [J]. FIFTH IEEE SOUTHWEST SYMPOSIUM ON IMAGE ANALYSIS AND INTERPRETATION, PROCEEDINGS, 2002, : 206 - 210
  • [6] Motion estimation on infrared image sequences
    Collet, C
    Fablet, R
    [J]. TARGETS AND BACKGROUNDS: CHARACTERIZATION AND REPRESENTATION V, 1999, 3699 : 67 - 77
  • [7] MOTION AND STRUCTURE FACTORIZATION AND SEGMENTATION OF LONG MULTIPLE MOTION IMAGE SEQUENCES
    DEBRUNNER, C
    AHUJA, N
    [J]. LECTURE NOTES IN COMPUTER SCIENCE, 1992, 588 : 217 - 221
  • [8] COMPARISON OF VIDEO SEQUENCES WITH HISTOGRAMS OF MOTION PATTERNS
    Almeida, Jurandy
    Leite, Neucimar J.
    Torres, Ricardo da S.
    [J]. 2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011,
  • [9] A robust method for motion estimation in image sequences
    Mecke, R
    Michaelis, B
    [J]. ARTICULATED MOTION AND DEFORMABLE OBJECTS, PROCEEDINGS, 2000, 1899 : 108 - 119
  • [10] CLOUD MOTION ESTIMATION IN SEVIRI IMAGE SEQUENCES
    Marcello, Javier
    Eugenio, Francisco
    Marques, Ferran
    [J]. 2009 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS 1-5, 2009, : 1944 - 1947