A new fusion framework for motion segmentation in dynamic scenes

被引:3
|
作者
Khelifi, Lazhar [1 ]
Mignotte, Max [1 ]
机构
[1] Univ Montreal, Dept Comp Sci & Operat Res, Image Proc Lab, Montreal, PQ, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Motion segmentation; dynamic texture segmentation; fusion framework; optimisation; global consistency error (GCE);
D O I
10.1080/19479832.2021.1900408
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Motion segmentation in dynamic scenes is currently widely dominated by parametric methods based on deep neural networks. The present study explores the unsupervised segmentation approach that can be used in the absence of training data to segment new videos. In particular, it tackles the task of dynamic texture segmentation. By automatically assigning a single class label to each region or group, this task consists of clustering into groups complex phenomena and characteristics which are both spatially and temporally repetitive. We present an effective fusion framework for motion segmentation in dynamic scenes (FFMS). This model is designed to merge different segmentation maps that contain multiple and weak quality regions in order to achieve a more accurate final result of segmentation. The diverse labelling fields required for the combination process are obtained by a simplified grouping scheme applied to an input video (on the basis of a three orthogonal planes: xy, yt and xt). Experiments conducted on two challenging datasets (SynthDB and YUP++) show that, contrary to current motion segmentation approaches that either require parameter estimation or a training step, FFMS is significantly faster, easier to code, simple and has limited parameters.
引用
收藏
页码:99 / 121
页数:23
相关论文
共 50 条
  • [1] A Consensus Model for Motion Segmentation in Dynamic Scenes
    Thanh Minh Nguyen
    Wu, Qingming Jonathan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2016, 26 (12) : 2240 - 2249
  • [2] Joint Motion Segmentation and Background Estimation in Dynamic Scenes
    Mumtaz, Adeel
    Zhang, Weichen
    Chan, Antoni B.
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 368 - 375
  • [3] A Dynamic Bayesian Framework for Motion Segmentation
    Thanh Minh Nguyen
    Wu, Q. M. Jonathan
    [J]. 2013 INTERNATIONAL CONFERENCE ON COMPUTER AND ROBOT VISION (CRV), 2013, : 332 - 339
  • [4] A New Approach for Salient Motion in Dynamic Scenes
    Liu, Min
    Liu, Weizhong
    Zhang, Daoli
    [J]. FIFTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2012): COMPUTER VISION, IMAGE ANALYSIS AND PROCESSING, 2013, 8783
  • [5] A Real-Time Dynamic Object Segmentation Framework for SLAM System in Dynamic Scenes
    Chang, Jianfang
    Dong, Na
    Li, Donghui
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [6] Joint Semantic and Motion Segmentation for Dynamic Scenes using Deep Convolutional Networks
    Haque, Nazrul
    Reddy, Dinesh
    Krishna, K. Madhava
    [J]. PROCEEDINGS OF THE 12TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISIGRAPP 2017), VOL 5, 2017, : 75 - 85
  • [7] Motion Segmentation Algorithm for Dynamic Scenes over H.264 Video
    Solana-Cipres, Cayetano J.
    Rodriguez-Benitez, Luis
    Moreno-Garcia, Juan
    Jimenez-Linares, Luis
    [J]. INFORMATION PROCESSING AND MANAGEMENT OF UNCERTAINTY IN KNOWLEDGE-BASED SYSTEMS: APPLICATIONS, PT II, 2010, 81 : 572 - +
  • [8] VSLAM algorithm based on instance segmentation and motion consistency constraints in dynamic scenes
    Chen, Mengyuan
    Qian, Runbang
    Guo, Hangrong
    Gong, Guangqiang
    [J]. Zhongguo Guanxing Jishu Xuebao/Journal of Chinese Inertial Technology, 2023, 31 (10): : 986 - 995
  • [9] Visual motion pattern extraction and fusion for collision detection in complex dynamic scenes
    Yue, Shigang
    Rind, F. Claire
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2006, 104 (01) : 48 - 60
  • [10] Volume fusion: A unified framework for multi-scale dynamic and heterogeneous scenes
    Liao, Duoduo
    Fang, Shiaofen
    [J]. PROCEEDINGS OF THE 2006 WINTER SIMULATION CONFERENCE, VOLS 1-5, 2006, : 2287 - 2287