SALIENCY-BASED FEATURE SELECTION STRATEGY IN STEREOSCOPIC PANORAMIC VIDEO GENERATION

被引:0
|
作者
Wang, Haoyu [1 ]
Sandin, Daniel J. [2 ]
Schonfeld, Dan [1 ]
机构
[1] Univ Illinois, Dept Elect & Comp Engn, 851 S Morgan St, Chicago, IL 60607 USA
[2] Univ Illinois, Dept Comp Sci, 851 S Morgan St, Chicago, IL 60607 USA
基金
美国国家科学基金会;
关键词
Stereoscopic Panoramic Video; Commonly-identified Feature; Saliency Map; Visual Sensitive;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
In this paper, we present one saliency-based feature selection and tracking strategy in the feature-based stereoscopic panoramic video generation system. Many existing stereoscopic video composition approaches aim at producing high-quality panoramas from multiple input cameras; however, most of them directly operate image alignment on those originally detected features without any refinement or optimization. The standard global feature extraction threshold always fails to guarantee stitching correctness of all human interested regions. Thus, based on the originally commonly identified feature set, we incorporate the saliency map into the distribution of control points to remove the redundancy in texture-rich regions and ensure the adequacy of selected features in visual sensitive regions. Intuitively, under the guidance of saliency change in the video sequence, one grid-based feature updating strategy is operated between consecutive frames instead of the standard global feature updating. The experiments show that our method can improve the stitching quality of visual important region without impairment to the human less-interested regions in the generated stereoscopic panoramic video.
引用
收藏
页码:1837 / 1841
页数:5
相关论文
共 50 条
  • [1] Saliency-based stereoscopic image retargeting
    Fang, Yuming
    Wang, Junle
    Yuan, Yuan
    Lei, Jianjun
    Lin, Weisi
    Le Callet, Patrick
    [J]. INFORMATION SCIENCES, 2016, 372 : 347 - 358
  • [2] Projection Invariant Feature and Visual Saliency-Based Stereoscopic Omnidirectional Image Quality Assessment
    Zhou, Xuemei
    Zhang, Yun
    Li, Na
    Wang, Xu
    Zhou, Yang
    Ho, Yo-Sung
    [J]. IEEE TRANSACTIONS ON BROADCASTING, 2021, 67 (02) : 512 - 523
  • [3] Saliency-based relief generation
    Wang, Meili
    Guo, Shihui
    Zhang, Hongming
    He, Dongjian
    Chang, Jian
    Zhang, Jian J.
    [J]. IETE TECHNICAL REVIEW, 2013, 30 (06) : 454 - 460
  • [4] Spectral Saliency-Based Video Deinterlacing
    Aggarwal, Umang
    Trocan, Maria
    Coudoux, Francois-Xavier
    [J]. COMPUTATIONAL COLLECTIVE INTELLIGENCE, ICCCI 2016, PT I, 2016, 9875 : 590 - 598
  • [5] Saliency-based automatic thumbnail generation
    Le Meur, Olivier
    Le Callet, Patrick
    Barba, Dominique
    [J]. TRAITEMENT DU SIGNAL, 2007, 24 (05) : 323 - 335
  • [6] Sparse embedding feature combination strategy for saliency-based visual attention system
    Zhao, Cairong
    Liu, Chuancai
    [J]. Journal of Computational Information Systems, 2010, 6 (09): : 2831 - 2838
  • [7] A scalable saliency-based feature selection method with instance-level information
    Cancela, Brais
    Bolon-Canedo, Veronica
    Alonso-Betanzos, Amparo
    Gama, Joao
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 192
  • [8] Saliency-Based Spatiotemporal Attention for Video Captioning
    Chen, Yangyu
    Zhang, Weigang
    Wang, Shuhui
    Li, Liang
    Huang, Qingming
    [J]. 2018 IEEE FOURTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM), 2018,
  • [9] Saliency-Based Sharpness Mismatch Detection For Stereoscopic Omnidirectional Images
    Croci, Simone
    Knorr, Sebastian
    Smolic, Aljosa
    [J]. 14TH EUROPEAN CONFERENCE ON VISUAL MEDIA PRODUCTION (CVMP), 2017,
  • [10] A generalised framework for saliency-based point feature detection
    Brown, Mark
    Windridge, David
    Guillemaut, Jean-Yves
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2017, 157 : 117 - 137