Object-Aware Ghost Identification and Elimination for Dynamic Scene Mosaic

被引:1
|
作者
Zhang, Zhe [1 ]
Ren, Xuhong [1 ]
Xue, Wanli [1 ]
Zhang, Chengwei [2 ]
Guo, Qing [3 ]
Chen, Shengyong [1 ]
机构
[1] Tianjin Univ Technol, Sch Comp Sci & Engn, Key Lab Comp Vis & Syst, Engn Res Ctr Learning Based Intelligent Syst,Mini, Tianjin 300384, Peoples R China
[2] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian 116026, Peoples R China
[3] Nanyang Technol Univ, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Image stitching; Transforms; Image segmentation; Distortion; Automobiles; Registers; Interpolation; Image mosaic; dynamic scene mosaic; ghost; IMAGE; ARTIFACTS; WARPS;
D O I
10.1109/TCSVT.2021.3093039
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Composite ghost is a common phenomenon that widely exists in dynamic scene image mosaic and significantly affects the naturalness of mosaic. To remove the ghost effectively and produce visually natural mosaic, we propose a novel image mosaic method by jointly identifying composite ghost and eliminating ghost regions without distorting, splitting, and duplicating objects. Specifically, our main contributions are three-fold: First, we propose the motion-aware composite ghost identification to localize the potential composite ghosts in the mosaic region (i.e., overlapping area between two images to be stitched) by detecting the salient-moving objects in two stitched images. Second, we design the object-aware alternative region selection strategy to produce ghostless regions that can replace the localized composite ghosts while avoiding object distortion, object separation, and object repetition. Third, we realize the image interpolation-based composite ghost elimination that can generate natural stitched image by eliminating the composite ghost of the initial blending result with the selected image source. We validate the proposed method on challenging datasets and show that our method outperform the state-of-the-art methods.
引用
收藏
页码:2025 / 2034
页数:10
相关论文
共 50 条
  • [1] Object-aware Identification of Microservices
    Amiri, Mohammad Javad
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON SERVICES COMPUTING (IEEE SCC 2018), 2018, : 253 - 256
  • [2] Object-Aware Guidance for Autonomous Scene Reconstruction
    Liu, Ligang
    Xia, Xi
    Sun, Han
    Shen, Qi
    Xu, Juzhan
    Chen, Bin
    Huang, Hui
    Xu, Kai
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (04):
  • [3] Spatial Perception by Object-Aware Visual Scene Representation
    Lee, Chung-Yeon
    Lee, Hyundo
    Hwang, Injune
    Zhang, Byoung-Tak
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3751 - 3758
  • [4] Object-aware interactive perception for tabletop scene exploration
    Koc, Cagatay
    Sariel, Sanem
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2024, 175
  • [5] Object-aware Contrastive Learning for Debiased Scene Representation
    Mo, Sangwoo
    Kang, Hyunwoo
    Sohn, Kihyuk
    Li, Chun-Liang
    Shin, Jinwoo
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [6] Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representation
    Kundu, Abhijit
    Genova, Kyle
    Yin, Xiaoqi
    Fathi, Alireza
    Pantofaru, Caroline
    Guibas, Leonidas
    Tagliasacchi, Andrea
    Dellaert, Frank
    Funkhouser, Thomas
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12861 - 12871
  • [7] Object-Aware Tracking
    Bogun, Ivan
    Ribeiro, Eraldo
    [J]. 2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 1695 - 1700
  • [8] SOAT: A Scene- and Object-Aware Transformer for Vision-and-Language Navigation
    Moudgil, Abhinav
    Majumdar, Arjun
    Agrawal, Harsh
    Lee, Stefan
    Batra, Dhruv
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021,
  • [9] Integrating Object-aware and Interaction-aware Knowledge for Weakly Supervised Scene Graph Generation
    Li, Xingchen
    Chen, Long
    Ma, Wenbo
    Yang, Yi
    Xiao, Jun
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 4204 - 4213
  • [10] An object-aware memory architecture
    Wright, Greg
    Seidl, Matthew L.
    Wolczko, Mario
    [J]. SCIENCE OF COMPUTER PROGRAMMING, 2006, 62 (02) : 145 - 163