MULTI-SOURCE MOTION IMAGES FUSION BASED ON 3D SPARSE REPRESENTATION

被引:0
|
作者
Zhang, Zhenhong [1 ]
Du, Junping [1 ]
Xu, Liang [1 ]
Li, Qingping [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing Key Lab Intelligent Telecommun Software &, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; 3D sparse representation; Sparse coefficients; Dictionary Training; DICTIONARIES;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to effectively fusing multi-source images of the same scene, this paper proposes a novel multi-source motion images' fusion framework based on 3d sparse representation. Compared to the single-frame image fusion technology, the temporal dimension of the motion image is needed to be considered by using sparse coefficient across the adjacent front and rear frames. This helps to obtain a more efficient algorithm and better fusion quality. In addition, the proposed algorithm uses 3D atomic block, make full use of the space-time motion image sequence information, removes redundant dictionary atoms and improves dictionary generation rules to reduce the number of iterations. The proposed fusion framework consists of four steps, i.e. training and updating the dictionary, finding the sparse coefficient, coefficient fusion, image reconstruction. The experimental results demonstrate that, the proposed based on 3D sparse representation fusion method has superior performance to the traditional methods (Dual-Tree Complex Wavelet transform, discrete wavelet transform and Ordinary sparse representation) on objective and subjective metrics.
引用
收藏
页码:624 / 629
页数:6
相关论文
共 50 条
  • [1] Multi-Source Remote Sensing Image Fusion Method Based on Sparse representation
    Yu, Xianchuan
    Gao, Guanyin
    [J]. INTERNATIONAL SYMPOSIUM ON OPTOELECTRONIC TECHNOLOGY AND APPLICATION 2014: IMAGE PROCESSING AND PATTERN RECOGNITION, 2014, 9301
  • [2] 3D model of building based on multi-source data fusion
    Wang, Yan
    Huang, Xiangyu
    Gao, Meiqi
    [J]. URBAN GEOINFORMATICS 2022, 2022, : 73 - 78
  • [3] A multi-source image fusion algorithm based on gradient regularized convolution sparse representation
    WANG Jian
    QIN Chunxia
    ZHANG Xiufei
    YANG Ke
    REN Ping
    [J]. Journal of Systems Engineering and Electronics, 2020, 31 (03) : 447 - 459
  • [4] A multi-source image fusion algorithm based on gradient regularized convolution sparse representation
    Wang Jian
    Qin Chunxia
    Zhang Xiufei
    Yang Ke
    Ren Ping
    [J]. JOURNAL OF SYSTEMS ENGINEERING AND ELECTRONICS, 2020, 31 (03) : 447 - 459
  • [5] SPARSE REPRESENTATION-BASED IMAGE FUSION FOR MULTI-SOURCE NDVI CHANGE DETECTION
    Zhang, Mengliang
    Chen, Yuerong
    Li, Song
    Tian, Xin
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 69 - +
  • [6] Robust Fusion of Multi-Source Images for Accurate 3D Reconstruction of Complex Urban Scenes
    Liang, Yubin
    Yang, Yang
    Mu, Yifan
    Cui, Tiejun
    [J]. REMOTE SENSING, 2023, 15 (22)
  • [7] Motion recognition and synthesis based on 3D sparse representation
    Xiang, Jian
    Liang, Ronghua
    [J]. SIGNAL PROCESSING, 2015, 110 : 82 - 93
  • [8] Motion Segment based on Sparse Representation and 3D Features
    Zhu, Hongli
    Xiang, Jian
    [J]. PROCEEDINGS OF THE 2017 INTERNATIONAL CONFERENCE ON MANUFACTURING ENGINEERING AND INTELLIGENT MATERIALS (ICMEIM 2017), 2017, 100 : 629 - 633
  • [9] A multi-focus image fusion method based on multi-source joint layering and convolutional sparse representation
    Hu, Yanxiang
    Chen, Zhijie
    Zhang, Bo
    Ma, Lifeng
    Li, Jiaqi
    [J]. IET IMAGE PROCESSING, 2022, 16 (01) : 216 - 228
  • [10] Validate and Update of 3D Urban Features using Multi-Source Fusion
    Arrington, Marcus
    Edwards, Dan
    Sengers, Arjan
    [J]. GEOSPATIAL INFOFUSION II, 2012, 8396