Generalized Content-Preserving Warp: Direct Photometric Alignment Beyond Color Consistency

被引:7
|
作者
Chen, Kai [1 ]
Tu, Jingmin [1 ]
Yao, Jian [1 ]
Li, Jie [2 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Hubei, Peoples R China
[2] Hubei Univ Technol, Sch Elect & Elect Engn, Wuhan 430068, Hubei, Peoples R China
来源
IEEE ACCESS | 2018年 / 6卷
基金
中国国家自然科学基金;
关键词
Motion estimation; photometric constraint; color difference; image stitching; video stabilization; LINE SEGMENT DETECTOR; VIDEO STABILIZATION; HOMOGRAPHY;
D O I
10.1109/ACCESS.2018.2877794
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Motion estimation is vital in many computer vision applications. Most existing methods require high quality and large quantity of feature correspondence and may fail for images with few textures. In this paper, a photometric alignment method is proposed to obtain better motion estimation result. Since the adopted photometric constraints are usually limited to the required illumination or color consistency assumption, a new generalized content-preserving warp (GCPW) framework, therefore, is designed to perform photometric alignment beyond color consistency. Similar to conventional content-preserving warp (CPW), GCPW is also a mesh-based framework, but it extends CPW by appending a local color transformation model for every mesh quad, which expresses the color transformation from a source image to a target image within the quad. Motion-related mesh vertexes and color-related mapping parameters are optimized jointly in GCPW to get more robust motion estimation results. Evaluation of tens of videos reveals that the proposed method achieves more accurate motion estimation results. More importantly, it is robust to significant color variation. Besides, this paper explores the performance of GCPW in two popular computer vision applications: image stitching and video stabilization. Experimental results demonstrate GCPW's effectiveness in dealing with typical challenging scenes for these two applications.
引用
收藏
页码:69835 / 69849
页数:15
相关论文
共 1 条
  • [1] Introducing Pose Consistency and Warp-Alignment for Self-Supervised 6D Object Pose Estimation in Color Images
    Sock, Juil
    Garcia-Hernando, Guillermo
    Armagan, Anil
    Kim, Tae-Kyun
    2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, : 291 - 300