Learning Camera Parameters With Weighted Edge Attention From Single-View Images

被引:0
|
作者
Jeong, Moonsoo [1 ]
Byun, Hyogeun [2 ]
Lee, Sungkil [1 ,2 ]
机构
[1] Sungkyunkwan Univ, Dept Elect & Comp Engn, Suwon 16419, South Korea
[2] Sungkyunkwan Univ, Dept Comp Sci & Engn, Suwon 16419, South Korea
基金
新加坡国家研究基金会;
关键词
Cameras; Image edge detection; Estimation; Distortion; Edge computing; Deep learning; Task analysis; weighted edge attention; camera rotation; field of view; distortion parameter; AUTOMATIC UPRIGHT ADJUSTMENT; VANISHING POINTS; CALIBRATION; MODEL;
D O I
10.1109/ACCESS.2023.3246260
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a novel Deep Learning (DL) model that estimates camera parameters, including camera rotations, field of view, and distortion parameter, from single-view images. The classical approach often analyzes geometric cues such as vanishing points, but is constrained only when geometric cues exist in images. To alleviate such constraints, we use DL, and employ implicit geometric cues, which can reflect the inter-image changes of camera parameters and be observed more frequently in images. Our geometric cues are inspired by two important intuitions: 1) geometric appearance changes caused by camera parameters are the most prominent in object edges; 2) spatially consistent objects (in size and shape) better reflect the inter-image changes of camera parameters. To realize our approach, we propose a weighted edge-attention mechanism that assigns higher weights onto the edges of spatially consistent objects. Our experiments prove that our edge-driven geometric emphasis significantly improves the estimation accuracy of the camera parameters than the existing DL-based approaches.
引用
收藏
页码:16896 / 16906
页数:11
相关论文
共 50 条
  • [1] Single-View View Synthesis with Multiplane Images
    Tucker, Richard
    Snavely, Noah
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 548 - 557
  • [2] Generating full-view face images from a single-view image
    Zhong, Lei
    Bai, ChangMin
    Li, Jianfeng
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [3] Generating full-view face images from a single-view image
    Zhong, Lei
    Bai, ChangMin
    Li, Jianfeng
    [J]. Proceedings of the International Joint Conference on Neural Networks, 2021, 2021-July
  • [4] Human Body Pose Recognition from a Single-View Depth Camera
    Huang, Po-Chi
    Jeng, Shyh-Kang
    [J]. PROCEEDINGS 2012 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2012, : 2144 - 2149
  • [5] Generative View Synthesis: From Single-view Semantics to Novel-view Images
    Habtegebrial, Tewodros
    Jampani, Varun
    Gallo, Orazio
    Stricker, Didier
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [6] Unsupervised cycle optimization learning for single-view depth and camera pose with Kalman filter
    Gu, Tianhao
    Wang, Zhe
    Chi, Ziqiu
    Zhu, Yiwen
    Du, Wenli
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 106
  • [7] A novel multi-view learning developed from single-view patterns
    Wang, Zhe
    Chen, Songcan
    Gao, Daqi
    [J]. PATTERN RECOGNITION, 2011, 44 (10-11) : 2395 - 2413
  • [8] Shape and Refractive Index Recovery from Single-View Polarisation Images
    Huynh, Cong Phuoc
    Robles-Kelly, Antonio
    Hancock, Edwin
    [J]. 2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 1229 - 1236
  • [9] Artificial intelligence to estimate wine volume from single-view images
    Cobo, Miriam
    Heredia, Ignacio
    Aguilar, Fernando
    Iglesias, Lara Lloret
    Garcia, Daniel
    Bartolome, Begona
    Moreno-Arribas, M. Victoria
    Yuste, Silvia
    Perez-Matute, Patricia
    Motilva, Maria-Jose
    [J]. HELIYON, 2022, 8 (09)
  • [10] Learning pose-invariant 3D object reconstruction from single-view images
    Peng, Bo
    Wang, Wei
    Dong, Jing
    Tan, Tieniu
    [J]. NEUROCOMPUTING, 2021, 423 : 407 - 418