Intrinsic Image Decomposition Using Optimization and User Scribbles

被引:74
|
作者
Shen, Jianbing [1 ]
Yang, Xiaoshan [1 ]
Li, Xuelong [2 ]
Jia, Yunde [1 ]
机构
[1] Beijing Inst Technol, Beijing Lab Intelligent Informat Technol, Sch Comp Sci, Beijing 100081, Peoples R China
[2] Chinese Acad Sci, Ctr OPT IMagery Anal & Learning OPTIMAL, State Key Lab Transient Opt & Photon, Xian Inst Opt & Precis Mech, Xian 710119, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy optimization; illumination; intrinsic images; reflectance; user scribbles; COLOR; RETINEX;
D O I
10.1109/TSMCB.2012.2208744
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we present a novel high-quality intrinsic image recovery approach using optimization and user scribbles. Our approach is based on the assumption of color characteristics in a local window in natural images. Our method adopts a premise that neighboring pixels in a local window having similar intensity values should have similar reflectance values. Thus, the intrinsic image decomposition is formulated by minimizing an energy function with the addition of a weighting constraint to the local image properties. In order to improve the intrinsic image decomposition results, we further specify local constraint cues by integrating the user strokes in our energy formulation, including constant-reflectance, constant-illumination, and fixed-illumination brushes. Our experimental results demonstrate that the proposed approach achieves a better recovery result of intrinsic reflectance and illumination components than the previous approaches.
引用
收藏
页码:425 / 436
页数:12
相关论文
共 50 条
  • [41] Intrinsic decomposition from a single spectral image
    Chen, Xi
    Zhu, Weixin
    Zhao, Yang
    Yu, Yao
    Zhou, Yu
    Yue, Tao
    Du, Sidan
    Cao, Xun
    APPLIED OPTICS, 2017, 56 (20) : 5676 - 5684
  • [42] Intrinsic Autoencoders for Joint Deferred Neural Rendering and Intrinsic Image Decomposition
    Abu Alhaija, Hassan
    Mustikovela, Siva Karthik
    Thies, Justus
    Jampani, Varun
    Niesner, Matthias
    Geiger, Andreas
    Rother, Carsten
    2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, : 1176 - 1185
  • [43] Unsupervised Deep Single-Image Intrinsic Decomposition using Illumination-Varying Image Sequences
    Lettry, L.
    Vanhoey, K.
    Van Gool, L.
    COMPUTER GRAPHICS FORUM, 2018, 37 (07) : 409 - 419
  • [44] Neural Process Reconstruction from Sparse User Scribbles
    Roberts, Mike
    Jeong, Won-Ki
    Vazquez-Reina, Amelio
    Unger, Markus
    Bischof, Horst
    Lichtman, Jeff
    Pfister, Hanspeter
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, MICCAI 2011, PT I, 2011, 6891 : 621 - +
  • [45] DeepScribble: Interactive Pathology Image Segmentation Using Deep Neural Networks with Scribbles
    Cho, Sungduk
    Jang, Hyungjoon
    Tan, Jing Wei
    Jeong, Won-Ki
    2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 761 - 765
  • [46] Scribbles for Metric Learning in Histological Image Segmentation
    Harada, Daisuke
    Bise, Ryoma
    Tokunaga, Hiroki
    Ohyama, Wataru
    Oka, Sanae
    Fujimori, Toshihiko
    Uchida, Seiichi
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 1026 - 1030
  • [47] Joint Deep Estimation of Intrinsic and Dichromatic Image Decomposition
    Ha, Jeong-Won
    Lee, Kang-Kyu
    Kim, Jong-Ok
    IEEE ACCESS, 2023, 11 : 41770 - 41782
  • [48] Challenges and Applications of Intrinsic Image Decomposition: A Short Review
    Diclehan Ulucan
    Oguzhan Ulucan
    Marc Ebner
    SN Computer Science, 6 (2)
  • [49] Intrinsic Image Decomposition with Step and Drift Shading Separation
    Sheng, Bin
    Li, Ping
    Jin, Yuxi
    Tan, Ping
    Lee, Tong-Yee
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (02) : 1332 - 1346
  • [50] Hyperspectral Intrinsic Image Decomposition With Enhanced Spatial Information
    Gu, Yanfeng
    Xie, Wen
    Li, Xian
    Jin, Xudong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60