Two-stage pyramidal convolutional neural networks for image colorization

被引:2
|
作者
Wei, Yu-Jen [1 ]
Wei, Tsu-Tsai [1 ]
Kuo, Tien-Ying [1 ]
Su, Po-Chyi [2 ]
机构
[1] Natl Taipei Univ Technol, Dept Elect Engn, Taipei, Taiwan
[2] Natl Cent Univ, Dept Comp Sci & Informat Engn, Taoyuan, Taiwan
关键词
Image colorization; Convolutional neural network; Image pyramid;
D O I
10.1017/ATSIP.2021.13
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The development of colorization algorithms through deep learning has become the current research trend. These algorithms colorize grayscale images automatically and quickly, but the colors produced are usually subdued and have low saturation. This research addresses this issue of existing algorithms by presenting a two-stage convolutional neural network (CNN) structure with the first and second stages being a chroma map generation network and a refinement network, respectively. To begin, we convert the color space of an image from RGB to HSV to predict its low-resolution chroma components and therefore reduce the computational complexity. Following that, the first-stage output is zoomed in and its detail is enhanced with a pyramidal CNN, resulting in a colorized image. Experiments show that, while using fewer parameters, our methodology produces results with more realistic color and higher saturation than existing methods.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Two-stage image colorization via color codebook
    Tang, Hui
    Zhou, Yuanbo
    Chen, Yuanbin
    Zhang, Xinlin
    Xue, Yuyang
    Lin, Xiaoyong
    Dai, Xinwei
    Qiu, Xintao
    Gao, Qinquan
    Tong, Tong
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 250
  • [2] A Two-Stage Convolutional Neural Networks for Lung Nodule Detection
    Cao, Haichao
    Liu, Hong
    Song, Enmin
    Ma, Guangzhi
    Xu, Xiangyang
    Jin, Renchao
    Liu, Tengying
    Hung, Chih-Cheng
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (07) : 2006 - 2015
  • [3] NIR image colorization with graph-convolutional neural networks
    Valsesia, Diego
    Fracastoro, Giulia
    Magli, Enrico
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2020, : 451 - 454
  • [4] Two-stage Sketch Colorization
    Zhang, Lvmin
    Li, Chengze
    Wong, Tien-Tsin
    Ji, Yi
    Liu, Chunping
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (06):
  • [5] Two-stage Sketch Colorization
    Zhang, Lvmin
    Li, Chengze
    Wong, Tien-Tsin
    Ji, Yi
    Liu, Chunping
    [J]. SIGGRAPH ASIA'18: SIGGRAPH ASIA 2018 TECHNICAL PAPERS, 2018,
  • [6] Two-Stage Solar Flare Forecasting Based on Convolutional Neural Networks
    Chen, Jun
    Li, Weifu
    Li, Shuxin
    Chen, Hong
    Zhao, Xuebin
    Peng, Jiangtao
    Chen, Yanhong
    Deng, Hao
    [J]. SPACE: SCIENCE & TECHNOLOGY, 2022, 2022
  • [7] Two-Stage Ensemble of Deep Convolutional Neural Networks for Object Recognition
    Uddamvathanak, Rom
    Yang, Feng
    Yang, Xulei
    Das, Ankit Kumar
    Shen, Yan
    Salahuddin, Mohamed
    Hussain, Shaista
    Chawla, Shailey
    [J]. 2018 INTERNATIONAL CONFERENCE ON INTELLIGENT RAIL TRANSPORTATION (ICIRT), 2018,
  • [8] Two-Stage Approach to Image Classification by Deep Neural Networks
    Ososkov, Gennady
    Goncharov, Pavel
    [J]. MATHEMATICAL MODELING AND COMPUTATIONAL PHYSICS 2017 (MMCP 2017), 2018, 173
  • [9] Image Colorization with Neural Networks
    Richart, Matias
    Visca, Jorge
    Baliosian, Javier
    [J]. 2017 WORKSHOP OF COMPUTER VISION (WVC), 2017, : 55 - 60
  • [10] Two-Stage Convolutional Neural Network for Breast Cancer Histology Image Classification
    Nazeri, Kamyar
    Aminpour, Azad
    Ebrahimi, Mehran
    [J]. IMAGE ANALYSIS AND RECOGNITION (ICIAR 2018), 2018, 10882 : 717 - 726