Image Interpolation Using Multi-Scale Attention-Aware Inception Network

被引:12
|
作者
Ji, Jiahuan [1 ]
Zhong, Baojiang [1 ]
Ma, Kai-Kuang [2 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215008, Peoples R China
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Interpolation; Task analysis; Machine learning; Image edge detection; Training; Image resolution; Image interpolation; image super-resolution; deep learning; multi-scale; convolutional neural network; attention-aware; inception network; image pyramid; pyramid cut;
D O I
10.1109/TIP.2020.3026632
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A new multi-scale deep learning (MDL) framework is proposed and exploited for conducting image interpolation in this paper. The core of the framework is a seeding network that needs to be designed for the targeted task. For image interpolation, a novel attention-aware inception network (AIN) is developed as the seeding network; it has two key stages: 1) feature extraction based on the low-resolution input image; and 2) feature-to-image mapping to enlarge image's size or resolution. Note that the designed seeding network, AIN, needs to be trained with a matched training dataset at each scale. For that, multi-scale image patches are generated using our proposed pyramid cut, which outperforms the conventional image pyramid method by completely avoiding aliasing issue. After training, the trained AINs are then combined for processing the input image in the testing stage. Extensive experimental simulation results obtained from seven image datasets (comprising 359 images in total) have clearly shown that the proposed MAIN consistently delivers highly accurate interpolated images.
引用
收藏
页码:9413 / 9428
页数:16
相关论文
共 50 条
  • [21] Attention-Aware Invertible Hashing Network
    Li, Shanshan
    Cai, Qiang
    Li, Zhuangzi
    Li, Haisheng
    Zhang, Naiguang
    Cao, Jian
    [J]. IMAGE AND GRAPHICS, ICIG 2019, PT III, 2019, 11903 : 409 - 420
  • [22] Multimodal medical image segmentation using multi-scale context- aware network
    Wang, Xue
    Li, Zhanshan
    Huang, Yongping
    Jiao, Yingying
    [J]. NEUROCOMPUTING, 2022, 486 : 135 - 146
  • [23] Multi-scale attention context-aware network for detection and localization of image splicing Efficient and robust identification network
    Ren, Ruyong
    Niu, Shaozhang
    Jin, Junfeng
    Zhang, Jiwei
    Ren, Hua
    Zhao, Xiaojie
    [J]. APPLIED INTELLIGENCE, 2023, 53 (15) : 18219 - 18238
  • [24] An Intelligent Deep Learning Architecture Using Multi-scale Residual Network Model for Image Interpolation
    Earshia, Diana, V
    Sumathi, M.
    [J]. JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2023, 14 (05) : 970 - 979
  • [25] Msap: multi-scale attention probabilistic network for underwater image enhancement network
    Chang, Baocai
    Li, Jinjiang
    Wang, Haiyang
    Li, Mengjun
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (SUPPL 1) : 653 - 661
  • [26] Multi-scale Multi-attention Network for Moire Document Image Binarization
    Guo, Yanqing
    Ji, Caijuan
    Zheng, Xin
    Wang, Qianyu
    Luo, Xiangyang
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 90
  • [27] Multi-Scale Density-Aware Network for Single Image Dehazing
    Gao, Tao
    Liu, Yao
    Cheng, Peng
    Chen, Ting
    Liu, Lidong
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1117 - 1121
  • [28] Multi-Scale Density-Aware Network for Single Image Dehazing
    Gao, Tao
    Liu, Yao
    Cheng, Peng
    Chen, Ting
    Liu, Lidong
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1117 - 1121
  • [29] Single image super-resolution via global aware external attention and multi-scale residual channel attention network
    Liu, Mingming
    Li, Sui
    Liu, Bing
    Yang, Yuxin
    Liu, Peng
    Zhang, Chen
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (06) : 2309 - 2321
  • [30] Attention-Aware Heterogeneous Graph Neural Network
    Jintao Zhang
    Quan Xu
    [J]. Big Data Mining and Analytics, 2021, 4 (04) : 233 - 241