Image Interpolation Using Multi-Scale Attention-Aware Inception Network

被引:12
|
作者
Ji, Jiahuan [1 ]
Zhong, Baojiang [1 ]
Ma, Kai-Kuang [2 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215008, Peoples R China
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Interpolation; Task analysis; Machine learning; Image edge detection; Training; Image resolution; Image interpolation; image super-resolution; deep learning; multi-scale; convolutional neural network; attention-aware; inception network; image pyramid; pyramid cut;
D O I
10.1109/TIP.2020.3026632
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A new multi-scale deep learning (MDL) framework is proposed and exploited for conducting image interpolation in this paper. The core of the framework is a seeding network that needs to be designed for the targeted task. For image interpolation, a novel attention-aware inception network (AIN) is developed as the seeding network; it has two key stages: 1) feature extraction based on the low-resolution input image; and 2) feature-to-image mapping to enlarge image's size or resolution. Note that the designed seeding network, AIN, needs to be trained with a matched training dataset at each scale. For that, multi-scale image patches are generated using our proposed pyramid cut, which outperforms the conventional image pyramid method by completely avoiding aliasing issue. After training, the trained AINs are then combined for processing the input image in the testing stage. Extensive experimental simulation results obtained from seven image datasets (comprising 359 images in total) have clearly shown that the proposed MAIN consistently delivers highly accurate interpolated images.
引用
收藏
页码:9413 / 9428
页数:16
相关论文
共 50 条
  • [31] Attention-Aware Multi-View Stereo
    Luo, Keyang
    Guan, Tao
    Ju, Lili
    Wang, Yuesong
    Chen, Zhuo
    Luo, Yawei
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1587 - 1596
  • [32] HYPERSPECTRAL IMAGE CLASSIFICATION VIA MULTI-SCALE RESIDUAL ATTENTION NETWORK
    Xie, Wen
    Wu, Qinzhe
    Ren, Wen
    Zhang, Yuzhuo
    [J]. IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 7649 - 7652
  • [33] Multi-Scale Attention Feature Enhancement Network for Single Image Dehazing
    Dong, Weida
    Wang, Chunyan
    Sun, Hao
    Teng, Yunjie
    Xu, Xiping
    [J]. SENSORS, 2023, 23 (19)
  • [34] MGTANet: Multi-Scale Guided Token Attention Network for Image Captioning
    Jia, Wenhao
    Wang, Ronggui
    Yang, Juan
    Xua, Lixia
    [J]. PROCEEDINGS OF 2024 3RD INTERNATIONAL CONFERENCE ON CYBER SECURITY, ARTIFICIAL INTELLIGENCE AND DIGITAL ECONOMY, CSAIDE 2024, 2024, : 237 - 245
  • [35] MSDANet: A multi-scale dilation attention network for medical image segmentation
    Zhang, Jinquan
    Luan, Zhuang
    Ni, Lina
    Qi, Liang
    Gong, Xu
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 90
  • [36] Multi-Scale Feature Fusion Network with Attention for Single Image Dehazing
    Hu, Bin
    [J]. PATTERN RECOGNITION AND IMAGE ANALYSIS, 2021, 31 (04) : 608 - 615
  • [37] Lightweight multi-scale generative adversarial network with attention for image denoising
    Hu, Xuegang
    Zhao, Wei
    [J]. MULTIMEDIA SYSTEMS, 2024, 30 (05)
  • [38] MSAANet: Multi-scale Axial Attention Network for medical image segmentation
    Zeng, Hao
    Shan, Xinxin
    Feng, Yu
    Wen, Ying
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2291 - 2296
  • [39] GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazing
    Liu, Xiaohong
    Ma, Yongrui
    Shi, Zhihao
    Chen, Jun
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7313 - 7322
  • [40] Multi-scale Underwater Image Enhancement Network Based on Attention Mechanism
    Fang Ming
    Liu Xiaohan
    Fu Feiran
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2021, 43 (12) : 3513 - 3521