Image Interpolation Using Multi-Scale Attention-Aware Inception Network

被引:12
|
作者
Ji, Jiahuan [1 ]
Zhong, Baojiang [1 ]
Ma, Kai-Kuang [2 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215008, Peoples R China
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Interpolation; Task analysis; Machine learning; Image edge detection; Training; Image resolution; Image interpolation; image super-resolution; deep learning; multi-scale; convolutional neural network; attention-aware; inception network; image pyramid; pyramid cut;
D O I
10.1109/TIP.2020.3026632
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A new multi-scale deep learning (MDL) framework is proposed and exploited for conducting image interpolation in this paper. The core of the framework is a seeding network that needs to be designed for the targeted task. For image interpolation, a novel attention-aware inception network (AIN) is developed as the seeding network; it has two key stages: 1) feature extraction based on the low-resolution input image; and 2) feature-to-image mapping to enlarge image's size or resolution. Note that the designed seeding network, AIN, needs to be trained with a matched training dataset at each scale. For that, multi-scale image patches are generated using our proposed pyramid cut, which outperforms the conventional image pyramid method by completely avoiding aliasing issue. After training, the trained AINs are then combined for processing the input image in the testing stage. Extensive experimental simulation results obtained from seven image datasets (comprising 359 images in total) have clearly shown that the proposed MAIN consistently delivers highly accurate interpolated images.
引用
收藏
页码:9413 / 9428
页数:16
相关论文
共 50 条
  • [1] MA-NET: MULTI-SCALE ATTENTION-AWARE NETWORK FOR OPTICAL FLOW ESTIMATION
    Li, Mu
    Zhong, Baojiang
    Ma, Kai-Kuang
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2844 - 2848
  • [2] AMF-NET: Attention-aware Multi-scale Fusion Network for Retinal Vessel Segmentation
    Yang, Qi
    Ma, Bingqi
    Cui, Hui
    Ma, Jiquan
    [J]. 2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 3277 - 3280
  • [3] Multi-Scale Attention Network for Image Cropping
    Lian, Tianpei
    Xian, Ke
    Pan, Zhiyu
    Hong, Chaoyi
    Cao, Zhiguo
    Zhong, Weicai
    [J]. 2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 2640 - 2645
  • [4] Multi-scale attention network for image inpainting
    Qin, Jia
    Bai, Huihui
    Zhao, Yao
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 204
  • [5] Truncated attention-aware proposal networks with multi-scale dilation for temporal action detection
    Li, Ping
    Cao, Jiachen
    Yuan, Li
    Ye, Qinghao
    Xu, Xianghua
    [J]. PATTERN RECOGNITION, 2023, 142
  • [6] Label-aware Attention Network with Multi-scale Boosting for Medical Image Segmentation
    Wang, Linbo
    Xu, Peng
    Cao, Xianfeng
    Nappi, Michele
    Wan, Shaohua
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 255
  • [7] STACKED MULTI-SCALE ATTENTION NETWORK FOR IMAGE COLORIZATION
    Jiang, Bin
    Xu, Fangqiang
    Xia, Jun
    Yang, Chao
    Huang, Wei
    Huang, Yun
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2225 - 2229
  • [8] Multi-Scale Context Attention Network for Image Retrieval
    Lou, Yihang
    Bai, Yan
    Wang, Shiqi
    Duan, Ling-Yu
    [J]. PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 1128 - 1136
  • [9] Learned Image Compression with Inception Residual Blocks and Multi-Scale Attention Module
    Fu, Haisheng
    Liang, Feng
    Liang, Jie
    Li, BingLin
    Zhang, GuoHe
    Han, JiangNing
    [J]. 2022 PICTURE CODING SYMPOSIUM (PCS), 2022, : 43 - 47
  • [10] A Multi-Scale Context Aware Attention Model for Medical Image Segmentation
    Alam, Md. Shariful
    Wang, Dadong
    Liao, Qiyu
    Sowmya, Arcot
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (08) : 3731 - 3739