A Dual Transformer Super-Resolution Network for Improving the Definition of Vibration Image

被引:2
|
作者
Zhu, Yang [1 ]
Wang, Sen [1 ]
Zhang, Yinhui [1 ]
He, Zifen [1 ]
Wang, Qingjian [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Mech & Elect Engn, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
Vibrations; Transformers; Superresolution; Feature extraction; Image reconstruction; Task analysis; Displacement measurement; Attention mechanism; computer vision; image super-resolution; transformer; visual vibration measurement;
D O I
10.1109/TIM.2022.3222503
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual measurement methods are gaining more and more attention in the field of structural body health monitoring due to the advantages of long-range, noncontact, and multipoint monitoring. However, the imaging system is usually affected by many factors, such as distortion, blurring, and noise, which lead to displacement measurement errors after the degradation of the acquired image quality. Therefore, in this article, we propose a structural body image super-resolution network based on a dual transformer architecture to improve the clarity of the collected structural body vibration displacement image to better capture the vibration displacement information of the target. Meanwhile, we design a dual transformer block based on an encoder-decoder architecture for the characteristics of vision-based structural body vibration displacement measurement tasks to better extract structural body image details and edge feature information. In this module, we introduce two different transformers. In addition, modules based on the encoder-decoder architecture focus more on the input and output image information and often ignore the feature information in different layers. Therefore, we introduce an attention mechanism in the network and interact with the feature information in different layers of the encoder-decoder architecture to obtain a better structural body image super-resolution effect. After comparison tests with the rest of the latest and most classical networks as well as the current optimal networks, it is shown that our network obtains excellent image reconstruction results under different structural body vibration image datasets (SETs), which also provides a strong guarantee for the task of accurate vision-based structural body vibration displacement measurement.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Geometric relationship-guided transformer network for omnidirectional image super-resolution
    Junfeng Cao
    Qinghai Ding
    Haibo Luo
    Signal, Image and Video Processing, 2025, 19 (5)
  • [42] Adaptive Importance Learning for Improving Lightweight Image Super-Resolution Network
    Lei Zhang
    Peng Wang
    Chunhua Shen
    Lingqiao Liu
    Wei Wei
    Yanning Zhang
    Anton van den Hengel
    International Journal of Computer Vision, 2020, 128 : 479 - 499
  • [43] Feedback Network for Image Super-Resolution
    Li, Zhen
    Yang, Jinglei
    Liu, Zheng
    Yang, Xiaomin
    Jeon, Gwanggil
    Wu, Wei
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3862 - 3871
  • [44] Iterative Network for Image Super-Resolution
    Liu, Yuqing
    Wang, Shiqi
    Zhang, Jian
    Wang, Shanshe
    Ma, Siwei
    Gao, Wen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 2259 - 2272
  • [45] Joint image deblurring and super-resolution with attention dual supervised network
    Zhang, Dongyang
    Liang, Zhenwen
    Shao, Jie
    NEUROCOMPUTING, 2020, 412 (412) : 187 - 196
  • [46] Dual-Channel Residual Network for Image Super-Resolution Reconstruction
    Zuo L.
    Zhang P.
    Jing S.
    Zhao Y.
    Li F.
    Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2022, 56 (01): : 158 - 164
  • [47] Dual Discriminator Generative Adversarial Network for Single Image Super-Resolution
    Liu, Peng
    Hong, Ying
    Liu, Yan
    PROCEEDINGS OF 2018 IEEE 9TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS), 2018, : 680 - 687
  • [48] Wavelet-Based Dual Recursive Network for Image Super-Resolution
    Xin, Jingwei
    Li, Jie
    Jiang, Xinrui
    Wang, Nannan
    Huang, Heng
    Gao, Xinbo
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (02) : 707 - 720
  • [49] Improved dual-scale residual network for image super-resolution
    Liu, Huan
    Cao, Feilong
    NEURAL NETWORKS, 2020, 132 : 84 - 95
  • [50] Dual-path attention network for single image super-resolution
    Huang, Zhiyong
    Li, Wenbin
    Li, Jinxin
    Zhou, Dengwen
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 169