A Dual Transformer Super-Resolution Network for Improving the Definition of Vibration Image

被引:2
|
作者
Zhu, Yang [1 ]
Wang, Sen [1 ]
Zhang, Yinhui [1 ]
He, Zifen [1 ]
Wang, Qingjian [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Mech & Elect Engn, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
Vibrations; Transformers; Superresolution; Feature extraction; Image reconstruction; Task analysis; Displacement measurement; Attention mechanism; computer vision; image super-resolution; transformer; visual vibration measurement;
D O I
10.1109/TIM.2022.3222503
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual measurement methods are gaining more and more attention in the field of structural body health monitoring due to the advantages of long-range, noncontact, and multipoint monitoring. However, the imaging system is usually affected by many factors, such as distortion, blurring, and noise, which lead to displacement measurement errors after the degradation of the acquired image quality. Therefore, in this article, we propose a structural body image super-resolution network based on a dual transformer architecture to improve the clarity of the collected structural body vibration displacement image to better capture the vibration displacement information of the target. Meanwhile, we design a dual transformer block based on an encoder-decoder architecture for the characteristics of vision-based structural body vibration displacement measurement tasks to better extract structural body image details and edge feature information. In this module, we introduce two different transformers. In addition, modules based on the encoder-decoder architecture focus more on the input and output image information and often ignore the feature information in different layers. Therefore, we introduce an attention mechanism in the network and interact with the feature information in different layers of the encoder-decoder architecture to obtain a better structural body image super-resolution effect. After comparison tests with the rest of the latest and most classical networks as well as the current optimal networks, it is shown that our network obtains excellent image reconstruction results under different structural body vibration image datasets (SETs), which also provides a strong guarantee for the task of accurate vision-based structural body vibration displacement measurement.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] An Amalgamated CNN-Transformer Network for Lightweight Image Super-Resolution
    Fang, Jinsheng
    Lin, Hanjiang
    Zeng, Kun
    Journal of Network Intelligence, 2024, 9 (03): : 1376 - 1387
  • [22] Spatial Transformer Generative Adversarial Network for Robust Image Super-Resolution
    Kasem, Hossam M.
    Hung, Kwok-Wai
    Jiang, Jianmin
    IEEE ACCESS, 2019, 7 : 182993 - 183009
  • [23] Iterative dual regression network for blind image super-resolution
    Chunting Lei
    Sihan Yang
    Xiaomin Yang
    Binyu Yan
    Gwanggil Jeon
    Signal, Image and Video Processing, 2023, 17 : 2437 - 2446
  • [24] Dual Recovery Network with Online Compensation for Image Super-Resolution
    Xia, Sifeng
    Yang, Wenhan
    Liu, Jiaying
    Guo, Zongming
    2018 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2018,
  • [25] Dual-Path Recurrent Network for Image Super-Resolution
    Li, Xinyao
    Zhang, Dongyang
    Shao, Jie
    NEURAL INFORMATION PROCESSING, ICONIP 2019, PT V, 2019, 1143 : 99 - 108
  • [26] Iterative dual regression network for blind image super-resolution
    Lei, Chunting
    Yang, Sihan
    Yang, Xiaomin
    Yan, Binyu
    Jeon, Gwanggil
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (05) : 2437 - 2446
  • [27] Dynamic dual attention iterative network for image super-resolution
    Feng, Hao
    Wang, Liejun
    Cheng, Shuli
    Du, Anyu
    Li, Yongming
    APPLIED INTELLIGENCE, 2022, 52 (07) : 8189 - 8208
  • [28] Dynamic dual attention iterative network for image super-resolution
    Hao Feng
    Liejun Wang
    Shuli Cheng
    Anyu Du
    Yongming Li
    Applied Intelligence, 2022, 52 : 8189 - 8208
  • [29] Spatial relaxation transformer for image super-resolution
    Li, Yinghua
    Zhang, Ying
    Zeng, Hao
    He, Jinglu
    Guo, Jie
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2024, 36 (07)
  • [30] Dual Self-Attention Swin Transformer for Hyperspectral Image Super-Resolution
    Long, Yaqian
    Wang, Xun
    Xu, Meng
    Zhang, Shuyu
    Jiang, Shuguo
    Jia, Sen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61