A Dual Transformer Super-Resolution Network for Improving the Definition of Vibration Image

被引:2
|
作者
Zhu, Yang [1 ]
Wang, Sen [1 ]
Zhang, Yinhui [1 ]
He, Zifen [1 ]
Wang, Qingjian [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Mech & Elect Engn, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
Vibrations; Transformers; Superresolution; Feature extraction; Image reconstruction; Task analysis; Displacement measurement; Attention mechanism; computer vision; image super-resolution; transformer; visual vibration measurement;
D O I
10.1109/TIM.2022.3222503
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual measurement methods are gaining more and more attention in the field of structural body health monitoring due to the advantages of long-range, noncontact, and multipoint monitoring. However, the imaging system is usually affected by many factors, such as distortion, blurring, and noise, which lead to displacement measurement errors after the degradation of the acquired image quality. Therefore, in this article, we propose a structural body image super-resolution network based on a dual transformer architecture to improve the clarity of the collected structural body vibration displacement image to better capture the vibration displacement information of the target. Meanwhile, we design a dual transformer block based on an encoder-decoder architecture for the characteristics of vision-based structural body vibration displacement measurement tasks to better extract structural body image details and edge feature information. In this module, we introduce two different transformers. In addition, modules based on the encoder-decoder architecture focus more on the input and output image information and often ignore the feature information in different layers. Therefore, we introduce an attention mechanism in the network and interact with the feature information in different layers of the encoder-decoder architecture to obtain a better structural body image super-resolution effect. After comparison tests with the rest of the latest and most classical networks as well as the current optimal networks, it is shown that our network obtains excellent image reconstruction results under different structural body vibration image datasets (SETs), which also provides a strong guarantee for the task of accurate vision-based structural body vibration displacement measurement.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Dual Aggregation Transformer for Image Super-Resolution
    Chen, Zheng
    Zhang, Yulun
    Gu, Jinjin
    Kong, Linghe
    Yang, Xiaokang
    Yu, Fisher
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 12278 - 12287
  • [2] Efficient Dual Attention Transformer for Image Super-Resolution
    Park, Soobin
    Jeong, Yuna
    Choi, Yong Suk
    39TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2024, 2024, : 963 - 970
  • [3] Dual-aware transformer network for single-image super-resolution
    Luo, Zhonghua
    Wang, Li
    Wang, Fengzhou
    Ruan, Yinglan
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (02)
  • [4] Dual branches network for image super-resolution
    Matsune, Ai
    Cheng, Guoan
    Zhan, Shu
    ELECTRONICS LETTERS, 2019, 55 (23) : 1229 - 1230
  • [5] Learning Texture Transformer Network for Image Super-Resolution
    Yang, Fuzhi
    Yang, Huan
    Fu, Jianlong
    Lu, Hongtao
    Guo, Baining
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5790 - 5799
  • [6] A Hybrid Network of CNN and Transformer for Lightweight Image Super-Resolution
    Fang, Jinsheng
    Lin, Hanjiang
    Chen, Xinyu
    Zeng, Kun
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1102 - 1111
  • [7] Structured image super-resolution network based on improved Transformer
    Lv X.-D.
    Li J.
    Deng Z.-N.
    Feng H.
    Cui X.-T.
    Deng H.-X.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (05): : 865 - 874+910
  • [8] Spatial Transformer Generative Adversarial Network for Image Super-Resolution
    Rempakos, Pantelis
    Vrigkas, Michalis
    Plissiti, Marina E.
    Nikou, Christophoros
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2023, PT I, 2023, 14233 : 399 - 411
  • [9] A Residual Network with Efficient Transformer for Lightweight Image Super-Resolution
    Yan, Fengqi
    Li, Shaokun
    Zhou, Zhiguo
    Shi, Yonggang
    ELECTRONICS, 2024, 13 (01)
  • [10] Image Super-Resolution Based on Dual Path Network
    Kuang, Hailan
    Wang, Hongchuan
    Ma, Xiaolin
    Liu, Xinhua
    2018 10TH INTERNATIONAL CONFERENCE ON MEASURING TECHNOLOGY AND MECHATRONICS AUTOMATION (ICMTMA), 2018, : 225 - 228