Semantic Segmentation of Defects in Infrastructures through Multi-modal Images

被引:0
|
作者
Shahsavarani, Sara [1 ]
Lopez, Fernando [2 ]
Ibarra-Castanedo, Clemente [1 ]
Maldague, Xavier P., V [1 ]
机构
[1] Laval Univ, Dept Elect & Comp Engn, 1065 Av Med, Quebec City, PQ G1V 0A6, Canada
[2] TORNGATS, 200 Boul Parc Technol, Torngats, PQ G1P 4S3, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
non-destructive testing; image segmentation; defect detection; texture analysis; super-pixel segmentation; AUTOMATIC CRACK DETECTION;
D O I
10.1117/12.3013884
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
The accurate segmentation and detection of defects in infrared and visible images are critical for non-destructive testing applications, however those steps are often excluded by limited annotated training data. This paper presents an innovative approach for the segmentation and detection tasks into a unified framework. The proposed method introduces and tests a novel framework tailored to the domain of infrared and visible imaging. This framework eliminates the need for annotated defect data during training, enabling models to adapt to real-world scenarios where annotations are scarce. To enhance the accuracy of segmentation and detection, it employs super-pixel segmentation, following by texture analysis.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Multi-modal semantic image segmentation
    Pemasiri, Akila
    Kien Nguyen
    Sridharan, Sridha
    Fookes, Clinton
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 202
  • [2] EISNet: A Multi-Modal Fusion Network for Semantic Segmentation With Events and Images
    Xie, Bochen
    Deng, Yongjian
    Shao, Zhanpeng
    Li, Youfu
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8639 - 8650
  • [3] Pseudo Multi-Modal Approach to LiDAR Semantic Segmentation
    Kim, Kyungmin
    [J]. Sensors, 2024, 24 (23)
  • [4] MULTI-MODAL SEMANTIC MESH SEGMENTATION IN URBAN SCENES
    Laupheimer, Dominik
    Haala, Norbert
    [J]. XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION II, 2022, 5-2 : 267 - 274
  • [5] Multi-task Learning of Semantic Segmentation and Height Estimation for Multi-modal Remote Sensing Images
    Mengyu WANG
    Zhiyuan YAN
    Yingchao FENG
    Wenhui DIAO
    Xian SUN
    [J]. Journal of Geodesy and Geoinformation Science, 2023, 6 (04) : 27 - 39
  • [6] A framework for unsupervised segmentation of multi-modal medical images
    El-Baz, Ayman
    Farag, Aly
    Ali, Asem
    Gimel'farb, Georgy
    Casanova, Manuel
    [J]. COMPUTER VISION APPROACHES TO MEDICAL IMAGE ANALYSIS, 2006, 4241 : 120 - 131
  • [7] Application of Multi-modal Fusion Attention Mechanism in Semantic Segmentation
    Liu, Yunlong
    Yoshie, Osamu
    Watanabe, Hiroshi
    [J]. COMPUTER VISION - ACCV 2022, PT VII, 2023, 13847 : 378 - 397
  • [8] Multi-modal unsupervised domain adaptation for semantic image segmentation
    Hu, Sijie
    Bonardi, Fabien
    Bouchafa, Samia
    Sidibe, Desire
    [J]. PATTERN RECOGNITION, 2023, 137
  • [9] Multi-modal Prototypes for Open-World Semantic Segmentation
    Yang, Yuhuan
    Ma, Chaofan
    Ju, Chen
    Zhang, Fei
    Yao, Jiangchao
    Zhang, Ya
    Wang, Yanfeng
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, : 6004 - 6020
  • [10] Ticino: A multi-modal remote sensing dataset for semantic segmentation
    Barbato, Mirko Paolo
    Piccoli, Flavio
    Napoletano, Paolo
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 249