An efficient approach to detect and segment underwater images using Swin Transformer

被引:2
|
作者
Pavithra, S. [1 ]
Denny, J. Cicil Melbin [1 ]
机构
[1] Vellore Inst Technol, Sch Comp Sci & Engn, Chennai, Tamil Nadu, India
关键词
Artificial Intelligence; Attention mechanisms; ConvMixer; Swin Transformer; Underwater environments;
D O I
10.1016/j.rineng.2024.102460
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In managing the fish environment and underwater ecosystem, there 's been a big shift from old-generational schoolings, hands-on methods to high-technologies, automatic ways of doing things, because of some clever computer technology, using a type of Artificial Intelligence smartness known as Convolutional Neural Networks, or CNNs in short. These smart systems help deal with the tricky task of keeping tabs on where fish stay out in deeper underwater, particularly when it 's hard to see underwater and when the fish are all over the place. There are some pretty good tools and techniques already out there, like DPANet and a few others with names like PIFSNet, EFS -Net, and MFAS-Net, which have been helping a bunch of researches and developments for underwater ecosystem. But Deeper water environment still needs a newer and better way to get the tasks done. So, to answer this major question, this hybrid architecture rolls out a new combination that takes the best bits of transformer architecture known as Swin Transformer and another mechanism known as ConvMixer, making it in a form of SwinUNet Architecture. This Swin Transformer is well defined at picking up on the spatial information from underwater deeper images in our case, which is a key point to be highlighted in really getting the fish 's niche turf and enquiring their ecosystem. And when the underwater turns misty, the specialized implementation of ConvMixer modules incorporated with Swin Transformer increases its ability to sort out the fish from the rest of the underwater world. And this makes it to perform even more better compared with the existing state of arts model, even under Modern Underwater Machine Vision System conditions. This model even over takes to utilization of Few-Shot Learning model for training it in this lesser Underwater Images, with its capability of identifying the patterns and differentiations in both larger and smaller class objects in the given ground truth image. In this new approach, the paper combines the smart focusing methods with a way to blend different signals to better mIoU score, making it super useful for having a deeper understanding on fish-ecosystem and also their underwater ecosystem. While comparing it with the pre-existing state of arts model and the booming Image Segmentation models (YOLO v8, Pix 2 Pix GAN model, Auto Encoders, UNet), the hybrid approach outperformed the existing model results on this Semantic Segmentation for Underwater Imagery (SUIM) dataset, which is been disclosed in the further sections below.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] An Approach to Segment Nuclei and Cytoplasm in Lung Cancer Brightfield Images Using Hybrid Swin-Unet Transformer
    Sreekumar, Sreelekshmi Palliyil
    Palanisamy, Rohini
    Swaminathan, Ramakrishnan
    JOURNAL OF MEDICAL AND BIOLOGICAL ENGINEERING, 2024, 44 (03) : 448 - 459
  • [2] An efficient swin transformer-based method for underwater image enhancement
    Wang, Rong
    Zhang, Yonghui
    Zhang, Jian
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (12) : 18691 - 18708
  • [3] An efficient swin transformer-based method for underwater image enhancement
    Rong Wang
    Yonghui Zhang
    Jian Zhang
    Multimedia Tools and Applications, 2023, 82 : 18691 - 18708
  • [4] Underwater Target Detection Algorithm Based on YOLO and Swin Transformer for Sonar Images
    Chen, Ruoyu
    Zhan, Shuyue
    Chen, Ying
    2022 OCEANS HAMPTON ROADS, 2022,
  • [5] A data efficient transformer based on Swin Transformer
    Yao, Dazhi
    Shao, Yunxue
    VISUAL COMPUTER, 2024, 40 (04): : 2589 - 2598
  • [6] Swin transformer and fusion for underwater image enhancement
    Sun, Jinghao
    Dong, Junyu
    Lv, Qingxuan
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2022, 2022, 12177
  • [7] A data efficient transformer based on Swin Transformer
    Dazhi Yao
    Yunxue Shao
    The Visual Computer, 2024, 40 : 2589 - 2598
  • [8] Nutritional composition analysis in food images: an innovative Swin Transformer approach
    Wang, Hui
    Tian, Haixia
    Ju, Ronghui
    Ma, Liyan
    Yang, Ling
    Chen, Jingyao
    Liu, Feng
    FRONTIERS IN NUTRITION, 2024, 11
  • [9] Efficient Supervised Pretraining of Swin-Transformer for Virtual Staining of Microscopy Images
    Ma, Jiabo
    Chen, Hao
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (04) : 1388 - 1399
  • [10] Two-Stage Underwater Object Detection Network Using Swin Transformer
    Liu, Jia
    Liu, Shuang
    Xu, Shujuan
    Zhou, Changjun
    IEEE ACCESS, 2022, 10 : 117235 - 117247