A Lithological Classification Model Based on Fourier Neural Operators and Channel-Wise Self-Attention

被引:0
|
作者
Marques Jr, Ademir [1 ]
Silva, Luiz Jose Schirmer [1 ]
Cagliari, Joice [1 ,2 ]
Scalco, Leonardo [1 ]
da Silva, Luiza Carine Ferreira [1 ]
Veronez, Mauricio Roberto [1 ]
Gonzaga Jr, Luiz [1 ]
机构
[1] Unisinos Univ, Ctr Excellence Geoinformat & Visual Comp, VizLab, BR-93020 Sao Leopoldo, RS, Brazil
[2] Unisinos Univ, Grad Program Geol, BR-93020 Sao Leopoldo, RS, Brazil
关键词
Attention mechanisms; convolutional neural networks (CNNs); deep learning (DL); Fourier transform; geology; image classification; rocks; stratigraphy; transfer learning; ARARIPE BASIN;
D O I
10.1109/LGRS.2024.3438547
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Lithological characterization plays a crucial role in geological studies, and outcrops serve as the primary source of geological information. Automatic identification of lithologies enhances geological mapping and reduces costs and risks associated with mapping less accessible outcrops. These outcrops are typically imaged using remote sensing techniques, enabling the identification of geological structures and lithologies through computer vision and machine learning (ML) approaches. In this context, convolutional neural networks (CNNs) have significantly contributed to lithological characterization in outcrop images. Recent advancements include novel architectures based on residual and attention blocks, which improve upon base CNN models. In addition, transformer-based architectures have surpassed CNNs in various tasks. Taking a step further, we propose a novel architecture that incorporates Fourier operators. Our proposed architecture builds upon the Transformer model, utilizing a sequential combination of Fourier neural operators (FNOs) and channelwise self-attention layers. To train our model, we adopt a transfer learning strategy, initially training it on a texture dataset with 47 classes. Subsequently, we fine-tune the same model to classify five specific lithologies in our custom dataset. These lithologies include sandstone, gray and brownish-gray shale, limestone, and laminated limestone images from the Tres Irm & atilde;os quarry within the Araripe Basin-an outcrop analogous to oil exploration reservoirs. The proposed architecture achieved an F1-score of up to 98%, performing better than reference CNN and ResNet models. This advancement holds promise for accurate lithological characterization, benefiting geological research and exploration efforts.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] Bi-Modal Learning With Channel-Wise Attention for Multi-Label Image Classification
    Li, Peng
    Chen, Peng
    Xie, Yonghong
    Zhang, Dezheng
    IEEE ACCESS, 2020, 8 : 9965 - 9977
  • [22] RETRACTED: Channel-Wise Correlation Calibrates Attention Module for Convolutional Neural Networks (Retracted Article)
    Lu, Ziqiang
    Dong, Yanwu
    Li, Jie
    Lu, Ziying
    He, Pengjie
    Ru, Haibo
    JOURNAL OF SENSORS, 2022, 2022
  • [23] DCCL: Dual-channel hybrid neural network combined with self-attention for text classification
    Li, Chaofan
    Qiong, Liu
    Kai, Ma
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (02) : 1981 - 1992
  • [24] CarveNet: a channel-wise attention-based network for irregular scene text recognition
    Guibin Wu
    Zheng Zhang
    Yongping Xiong
    International Journal on Document Analysis and Recognition (IJDAR), 2022, 25 : 177 - 186
  • [25] Occluded Pedestrian Detection Based on Joint Attention Mechanism of Channel-wise and Spatial Information
    Chen Yong
    Liu Xi
    Liu Huanlin
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (06) : 1486 - 1493
  • [26] SCEP-A New Image Dimensional Emotion Recognition Model Based on Spatial and Channel-Wise Attention Mechanisms
    Li, Bo
    Ren, Hui
    Jiang, Xuekun
    Miao, Fang
    Feng, Feng
    Jin, Libiao
    IEEE ACCESS, 2021, 9 : 25278 - 25290
  • [27] CarveNet: a channel-wise attention-based network for irregular scene text recognition
    Wu, Guibin
    Zhang, Zheng
    Xiong, Yongping
    INTERNATIONAL JOURNAL ON DOCUMENT ANALYSIS AND RECOGNITION, 2022, 25 (3) : 177 - 186
  • [28] Self-Attention Enhanced Recurrent Neural Networks for Sentence Classification
    Kumar, Ankit
    Rastogi , Reshma
    2018 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI), 2018, : 905 - 911
  • [29] SmokeNet: Satellite Smoke Scene Detection Using Convolutional Neural Network with Spatial and Channel-Wise Attention
    Ba, Rui
    Chen, Chen
    Yuan, Jing
    Song, Weiguo
    Lo, Siuming
    REMOTE SENSING, 2019, 11 (14)
  • [30] Point Cloud Classification Segmentation Model Based on Self-Attention and Edge Convolution
    Shen, Lu
    Yang, Jiazhi
    Zhou, Guoqing
    Huo, Jiaxin
    Chen, Mengqiang
    Yu, Guangwang
    Zhang, Yuyang
    Computer Engineering and Applications, 2023, 59 (19) : 106 - 113