A Lithological Classification Model Based on Fourier Neural Operators and Channel-Wise Self-Attention

被引:0
|
作者
Marques Jr, Ademir [1 ]
Silva, Luiz Jose Schirmer [1 ]
Cagliari, Joice [1 ,2 ]
Scalco, Leonardo [1 ]
da Silva, Luiza Carine Ferreira [1 ]
Veronez, Mauricio Roberto [1 ]
Gonzaga Jr, Luiz [1 ]
机构
[1] Unisinos Univ, Ctr Excellence Geoinformat & Visual Comp, VizLab, BR-93020 Sao Leopoldo, RS, Brazil
[2] Unisinos Univ, Grad Program Geol, BR-93020 Sao Leopoldo, RS, Brazil
关键词
Attention mechanisms; convolutional neural networks (CNNs); deep learning (DL); Fourier transform; geology; image classification; rocks; stratigraphy; transfer learning; ARARIPE BASIN;
D O I
10.1109/LGRS.2024.3438547
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Lithological characterization plays a crucial role in geological studies, and outcrops serve as the primary source of geological information. Automatic identification of lithologies enhances geological mapping and reduces costs and risks associated with mapping less accessible outcrops. These outcrops are typically imaged using remote sensing techniques, enabling the identification of geological structures and lithologies through computer vision and machine learning (ML) approaches. In this context, convolutional neural networks (CNNs) have significantly contributed to lithological characterization in outcrop images. Recent advancements include novel architectures based on residual and attention blocks, which improve upon base CNN models. In addition, transformer-based architectures have surpassed CNNs in various tasks. Taking a step further, we propose a novel architecture that incorporates Fourier operators. Our proposed architecture builds upon the Transformer model, utilizing a sequential combination of Fourier neural operators (FNOs) and channelwise self-attention layers. To train our model, we adopt a transfer learning strategy, initially training it on a texture dataset with 47 classes. Subsequently, we fine-tune the same model to classify five specific lithologies in our custom dataset. These lithologies include sandstone, gray and brownish-gray shale, limestone, and laminated limestone images from the Tres Irm & atilde;os quarry within the Araripe Basin-an outcrop analogous to oil exploration reservoirs. The proposed architecture achieved an F1-score of up to 98%, performing better than reference CNN and ResNet models. This advancement holds promise for accurate lithological characterization, benefiting geological research and exploration efforts.
引用
收藏
页数:5
相关论文
共 50 条
  • [41] Multi-Gram CNN-Based Self-Attention Model for Relation Classification
    Zhang, Chunyun
    Cui, Chaoran
    Gao, Sheng
    Nie, Xiushan
    Xu, Weiran
    Yang, Lu
    Xi, Xiaoming
    Yin, Yilong
    IEEE ACCESS, 2019, 7 : 5343 - 5357
  • [42] Combining channel-wise joint attention and temporal attention in graph convolutional networks for skeleton-based action recognition
    Zhonghua Sun
    Tianyi Wang
    Meng Dai
    Signal, Image and Video Processing, 2023, 17 : 2481 - 2488
  • [43] SABDM: A self-attention based bidirectional-RNN deep model for requirements classification
    Kaur, Kamaljit
    Kaur, Parminder
    JOURNAL OF SOFTWARE-EVOLUTION AND PROCESS, 2024, 36 (02)
  • [44] Point cloud classification network based on self-attention mechanism
    Li, Yujie
    Cai, Jintong
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 104
  • [45] Combining channel-wise joint attention and temporal attention in graph convolutional networks for skeleton-based action recognition
    Sun, Zhonghua
    Wang, Tianyi
    Dai, Meng
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (05) : 2481 - 2488
  • [46] A time-aware self-attention based neural network model for sequential recommendation
    Zhang, Yihu
    Yang, Bo
    Liu, Haodong
    Li, Dongsheng
    APPLIED SOFT COMPUTING, 2023, 133
  • [47] Exploration of an intrinsically explainable self-attention based model for prototype generation on single-channel EEG sleep stage classification
    Adey, Brenton
    Habib, Ahsan
    Karmakar, Chandan
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [48] EEG-based emotion recognition via capsule network with channel-wise attention and LSTM models
    Lina Deng
    Xiaoliang Wang
    Frank Jiang
    Robin Doss
    CCF Transactions on Pervasive Computing and Interaction, 2021, 3 : 425 - 435
  • [49] Sunflower seeds classification based on self-attention Focusing algorithm
    Xiaowei Jin
    Yuhong Zhao
    Haodong Bian
    Jianjun Li
    Chuanshuai Xu
    Journal of Food Measurement and Characterization, 2023, 17 : 143 - 154
  • [50] Sunflower seeds classification based on self-attention Focusing algorithm
    Jin, Xiaowei
    Zhao, Yuhong
    Bian, Haodong
    Li, Jianjun
    Xu, Chuanshuai
    JOURNAL OF FOOD MEASUREMENT AND CHARACTERIZATION, 2023, 17 (01) : 143 - 154