A Lithological Classification Model Based on Fourier Neural Operators and Channel-Wise Self-Attention

被引:0
|
作者
Marques Jr, Ademir [1 ]
Silva, Luiz Jose Schirmer [1 ]
Cagliari, Joice [1 ,2 ]
Scalco, Leonardo [1 ]
da Silva, Luiza Carine Ferreira [1 ]
Veronez, Mauricio Roberto [1 ]
Gonzaga Jr, Luiz [1 ]
机构
[1] Unisinos Univ, Ctr Excellence Geoinformat & Visual Comp, VizLab, BR-93020 Sao Leopoldo, RS, Brazil
[2] Unisinos Univ, Grad Program Geol, BR-93020 Sao Leopoldo, RS, Brazil
关键词
Attention mechanisms; convolutional neural networks (CNNs); deep learning (DL); Fourier transform; geology; image classification; rocks; stratigraphy; transfer learning; ARARIPE BASIN;
D O I
10.1109/LGRS.2024.3438547
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Lithological characterization plays a crucial role in geological studies, and outcrops serve as the primary source of geological information. Automatic identification of lithologies enhances geological mapping and reduces costs and risks associated with mapping less accessible outcrops. These outcrops are typically imaged using remote sensing techniques, enabling the identification of geological structures and lithologies through computer vision and machine learning (ML) approaches. In this context, convolutional neural networks (CNNs) have significantly contributed to lithological characterization in outcrop images. Recent advancements include novel architectures based on residual and attention blocks, which improve upon base CNN models. In addition, transformer-based architectures have surpassed CNNs in various tasks. Taking a step further, we propose a novel architecture that incorporates Fourier operators. Our proposed architecture builds upon the Transformer model, utilizing a sequential combination of Fourier neural operators (FNOs) and channelwise self-attention layers. To train our model, we adopt a transfer learning strategy, initially training it on a texture dataset with 47 classes. Subsequently, we fine-tune the same model to classify five specific lithologies in our custom dataset. These lithologies include sandstone, gray and brownish-gray shale, limestone, and laminated limestone images from the Tres Irm & atilde;os quarry within the Araripe Basin-an outcrop analogous to oil exploration reservoirs. The proposed architecture achieved an F1-score of up to 98%, performing better than reference CNN and ResNet models. This advancement holds promise for accurate lithological characterization, benefiting geological research and exploration efforts.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Automated Heartbeat Classification Exploiting Convolutional Neural Network With Channel-Wise Attention
    Li, Feiteng
    Wu, Jiaquan
    Jia, Menghan
    Chen, Zhijian
    Pu, Yu
    IEEE ACCESS, 2019, 7 : 122955 - 122963
  • [2] EEG-Based Emotion Recognition via Channel-Wise Attention and Self Attention
    Tao, Wei
    Li, Chang
    Song, Rencheng
    Cheng, Juan
    Liu, Yu
    Wan, Feng
    Chen, Xun
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (01) : 382 - 393
  • [3] LiteSCANet: An Efficient Lightweight Network Based on Spectral and Channel-Wise Attention for Hyperspectral Image Classification
    Qiao, Su
    Dong, Xue-Mei
    Peng, Jiangtao
    Sun, Weiwei
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 11655 - 11668
  • [4] Channel-wise attention model-based fire and rating level detection in video
    Wu, Yirui
    He, Yuechao
    Shivakumara, Palaiahnakote
    Li, Ziming
    Guo, Hongxin
    Lu, Tong
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2019, 4 (02) : 117 - 121
  • [5] Image Classification based on Self-attention Convolutional Neural Network
    Cai, Xiaohong
    Li, Ming
    Cao, Hui
    Ma, Jingang
    Wang, Xiaoyan
    Zhuang, Xuqiang
    SIXTH INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION, 2021, 11913
  • [6] Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimation
    Yan, Jiaxing
    Zhao, Hong
    Bu, Penghui
    Jin, YuSheng
    2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 464 - 473
  • [7] Bottleneck Transformer model with Channel Self-Attention for skin lesion classification
    Tada, Masato
    Han, Xian-Hua
    2023 18TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND APPLICATIONS, MVA, 2023,
  • [8] A channel-wise attention-based representation learning method for epileptic seizure detection and type classification
    Baghdadi A.
    Fourati R.
    Aribi Y.
    Daoud S.
    Dammak M.
    Mhiri C.
    Chabchoub H.
    Siarry P.
    Alimi A.
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (07) : 9403 - 9418
  • [9] Region-based feature enhancement using channel-wise attention for classification of breast histopathological images
    R. Rashmi
    Keerthana Prasad
    Chethana Babu K. Udupa
    Neural Computing and Applications, 2023, 35 : 5839 - 5854
  • [10] Posture Detection of Individual Pigs Based on Lightweight Convolution Neural Networks and Efficient Channel-Wise Attention
    Luo, Yizhi
    Zeng, Zhixiong
    Lu, Huazhong
    Lv, Enli
    SENSORS, 2021, 21 (24)