ENHANCING TONGUE REGION SEGMENTATION THROUGH SELF-ATTENTION AND TRANSFORMER BASED

被引:0
|
作者
Song, Yihua [1 ,2 ]
Li, Can [1 ,2 ]
Zhang, Xia [1 ,2 ]
Liu, Zhen [3 ]
Song, Ningning [4 ]
Zhou, Zuojian [1 ,2 ]
机构
[1] Nanjing Univ Chinese Med, Sch Articial Intelligence & Informat Technol, Nanjing 210003, Peoples R China
[2] Nanjing Univ Chinese Med, Jiangsu Prov Engn Res Ctr TCM Intelligence Hlth Se, Nanjing, Peoples R China
[3] Nanjing Univ Chinese Med, Sch Med Humanities, Nanjing 210003, Peoples R China
[4] Nanjing First Hosp, Nanjing 210003, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Deep learning; transformer; harnessing self-attention tongue segmentation; tongue segmentation;
D O I
10.1142/S0219519424400098
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
As an essential component of traditional Chinese medicine diagnosis, tongue diagnosis has faced limitations in clinical practice due to its subjectivity and reliance on the experience of physicians. Recent advancements in deep learning techniques have opened new possibilities for the automated analysis and diagnosis of tongue images. In this paper, we collected 500 tongue images from various patients. These images were initially preprocessed and annotated, resulting in the dataset used for this experiment. This project is based on the previously proposed segmentation method using Harnessing Self-Attention and Transformer, which is divided into three key stages: feature extraction, feature fusion, and segmentation prediction. By organically combining these three key stages, our tongue region segmentation model is better equipped to handle complex tongue images and provides accurate segmentation results. The segmentation DICE coefficient reaches 0.953, which is of significant importance for the automation and objectivity of tongue diagnosis in traditional Chinese medicine.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Fixed Encoder Self-Attention Patterns in Transformer-Based Machine Translation
    Raganato, Alessandro
    Scherrer, Yves
    Tiedemann, Jorg
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020, : 556 - 568
  • [42] Worker behavior recognition based on temporal and spatial self-attention of vision Transformer
    Lu Y.-X.
    Xu G.-H.
    Tang B.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (03): : 446 - 454
  • [43] Refined Self-Attention Transformer Model for ECG-Based Arrhythmia Detection
    Tao, Yanyun
    Xu, Biao
    Zhang, Yuzhen
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 14
  • [44] Micro-Expression Recognition Method Based on Transformer with Separable Self-Attention
    Yang, Peng
    Zeng, Zhifeng
    Zhu, Tianyuan
    2024 4TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND INTELLIGENT SYSTEMS ENGINEERING, MLISE 2024, 2024, : 90 - 95
  • [45] Local-Global Self-Attention for Transformer-Based Object Tracking
    Chen, Langkun
    Gao, Long
    Jiang, Yan
    Li, Yunsong
    He, Gang
    Ning, Jifeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 12316 - 12329
  • [46] Focal cross transformer: multi-view brain tumor segmentation model based on cross window and focal self-attention
    Li, Zongren
    Silamu, Wushouer
    Feng, Shurui
    Yan, Guanghui
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [47] Self-attention CNN for retinal layer segmentation in OCT
    Cao, Guogang
    Wu, Yan
    Peng, Zeyu
    Zhou, Zhilin
    Dai, Cuixia
    BIOMEDICAL OPTICS EXPRESS, 2024, 15 (03) : 1605 - 1617
  • [48] Self-attention feature fusion network for semantic segmentation
    Zhou, Zhen
    Zhou, Yan
    Wang, Dongli
    Mu, Jinzhen
    Zhou, Haibin
    NEUROCOMPUTING, 2021, 453 : 50 - 59
  • [49] Multiple Self-attention Network for Intracranial Vessel Segmentation
    Li, Yang
    Ni, Jiajia
    Elazab, Ahmed
    Wu, Jianhuang
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [50] SATS: Self-attention transfer for continual semantic segmentation
    Qiu, Yiqiao
    Shen, Yixing
    Sun, Zhuohao
    Zheng, Yanchong
    Chang, Xiaobin
    Zheng, Weishi
    Wang, Ruixuan
    PATTERN RECOGNITION, 2023, 138