A multimodal dual-branch fusion network for fetal hypoxia detection

被引:0
|
作者
Liu, Mujun [1 ]
Xiao, Yahui [2 ]
Zeng, Rongdan [3 ]
Wu, Zhe [1 ]
Liu, Yu [4 ]
Li, Hongfei [5 ]
机构
[1] Army Med Univ, Mil Med Univ 3, Coll Biomed Engn & Imaging Med, Dept Digital Med, Chongqing 400038, Peoples R China
[2] South China Univ Technol, Sch Future Technol, Guangzhou 511442, Peoples R China
[3] Jinan Univ, Coll Informat Sci & Technol, Guangzhou 510632, Peoples R China
[4] South China Univ Technol, Sch Automat Sci & Engn, Guangzhou 510641, Peoples R China
[5] Guangxi Univ, Law Sch, Nanning 530004, Guangxi, Peoples R China
关键词
Cardiotocography; Fetal state classification; Attention module; Multimodal fusion; COMPLEXITY;
D O I
10.1016/j.eswa.2024.125263
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Labor is the most severe test of a fetus's ability to survive hypoxia. Even low-risk full-term fetuses may endure variable degrees of hypoxia as a result of intrapartum uterine contractions. It is imperative for clinicians to expeditiously identify fetal hypoxia and implement timely interventions. However, due to the intricacy and intra-class variability of fetal heart rate (FHR) data, distinguishing normal babies from acidotic fetuses is extremely challenging. This research proposes a novel multimodal dual-branch fusion network to improve the accuracy of fetal hypoxia identification. The dual-branch network is constructed through the signal slicing method. Additionally, we present a novel attention guidance module that leverages spatial attention to capture hypoxia-related information from two branches of signal. Ultimately, the network integrates maternal electronic medical records, FHR features, and FHR signals to achieve multimodal fusion of the input features. Furthermore, label smoothing can yield better calibrated networks, thus improving classification performance even further. On the public dataset, this method obtained a sensitivity of 72.58 %, a specificity of 71.08 %, a quality index of 71.59 %, and an area under the curve of 74.70 %. This method combines maternal-fetal medicine and artificial intelligence, represents a new strategy to recognize fetal acidosis.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Dual-Branch Multimodal Fusion Network for Driver Facial Emotion Recognition
    Wang, Le
    Chang, Yuchen
    Wang, Kaiping
    APPLIED SCIENCES-BASEL, 2024, 14 (20):
  • [2] Dual-Branch Feature Fusion Network for Salient Object Detection
    Song, Zhehan
    Xu, Zhihai
    Wang, Jing
    Feng, Huajun
    Li, Qi
    PHOTONICS, 2022, 9 (01)
  • [3] Dual-Branch Enhanced Network for Change Detection
    Zhang, Hongrui
    Qu, Shaocheng
    Li, Huan
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2022, 47 (03) : 3459 - 3471
  • [4] Dual-Branch Enhanced Network for Change Detection
    Hongrui Zhang
    Shaocheng Qu
    Huan Li
    Arabian Journal for Science and Engineering, 2022, 47 : 3459 - 3471
  • [5] A Dual-branch Network for Infrared and Visible Image Fusion
    Fu, Yu
    Wu, Xiao-Jun
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10675 - 10680
  • [6] A Dual-Branch Fusion Network for Surgical Instrument Segmentation
    Yang, Lei
    Zhai, Chenxu
    Wang, Hongyong
    Liu, Yanhong
    Bian, Guibin
    IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2024, 6 (04): : 1542 - 1554
  • [7] DUAL-BRANCH MULTIMODAL FUSION NETWORK FOR SKIN LESIONS DIAGNOSIS USING CLINICAL AND ULTRASOUND IMAGE
    Xiao, Chunlun
    Zhu, Anqi
    Xia, Chunmei
    Liu, Yuanlin
    Qiu, Zifeng
    Wang, Qiao
    Ren, Weiwei
    Shan, Dandan
    Wang, Tianfu
    Guo, Lehang
    Lei, Baiying
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [8] DBFNet: A Dual-Branch Fusion Network for Underwater Image Enhancement
    Sun, Kaichuan
    Tian, Yubo
    REMOTE SENSING, 2023, 15 (05)
  • [9] Parallel Dual-Branch Fusion Network for Epileptic Seizure Prediction
    Ma H.
    Wu Y.
    Tang Y.
    Chen R.
    Xu T.
    Zhang W.
    Computers in Biology and Medicine, 2024, 176
  • [10] Dual-branch network with memory for video anomaly detection
    Dicong Wang
    Qinghua Hu
    Kaijun Wu
    Multimedia Systems, 2023, 29 : 247 - 259