A multimodal dual-branch fusion network for fetal hypoxia detection

被引:0
|
作者
Liu, Mujun [1 ]
Xiao, Yahui [2 ]
Zeng, Rongdan [3 ]
Wu, Zhe [1 ]
Liu, Yu [4 ]
Li, Hongfei [5 ]
机构
[1] Department of Digital Medicine, College of Biomedical Engineering and Imaging Medicine, Army Medical University (Third Military Medical University), Chongqing,400038, China
[2] School of Future Technology, South China University of Technology, Guangzhou,511442, China
[3] College of Information Science and Technology, Jinan University, Guangzhou,510632, China
[4] School of Automation Science and Engineering, South China University of Technology, Guangzhou,510641, China
[5] Law School, Guangxi University, Guangxi,530004, China
关键词
D O I
10.1016/j.eswa.2024.125263
中图分类号
学科分类号
摘要
Labor is the most severe test of a fetus's ability to survive hypoxia. Even low-risk full-term fetuses may endure variable degrees of hypoxia as a result of intrapartum uterine contractions. It is imperative for clinicians to expeditiously identify fetal hypoxia and implement timely interventions. However, due to the intricacy and intra-class variability of fetal heart rate (FHR) data, distinguishing normal babies from acidotic fetuses is extremely challenging. This research proposes a novel multimodal dual-branch fusion network to improve the accuracy of fetal hypoxia identification. The dual-branch network is constructed through the signal slicing method. Additionally, we present a novel attention guidance module that leverages spatial attention to capture hypoxia-related information from two branches of signal. Ultimately, the network integrates maternal electronic medical records, FHR features, and FHR signals to achieve multimodal fusion of the input features. Furthermore, label smoothing can yield better calibrated networks, thus improving classification performance even further. On the public dataset, this method obtained a sensitivity of 72.58 %, a specificity of 71.08 %, a quality index of 71.59 %, and an area under the curve of 74.70 %. This method combines maternal-fetal medicine and artificial intelligence, represents a new strategy to recognize fetal acidosis. © 2024 Elsevier Ltd
引用
收藏
相关论文
共 50 条
  • [41] Incremental Learning Based on Dual-Branch Network
    Dong, Mingda
    Zhang, Zhizhong
    Xie, Yuan
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT III, 2024, 14427 : 263 - 272
  • [42] A dual-branch residual network for inhomogeneous dehazing
    Xu, Yifei
    Li, Jingjing
    Wei, Pingping
    Wang, Aichen
    Rao, Yuan
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 102
  • [43] DBT: multimodal emotion recognition based on dual-branch transformer
    Yufan Yi
    Yan Tian
    Cong He
    Yajing Fan
    Xinli Hu
    Yiping Xu
    [J]. The Journal of Supercomputing, 2023, 79 : 8611 - 8633
  • [44] A Nonintrusive Load Identification Method Based on Dual-Branch Attention GRU Fusion Network
    Yuan, Jie
    Jin, Ran
    Wang, Lidong
    Wang, Ting
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [45] DBT: multimodal emotion recognition based on dual-branch transformer
    Yi, Yufan
    Tian, Yan
    He, Cong
    Fan, Yajing
    Hu, Xinli
    Xu, Yiping
    [J]. JOURNAL OF SUPERCOMPUTING, 2023, 79 (08): : 8611 - 8633
  • [46] Ship Recognition for Complex SAR Images via Dual-Branch Transformer Fusion Network
    Sun, Zhongzhen
    Leng, Xiangguang
    Zhang, Xianghui
    Xiong, Boli
    Ji, Kefeng
    Kuang, Gangyao
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [47] DBF-Net: A Dual-Branch Network with Feature Fusion for Ultrasound Image Segmentation
    Xu, Guoping
    Wu, Xiaming
    Liao, Wentao
    Wu, Xinglong
    Huang, Qing
    Li, Chang
    [J]. arXiv,
  • [48] Tumor Classification Based on Approximate Symmetry Using Dual-Branch Complementary Fusion Network
    Yu, Mei
    Cheng, Minyutong
    Li, Xubin
    Liu, Zhiqiang
    Gao, Jie
    Fu, Xuzhou
    Li, Xuewei
    Yu, Ruiguo
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 1215 - 1215
  • [49] Dual-Branch Remote Sensing Spatiotemporal Fusion Network Based on Selection Kernel Mechanism
    Li, Weisheng
    Wu, Fengyan
    Cao, Dongwen
    [J]. REMOTE SENSING, 2022, 14 (17)
  • [50] DFTI: Dual-Branch Fusion Network Based on Transformer and Inception for Space Noncooperative Objects
    Zhang, Zhao
    Zhou, Dong
    Sun, Guanghui
    Hu, YuHui
    Deng, Runran
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73