A multimodal dual-branch fusion network for fetal hypoxia detection

被引:0
|
作者
Liu, Mujun [1 ]
Xiao, Yahui [2 ]
Zeng, Rongdan [3 ]
Wu, Zhe [1 ]
Liu, Yu [4 ]
Li, Hongfei [5 ]
机构
[1] Department of Digital Medicine, College of Biomedical Engineering and Imaging Medicine, Army Medical University (Third Military Medical University), Chongqing,400038, China
[2] School of Future Technology, South China University of Technology, Guangzhou,511442, China
[3] College of Information Science and Technology, Jinan University, Guangzhou,510632, China
[4] School of Automation Science and Engineering, South China University of Technology, Guangzhou,510641, China
[5] Law School, Guangxi University, Guangxi,530004, China
关键词
D O I
10.1016/j.eswa.2024.125263
中图分类号
学科分类号
摘要
Labor is the most severe test of a fetus's ability to survive hypoxia. Even low-risk full-term fetuses may endure variable degrees of hypoxia as a result of intrapartum uterine contractions. It is imperative for clinicians to expeditiously identify fetal hypoxia and implement timely interventions. However, due to the intricacy and intra-class variability of fetal heart rate (FHR) data, distinguishing normal babies from acidotic fetuses is extremely challenging. This research proposes a novel multimodal dual-branch fusion network to improve the accuracy of fetal hypoxia identification. The dual-branch network is constructed through the signal slicing method. Additionally, we present a novel attention guidance module that leverages spatial attention to capture hypoxia-related information from two branches of signal. Ultimately, the network integrates maternal electronic medical records, FHR features, and FHR signals to achieve multimodal fusion of the input features. Furthermore, label smoothing can yield better calibrated networks, thus improving classification performance even further. On the public dataset, this method obtained a sensitivity of 72.58 %, a specificity of 71.08 %, a quality index of 71.59 %, and an area under the curve of 74.70 %. This method combines maternal-fetal medicine and artificial intelligence, represents a new strategy to recognize fetal acidosis. © 2024 Elsevier Ltd
引用
收藏
相关论文
共 50 条
  • [21] DFENet: A dual-branch feature enhanced network integrating transformers and convolutional feature learning for multimodal medical image fusion
    Li, Weisheng
    Zhang, Yin
    Wang, Guofen
    Huang, Yuping
    Li, Ruyue
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 80
  • [22] DMMFnet: A Dual-Branch Multimodal Medical Image Fusion Network Using Super Token and Channel-Spatial Attention
    Zhang, Yukun
    Wang, Lei
    Tahir, Muhammad
    Huang, Zizhen
    Han, Yaolong
    Yang, Shanliang
    Liu, Shilong
    Saeed, Muhammad Imran
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (08) : 696 - 705
  • [23] Dual-branch fusion model for lensless imaging
    Zhang, Yinger
    Wu, Zhouyi
    Xu, Yunhui
    Huangfu, Jiangtao
    [J]. OPTICS EXPRESS, 2023, 31 (12) : 19463 - 19477
  • [24] A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification
    Gao, Hongmin
    Zhang, Yiyan
    Chen, Zhonghao
    Li, Chenming
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 (14) : 8180 - 8192
  • [25] Dual-Branch Network of Information Mutual Optimization for Salient Object Detection
    Chen, Zijun
    Zhan, Yinwei
    Gao, Shanglei
    [J]. IEEE ACCESS, 2023, 11 : 46120 - 46131
  • [26] PFRNet: Dual-Branch Progressive Fusion Rectification Network for Monaural Speech Enhancement
    Yu, Runxiang
    Zhao, Ziwei
    Ye, Zhongfu
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2358 - 2362
  • [27] Source camera identification based on an adaptive dual-branch fusion residual network
    Hong Zheng
    Changhui You
    Tianyu Wang
    Jianping Ju
    Xi Li
    [J]. Multimedia Tools and Applications, 2024, 83 : 18479 - 18495
  • [28] FUSION OF HYPERSPECTRAL AND LIDAR DATA BASED ON DUAL-BRANCH CONVOLUTIONAL NEURAL NETWORK
    Wang, Jinzhe
    Zhang, Junping
    Guo, Qingle
    Li, Tong
    [J]. 2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 3388 - 3391
  • [29] Source camera identification based on an adaptive dual-branch fusion residual network
    Zheng, Hong
    You, Changhui
    Wang, Tianyu
    Ju, Jianping
    Li, Xi
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (06) : 18479 - 18495
  • [30] CFIFusion: Dual-Branch Complementary Feature Injection Network for Medical Image Fusion
    Xie, Yiyuan
    Yu, Lei
    Ding, Cheng
    [J]. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2024, 34 (04)