NHBS-Net: A Feature Fusion Attention Network for Ultrasound Neonatal Hip Bone Segmentation

被引:29
|
作者
Liu, Ruhan [1 ]
Liu, Mengyao [2 ,3 ]
Sheng, Bin [1 ]
Li, Huating [4 ]
Li, Ping [5 ]
Song, Haitao [6 ]
Zhang, Ping [7 ,8 ]
Jiang, Lixin [2 ,3 ]
Shen, Dinggang [9 ,10 ,11 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Renji Hosp, Sch Med, Dept Ultrasound, Shanghai 200127, Peoples R China
[3] Shanghai Inst Ultrasound Med, Shanghai 200233, Peoples R China
[4] Shanghai Jiao Tong Univ, Affiliated Peoples Hosp 6, Shanghai 200233, Peoples R China
[5] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[6] Shanghai Jiao Tong Univ, Artificial Intelligence Inst, Shanghai 200240, Peoples R China
[7] Ohio State Univ, Dept Comp Sci & Engn, Columbus, OH 43210 USA
[8] Ohio State Univ, Dept Biomed Informat, Columbus, OH 43210 USA
[9] ShanghaiTech Univ, Sch Biomed Engn, Shanghai 201210, Peoples R China
[10] Shanghai United Imaging Intelligence Co Ltd, Dept Res & Dev, Shanghai 201807, Peoples R China
[11] Korea Univ, Dept Artificial Intelligence, Seoul 02841, South Korea
基金
中国国家自然科学基金;
关键词
Image segmentation; Hip; Ultrasonic imaging; Bones; Feature extraction; Standards; Pediatrics; Neonatal hip bone segmentation; self-attention mechanism; medical image segmentation; IMAGE; DIAGNOSIS; DYSPLASIA; PROSTATE;
D O I
10.1109/TMI.2021.3087857
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Ultrasound is a widely used technology for diagnosing developmental dysplasia of the hip (DDH) because it does not use radiation. Due to its low cost and convenience, 2-D ultrasound is still the most common examination in DDH diagnosis. In clinical usage, the complexity of both ultrasound image standardization and measurement leads to a high error rate for sonographers. The automatic segmentation results of key structures in the hip joint can be used to develop a standard plane detection method that helps sonographers decrease the error rate. However, current automatic segmentation methods still face challenges in robustness and accuracy. Thus, we propose a neonatal hip bone segmentation network (NHBS-Net) for the first time for the segmentation of seven key structures. We design three improvements, an enhanced dual attention module, a two-class feature fusion module, and a coordinate convolution output head, to help segment different structures. Compared with current state-of-the-art networks, NHBS-Net gains outstanding performance accuracy and generalizability, as shown in the experiments. Additionally, image standardization is a common need in ultrasonography. The ability of segmentation-based standard plane detection is tested on a 50-image standard dataset. The experiments show that our method can help healthcare workers decrease their error rate from 6%-10% to 2%. In addition, the segmentation performance in another ultrasound dataset (fetal heart) demonstrates the ability of our network.
引用
收藏
页码:3446 / 3458
页数:13
相关论文
共 50 条
  • [31] Multilayer feature fusion and attention-based network for crops and weeds segmentation
    Wang, Haoyu
    Song, Haiyu
    Wu, Haiyan
    Zhang, Zhiqiang
    Deng, Shengchun
    Feng, Xiaoqing
    Chen, Yanhong
    JOURNAL OF PLANT DISEASES AND PROTECTION, 2022, 129 (06) : 1475 - 1489
  • [32] Automated Segmentation of Fetal Ultrasound Images Using Feature Attention Supervised Network
    Liu, Pengfei
    Zhao, Huaici
    Li, Peixuan
    ULTRASOUND QUARTERLY, 2021, 37 (03) : 278 - 286
  • [33] AFFD-Net: A Dual-Decoder Network Based on Attention-Enhancing and Feature Fusion for Retinal Vessel Segmentation
    Xiang, Zijian
    Ning, Chunyu
    Li, Mingye
    Ma, Kaizheng
    Shi, Lemin
    Wang, Wei
    Ye, Guanshi
    IEEE ACCESS, 2023, 11 : 45871 - 45887
  • [34] MSSA-Net: A novel multi-scale feature fusion and global self-attention network for lesion segmentation
    Huang, Zhaohong
    Zhang, Xiangchen
    Zhang, Guowei
    Cai, Guorong
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (21):
  • [35] CAFE-Net: Cross-Attention and Feature Exploration Network for polyp segmentation
    Liu, Guoqi
    Yao, Sheng
    Liu, Dong
    Chang, Baofang
    Chen, Zongyu
    Wang, Jiajia
    Wei, Jiangqi
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [36] DGFAU-Net: Global feature attention upsampling network for medical image segmentation
    Dunlu Peng
    Xi Yu
    Wenjia Peng
    Jianping Lu
    Neural Computing and Applications, 2021, 33 : 12023 - 12037
  • [37] DGFAU-Net: Global feature attention upsampling network for medical image segmentation
    Peng, Dunlu
    Yu, Xi
    Peng, Wenjia
    Lu, Jianping
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (18): : 12023 - 12037
  • [38] BCUIS-Net: A breast cancer ultrasound image segmentation network via boundary-aware and shape feature fusion
    Li, Haiyan
    Wang, Xu
    Tang, Yiyin
    Ye, Shuhua
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2024, 34 (01)
  • [39] MF2-Net: A multipath feature fusion network for medical image segmentation
    Yamanakkanavar, Nagaraj
    Lee, Bumshik
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 114
  • [40] Bone Ultrasound Segmentation Network Based on Sequential Attention and Local Phase Guidance
    Chen F.
    Zhang D.-Q.
    Liao H.-E.
    Zhao Z.
    Zidonghua Xuebao/Acta Automatica Sinica, 2024, 50 (05): : 970 - 979