Enhancing fetal ultrasound image quality assessment with multi-scale fusion and clustering-based optimization

被引:0
|
作者
Chen, Chaoyu [1 ,2 ]
Huang, Yuhao [1 ,2 ]
Yang, Xin [1 ,2 ]
Hu, Xindi [4 ]
Zhang, Yuanji [1 ,2 ]
Tan, Tao [5 ]
Xue, Wufeng [1 ,2 ]
Ni, Dong [1 ,2 ,3 ]
机构
[1] Shenzhen Univ, Med Sch, Sch Biomed Engn, Natl Reg Key Technol Engn Lab Med Ultrasound, Shenzhen, Peoples R China
[2] Shenzhen Univ, Med Ultrasound Image Comp MUS Lab, Shenzhen, Peoples R China
[3] Nanjing Med Univ, Sch Biomed Engn & Informat, Nanjing, Peoples R China
[4] Shenzhen RayShape Med Technol Co Ltd, Shenzhen, Peoples R China
[5] Macao Polytech Univ, Fac Appl Sci, Taipa, Macao, Peoples R China
基金
中国国家自然科学基金;
关键词
Fetal ultrasound; Image quality assessment; Multi-scale fusion; Clustering-based optimization; Global correlation consistency; LOCALIZATION; PLANES;
D O I
10.1016/j.bspc.2024.107249
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Fetal ultrasound image quality assessment (FUIQA) requires experienced physicians to identify anatomical structures and overall information within the image, providing a quality evaluation based on their subjective perception. Obtaining high-quality images can aid in clinical diagnosis and serve as reliable input for downstream tasks such as structure detection, organ segmentation, and disease diagnosis. However, the objective and accurate assessment fetal ultrasound image quality using deep learning poses several challenges. The FUIQA process involves an interaction between objective analysis and subjective judgment. Quality annotation requires careful attention to both global and local information, making it time-consuming and labor-intensive. Additionally, optimizing deep models with case-wise loss functions may result in suboptimal performance on global evaluation metrics compared to directly optimizing for global correlation consistency. In this paper, we construct a novel deep learning-based FUIQA framework to address these challenges. Our contributions are threefold. First, we propose a multiscale quality-aware fusion module that fuses and enhances feature representations at different scales, thereby ensuring effective feature perception and improving model performance. Second, we introduce a clustering-based mix-up (CMX) strategy to generate a sufficient number of rich pseudo-samples, alleviating the problem of insufficient training samples. Third, considering that the pseudo-samples generated by CMX can effectively simulate the global distribution under the batch-based training approach, we design a novel global correlation consistency loss to directly learn global evaluation metrics, ensuring consistency between training and testing objectives. Extensive experiments on five FUIQA datasets demonstrated that our framework outperforms other strong competitors.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Multi-scale fidelity measure for image fusion quality assessment
    Martinez, Jorge
    Pistonesi, Silvina
    Cristina Maciel, Maria
    Georgina Flesia, Ana
    INFORMATION FUSION, 2019, 50 : 197 - 211
  • [2] A multi-scale contrast-based image quality assessment model for multi-exposure image fusion
    Xing, Lu
    Cai, Lei
    Zeng, Huanqiang
    Chen, Jing
    Zhu, Jianqing
    Hou, Junhui
    SIGNAL PROCESSING, 2018, 145 : 233 - 240
  • [3] Multi-modal image fusion technique for enhancing image quality with multi-scale decomposition algorithm
    Sunitha, T. O.
    Rajalakshmi, R.
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, 2021, 9 (02): : 192 - 204
  • [4] Sensitivity clustering-based multi-scale topology optimization method for metamaterial thermal actuators
    Qiu, Zheng
    Li, Quhao
    Liu, Shutian
    STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2024, 67 (01)
  • [5] Comprehensive clustering-based topology optimization for connectable multi-scale additive manufacturing structures
    Zhang, Chenghu
    Xu, Shuzhi
    Liu, Jikai
    Ma, Yongsheng
    ADDITIVE MANUFACTURING, 2022, 54
  • [6] Sensitivity clustering-based multi-scale topology optimization method for metamaterial thermal actuators
    Zheng Qiu
    Quhao Li
    Shutian Liu
    Structural and Multidisciplinary Optimization, 2024, 67
  • [7] Seismic reliability assessment of lifeline networks using clustering-based multi-scale approach
    Lim, Hyun-Woo
    Song, Junho
    Kurtz, Nolan
    EARTHQUAKE ENGINEERING & STRUCTURAL DYNAMICS, 2015, 44 (03): : 355 - 369
  • [8] Image quality assessment based on multi-scale representation of structure
    Qian, Jiansheng
    Wu, Dong
    Li, Leida
    Cheng, Deqiang
    Wang, Xuesong
    DIGITAL SIGNAL PROCESSING, 2014, 33 : 125 - 133
  • [9] Blind Image Quality Assessment Based on Multi-scale KLT
    Yang, Chao
    Zhang, Xinfeng
    An, Ping
    Shen, Liquan
    Kuo, C. -C. Jay
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 1557 - 1566
  • [10] Image Quality Assessment Based on Multi-scale Geometric Analysis
    Liu, Mingna
    Yang, Xin
    Shang, Yanfeng
    IMAGE ANALYSIS AND PROCESSING - ICIAP 2009, PROCEEDINGS, 2009, 5716 : 807 - +