Enhancing fetal ultrasound image quality assessment with multi-scale fusion and clustering-based optimization

被引:0
|
作者
Chen, Chaoyu [1 ,2 ]
Huang, Yuhao [1 ,2 ]
Yang, Xin [1 ,2 ]
Hu, Xindi [4 ]
Zhang, Yuanji [1 ,2 ]
Tan, Tao [5 ]
Xue, Wufeng [1 ,2 ]
Ni, Dong [1 ,2 ,3 ]
机构
[1] Shenzhen Univ, Med Sch, Sch Biomed Engn, Natl Reg Key Technol Engn Lab Med Ultrasound, Shenzhen, Peoples R China
[2] Shenzhen Univ, Med Ultrasound Image Comp MUS Lab, Shenzhen, Peoples R China
[3] Nanjing Med Univ, Sch Biomed Engn & Informat, Nanjing, Peoples R China
[4] Shenzhen RayShape Med Technol Co Ltd, Shenzhen, Peoples R China
[5] Macao Polytech Univ, Fac Appl Sci, Taipa, Macao, Peoples R China
基金
中国国家自然科学基金;
关键词
Fetal ultrasound; Image quality assessment; Multi-scale fusion; Clustering-based optimization; Global correlation consistency; LOCALIZATION; PLANES;
D O I
10.1016/j.bspc.2024.107249
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Fetal ultrasound image quality assessment (FUIQA) requires experienced physicians to identify anatomical structures and overall information within the image, providing a quality evaluation based on their subjective perception. Obtaining high-quality images can aid in clinical diagnosis and serve as reliable input for downstream tasks such as structure detection, organ segmentation, and disease diagnosis. However, the objective and accurate assessment fetal ultrasound image quality using deep learning poses several challenges. The FUIQA process involves an interaction between objective analysis and subjective judgment. Quality annotation requires careful attention to both global and local information, making it time-consuming and labor-intensive. Additionally, optimizing deep models with case-wise loss functions may result in suboptimal performance on global evaluation metrics compared to directly optimizing for global correlation consistency. In this paper, we construct a novel deep learning-based FUIQA framework to address these challenges. Our contributions are threefold. First, we propose a multiscale quality-aware fusion module that fuses and enhances feature representations at different scales, thereby ensuring effective feature perception and improving model performance. Second, we introduce a clustering-based mix-up (CMX) strategy to generate a sufficient number of rich pseudo-samples, alleviating the problem of insufficient training samples. Third, considering that the pseudo-samples generated by CMX can effectively simulate the global distribution under the batch-based training approach, we design a novel global correlation consistency loss to directly learn global evaluation metrics, ensuring consistency between training and testing objectives. Extensive experiments on five FUIQA datasets demonstrated that our framework outperforms other strong competitors.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] MAFBLiF: Multi-Scale Attention Feature Fusion-Based Blind Light Field Image Quality Assessment
    Zhou, Rui
    Jiang, Gangyi
    Cui, Yueli
    Chen, Yeyao
    Xu, Haiyong
    Luo, Ting
    Yu, Mei
    IEEE TRANSACTIONS ON BROADCASTING, 2024, 70 (04) : 1266 - 1278
  • [22] A Hyperspectral Image Classification Model Based on Band Clustering and Multi-Scale Structure Feature Fusion
    WANG Cai-ling
    ZHANG Jing
    WANG Hong-wei
    SONG Xiao-nan
    JI Tong
    SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44 (01) : 258 - 265
  • [23] An infrared and visible image fusion method based on multi-scale transformation and norm optimization
    Li, Guofa
    Lin, Yongjie
    Qu, Xingda
    INFORMATION FUSION, 2021, 71 : 109 - 129
  • [24] Hierarchical multi-scale stereoscopic image quality assessment based on visual mechanism
    Yongli Chang
    Sumei Li
    Ping Zhao
    Signal, Image and Video Processing, 2022, 16 : 1177 - 1185
  • [25] Hierarchical multi-scale stereoscopic image quality assessment based on visual mechanism
    Chang, Yongli
    Li, Sumei
    Zhao, Ping
    SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (05) : 1177 - 1185
  • [26] Deep Multi-scale Subspace Clustering Based on Bayesian Optimization
    Qian, Zhenyu
    Hong, Zhou
    Zhao, Yaping
    Nie, Lei
    Jiang, Yizhang
    Xia, Kaijian
    ADVANCED INTELLIGENT COMPUTING IN BIOINFORMATICS, PT II, ICIC 2024, 2024, 14882 : 381 - 391
  • [27] IQMA Network: Image Quality Multi-scale Assessment Network
    Guo, Haiyang
    Bin, Yi
    Hou, Yuqing
    Zhang, Qing
    Luo, Hengliang
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 443 - 452
  • [28] Image Dehazing Method Based on Multi-scale Feature Fusion
    Yao, Minghai
    Miao, Qi
    Hao, Qiaohong
    PROCEEDINGS OF THE 2017 3RD INTERNATIONAL CONFERENCE ON ECONOMICS, SOCIAL SCIENCE, ARTS, EDUCATION AND MANAGEMENT ENGINEERING (ESSAEME 2017), 2017, 119 : 2163 - 2166
  • [29] Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting
    Chen, Jun
    Li, Xuejiao
    Luo, Linbo
    Ma, Jiayi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 655 - 667
  • [30] A Novel Image Fusion Metric Based on Multi-Scale Analysis
    Wang, Peng-wei
    Liu, Bo
    ICSP: 2008 9TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, VOLS 1-5, PROCEEDINGS, 2008, : 965 - +