Deep Learning based Multi-modal Ultrasound-Photoacoustic Imaging

被引:0
|
作者
Halder, Sumana [1 ]
Patidar, Sankalp [2 ]
Chaudhury, Koel [1 ]
Mandal, Subhamoy [1 ]
机构
[1] Indian Inst Technol Kharagpur, Sch Med Sci & Technol, Kharagpur 721302, W Bengal, India
[2] Indian Inst Technol Kharagpur, Dept Biosci & Biotechnol, Kharagpur, W Bengal, India
关键词
Ultrasound imaging; Photoacoustic imaging; Deep Learning; Functional imaging; Multi-modality;
D O I
10.1109/SAUS61785.2024.10563622
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This study explores the implementation of an artificial intelligence (AI)-assisted multi-modal imaging platform for renal tissue analysis. Leveraging contrast-enhanced ultrasound (CEUS) and photoacoustic (PA) imaging, it provides a comprehensive view of renal tissues. Using deep learning (DL) models like U-Net and nnU-Net, anatomical structures are accurately segmented in medical ultrasound images. Evaluation metrics confirm the effectiveness of DL models. Functional imaging analysis correlates DL predictions with non-linear constrast (NLC) images to understand renal tissue perfusion dynamics. Future work involves using DL predictions for fluence correction in PA images, enhancing tissue absorption accuracy. This multi-modal approach has potential in clinical diagnostics and disease monitoring.
引用
收藏
页数:3
相关论文
共 50 条
  • [1] Deep Learning Based Multi-modal Registration for Retinal Imaging
    Arikan, Mustafa
    Sadeghipour, Amir
    Gerendas, Bianca
    Told, Reinhard
    Schmidt-Erfurt, Ursula
    INTERPRETABILITY OF MACHINE INTELLIGENCE IN MEDICAL IMAGE COMPUTING AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, 2020, 11797 : 75 - 82
  • [2] MULTI-MODAL DEEP LEARNING ON IMAGING GENETICS FOR SCHIZOPHRENIA CLASSIFICATION
    Kanyal, Ayush
    Kandula, Srinivas
    Calhoun, Vince
    Ye, Dong Hye
    2023 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW, 2023,
  • [3] Memory based fusion for multi-modal deep learning
    Priyasad, Darshana
    Fernando, Tharindu
    Denman, Simon
    Sridharan, Sridha
    Fookes, Clinton
    INFORMATION FUSION, 2021, 67 : 136 - 146
  • [4] Integrated transrectal probe for translational ultrasound-photoacoustic imaging
    Bell, Keven L.
    Harrison, Tyler
    Usmani, Nawaid
    Zemp, Roger J.
    PHOTONS PLUS ULTRASOUND: IMAGING AND SENSING 2016, 2016, 9708
  • [5] Multi-modal breast imaging with ultrasound tomography
    Duric, Neb
    Li, Cuiping
    Littrup, Peter
    Glide-Hurst, Carri
    Huang, Lianjie
    Lupinacci, Jessica
    Schmidt, Steven
    Rama, Olsi
    Bey-Knight, Lisa
    Xu, Yang
    MEDICAL IMAGING 2008: ULTRASONIC IMAGING AND SIGNAL PROCESSING, 2008, 6920
  • [6] Effective deep learning-based multi-modal retrieval
    Wei Wang
    Xiaoyan Yang
    Beng Chin Ooi
    Dongxiang Zhang
    Yueting Zhuang
    The VLDB Journal, 2016, 25 : 79 - 101
  • [7] Effective deep learning-based multi-modal retrieval
    Wang, Wei
    Yang, Xiaoyan
    Ooi, Beng Chin
    Zhang, Dongxiang
    Zhuang, Yueting
    VLDB JOURNAL, 2016, 25 (01): : 79 - 101
  • [8] Multi-modal haptic image recognition based on deep learning
    Han, Dong
    Nie, Hong
    Chen, Jinbao
    Chen, Meng
    Deng, Zhen
    Zhang, Jianwei
    SENSOR REVIEW, 2018, 38 (04) : 486 - 493
  • [9] Multi-Modal Pedestrian Detection Algorithm Based on Deep Learning
    Li X.
    Fu H.
    Niu W.
    Wang P.
    Lü Z.
    Wang W.
    Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2022, 56 (10): : 61 - 70
  • [10] A Novel Cross Modal Hashing Algorithm Based on Multi-modal Deep Learning
    Qu, Wen
    Wang, Daling
    Feng, Shi
    Zhang, Yifei
    Yu, Ge
    SOCIAL MEDIA PROCESSING, SMP 2015, 2015, 568 : 156 - 167