Deep Learning based Multi-modal Ultrasound-Photoacoustic Imaging

被引:0
|
作者
Halder, Sumana [1 ]
Patidar, Sankalp [2 ]
Chaudhury, Koel [1 ]
Mandal, Subhamoy [1 ]
机构
[1] Indian Inst Technol Kharagpur, Sch Med Sci & Technol, Kharagpur 721302, W Bengal, India
[2] Indian Inst Technol Kharagpur, Dept Biosci & Biotechnol, Kharagpur, W Bengal, India
关键词
Ultrasound imaging; Photoacoustic imaging; Deep Learning; Functional imaging; Multi-modality;
D O I
10.1109/SAUS61785.2024.10563622
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This study explores the implementation of an artificial intelligence (AI)-assisted multi-modal imaging platform for renal tissue analysis. Leveraging contrast-enhanced ultrasound (CEUS) and photoacoustic (PA) imaging, it provides a comprehensive view of renal tissues. Using deep learning (DL) models like U-Net and nnU-Net, anatomical structures are accurately segmented in medical ultrasound images. Evaluation metrics confirm the effectiveness of DL models. Functional imaging analysis correlates DL predictions with non-linear constrast (NLC) images to understand renal tissue perfusion dynamics. Future work involves using DL predictions for fluence correction in PA images, enhancing tissue absorption accuracy. This multi-modal approach has potential in clinical diagnostics and disease monitoring.
引用
收藏
页数:3
相关论文
共 50 条
  • [21] Applying deep learning-based multi-modal for detection of coronavirus
    Geeta Rani
    Meet Ganpatlal Oza
    Vijaypal Singh Dhaka
    Nitesh Pradhan
    Sahil Verma
    Joel J. P. C. Rodrigues
    Multimedia Systems, 2022, 28 : 1251 - 1262
  • [22] Quantitative reconstructions in multi-modal photoacoustic and optical coherence tomography imaging
    Elbau, P.
    Mindrinos, L.
    Scherzer, O.
    INVERSE PROBLEMS, 2018, 34 (01)
  • [23] Multi-modal Registration Based Ultrasound Mosaicing
    Kutter, Oliver
    Wein, Wolfgang
    Navab, Nassir
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2009, PT I, PROCEEDINGS, 2009, 5761 : 763 - +
  • [24] Systematic comparison of deep-learning based fusion strategies for multi-modal ultrasound in diagnosis of liver cancer
    Li, Ming-De
    Li, Wei
    Lin, Man-Xia
    Lin, Xin-Xin
    Hu, Hang-Tong
    Wang, Ying-Chen
    Ruan, Si-Min
    Huang, Ze-Rong
    Lu, Rui-Fang
    Li, Lv
    Kuang, Ming
    Lu, Ming-De
    Chen, Li-Da
    Wang, Wei
    Huang, Qing-hua
    NEUROCOMPUTING, 2024, 603
  • [25] Artificial Intelligence Assisted Multi-modal Photoacoustic-Ultrasound Imaging for Studying Renal Tissue Function and Hemodynamics
    Halder, Sumana
    Patidar, Sankalp
    Chaudhury, Koel
    Mandal, Subhamoy
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [26] Multi-Modal Song Mood Detection with Deep Learning
    Pyrovolakis, Konstantinos
    Tzouveli, Paraskevi
    Stamou, Giorgos
    SENSORS, 2022, 22 (03)
  • [27] A Multi-Modal Deep Learning Approach for Emotion Recognition
    Shahzad, H. M.
    Bhatti, Sohail Masood
    Jaffar, Arfan
    Rashid, Muhammad
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 36 (02): : 1561 - 1570
  • [28] Deep contrastive representation learning for multi-modal clustering
    Lu, Yang
    Li, Qin
    Zhang, Xiangdong
    Gao, Quanxue
    NEUROCOMPUTING, 2024, 581
  • [29] RADIOGRAPHIC OSTEOARTHRITIS PROGRESSION PREDICTION VIA MULTI-MODAL IMAGING DATA AND DEEP LEARNING
    Panfilov, E.
    Tiulpin, A.
    Nieminen, M. T.
    Saarakkala, S.
    OSTEOARTHRITIS AND CARTILAGE, 2022, 30 : S86 - S87
  • [30] Electromagnetic signal feature fusion and recognition based on multi-modal deep learning
    Hou C.
    Zhang X.
    Chen X.
    International Journal of Performability Engineering, 2020, 16 (06): : 941 - 949