Deep Learning based Multi-modal Ultrasound-Photoacoustic Imaging

被引:0
|
作者
Halder, Sumana [1 ]
Patidar, Sankalp [2 ]
Chaudhury, Koel [1 ]
Mandal, Subhamoy [1 ]
机构
[1] Indian Inst Technol Kharagpur, Sch Med Sci & Technol, Kharagpur 721302, W Bengal, India
[2] Indian Inst Technol Kharagpur, Dept Biosci & Biotechnol, Kharagpur, W Bengal, India
关键词
Ultrasound imaging; Photoacoustic imaging; Deep Learning; Functional imaging; Multi-modality;
D O I
10.1109/SAUS61785.2024.10563622
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This study explores the implementation of an artificial intelligence (AI)-assisted multi-modal imaging platform for renal tissue analysis. Leveraging contrast-enhanced ultrasound (CEUS) and photoacoustic (PA) imaging, it provides a comprehensive view of renal tissues. Using deep learning (DL) models like U-Net and nnU-Net, anatomical structures are accurately segmented in medical ultrasound images. Evaluation metrics confirm the effectiveness of DL models. Functional imaging analysis correlates DL predictions with non-linear constrast (NLC) images to understand renal tissue perfusion dynamics. Future work involves using DL predictions for fluence correction in PA images, enhancing tissue absorption accuracy. This multi-modal approach has potential in clinical diagnostics and disease monitoring.
引用
收藏
页数:3
相关论文
共 50 条
  • [41] A Multi-Modal Joint Voice Parts Division Method Based On Deep Learning
    Chen, Lingjun
    Zhao, Caidan
    Liu, Yunyi
    Zhuang, Peiyun
    2021 15TH INTERNATIONAL SYMPOSIUM ON MEDICAL INFORMATION AND COMMUNICATION TECHNOLOGY (ISMICT), 2021, : 35 - 40
  • [42] Deep-Learning-Based Multi-Modal Fusion for Fast MR Reconstruction
    Xiang, Lei
    Chen, Yong
    Chang, Weitang
    Zhan, Yiqiang
    Lin, Weili
    Wang, Qian
    Shen, Dinggang
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2019, 66 (07) : 2105 - 2114
  • [43] Robust Deep Multi-modal Learning Based on Gated Information Fusion Network
    Kim, Jaekyum
    Koh, Junho
    Kim, Yecheol
    Choi, Jaehyung
    Hwang, Youngbae
    Choi, Jun Won
    COMPUTER VISION - ACCV 2018, PT IV, 2019, 11364 : 90 - 106
  • [44] Assessment of multi-modal magnetic resonance imaging for glioma based on a deep learning reconstruction approach with the denoising method
    Sun, Jun
    Xu, Siyao
    Guo, Yiding
    Ding, Jinli
    Zhuo, Zhizheng
    Zhou, Dabiao
    Liu, Yaou
    ACTA RADIOLOGICA, 2024, 65 (10) : 1257 - 1264
  • [45] RGB-D BASED MULTI-MODAL DEEP LEARNING FOR FACE IDENTIFICATION
    Lin, Tzu-Ying
    Chiu, Ching-Te
    Tang, Ching-Tung
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 1668 - 1672
  • [46] Research on Multi-Modal Pedestrian Detection and Tracking Algorithm Based on Deep Learning
    Zhao, Rui
    Hao, Jutao
    Huo, Huan
    FUTURE INTERNET, 2024, 16 (06)
  • [47] Multi-modal tumor segmentation methods based on deep learning: a narrative review
    Xue, Hengzhi
    Yao, Yudong
    Teng, Yueyang
    QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2024, 14 (01) : 1122 - 1140
  • [48] Development of a Multi-modal Tissue Diagnostic System Combining High Frequency Ultrasound and Photoacoustic Imaging with Lifetime Fluorescence Spectroscopy
    Sun, Yang
    Stephens, Douglas N.
    Park, Jesung
    Sun, Yinghua
    Marcu, Laura
    Cannata, Jonathan M.
    Shung, K. Kirk
    2008 IEEE ULTRASONICS SYMPOSIUM, VOLS 1-4 AND APPENDIX, 2008, : 570 - +
  • [49] Multi-modal imaging: Simultaneous MRI and ultrasound imaging for carotid arteries visualization
    Tang, Annie M.
    Kacher, Daniel F.
    Lam, Edmund Y.
    Brodsky, Michael
    Jolesz, Ferenc A.
    Yang, Edward S.
    2007 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-16, 2007, : 2603 - 2606
  • [50] Multi-modal deep convolutional dictionary learning for image denoising
    Sun, Zhonggui
    Zhang, Mingzhu
    Sun, Huichao
    Li, Jie
    Liu, Tingting
    Gao, Xinbo
    NEUROCOMPUTING, 2023, 562