Deep Learning based Multi-modal Ultrasound-Photoacoustic Imaging

被引:0
|
作者
Halder, Sumana [1 ]
Patidar, Sankalp [2 ]
Chaudhury, Koel [1 ]
Mandal, Subhamoy [1 ]
机构
[1] Indian Inst Technol Kharagpur, Sch Med Sci & Technol, Kharagpur 721302, W Bengal, India
[2] Indian Inst Technol Kharagpur, Dept Biosci & Biotechnol, Kharagpur, W Bengal, India
关键词
Ultrasound imaging; Photoacoustic imaging; Deep Learning; Functional imaging; Multi-modality;
D O I
10.1109/SAUS61785.2024.10563622
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This study explores the implementation of an artificial intelligence (AI)-assisted multi-modal imaging platform for renal tissue analysis. Leveraging contrast-enhanced ultrasound (CEUS) and photoacoustic (PA) imaging, it provides a comprehensive view of renal tissues. Using deep learning (DL) models like U-Net and nnU-Net, anatomical structures are accurately segmented in medical ultrasound images. Evaluation metrics confirm the effectiveness of DL models. Functional imaging analysis correlates DL predictions with non-linear constrast (NLC) images to understand renal tissue perfusion dynamics. Future work involves using DL predictions for fluence correction in PA images, enhancing tissue absorption accuracy. This multi-modal approach has potential in clinical diagnostics and disease monitoring.
引用
收藏
页数:3
相关论文
共 50 条
  • [31] Deep learning based object detection from multi-modal sensors: an overview
    Ye Liu
    Shiyang Meng
    Hongzhang Wang
    Jun Liu
    Multimedia Tools and Applications, 2024, 83 : 19841 - 19870
  • [32] Deep learning based object detection from multi-modal sensors: an overview
    Liu, Ye
    Meng, Shiyang
    Wang, Hongzhang
    Liu, Jun
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (07) : 19841 - 19870
  • [33] Multi-modal Fusion Brain Tumor Detection Method Based on Deep Learning
    Yao Hong-ge
    Shen Xin-xia
    Li Yu
    Yu Jun
    Lei Song-ze
    ACTA PHOTONICA SINICA, 2019, 48 (07)
  • [34] Multi-Modal Deep Learning-Based Violin Bowing Action Recognition
    Liu, Bao-Yun
    Jen, Yi-Hsin
    Sun, Shih-Wei
    Su, Li
    Chang, Pao-Chi
    2020 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TAIWAN), 2020,
  • [35] Representation learning using step-based deep multi-modal autoencoders
    Bhatt, Gaurav
    Jha, Piyush
    Raman, Balasubramanian
    PATTERN RECOGNITION, 2019, 95 : 12 - 23
  • [36] Deep Learning Based Multi-Modal Fusion Architectures for Maritime Vessel Detection
    Farahnakian, Fahimeh
    Heikkonen, Jukka
    REMOTE SENSING, 2020, 12 (16)
  • [37] Deep Learning Based Multi-modal Addressee Recognition in Visual Scenes with Utterances
    Thao Le Minh
    Shimizu, Nobuyuki
    Miyazaki, Takashi
    Shinoda, Koichi
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 1546 - 1553
  • [38] Multi-Modal Emotion Recognition Based On deep Learning Of EEG And Audio Signals
    Li, Zhongjie
    Zhang, Gaoyan
    Dang, Jianwu
    Wang, Longbiao
    Wei, Jianguo
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [39] Cardiovascular disease detection based on deep learning and multi-modal data fusion
    Zhu, Jiayuan
    Liu, Hui
    Liu, Xiaowei
    Chen, Chao
    Shu, Minglei
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 99
  • [40] Multi-modal anchor adaptation learning for multi-modal summarization
    Chen, Zhongfeng
    Lu, Zhenyu
    Rong, Huan
    Zhao, Chuanjun
    Xu, Fan
    NEUROCOMPUTING, 2024, 570