AS-Net: Fast Photoacoustic Reconstruction With Multi-Feature Fusion From Sparse Data

被引:17
|
作者
Guo, Mengjie [1 ]
Lan, Hengrong [1 ,2 ,3 ]
Yang, Changchun [1 ]
Liu, Jiang [4 ,5 ]
Gao, Fei [1 ,6 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Hybrid Imaging Syst Lab, Shanghai 201210, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai 200050, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Southern Univ Sci & Technol, Dept Comp Sci & Engn, Shenzhen 518055, Guangdong, Peoples R China
[5] Chinese Acad Sci, Cixi Inst Biomed Engn, Shanghai 200050, Peoples R China
[6] Shanghai Engn Res Ctr Energy Efficient & Custom A, Shanghai 201210, Peoples R China
基金
中国国家自然科学基金;
关键词
Attention; deep learning; photoacoustic tomography; reconstruction; sparse sampling; IMAGE-RECONSTRUCTION;
D O I
10.1109/TCI.2022.3155379
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Photoacoustic (PA) imaging is a biomedical imaging modality capable of acquiring high-contrast images of optical absorption at depths much greater than traditional optical imaging techniques. However, practical instrumentation and geometry limit the number of available acoustic sensors surrounding the imaging target, which results in the sparsity of sensor data. Conventional PA image reconstruction methods give severe artifacts when they are applied directly to the sparse PA data. In this paper, we firstly propose to employ a novel signal processing method to make sparse PA raw data more suitable for the neural network, concurrently speeding up image reconstruction. Then we propose Attention Steered Network (AS-Net) for PA reconstruction with multi-feature fusion. AS-Net is validated on different datasets, including simulated photoacoustic data from fundus vasculature phantoms and experimental data from in vivo fish and mice. Notably, the method is also able to eliminate some artifacts present in the ground truth for in vivo data. Results demonstrated that our method provides superior reconstructions at a faster speed.
引用
收藏
页码:215 / 223
页数:9
相关论文
共 50 条
  • [41] Knowledge tracing based on multi-feature fusion
    Xiao, Yongkang
    Xiao, Rong
    Huang, Ning
    Hu, Yixin
    Li, Huan
    Sun, Bo
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (02): : 1819 - 1833
  • [42] Multi-feature fusion target tracking algorithm
    Liang Hui-hui
    He Qiu-sheng
    Jia Wei-zhen
    Zhang Wei-feng
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2020, 35 (06) : 583 - 594
  • [43] Multi-feature fusion for thermal face recognition
    Bi, Yin
    Lv, Mingsong
    Wei, Yangjie
    Guan, Nan
    Yi, Wang
    INFRARED PHYSICS & TECHNOLOGY, 2016, 77 : 366 - 374
  • [44] Image retrieval based on multi-feature fusion
    Dong Wenfei
    Yu Shuchun
    Liu Songyu
    Zhang Zhiqiang
    Gu Wenbo
    2014 FOURTH INTERNATIONAL CONFERENCE ON INSTRUMENTATION AND MEASUREMENT, COMPUTER, COMMUNICATION AND CONTROL (IMCCC), 2014, : 240 - 243
  • [45] Multi-feature fusion dehazing based on CycleGAN
    Wang, Jingpin
    Ge, Yuan
    Zhao, Jie
    Han, Chao
    AI COMMUNICATIONS, 2024, 37 (04) : 619 - 635
  • [46] Multi-feature decomposition and transformer-fusion: an infrared and visible image fusion network based on multi-feature decomposition and transformer
    Li, Xujun
    Duan, Zhicheng
    Chang, Jia
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (06)
  • [47] EEG FEATURE EXTRACTION AND RECOGNITION BASED ON MULTI-FEATURE FUSION
    Sun, Jian
    Wu, Quanyu
    Gao, Nan
    Pan, Lingjiao
    Tao, Weige
    BIOMEDICAL ENGINEERING-APPLICATIONS BASIS COMMUNICATIONS, 2024, 36 (06):
  • [48] MFR-Net: A multi-feature fusion phase unwrapping method for different speckle noises
    Liu, Yun
    Kang, Qi
    Chen, Menglu
    Xue, Haoxing
    Jiao, Mingxing
    Xing, Junhong
    Shui, Linqi
    Li, Hequn
    Wang, Xian
    OPTICS AND LASERS IN ENGINEERING, 2025, 184
  • [49] MFC-Net : Multi-feature fusion cross neural network for salient object detection
    Wang, Zhenyu
    Zhang, Yunzhou
    Liu, Yan
    Liu, Shichang
    Coleman, Sonya
    Kerr, Dermot
    IMAGE AND VISION COMPUTING, 2021, 113
  • [50] Multi-feature indexing for music data
    Lo, YL
    Chen, SJ
    23RD INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS, 2003, : 654 - 659