Physics-based generative adversarial network for real-time acoustic holography

被引:1
|
作者
Lu, Qingyi [1 ]
Zhong, Chengxi [1 ]
Su, Hu [2 ]
Liu, Song [1 ,3 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[2] Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
[3] Shanghai Engn Res Ctr Intelligent Vis & Imaging, Shanghai 201210, Peoples R China
关键词
Acoustic Holography; Deep Learning; Phase-only Hologram; Wave Propagation;
D O I
10.1016/j.ultras.2025.107583
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Acoustic holography (AH) encodes the acoustic fields in high dimensions into two-dimensional holograms without information loss. Phase-only holography (POH) modulates only the phase profiles of the encoded hologram, establishing its superiority over alternative modulation schedules due to its information volume and storage efficiency. Moreover, POH implemented by a phased array of transducers (PAT) facilitates active and dynamic manipulation by independently modulating the phase of each transducer. However, existing algorithms for POH calculation suffer from a deficiency in terms of high fidelity and good real-time performance. Thus, a deep learning algorithm reinforced by the physical model, i.e. Angular Spectrum Method (ASM), is proposed to learn the inverse physical mapping from the target field to the source POH. This method comprises a generative adversarial network (GAN) evaluated by soft label, which is referred to as soft-GAN. Furthermore, to avoid the intrinsic limitation of neural networks on high-frequency features, a Y-Net structure is developed with two decoder branches in frequency and spatial domain, respectively. The proposed method achieves the reconstruction performance with a state-of-the-art (SOTA) Peak Signal-to-Noise Ratio (PSNR) of 24.05 dB. Experiment results demonstrated that the POH calculated by the proposed method enables accurate and real-time hologram reconstruction, showing enormous potential for applications.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Real-time Acoustic Holography with Physics-based Deep Learning for Acoustic Robotic Manipulation
    Zhong, Chengxi
    Sun, Zhenhuan
    Lyu, Kunyong
    Guo, Yao
    Liu, Song
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 1083 - 1089
  • [2] Real-Time Acoustic Holography With Physics-Based Deep Learning for Robotic Manipulation
    Zhong, Chengxi
    Li, Jiaqi
    Sun, Zhenhuan
    Li, Teng
    Guo, Yao
    Jeong, David C.
    Su, Hu
    Liu, Song
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (03) : 4155 - 4164
  • [3] Physics-based modeling and real-time simulation
    Chen, JX
    Yang, YG
    Wang, XS
    COMPUTING IN SCIENCE & ENGINEERING, 2001, 3 (03) : 98 - 102
  • [4] A REAL-TIME MEDICAL ULTRASOUND SIMULATOR BASED ON A GENERATIVE ADVERSARIAL NETWORK MODEL
    Peng, Bo
    Huang, Xing
    Wang, Shiyuan
    Jiang, Jingfeng
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 4629 - 4633
  • [5] REAL-TIME ACOUSTIC HOLOGRAPHY
    MUELLER, RK
    MATERIALS EVALUATION, 1968, 26 (09) : A41 - &
  • [6] Real-time Physics-based Simulation of Mechanisms and Systems
    Benoit, Tuur
    Moten, Sikandar
    Lemmens, Yves
    2017 IEEE/ACM 21ST INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL TIME APPLICATIONS (DS-RT), 2017, : 198 - 199
  • [7] Real-time Physics-based Interaction in Augmented Reality
    Li, Jin
    Deng, Hanchen
    Gao, Yang
    Chen, Anqi
    Song, Zilong
    Hao, Aimin
    2023 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS, VRW, 2023, : 573 - 574
  • [8] Real-time Traffic Flow Parameters Estimation Model Based on Generative Adversarial Network
    Yao R.-H.
    Wang R.-Y.
    Zhang W.-S.
    Ye J.-S.
    Sun F.
    Jiaotong Yunshu Xitong Gongcheng Yu Xinxi/Journal of Transportation Systems Engineering and Information Technology, 2022, 22 (03): : 158 - 167
  • [9] Real-time coloring method of laser surgery video based on generative adversarial network
    Pan, Xiaoying
    Lian, Jia
    He, Qiqi
    Xue, Yufeng
    Wang, Hao
    He, Dalin
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2023, 33 (04) : 1424 - 1436
  • [10] Monocular Camera Based Real-Time Dense Mapping Using Generative Adversarial Network
    Yang, Xin
    Chen, Jingyu
    Wang, Zhiwei
    Zhang, Qiaozhe
    Liu, Wenyu
    Liao, Chunyuan
    Cheng, Kwang-Ting
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 896 - 904