ONIX: An X-ray deep-learning tool for 3D reconstructions from sparse views

被引:0
|
作者
Zhang Y. [1 ]
Yao Z. [1 ]
Ritschel T. [2 ]
Villanueva-Perez P. [1 ]
机构
[1] Synchrotron Radiation Research and NanoLund, Lund University, Lund
[2] Department of Computer Science, University College London, London
来源
Applied Research | 2023年 / 2卷 / 04期
关键词
3D reconstruction; deep learning; materials science; multi-projection imaging; stereoscopy; X-ray imaging;
D O I
10.1002/appl.202300016
中图分类号
学科分类号
摘要
Time-resolved three-dimensional (3D) X-ray imaging techniques rely on obtaining 3D information for each time point and are crucial for materials-science applications in academia and industry. Standard 3D X-ray imaging techniques like tomography and confocal microscopy access 3D information by scanning the sample with respect to the X-ray source. However, the scanning process limits the temporal resolution when studying dynamics and is not feasible for many materials-science applications, such as cell-wall rupture of metallic foams. Alternatives to obtaining 3D information when scanning is not possible are X-ray stereoscopy and multi-projection imaging, but these approaches suffer from limited volumetric information as they only acquire a very small number of views or projections compared to traditional 3D scanning techniques. Here, we present optimized neural implicit X-ray imaging (ONIX), a deep-learning algorithm capable of retrieving a continuous 3D object representation from only a small and limited set of sparse projections. ONIX is based on an accurate differentiable model of the physics of X-ray propagation. It generalizes across different instances of similar samples to overcome the limited volumetric information provided by limited sparse views. We demonstrate the capabilities of ONIX compared to state-of-the-art tomographic reconstruction algorithms by applying it to simulated and experimental datasets, where a maximum of eight projections are acquired. ONIX, although it does not have access to any volumetric information, outperforms unsupervised reconstruction algorithms, which reconstruct using single instances without generalization over different instances. We anticipate that ONIX will become a crucial tool for the X-ray community by (i) enabling the study of fast dynamics not possible today when implemented together with X-ray multi-projection imaging and (ii) enhancing the volumetric information and capabilities of X-ray stereoscopic imaging. © 2023 The Authors. Applied Research published by Wiley-VCH GmbH.
引用
收藏
相关论文
共 50 条
  • [1] Machine learning for detection of 3D features using sparse x-ray tomographic reconstruction
    Wolfe, Bradley T.
    Falato, Michael J.
    Zhang, Xinhua
    Nguyen-Fotiadis, Nga T. T.
    Sauppe, J. P.
    Kozlowski, P. M.
    Keiter, P. A.
    Reinovsky, R. E.
    Batha, S. A.
    Wang, Zhehui
    [J]. REVIEW OF SCIENTIFIC INSTRUMENTS, 2023, 94 (02):
  • [2] Low resolution 3D reconstructions of viruses from X-ray crystal diffraction data
    Zheng, YB
    Li, T
    Doerschuk, PC
    Johnson, JE
    [J]. 1998 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING - PROCEEDINGS, VOL 3, 1998, : 358 - 360
  • [3] Deep learning enables nanoscale X-ray 3D imaging with limited data
    Zhao, Chonghang
    Yan, Hanfei
    [J]. LIGHT-SCIENCE & APPLICATIONS, 2023, 12 (01)
  • [4] Deep learning enables nanoscale X-ray 3D imaging with limited data
    Chonghang Zhao
    Hanfei Yan
    [J]. Light: Science & Applications, 12
  • [5] Urban object classification with 3D Deep-Learning
    Zegaoui, Younes
    Chaumont, Marc
    Subsol, Gerard
    Borianne, Philippe
    Derras, Mustapha
    [J]. 2019 JOINT URBAN REMOTE SENSING EVENT (JURSE), 2019,
  • [6] Efficient 3D Reconstruction of Vessels from Multi-views of X-Ray Angiography
    Liu, Xinglong
    Hou, Fei
    Li, Shuai
    Hao, Aimin
    Qin, Hong
    [J]. 2013 INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN AND COMPUTER GRAPHICS (CAD/GRAPHICS), 2013, : 403 - 404
  • [7] Prior Function Designs for X-ray Reconstructions from Limited Angular Views
    Nikishkov, Yuri
    Makeev, Andrew
    [J]. e-Journal of Nondestructive Testing, 2024, 29 (06):
  • [8] Deep X-ray mask with integrated actuator for 3D microfabrication
    Lee, KC
    Lee, SS
    [J]. SENSORS AND ACTUATORS A-PHYSICAL, 2003, 108 (1-3) : 121 - 127
  • [9] Fabrication of 3D photonic crystal by deep X-ray lithography
    Liu, Gang
    Tian, Yangchao
    Xiong, Ying
    Kan, Ya
    [J]. MICROMACHING TECHNOLOGY FOR MICRO-OPTICS AND NANO-OPTICS IV, 2006, 6110
  • [10] Hip Fracture Discrimination using 3D Reconstructions from Dual-energy X-ray Absorptiometry
    Whitmarsh, Tristan
    Fritscher, Karl D.
    Humbert, Ludovic
    Del-Rio-Barquero, Luis M.
    Schubert, Rainer
    Frangi, Alejandro F.
    [J]. 2011 8TH IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, 2011, : 1189 - 1192