Recent progress and prospect of laser imaging processing technology (invited)

被引:1
|
作者
Hu Y. [1 ,2 ,3 ,4 ]
Zhao L. [1 ,2 ,3 ,4 ]
机构
[1] College of Electronic Engineering, National University of Defense Technology, Hefei
[2] State Key Laboratory of Pulsed Power Laser Technology, National University of Defense Technology, Hefei
[3] Anhui Province Key Laboratory of Electronic Restriction, National University of Defense Technology, Hefei
[4] Information Security Research Center, Hefei Comprehensive National Science Center, Hefei
基金
中国国家自然科学基金;
关键词
deep learning; information processing; laser imaging; point cloud processing; signal processing;
D O I
10.3788/IRLA20230169
中图分类号
学科分类号
摘要
Significance Laser imaging refers to an imaging method that emits a specially designed laser signal, receives the laser echo, and processes it to obtain attribute information such as an image of the target. Laser imaging has wide applications in target detection, satellite surveying, smart agriculture, national defense and aerospace, and other fields. It contains a series of signals and information processing processes, including denoising, radiation, geometric correction, point cloud processing of laser echo signals, and subsequent data processing of various imaging tasks (such as laser ranging, laser image reconstruction, target detection, etc.), and have a critical impact on imaging quality and play a crucial role in the application of imaging information. Currently, with the continuous development of imaging systems and imaging hardware, laser imaging processing technology has increasingly high requirements for processing accuracy and speed, and involves a wider range of technical fields. Especially with the rapid development of machine learning technology represented by deep learning, it has achieved better results than traditional technologies in many classic problems, and has also been successfully applied in laser imaging processing technology, providing a new development direction for laser imaging processing. Progress This paper first introduces the characteristics of laser imaging processing technology of typical imaging system (Fig.1). We explained the characteristics of imaging processing technologies under various laser imaging systems, identified the similarities and differences between laser imaging processing technologies under different systems, and conducted a comparative analysis of laser imaging processing technologies under typical imaging systems (Tab.1). In summary, it can be found that although there are differences in the names of signal and information processing contents corresponding to different systems, the common contents of laser imaging signal processing can be summarized into four aspects of signal denoising, radiation correction, geometric correction, and point cloud processing. The common contents of imaging information processing can be summarized into three common processing contents of laser ranging, image reconstruction, and object detection. Based on the summarized common methods of laser imaging signals and information processing technology, we conducted separate studies. In the current research status of laser imaging signal processing technology, we focus on the laser signal denoising, correction and laser point cloud processing technology. In the research of signal denoising, we have conducted research based on wavelet transform, empirical mode decomposition, variational mode decomposition, and hybrid methods. We have also conducted specialized research on the application of deep learning algorithms in laser signal denoising. Representative algorithms are shown (Fig.5). The laser signal correction focuses on two aspects of laser signal radiation and geometric correction. And in point cloud signal processing, we mainly summarized the work on denoising and background removal, and focused on the work based on deep learning. Besides, we have organized and summarized the research on laser information processing for laser ranging, image reconstruction and target detection information processing technology. In the section of laser image reconstruction, we conducted research on three aspects of stereo matching, point cloud data stitching, and laser reflection tomography reconstruction. In object detection, the traditional method and deep-learning based method were elaborated, and classic point cloud object detection algorithms based on deep learning algorithms were studied (Fig.9-10). Based on the classification of laser imaging processing technology in this paper, we finally analyzed the current challenges and future development directions of laser imaging processing technologies, and summarized the current development of laser imaging technology and future laser imaging processing technology examples. It is hoped that it can provide some reference for the research related to laser imaging. Conclusions and Prospects Laser imaging has always been a hot topic in the field of optical imaging and signal processing. In the past 20 years, laser imaging signal and information processing technology has made great progress. In the previous studies, deep learning has been deeply applied to laser imaging processing. Through the powerful representation learning ability of deep learning, great improvements have been made in laser imaging processing quality, precision, robustness and other aspects. In the future research on different signal and information processing tasks, the standardization of large-scale data sets for imaging tasks and more robust deep neural network processing paradigm will be the further development direction of the research. It should be noted that laser imaging processing technology is not limited to the contents in this paper. There are many other signal and information processing technologies not involved in this paper, which worth further study and exploration by researchers. © 2023 Chinese Society of Astronautics. All rights reserved.
引用
收藏
相关论文
共 109 条
  • [81] Zhong Y, Bai F, Liu Y, Et al., Point cloud splicing based on 3D-Harris operator, 2021 3rd International Symposium on Smart and Healthy Cities (ISHC), pp. 61-66, (2021)
  • [82] Yang Biao, Hu Yihua, Laser reflection tomography target reconstruction algorithm based on algebraic iteration, Infrared and Laser Engineering, 48, 7, (2019)
  • [83] Liu Y F, Hu Y H, Xu S L, Et al., Optimization method for laser reflective tomography imaging based on waveform decomposition method [J], Acta Optica Sinica, 43, 18, (2023)
  • [84] Hu Y., Theory and Technology of Laser Imaging Based Target Detection, (2018)
  • [85] Moosmann F, Fraichard T., Motion estimation from range images in dynamic outdoor scenes, 2010 IEEE International Conference on Robotics and Automation, pp. 142-147, (2010)
  • [86] Dewan A, Caselitz T, Tipaldi G D, Et al., Motion-based detection and tracking in 3d lidar scans, 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 4508-4513, (2016)
  • [87] Dewan A, Caselitz T, Tipaldi G D, Et al., Rigid scene flow for 3D lidar scans, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1765-1770, (2016)
  • [88] Qi C R, Yi L, Su H, Et al., Pointnet++: Deep hierarchical feature learning on point sets in a metric space, Advances in Neural Information Processing Systems, (2017)
  • [89] Zeng Y, Hu Y, Liu S, Et al., Rt3d: Real-time 3D vehicle detection in lidar point cloud for autonomous driving, IEEE Robotics and Automation Letters, 3, 4, pp. 3434-3440, (2018)
  • [90] Zhou Y, Tuzel O., Voxelnet: End-to-end learning for point cloud based 3D object detection, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4490-4499, (2018)