INTENSITY-IMAGE RECONSTRUCTION FOR EVENT CAMERAS USING CONVOLUTIONAL NEURAL NETWORK

被引:0
|
作者
Chen, Yongwei [1 ]
Chen, Weitong [1 ]
Cao, Xixin [1 ]
Hua, Qianting [1 ]
机构
[1] Peking Univ, Sch Software & Microelect, Beijing, Peoples R China
关键词
event camera; dynamic vision sensor; image reconstruction; deep learning; U-net network;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Event cameras have many benefits than conventional cameras, such as high temporal resolution, high dynamic range. However, because the outputs of event cameras are asynchronous event streams than intensity images, Frame-based algorithms cannot be directly used. It is also necessary to present intensity images of event cameras on the display for human viewing. In this paper, "event frames" are recovered from event streams in an attenuation method and they are fed into the U-net network to generate intensity images. Our model is trained on a large amount of simulated data and gradually reduces the perceptual loss through training. In order to evaluate the model, we compare the generated image with the target image on the simulated data and the real data. This proves that our model can reconstruct intensity images of event cameras very well.
引用
收藏
页码:1973 / 1977
页数:5
相关论文
共 50 条
  • [1] Real-Time Intensity-Image Reconstruction for Event Cameras Using Manifold Regularisation
    Munda, Gottfried
    Reinbacher, Christian
    Pock, Thomas
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2018, 126 (12) : 1381 - 1393
  • [2] Real-Time Intensity-Image Reconstruction for Event Cameras Using Manifold Regularisation
    Gottfried Munda
    Christian Reinbacher
    Thomas Pock
    [J]. International Journal of Computer Vision, 2018, 126 : 1381 - 1393
  • [3] IMAGE RECONSTRUCTION USING DEEP CONVOLUTIONAL NEURAL NETWORK
    Shireesha, Muthineni
    Yadav, Gargi
    Chandra, Saroj Kumar
    Bajpai, Manish Kumar
    [J]. 2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND SIGNAL PROCESSING (AISP), 2020,
  • [4] Iterative PET Image Reconstruction Using Convolutional Neural Network Representation
    Gong, Kuang
    Guan, Jiahui
    Kim, Kyungsang
    Zhang, Xuezhu
    Yang, Jaewon
    Seo, Youngho
    El Fakhri, Georges
    Qi, Jinyi
    Li, Quanzheng
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (03) : 675 - 685
  • [5] Accelerated SPECT Image Reconstruction with a Convolutional Neural Network
    Dietze, Martijn
    Branderhorst, Woutjan
    Viergever, Max
    De Jong, Hugo
    [J]. JOURNAL OF NUCLEAR MEDICINE, 2019, 60
  • [6] Event Probability Mask (EPM) and Event Denoising Convolutional Neural Network (EDnCNN) for Neuromorphic Cameras
    Baldwin, R. Wes
    Almatrafi, Mohammed
    Asari, Vijayan
    Hirakawa, Keigo
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1698 - 1707
  • [7] Time-of-Flight Camera Intensity Image Reconstruction Based on an Untrained Convolutional Neural Network
    Wang, Tian-Long
    Ao, Lin
    Han, Na
    Zheng, Fu
    Wang, Yan-Qiu
    Sun, Zhi-Bin
    [J]. PHOTONICS, 2024, 11 (09)
  • [8] On the robustness of compressive sensing hyperspectral image reconstruction using convolutional neural network
    Gedalin, Daniel
    Heiser, Yaron
    Oiknine, Yaniv
    Stern, Adrian
    [J]. ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING IN DEFENSE APPLICATIONS, 2019, 11169
  • [9] CONVOLUTIONAL ISTA NETWORK WITH TEMPORAL CONSISTENCY CONSTRAINTS FOR VIDEO RECONSTRUCTION FROM EVENT CAMERAS
    Liu, Siying
    Alexandru, Roxana
    Dragotti, Pier Luigi
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1935 - 1939
  • [10] A Review of Image Reconstruction Based on Event Cameras
    Xu, Qi
    Deng, Jie
    Shen, Jiangrong
    Tang, Huajin
    Pan, Gang
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (08) : 2699 - 2709