End-to-End Video Compressive Sensing Using Anderson-Accelerated Unrolled Networks

被引:14
|
作者
Li, Yuqi [1 ]
Qi, Miao [1 ]
Gulve, Rahul [2 ]
Wei, Mian [2 ]
Genov, Roman [2 ]
Kutulakos, Kiriakos N. [2 ]
Heidrich, Wolfgang [1 ]
机构
[1] KAUST, VCC Imaging Grp, Thuwal, Saudi Arabia
[2] Univ Toronto, Toronto, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
high-frame-rate imaging; deep neural network; computational camera; HIGH-SPEED; CODED EXPOSURE; RECONSTRUCTION; DESIGN;
D O I
10.1109/iccp48838.2020.9105237
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Compressive imaging systems with spatial-temporal encoding can be used to capture and reconstruct fast-moving objects. The imaging quality highly depends on the choice of encoding masks and reconstruction methods. In this paper, we present a new network architecture to jointly design the encoding masks and the reconstruction method for compressive high-frame-rate imaging. Unlike previous works, the proposed method takes full advantage of denoising prior to provide a promising frame reconstruction. The network is also flexible enough to optimize full-resolution masks and efficient at reconstructing frames. To this end, we develop a new dense network architecture that embeds Anderson acceleration, known from numerical optimization, directly into the neural network architecture. Our experiments show the optimized masks and the dense accelerated network respectively achieve 1.5 dB and 1 dB improvements in PSNR without adding training parameters. The proposed method outperforms other state-of-the-art methods both in simulations and on real hardware. In addition, we set up a coded two-bucket camera for compressive high-frame-rate imaging, which is robust to imaging noise and provides promising results when recovering nearly 1,000 frames per second.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] End-to-End Relation Extraction Using Markov Logic Networks
    Pawar, Sachin
    Bhattacharya, Pushpak
    Palshikar, Girish K.
    COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, (CICLING 2016), PT II, 2018, 9624 : 535 - 551
  • [32] Supporting End-to-End Connectivity in Federated Networks using SDN
    di Lallo, Roberto
    Lospoto, Gabriele
    Rimondini, Massimo
    Di Battista, Giuseppe
    NOMS 2016 - 2016 IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, 2016, : 759 - 762
  • [33] End-to-End Transport for Video QoE Fairness
    Nathan, Vikram
    Sivaraman, Vibhaalakshmi
    Addanki, Ravichandra
    Khani, Mehrdad
    Goyal, Prateesh
    Alizadeh, Mohammad
    SIGCOMM '19 - PROCEEDINGS OF THE ACM SPECIAL INTEREST GROUP ON DATA COMMUNICATION, 2019, : 408 - 423
  • [34] End-to-end data transport using SSCOP in ATM networks
    Lin, WK
    Chen, YC
    EIGHTH IEEE WORKSHOP ON FUTURE TRENDS OF DISTRIBUTED COMPUTING SYSTEMS, PROCEEDINGS, 2001, : 112 - 118
  • [35] End-to-End Video Text Spotting with Transformer
    Wu, Weijia
    Cai, Yuanqiang
    Shen, Chunhua
    Zhang, Debing
    Fu, Ying
    Zhou, Hong
    Luo, Ping
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (09) : 4019 - 4035
  • [36] End-to-end stereoscopic video streaming system
    Pehlivan, Selen
    Aksay, Anil
    Bilen, Cagdas
    Akar, Gozde Bozdagi
    Civanlar, M. Reha
    2006 IEEE 14TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS, VOLS 1 AND 2, 2006, : 932 - +
  • [37] End-to-end stereoscopic video streaming system
    Pehlivan, Selen
    Aksay, Anil
    Bilen, Cagdas
    Akar, Gozde Bozdagi
    Civanlar, M. Reha
    2006 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO - ICME 2006, VOLS 1-5, PROCEEDINGS, 2006, : 2169 - 2172
  • [38] End-to-End Video Instance Segmentation with Transformers
    Wang, Yuqing
    Xu, Zhaoliang
    Wang, Xinlong
    Shen, Chunhua
    Cheng, Baoshan
    Shen, Hao
    Xia, Huaxia
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8737 - 8746
  • [39] Stereoscopic Video Streaming with End-to-End Modeling
    Tan, A. Serdar
    Aksay, Anil
    Akar, Goezde Bozdagi
    Arikan, Erdal
    2008 IEEE 16TH SIGNAL PROCESSING, COMMUNICATION AND APPLICATIONS CONFERENCE, VOLS 1 AND 2, 2008, : 541 - +
  • [40] An End-to-End Learning Framework for Video Compression
    Lu, Guo
    Zhang, Xiaoyun
    Ouyang, Wanli
    Chen, Li
    Gao, Zhiyong
    Xu, Dong
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (10) : 3292 - 3308