A Sensitive Dynamic and Active Pixel Vision Sensor for Color or Neural Imaging Applications

被引:69
|
作者
Moeys, Diederik Paul [1 ,2 ]
Corradi, Federico [3 ]
Li, Chenghan [1 ,2 ]
Bamford, Simeon A. [3 ]
Longinotti, Luca [3 ]
Voigt, Fabian F. [4 ]
Berry, Stewart [4 ]
Taverni, Gemma [1 ,2 ]
Helmchen, Fritjof [4 ]
Delbruck, Tobi [1 ,2 ]
机构
[1] Univ Zurich, Inst Neuroinformat, CH-8057 Zurich, Switzerland
[2] ETH, CH-8057 Zurich, Switzerland
[3] IniLabs GmbH, CH-8057 Zurich, Switzerland
[4] Univ Zurich, Brain Res Inst, CH-8006 Zurich, Switzerland
基金
瑞士国家科学基金会;
关键词
CMOS image sensors; biomedical optical imaging; image color analysis; neuromorphics; machine vision; discrete-event systems;
D O I
10.1109/TBCAS.2017.2759783
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Applications requiring detection of small visual contrast require high sensitivity. Event cameras can provide higher dynamic range (DR) and reduce data rate and latency, but most existing event cameras have limited sensitivity. This paper presents the results of a 180-nm Towerjazz CIS process vision sensor called SDAVIS192. It outputs temporal contrast dynamic vision sensor (DVS) events and conventional active pixel sensor frames. The SDAVIS192 improves on previous DAVIS sensors with higher sensitivity for temporal contrast. The temporal contrast thresholds can be set down to 1% for negative changes in logarithmic intensity (OFF events) and down to 3.5% for positive changes (ON events). The achievement is possible through the adoption of an in-pixel preamplification stage. This preamplifier reduces the effective intrascene DR of the sensor (70 dB for OFF and 50 dB for ON), but an automated operating region control allows up to at least 110-dB DR for OFF events. A second contribution of this paper is the development of characterization methodology for measuring DVS event detection thresholds by incorporating a measure of signal-to-noise ratio (SNR). At average SNR of 30 dB, the DVS temporal contrast threshold fixed pattern noise is measured to be 0.3%-0.8% temporal contrast. Results comparing monochrome and RGBW color filter array DVS events are presented. The higher sensitivity of SDAVIS192 make this sensor potentially useful for calcium imaging, as shown in a recording from cultured neurons expressing calcium sensitive green fluorescent protein GCaMP6f.
引用
收藏
页码:123 / 136
页数:14
相关论文
共 50 条
  • [1] Design of an RGBW Color VGA Rolling and Global Shutter Dynamic and Active-Pixel Vision Sensor
    Li, Chenghan
    Brandli, Christian
    Berner, Raphael
    Liu, Hongjie
    Yang, Minhao
    Liu, Shih-Chii
    Delbruck, Tobi
    2015 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2015, : 718 - 721
  • [2] Live Demonstration: The "DAVIS" Dynamic and Active-Pixel Vision Sensor
    Brandli, C.
    Berner, R.
    Yang, M.
    Liu, S. C.
    Villeneuva, V.
    Delbruck, T.
    2014 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2014, : 440 - 440
  • [3] A compact VLSI neural computer integrated with active pixel sensor for real-time machine vision applications
    Fang, WC
    Udomkesmalee, S
    Alkalai, L
    APPLICATIONS AND SCIENCE OF ARTIFICIAL NEURAL NETWORKS III, 1997, 3077 : 266 - 275
  • [4] Feature Detection and Tracking with the Dynamic and Active-pixel Vision Sensor (DAVIS)
    Tedaldi, David
    Gallego, Guillermo
    Mueggler, Elias
    Scaramuzza, Davide
    2016 2ND INTERNATIONAL CONFERENCE ON EVENT-BASED CONTROL, COMMUNICATION, AND SIGNAL PROCESSING (EBCCSP), 2016,
  • [5] Tunable Spectral Responses in a Color-Sensitive CMOS Pixel for Imaging Applications
    Langfelder, Giacomo
    Zaraga, Federico
    Longoni, Antonio
    IEEE TRANSACTIONS ON ELECTRON DEVICES, 2009, 56 (11) : 2563 - 2569
  • [6] High dynamic range active pixel sensor
    Anaxagoras, T
    Allinson, NM
    SENSORS AND CAMERA SYSTEMS FOR SCIENTIFIC, INDUSTRIAL, AND DIGITAL PHOTOGRAPHY APPLICATIONS V, 2004, 5301 : 149 - 160
  • [7] Feature Tracking Based on Line Segments With the Dynamic and Active-Pixel Vision Sensor (DAVIS)
    Li, Kaiyue
    Shi, Dianxi
    Zhang, Yongjun
    Li, Ruoxiang
    Qin, Wei
    Li, Ruihao
    IEEE ACCESS, 2019, 7 : 110874 - 110883
  • [8] Effect of pixel active area shape on imaging quality of CMOS active pixel sensor
    Fan Hong
    Xu Wujun
    Wang Chengliang
    ADVANCED MATERIALS AND DEVICES FOR SENSING AND IMAGING III, 2008, 6829
  • [9] A low power smart vision system based on active pixel sensor integrated with programmable neural processor
    Fang, WC
    Yang, G
    Pain, B
    Sheu, BJ
    INTERNATIONAL CONFERENCE ON COMPUTER DESIGN - VLSI IN COMPUTERS AND PROCESSORS, PROCEEDINGS, 1997, : 429 - 434
  • [10] High Frame Rate Video Reconstruction and Deblurring Based on Dynamic and Active Pixel Vision Image Sensor
    Nie, Kaiming
    Shi, Xiaopei
    Cheng, Silu
    Gao, Zhiyuan
    Xu, Jiangtao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (08) : 2938 - 2952