Energy Efficiency Through In-Sensor Computing: ADC-less Real-Time Sensing for Image Edge Detection

被引:0
|
作者
Modak, Nirmoy [1 ]
Roy, Kaushik [1 ]
机构
[1] Purdue Univ, W Lafayette, IN 47907 USA
关键词
CMOS image sensor (CIS); column-parallel (CP) imaging; Wide Dynamic Range (WDR); Image Signal Processor (ISP); time-to-digital conversion (TDC); ADC-less CIS; On-chip image edge detection; VISION SENSOR; MOTION;
D O I
10.1145/3665314.3670827
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In-sensor computing has revolutionized modern vision-based applications, particularly in scenarios like autonomous vehicles and robotics where real-time or near-real-time processing is crucial. By enabling data processing at the sensor level, in-sensor computing eliminates the need to transmit data to cloud servers, significantly reducing latency and enhancing decision-making speed. Central to the in-sensor computing paradigm, CMOS image sensors (CISs) with edge computing, play a pivotal role in machine vision applications. The need for high resolution, low power, and real-time operation aligns seamlessly with the demands of modern vision-based applications. In this paper, we propose a novel approach for real-time image edge detection with an in-sensor, ADC-less sensing solution that achieves high energy efficiency and speed. The design utilizes the column-parallel architecture of existing CIS and the row-wise pixel readout scheme. Column voltages of three consecutive rows with a delay arrangement extract 4-bit edge pixels without deriving the actual digital image pixels. A time-to-digital conversion (TDC) technique using a 4-bit counter eliminates the requirement of power-hungry ADC. A 256(H) x 256(V) 2D CMOS pixel array with 10.. m pixel pitch is simulated using Spectre in TSMC 65nm low-power technology. CMOS pixels with wide dynamic range (WDR) capture the light intensity variation up to 92dB [10]. Simulation results show energy consumption of 2pWper pixel per frame, operating at a frame rate of 3.9kfps, all well-contained within a modest 0.5 mW power budget. The resultant frame rate emerges as notably superior in terms of speed, accompanied by a more than tenfold reduction in power consumption per edge frame-pixel compared to the existing prior art.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] Demo Abstract: Real-time Heterogeneous Edge Computing System for Social Sensing Applications
    Zhang, Daniel
    Vance, Nathan
    Wang, Dong
    24TH IEEE REAL-TIME AND EMBEDDED TECHNOLOGY AND APPLICATIONS SYMPOSIUM (RTAS 2018), 2018, : 101 - 102
  • [22] Edge-Computing Oriented Real-Time Missing Track Components Detection
    Tang, Youzhi
    Wang, Yi
    Qian, Yu
    TRANSPORTATION RESEARCH RECORD, 2024, 2678 (09) : 670 - 682
  • [23] Privacy-preserving Real-time Anomaly Detection Using Edge Computing
    Mehnaz, Shagufta
    Bertino, Elisa
    2020 IEEE 36TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2020), 2020, : 469 - 480
  • [24] Enabling real-time road anomaly detection via mobile edge computing
    Zheng, Zengwei
    Zhou, Mingxuan
    Chen, Yuanyi
    Huo, Meimei
    Chen, Dan
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2019, 15 (11)
  • [25] Real-Time and Robust Hydraulic System Fault Detection via Edge Computing
    Fawwaz, Dzaky Zakiyal
    Chung, Sang-Hwa
    APPLIED SCIENCES-BASEL, 2020, 10 (17):
  • [26] Chip Contour Detection Based on Real-time Image Sensing and Recognition
    Chang, Bao-Rong
    Tsai, Hsiu-Fen
    Hsieh, Chia-Wei
    Chen, Mo-Lan
    SENSORS AND MATERIALS, 2022, 34 (03) : 1077 - 1089
  • [27] Energy efficiency strategy for a general real-time wireless sensor platform
    Chen, ZhiCong
    SMART STRUCTURES AND SYSTEMS, 2014, 14 (04) : 617 - 641
  • [28] A study on real-time image processing applications with edge computing support for mobile devices
    Mattia, Gabriele Proietti
    Beraldi, Roberto
    PROCEEDINGS OF THE 2021 IEEE/ACM 25TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL TIME APPLICATIONS (DS-RT 2021), 2021,
  • [29] Real-time detection of electrical load anomalies through hyperdimensional computing
    Wang, Xinlin
    Flores, Robert
    Brouwer, Jack
    Papaefthymiou, Marios
    ENERGY, 2022, 261
  • [30] Flood Detection Using Real-Time Image Segmentation from Unmanned Aerial Vehicles on Edge-Computing Platform
    Hernandez, Daniel
    Cecilia, Jose M.
    Cano, Juan-Carlos
    Calafate, Carlos T.
    REMOTE SENSING, 2022, 14 (01)