Energy Efficiency Through In-Sensor Computing: ADC-less Real-Time Sensing for Image Edge Detection

被引:0
|
作者
Modak, Nirmoy [1 ]
Roy, Kaushik [1 ]
机构
[1] Purdue Univ, W Lafayette, IN 47907 USA
关键词
CMOS image sensor (CIS); column-parallel (CP) imaging; Wide Dynamic Range (WDR); Image Signal Processor (ISP); time-to-digital conversion (TDC); ADC-less CIS; On-chip image edge detection; VISION SENSOR; MOTION;
D O I
10.1145/3665314.3670827
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In-sensor computing has revolutionized modern vision-based applications, particularly in scenarios like autonomous vehicles and robotics where real-time or near-real-time processing is crucial. By enabling data processing at the sensor level, in-sensor computing eliminates the need to transmit data to cloud servers, significantly reducing latency and enhancing decision-making speed. Central to the in-sensor computing paradigm, CMOS image sensors (CISs) with edge computing, play a pivotal role in machine vision applications. The need for high resolution, low power, and real-time operation aligns seamlessly with the demands of modern vision-based applications. In this paper, we propose a novel approach for real-time image edge detection with an in-sensor, ADC-less sensing solution that achieves high energy efficiency and speed. The design utilizes the column-parallel architecture of existing CIS and the row-wise pixel readout scheme. Column voltages of three consecutive rows with a delay arrangement extract 4-bit edge pixels without deriving the actual digital image pixels. A time-to-digital conversion (TDC) technique using a 4-bit counter eliminates the requirement of power-hungry ADC. A 256(H) x 256(V) 2D CMOS pixel array with 10.. m pixel pitch is simulated using Spectre in TSMC 65nm low-power technology. CMOS pixels with wide dynamic range (WDR) capture the light intensity variation up to 92dB [10]. Simulation results show energy consumption of 2pWper pixel per frame, operating at a frame rate of 3.9kfps, all well-contained within a modest 0.5 mW power budget. The resultant frame rate emerges as notably superior in terms of speed, accompanied by a more than tenfold reduction in power consumption per edge frame-pixel compared to the existing prior art.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Efficiency Near the Edge: Increasing the Energy Efficiency of FFTs on GPUs for Real-Time Edge Computing
    Adamek, Karel
    Novotny, Jan
    Thiyagalingam, Jeyarajan
    Armour, Wesley
    IEEE ACCESS, 2021, 9 : 18167 - 18182
  • [2] Edge Computing Application: Real-Time Anomaly Detection Algorithm for Sensing Data
    Zhang Q.
    Hu Y.
    Ji C.
    Zhan P.
    Li X.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2018, 55 (03): : 524 - 536
  • [3] A Novel Real-Time Image Restoration Algorithm in Edge Computing
    Ma, Xingmin
    Xu, Shenggang
    An, Fengping
    Lin, Fuhong
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2018,
  • [4] A Real-Time Edge-Detection CMOS Image Sensor for Machine Vision Applications
    Park, Min-Jun
    Kim, Hyeon-June
    IEEE SENSORS JOURNAL, 2023, 23 (09) : 9254 - 9261
  • [5] REAL-TIME EDGE-DETECTION AND IMAGE SEGMENTATION
    CHONG, CP
    SALAMA, CAT
    SMITH, KC
    ANALOG INTEGRATED CIRCUITS AND SIGNAL PROCESSING, 1992, 2 (02) : 117 - 130
  • [6] Real-time edge detection by hybrid image processing
    Mori, Kunihiko
    Murata, Kazumi
    Optical Computing and Processing, 1992, 2 (02):
  • [7] A real-time detection method of building energy efficiency based on image processing
    Cai, Wei
    Wen, Xiaodong
    Wang, Saisai
    Wang, Lijuan
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 60 : 295 - 304
  • [8] Real-Time Facial Emotion Detection Through the Use of Machine Learning and On-Edge Computing
    Dowd, Ashley
    Tonekaboni, Navid Hashemi
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 444 - 448
  • [9] A Real-Time UAV Target Detection Algorithm Based on Edge Computing
    Cheng, Qianqing
    Wang, Hongjun
    Zhu, Bin
    Shi, Yingchun
    Xie, Bo
    DRONES, 2023, 7 (02)
  • [10] Edge computing applied on real-time manatee detection using microcontrollers
    Rios, Edwin
    Merchan, Fernando
    Poveda, Hector
    Sanchez-Galan, Javier E.
    Guzman, Hector M.
    Ferre, Guillaume
    2023 IEEE LATIN-AMERICAN CONFERENCE ON COMMUNICATIONS, LATINCOM, 2023,