Energy Efficiency Through In-Sensor Computing: ADC-less Real-Time Sensing for Image Edge Detection

被引:0
|
作者
Modak, Nirmoy [1 ]
Roy, Kaushik [1 ]
机构
[1] Purdue Univ, W Lafayette, IN 47907 USA
关键词
CMOS image sensor (CIS); column-parallel (CP) imaging; Wide Dynamic Range (WDR); Image Signal Processor (ISP); time-to-digital conversion (TDC); ADC-less CIS; On-chip image edge detection; VISION SENSOR; MOTION;
D O I
10.1145/3665314.3670827
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In-sensor computing has revolutionized modern vision-based applications, particularly in scenarios like autonomous vehicles and robotics where real-time or near-real-time processing is crucial. By enabling data processing at the sensor level, in-sensor computing eliminates the need to transmit data to cloud servers, significantly reducing latency and enhancing decision-making speed. Central to the in-sensor computing paradigm, CMOS image sensors (CISs) with edge computing, play a pivotal role in machine vision applications. The need for high resolution, low power, and real-time operation aligns seamlessly with the demands of modern vision-based applications. In this paper, we propose a novel approach for real-time image edge detection with an in-sensor, ADC-less sensing solution that achieves high energy efficiency and speed. The design utilizes the column-parallel architecture of existing CIS and the row-wise pixel readout scheme. Column voltages of three consecutive rows with a delay arrangement extract 4-bit edge pixels without deriving the actual digital image pixels. A time-to-digital conversion (TDC) technique using a 4-bit counter eliminates the requirement of power-hungry ADC. A 256(H) x 256(V) 2D CMOS pixel array with 10.. m pixel pitch is simulated using Spectre in TSMC 65nm low-power technology. CMOS pixels with wide dynamic range (WDR) capture the light intensity variation up to 92dB [10]. Simulation results show energy consumption of 2pWper pixel per frame, operating at a frame rate of 3.9kfps, all well-contained within a modest 0.5 mW power budget. The resultant frame rate emerges as notably superior in terms of speed, accompanied by a more than tenfold reduction in power consumption per edge frame-pixel compared to the existing prior art.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] A power-aware vision-based virtual sensor for real-time edge computing
    Contoli, Chiara
    Calisti, Lorenzo
    Di Fabrizio, Giacomo
    Kania, Nicholas
    Bogliolo, Alessandro
    Lattanzi, Emanuele
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (04)
  • [42] DAGN: A Real-Time UAV Remote Sensing Image Vehicle Detection Framework
    Zhang, Zhongyu
    Liu, Yunpeng
    Liu, Tianci
    Lin, Zhiyuan
    Wang, Sikui
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (11) : 1884 - 1888
  • [43] Smart sensor: An on-board image processing system for real-time remote sensing
    You, Jane
    Zhang, David
    International Journal of Image and Graphics, 2002, 2 (03) : 481 - 499
  • [44] Real-time lane line and forward vehicle detection by smart image sensor
    Kutsuma, Y
    Yaguchi, H
    Hamamoto, T
    IEEE INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS AND INFORMATION TECHNOLOGIES 2004 (ISCIT 2004), PROCEEDINGS, VOLS 1 AND 2: SMART INFO-MEDIA SYSTEMS, 2004, : 957 - 962
  • [45] Real-time DNA Amplification and Detection System Based on a CMOS Image Sensor
    Wang, Tiantian
    Devadhasan, Jasmine Pramila
    Lee, Do Young
    Kim, Sanghyo
    ANALYTICAL SCIENCES, 2016, 32 (06) : 653 - 658
  • [46] Real-time DNA Amplification and Detection System Based on a CMOS Image Sensor
    Tiantian Wang
    Jasmine Pramila Devadhasan
    Do Young Lee
    Sanghyo Kim
    Analytical Sciences, 2016, 32 : 653 - 658
  • [47] Real-Time Detection of Intruders Using an Acoustic Sensor and Internet-of-Things Computing
    Al-Khalli, Najeeb
    Alateeq, Saud
    Almansour, Mohammed
    Alhassoun, Yousef
    Ibrahim, Ahmed B.
    Alshebeili, Saleh A.
    SENSORS, 2023, 23 (13)
  • [48] An Edge-Based Intelligent IoT Control System: Achieving Energy Efficiency with Secure Real-Time Incident Detection
    Lee, Gyeong Ho
    Han, Jaeseob
    JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 2025, 33 (01)
  • [49] Demo Abstract: Real-time Social Sensing Task Allocation Strategies in Heterogeneous Edge Computing Systems
    Zhang, Daniel
    Wang, Dong
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM 2019 WKSHPS), 2019, : 977 - 978
  • [50] A Real-Time Underwater Acoustic Telemetry Receiver With Edge Computing for Studying Fish Behavior and Environmental Sensing
    Yang, Yang
    Elsinghorst, Robbert
    Martinez, Jayson J.
    Hou, Hongfei
    Lu, Jun
    Deng, Zhiqun Daniel
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (18) : 17821 - 17831