Energy Efficiency Through In-Sensor Computing: ADC-less Real-Time Sensing for Image Edge Detection

被引:0
|
作者
Modak, Nirmoy [1 ]
Roy, Kaushik [1 ]
机构
[1] Purdue Univ, W Lafayette, IN 47907 USA
关键词
CMOS image sensor (CIS); column-parallel (CP) imaging; Wide Dynamic Range (WDR); Image Signal Processor (ISP); time-to-digital conversion (TDC); ADC-less CIS; On-chip image edge detection; VISION SENSOR; MOTION;
D O I
10.1145/3665314.3670827
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In-sensor computing has revolutionized modern vision-based applications, particularly in scenarios like autonomous vehicles and robotics where real-time or near-real-time processing is crucial. By enabling data processing at the sensor level, in-sensor computing eliminates the need to transmit data to cloud servers, significantly reducing latency and enhancing decision-making speed. Central to the in-sensor computing paradigm, CMOS image sensors (CISs) with edge computing, play a pivotal role in machine vision applications. The need for high resolution, low power, and real-time operation aligns seamlessly with the demands of modern vision-based applications. In this paper, we propose a novel approach for real-time image edge detection with an in-sensor, ADC-less sensing solution that achieves high energy efficiency and speed. The design utilizes the column-parallel architecture of existing CIS and the row-wise pixel readout scheme. Column voltages of three consecutive rows with a delay arrangement extract 4-bit edge pixels without deriving the actual digital image pixels. A time-to-digital conversion (TDC) technique using a 4-bit counter eliminates the requirement of power-hungry ADC. A 256(H) x 256(V) 2D CMOS pixel array with 10.. m pixel pitch is simulated using Spectre in TSMC 65nm low-power technology. CMOS pixels with wide dynamic range (WDR) capture the light intensity variation up to 92dB [10]. Simulation results show energy consumption of 2pWper pixel per frame, operating at a frame rate of 3.9kfps, all well-contained within a modest 0.5 mW power budget. The resultant frame rate emerges as notably superior in terms of speed, accompanied by a more than tenfold reduction in power consumption per edge frame-pixel compared to the existing prior art.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Edge-Based Real-Time Occupancy Detection System through a Non-Intrusive Sensing System
    Sayed, Aya Nabil
    Bensaali, Faycal
    Himeur, Yassine
    Houchati, Mahdi
    ENERGIES, 2023, 16 (05)
  • [32] Adaptive Resource Optimized Edge Federated Learning in Real-Time Image Sensing Classifications
    Tam, Prohim
    Math, Sa
    Nam, Chaebeen
    Kim, Seokhoon
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 10929 - 10940
  • [33] LAS-on-edge: A real-time laser absorption spectroscopic water vapor sensor on edge computing platforms
    Xia, Jiangnan
    Xia, Yikai
    Xiao, Di
    Zhang, Rui
    Yu, Nan
    Liu, Chang
    SENSORS AND ACTUATORS B-CHEMICAL, 2024, 418
  • [34] Real-time biscuit tile image segmentation method based on edge detection
    Matic, Tomislav
    Aleksi, Ivan
    Hocenski, Zeljko
    Kraus, Dieter
    ISA TRANSACTIONS, 2018, 76 : 246 - 254
  • [35] Adaptive Energy-Minimized Scheduling of Real-Time Applications in Vehicular Edge Computing
    Hu, Biao
    Shi, Yinbin
    Cao, Zhengcai
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (05) : 6895 - 6906
  • [36] Integration of Minimum Energy Point Tracking and Soft Real-Time Scheduling for Edge Computing
    Komori, Takumi
    Masuda, Yutaka
    Shiomi, Jun
    Ishihara, Tohru
    PROCEEDINGS OF THE 2021 TWENTY SECOND INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN (ISQED 2021), 2021, : 300 - 306
  • [37] Research on Real-Time Anomaly Detection of Fishing Vessels in a Marine Edge Computing Environment
    Huang, Jie
    Zhu, Fengwei
    Huang, Zejun
    Wan, Jian
    Ren, Yongjian
    MOBILE INFORMATION SYSTEMS, 2021, 2021
  • [38] Ordinary-Kriging Based Real-Time Seizure Detection in an Edge Computing Paradigm
    Olokodana, Ibrahim L.
    Mohanty, Saraju P.
    Kougianos, Elias
    2020 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2020, : 544 - 549
  • [39] Edge-Computing Enabled Real-Time Respiratory Monitoring and Breathing Pattern Detection
    Utsha, Ucchwas Talukder
    Morshed, Bashir I.
    2024 IEEE 20TH INTERNATIONAL CONFERENCE ON BODY SENSOR NETWORKS, BSN, 2024,
  • [40] Edge Computing Based Real-Time Streaming Data Mining Method for Wireless Sensor Networks
    Huang, Zhong-xing
    Ren, Xiao-li
    Zhou, Zai-ling
    Zhu, He
    Lin, Zhi-li
    ADVANCED HYBRID INFORMATION PROCESSING, PT II, 2022, 417 : 144 - 155