A Spherical Multi-camera System with Real-time Omnidirectional Video Acquisition Capability

被引:23
|
作者
Afshari, Hossein [1 ,2 ]
Popovic, Vladan [1 ,3 ]
Tasci, Tugce [4 ]
Schmid, Alexandre [5 ,6 ,7 ,8 ]
Leblebici, Yusuf [9 ]
机构
[1] Ecole Polytech Fed Lausanne, Microelect Syst Lab, Panopt Camera Project, CH-1015 Lausanne, Switzerland
[2] Ecole Polytech Fed Lausanne, Microelect Syst Lab LSM, CH-1015 Lausanne, Switzerland
[3] Ecole Polytech Fed Lausanne, Audiovisual Commun Lab LCAV, CH-1015 Lausanne, Switzerland
[4] Ecole Polytech Fed Lausanne, Microelect Syst Lab, Panopt Project, CH-1015 Lausanne, Switzerland
[5] Ecole Polytech Fed Lausanne, Integrated Syst Lab, CH-1015 Lausanne, Switzerland
[6] Ecole Polytech Fed Lausanne, Elect Labs, CH-1015 Lausanne, Switzerland
[7] Ecole Polytech Fed Lausanne, Microengn Dept, CH-1015 Lausanne, Switzerland
[8] Ecole Polytech Fed Lausanne, Dept Elect Engn, CH-1015 Lausanne, Switzerland
[9] Ecole Polytech Fed Lausanne, Swiss Fed Inst Technol Lausanne, CH-1015 Lausanne, Switzerland
基金
瑞士国家科学基金会;
关键词
Multi-camera system; Omnidirectional vision; Real-time; FPGA;
D O I
10.1109/TCE.2012.6414975
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A multi-camera system inspired from the visual system of flying insects is introduced which is referred to as the Panoptic camera. In the Panoptic system each camera is mounted over a hemispherical geometry and has its own vision of surrounding and distinct focal direction. The Panoptic device finds application in the area of omnidirectional vision and 3D imaging. A systematic approach is presented for the coverage analysis and design guidelines of the Panoptic device. The presented approach enables the construction of arbitrary multi-camera systems based on the Panoptic principle. An implemented hardware architecture based on FPGA is introduced which is capable of real-time omnidirectional vision reconstruction. The implemented hardware is capable of live video streaming at a rate of 6.25M pixels per second and a maximum image resolution of 32M pixels per FPGA board.(1)
引用
收藏
页码:1110 / 1118
页数:9
相关论文
共 50 条
  • [21] An Effective Multi-Camera Dataset and Hybrid Feature Matcher for Real-Time Video Stitching
    Hosen, Md Imran
    Islam, Md Baharul
    Sadeghzadeh, Arezoo
    [J]. PROCEEDINGS OF THE 2021 36TH INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2021,
  • [22] A real-time multi-camera vision system for UAV collision warning and navigation
    Zarandy, Akos
    Nemeth, Mate
    Nagy, Zoltan
    Kiss, Andras
    Santha, Levente
    Zsedrovits, Tamas
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2016, 12 (04) : 709 - 724
  • [23] Real-Time Physiological Measurement and Visualization Using a Synchronized Multi-Camera System
    Gupta, Otkrist
    McDuff, Daniel
    Raskar, Ramesh
    [J]. PROCEEDINGS OF 29TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, (CVPRW 2016), 2016, : 312 - 319
  • [24] A Calibration and Real-Time Object Matching Method for Heterogeneous Multi-Camera System
    Li, Chenming
    Cai, Chengtao
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [25] A real-time multi-camera vision system for UAV collision warning and navigation
    Ákos Zarándy
    Mate Nemeth
    Zoltan Nagy
    Andras Kiss
    Levente Santha
    Tamás Zsedrovits
    [J]. Journal of Real-Time Image Processing, 2016, 12 : 709 - 724
  • [26] Real-time Vehicle Matching for Multi-camera Tunnel Surveillance
    Jelaca, Vedran
    Castaneda, Jorge Oswaldo Nino
    Frias-Velazquez, Andres
    Pizurica, Aleksandra
    Philips, Wilfried
    [J]. REAL-TIME IMAGE AND VIDEO PROCESSING 2011, 2011, 7871
  • [27] Real-time wide area multi-camera stereo tracking
    Zhao, T
    Aggarwal, M
    Kumar, R
    Sawhney, H
    [J]. 2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, : 976 - 983
  • [28] Design and DSP Optimization of Real-time Multi-Camera Tracking
    Yan, Xiao
    Yang, Junchuan
    Yao, Bo
    [J]. CONFERENCE ON MODELING, IDENTIFICATION AND CONTROL, 2012, 3 : 589 - 594
  • [29] Smart surveillance system for real-time multi-person multi-camera tracking at the edge
    Bipin Gaikwad
    Abhijit Karmakar
    [J]. Journal of Real-Time Image Processing, 2021, 18 : 1993 - 2007
  • [30] Real-Time Visual Feedback Control of Multi-Camera UAV
    He, Dongqing
    Chuang, Hsiu-Min
    Chen, Jinyu
    Li, Jinwei
    Namiki, Akio
    [J]. JOURNAL OF ROBOTICS AND MECHATRONICS, 2021, 33 (02) : 263 - 273