Real-Time Monocular Three-Dimensional Motion Tracking Using a Multithread Active Vision System

被引:10
|
作者
Hu, Shaopeng [1 ]
Jiang, Mingjun [1 ]
Takaki, Takeshi [1 ]
Ishii, Idaku [1 ]
机构
[1] Hiroshima Univ, Grad Sch Engn, Robot Lab, 1-4-1 Kagamiyama, Higashihiroshima, Hiroshima 7398527, Japan
基金
日本学术振兴会;
关键词
high-speed vision; stereo tracking; three-dimensional motion capture; viewpoint switching;
D O I
10.20965/jrm.2018.p0453
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In this study, we developed a monocular stereo tracking system to be used as a marker-based, three-dimensional (3-D) motion capture system. This system aims to localize dozens of markers on multiple moving objects in real time by switching five hundred different views in 1 s. The ultrafast mirror-drive active vision used in our catadioptric stereo tracking system can accelerate a series of operations for multithread gaze control with video shooting, computation, and actuation within 2 ms. By switching between five hundred different views in 1 s, with real-time video processing for marker extraction, our system can function as J virtual left and right pan-tilt tracking cameras, operating at 250/J fps to simultaneously capture and process J pairs of 512 x 512 stereo images with different views via the catadioptric mirror system. We conducted several real-time 3-D motion experiments to capture multiple fast-moving objects with markers. The results demonstrated the effectiveness of our monocular 3-D motion tracking system.
引用
收藏
页码:453 / 466
页数:14
相关论文
共 50 条
  • [1] Three-dimensional liver motion tracking using real-time two-dimensional MRI
    Brix, Lau
    Ringgaard, Steffen
    Sorensen, Thomas Sangild
    Poulsen, Per Rugaard
    [J]. MEDICAL PHYSICS, 2014, 41 (04)
  • [2] Tracking vision system for real-time motion analysis
    Morita, T
    [J]. ADVANCED ROBOTICS, 1999, 12 (06) : 609 - 617
  • [3] Three-dimensional liver motion tracking using 2D real-time MRI
    Brix, L.
    Ringgaard, S.
    Sorensen, T. Sangild
    Poulsen, P. Rugaard
    [J]. RADIOTHERAPY AND ONCOLOGY, 2014, 111 : S86 - S86
  • [4] Use of a real-time three-dimensional motion tracking system for measurement of intrafractional motion of the thoracic wall in dogs
    Mayer, Monique N.
    Lanovaz, Joel L.
    Smith, Michael J.
    Sidhu, Narinder
    Waldner, Cheryl L.
    [J]. AMERICAN JOURNAL OF VETERINARY RESEARCH, 2013, 74 (01) : 11 - 16
  • [5] Management of three-dimensional intrafraction motion through real-time DMLC tracking
    Sawant, Amit
    Venkat, Raghu
    Srivastava, Vikram
    Carlson, David
    Povzner, Sergey
    Cattell, Herb
    Keall, Paul
    [J]. MEDICAL PHYSICS, 2008, 35 (05) : 2050 - 2061
  • [6] Real-time robust tracking control for a quadrotor using monocular vision
    Montoya-Morales, J. R.
    Guerrero-Sanchez, M. E.
    Valencia-Palomo, G.
    Hernandez-Gonzalez, O.
    Lopez-Estrada, F. R.
    Hoyo-Montano, J. A.
    [J]. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING, 2023, 237 (12) : 2729 - 2741
  • [7] Real-time obstacle detection with motion features using monocular vision
    Jia, Baozhi
    Liu, Rui
    Zhu, Ming
    [J]. VISUAL COMPUTER, 2015, 31 (03): : 281 - 293
  • [8] Real-time obstacle detection with motion features using monocular vision
    Baozhi Jia
    Rui Liu
    Ming Zhu
    [J]. The Visual Computer, 2015, 31 : 281 - 293
  • [9] Three-dimensional vision for real-time produce grading
    Bailey, DG
    Mercer, KA
    Plaw, C
    Ball, R
    Barraclough, H
    [J]. MACHINE VISION AND THREE-DIMENSIONAL IMAGING SYSTEMS FOR INSPECTION AND METROLOGY II, 2002, 4567 : 171 - 178
  • [10] Real-time Three-dimensional Tracking of Endocytic Vesicles
    Duhamel, Stephanie
    Zaoui, Kossay
    [J]. BIO-PROTOCOL, 2020, 10 (20):