Spatio-temporal alignment of multiple sensors

被引:0
|
作者
Zhang, Tinghua [1 ,2 ]
Ni, Guoqiang [1 ]
Fan, Guihua [2 ]
Sun, Huayan [2 ]
Yang, Biao [2 ]
机构
[1] Beijing Inst Technol, Sch Opt & Elect, Beijing 100081, Peoples R China
[2] Aerosp Engn Univ, Dept Opt & Elect Equipment, Beijing 101416, Peoples R China
关键词
Spatio-temporal alignment; Astronomical calibration; Star pattern recognition; Star image simulation; SIFT Flow; Total Variation;
D O I
10.1117/12.2292037
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Aiming to achieve the spatio-temporal alignment of multi sensor on the same platform for space target observation, a joint spatio-temporal alignment method is proposed. To calibrate the parameters and measure the attitude of cameras, an astronomical calibration method is proposed based on star chart simulation and collinear invariant features of quadrilateral diagonal between the observed star chart. In order to satisfy a temporal correspondence and spatial alignment similarity simultaneously, the method based on the astronomical calibration and attitude measurement in this paper formulates the video alignment to fold the spatial and temporal alignment into a joint alignment framework. The advantage of this method is reinforced by exploiting the similarities and prior knowledge of velocity vector field between adjacent frames, which is calculated by the SIFT Flow algorithm. The proposed method provides the highest spatio-temporal alignment accuracy compared to the state-of-the-art methods on sequences recorded from multi sensor at different times.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Spatio-temporal alignment of sequences
    Caspi, Y
    Irani, M
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (11) : 1409 - 1424
  • [2] Joint Spatio-Temporal Alignment of Sequences
    Diego, Ferran
    Serrat, Joan
    Lopez, Antonio M.
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2013, 15 (06) : 1377 - 1387
  • [3] Distributed Spatio-Temporal Association and Tracking of Multiple Targets Using Multiple Sensors
    Ren, Guohua
    Maroulas, Vasileios
    Schizas, Ioannis
    [J]. IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2015, 51 (04) : 2570 - 2589
  • [4] Spatio-temporal alignment of pedobarographic image sequences
    Francisco P. M. Oliveira
    Andreia Sousa
    Rubim Santos
    João Manuel R. S. Tavares
    [J]. Medical & Biological Engineering & Computing, 2011, 49 : 843 - 850
  • [5] Slice Matching for Accurate Spatio-Temporal Alignment
    Evangelidis, Georgios D.
    Diego, Ferran
    Serrat, Joan
    Lopez, Antonio M.
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCV WORKSHOPS), 2011,
  • [6] Spatio-temporal alignment of pedobarographic image sequences
    Oliveira, Francisco P. M.
    Sousa, Andreia
    Santos, Rubim
    Tavares, Joao Manuel R. S.
    [J]. MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2011, 49 (07) : 843 - 850
  • [7] Spatio-Temporal Registration of Multiple Trajectories
    Padoy, Nicolas
    Hager, Gregory D.
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, MICCAI 2011, PT I, 2011, 6891 : 145 - 152
  • [8] Towards Spatio-temporal Face Alignment in Unconstrained Conditions
    Belmonte, R.
    Ihaddadene, N.
    Tirilly, P.
    Bilasco, M.
    Djeraba, C.
    [J]. VISAPP: PROCEEDINGS OF THE 13TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL 4: VISAPP, 2018, : 433 - 438
  • [9] Joint Unsupervised Deformable Spatio-Temporal Alignment of Sequences
    Zafeiriou, Lazaros
    Antonakos, Epameinondas
    Zafeiriou, Stefanos
    Pantic, Maja
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 3382 - 3390
  • [10] A survey: Video alignment based on spatio-temporal information
    Shu-Jiang, Zhang
    Jing-Long, Yan
    Hui, Xing
    [J]. ISTM/2007: 7TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS 1-7, CONFERENCE PROCEEDINGS, 2007, : 1793 - 1796