Effects of Improper Ground Truth on Target Tracking Performance Evaluation in Benchmark

被引:2
|
作者
Liu, Gaocheng
Liu, Shuai [1 ]
Lu, Mengye
Pan, Zheng
机构
[1] Inner Mongolia Univ, Coll Comp Sci, Hohhot 010012, Peoples R China
关键词
target tracking; benchmark; bounding box; ground-truth; performance evaluation; OBJECT TRACKING;
D O I
10.1109/QRS-C.2017.51
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Target tracking is an important part of many applications in computer vision. With continuous researching and developing, more and more advanced tracking algorithms have been put forward. Therefore, a benchmark and dataset used to evaluate the most advanced tracking algorithms are needed. One of the most widely used benchmarks is Online Tracking Benchmark (OTB). This benchmark has a clear statement of the video attributes, and each frame in the sequences is appropriately provided with the ground-truth annotations. There may be some errors due to the annotations done by manual operation for bounding box and thus we find and modify the annotations that have some errors. The error means the bounding box for tracking target in some frames is beyond boundaries of corresponding frames. Then we study the effect of these small errors on the tracking algorithm evaluation in the corresponding video sequences.
引用
收藏
页码:261 / 266
页数:6
相关论文
共 50 条
  • [1] Performance Evaluation of Multi-target Tracking Without Knowing Ground Truth
    Zhang, Le
    Lan, Jian
    Li, X. Rong
    2016 19TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2016, : 185 - 192
  • [2] Challenges of Ground Truth Evaluation of Multi-Target Tracking
    Milan, Anton
    Schindler, Konrad
    Roth, Stefan
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2013, : 735 - 742
  • [3] Qualitative Tracking Performance Evaluation without Ground-Truth
    Han, Bohyung
    Hamm, Jihun
    2015 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2015, : 55 - 62
  • [4] Evaluation of Tracking Algorithm Performance without Ground-Truth Data
    Spampinato, C.
    Palazzo, S.
    Giordano, D.
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 1345 - 1348
  • [5] Track-Oriented Evaluation of Multi-Target Tracking Without Knowing Ground Truth
    Zhang, Le
    Lan, Jian
    Li, X. Rong
    2017 20TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2017, : 792 - 799
  • [6] Ground truth and benchmarks for performance evaluation
    Takeuchi, A
    Shneier, M
    Hong, T
    Chang, T
    Scrapper, C
    Cheok, G
    UNMANNED GROUND VEHICLE TECHNOLOGY V, 2003, 5083 : 408 - 413
  • [7] Online single target tracking in WAMI: benchmark and evaluation
    Wang, Dong
    Yi, Meng
    Yang, Fan
    Blasch, Erik
    Sheaff, Carolyn
    Chen, Genshe
    Ling, Haibin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (09) : 10939 - 10960
  • [8] Online single target tracking in WAMI: benchmark and evaluation
    Dong Wang
    Meng Yi
    Fan Yang
    Erik Blasch
    Carolyn Sheaff
    Genshe Chen
    Haibin Ling
    Multimedia Tools and Applications, 2018, 77 : 10939 - 10960
  • [9] Metrics for performance evaluation of video object segmentation and tracking without ground-truth
    Erdem, CE
    Tekalp, AM
    Sankur, B
    2001 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, 2001, : 69 - 72
  • [10] Performance Evaluation of MHT and GM-CPHD in a Ground Target Tracking Scenario
    Svensson, Daniel
    Wintenby, Johannes
    Svensson, Lennart
    FUSION: 2009 12TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION, VOLS 1-4, 2009, : 300 - +