Effects of Improper Ground Truth on Target Tracking Performance Evaluation in Benchmark

被引:2
|
作者
Liu, Gaocheng
Liu, Shuai [1 ]
Lu, Mengye
Pan, Zheng
机构
[1] Inner Mongolia Univ, Coll Comp Sci, Hohhot 010012, Peoples R China
关键词
target tracking; benchmark; bounding box; ground-truth; performance evaluation; OBJECT TRACKING;
D O I
10.1109/QRS-C.2017.51
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Target tracking is an important part of many applications in computer vision. With continuous researching and developing, more and more advanced tracking algorithms have been put forward. Therefore, a benchmark and dataset used to evaluate the most advanced tracking algorithms are needed. One of the most widely used benchmarks is Online Tracking Benchmark (OTB). This benchmark has a clear statement of the video attributes, and each frame in the sequences is appropriately provided with the ground-truth annotations. There may be some errors due to the annotations done by manual operation for bounding box and thus we find and modify the annotations that have some errors. The error means the bounding box for tracking target in some frames is beyond boundaries of corresponding frames. Then we study the effect of these small errors on the tracking algorithm evaluation in the corresponding video sequences.
引用
收藏
页码:261 / 266
页数:6
相关论文
共 50 条
  • [21] Evaluation with Confusable Ground Truth
    Li, Jiyi
    Yoshikawa, Masatoshi
    INFORMATION RETRIEVAL TECHNOLOGY, AIRS 2016, 2016, 9994 : 363 - 369
  • [22] Performance evaluation of an algorithm for multiple target angle tracking
    Keche, M
    Ouamri, A
    Harrison, I
    Woolfson, MS
    IEE PROCEEDINGS-RADAR SONAR AND NAVIGATION, 1997, 144 (05) : 252 - 258
  • [23] Performance Evaluation of Multiple-target Tracking Systems
    Feng, Yang
    Yan, Liang
    Liang, Ye
    Quan, Pan
    2010 CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-5, 2010, : 2923 - 2927
  • [24] Performance Evaluation Metrics and Approaches for Target Tracking: A Survey
    Song, Yan
    Hu, Zheng
    Li, Tiancheng
    Fan, Hongqi
    SENSORS, 2022, 22 (03)
  • [25] Introspective evaluation of perception performance for parameter tuning without ground truth
    Hu, Humphrey
    Kantor, George
    Robotics: Science and Systems, 2017, 13
  • [26] Performance Evaluation of Visual Odometry using an Industrial Robot as Ground Truth
    Rossi, Roberto
    Melacarne, Giulio
    Rocco, Paolo
    PROCEEDINGS OF THE IECON 2016 - 42ND ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2016, : 761 - 766
  • [27] Introspective Evaluation of Perception Performance for Parameter Tuning without Ground Truth
    Hu, Humphrey
    Kantor, George
    ROBOTICS: SCIENCE AND SYSTEMS XIII, 2017,
  • [28] Objective Performance Evaluation of Video Segmentation Algorithms with Ground-Truth
    杨高波
    张兆扬
    Journal of Shanghai University, 2004, (01) : 70 - 74
  • [29] Ground truth and target identification for fisheries acoustics
    McClatchie, S
    Thorne, RE
    Grimes, P
    Hanchet, S
    FISHERIES RESEARCH, 2000, 47 (2-3) : 173 - 191
  • [30] Tracking Benchmark and Evaluation for Manipulation Tasks
    Roy, Ankush
    Zhang, Xi
    Wolleb, Nina
    Quintero, Camilo Perez
    Jaegersand, Martin
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, : 2448 - 2453