DocTAG: A Customizable Annotation Tool for Ground Truth Creation

被引:2
|
作者
Giachelle, Fabio [1 ]
Irrera, Ornella [1 ]
Silvello, Gianmaria [1 ]
机构
[1] Univ Padua, Dept Informat Engn, Padua, Italy
来源
基金
欧盟地平线“2020”;
关键词
Annotation tool; Passage annotation; Evaluation; Ground-truth creation;
D O I
10.1007/978-3-030-99739-7_35
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Information Retrieval (IR) is a discipline deeply rooted on evaluation that in many cases relies on annotated data as ground truth. Manual annotation is a demanding and time-consuming task, involving human intervention for topic-document assessment. To ease and possibly speed up the work of the assessors, it is desirable to have easy-to-use, collaborative and flexible annotation tools. Despite their importance, in the IR domain no open-source fully customizable annotation tool has been proposed for topic-document annotation and assessment, so far. In this demo paper, we present DocTAG, a portable and customizable annotation tool for ground-truth creation in a web-based collaborative setting.
引用
收藏
页码:288 / 293
页数:6
相关论文
共 50 条
  • [31] LiDAR-based curb detection for ground truth annotation in automated driving validation
    Luis Apellaniz, Jose
    Garcia, Mikel
    Aranjuelo, Nerea
    Barandiaran, Javier
    Nieto, Marcos
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 5054 - 5059
  • [32] A ground truth tool for Synthetic Aperture Radar (SAR) imagery
    Pavlidis, I
    Perrin, D
    Papanikolopoulos, NP
    Au, W
    Sawtelle, S
    IEEE WORKSHOP ON COMPUTER VISION BEYOND THE VISIBLE SPECTRUM: METHODS AND APPLICATIONS (CVBVS'99) - PROCEEDINGS, 1999, : 82 - 87
  • [33] Semi-automatic Image and Video Annotation System for Generating Ground Truth Information
    Yang, Chang Mo
    Choo, Yusik
    Park, Sungjoo
    2018 32ND INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN), 2018, : 821 - 824
  • [34] Quantifying the Effects of Ground Truth Annotation Quality on Object Detection and Instance Segmentation Performance
    Agnew, Cathaoir
    Eising, Ciaran
    Denny, Patrick
    Scanlan, Anthony
    van de Ven, Pepijn
    Grua, Eoin M.
    IEEE ACCESS, 2023, 11 : 25174 - 25188
  • [35] Annotation and knowledge creation
    Boujut, JF
    DESIGN 2002: Proceedings of the 7th International Design Conference, Vols 1 and 2, 2002, : 301 - 306
  • [36] Ground Truth Or Dare: Factors Affecting The Creation Of Medical Datasets For Training AI
    Zajac, Hubert D.
    Avlona, Natalia R.
    Andersen, Tariq O.
    Kensing, Finn
    Shklovski, Irina
    PROCEEDINGS OF THE 2023 AAAI/ACM CONFERENCE ON AI, ETHICS, AND SOCIETY, AIES 2023, 2023, : 351 - 362
  • [37] Automatic Ground Truth Dataset Creation for Fake News Detection in Social Media
    Karidi, Danae Pla
    Nakos, Harry
    Stavrakas, Yannis
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2019, PT I, 2019, 11871 : 424 - 436
  • [38] A Novel Label Aggregation with Attenuated Scores for Ground-Truth Identification of Dataset Annotation with Crowdsourcing
    Thammasudjarit, Ratchainant
    Plangprasopchok, Anon
    Pluempitiwiriyawej, Charnyote
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2017, E100D (04): : 750 - 757
  • [39] Automatic Synchronization of Wearable Sensors and Video-Cameras for Ground Truth Annotation - A Practical Approach
    Ploetz, Thomas
    Chen, Chen
    Hammerla, Nils Y.
    Abowd, Gregory D.
    2012 16TH INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (ISWC), 2012, : 100 - 103
  • [40] Ground Truth Model, Tool, and Dataset for Layout Analysis of Historical Documents
    Chen, Kai
    Seuret, Mathias
    Wei, Hao
    Liwicki, Marcus
    Hennebert, Jean
    Ingold, Rolf
    DOCUMENT RECOGNITION AND RETRIEVAL XXII, 2015, 9402