Exploratory Visualization Tool for the Continuous Evaluation of Information Retrieval Systems

被引：0
|
作者：
Gonzalez-Saez, Gabriela [1 ]
Galuscakova, Petra [1 ]
Deveaud, Romain [2 ]
Goeuriot, Lorraine [1 ]
Mulhem, Philippe [1 ]
机构：
[1] Univ Grenoble Alpes, CNRS, Grenoble INP, LIG,Inst Engn, F-38000 Grenoble, France
[2] Qwant, Paris, France
来源：
PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023 | 2023年
基金：
奥地利科学基金会;
关键词：
information retrieval; continuous evaluation; visualization;
D O I：
10.1145/3539618.3591825
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
This paper introduces a novel visualization tool that facilitates the exploratory analysis of continuous evaluation for information retrieval systems. We base our analysis on score standardization and meta-analysis techniques applied to Information Retrieval evaluation. We present three functionalities: evaluation overview, delta evaluation, and meta-analysis applied to three perspectives: evaluation rounds, queries, and systems. To illustrate the use of the tool, we provide an example using the TREC-COVID test collection.
引用
收藏
页码：3220 / 3224
页数：5
相关论文
共 50 条
  • [1] Adaptive visualization for exploratory information retrieval
    Ahn, Jae-Wook
    Brusilovsky, Peter
    [J]. INFORMATION PROCESSING & MANAGEMENT, 2013, 49 (05) : 1139 - 1164
  • [2] Pooling-based continuous evaluation of information retrieval systems
    Tonon, Alberto
    Demartini, Gianluca
    Cudre-Mauroux, Philippe
    [J]. INFORMATION RETRIEVAL JOURNAL, 2015, 18 (05): : 445 - 472
  • [3] Pooling-based continuous evaluation of information retrieval systems
    Alberto Tonon
    Gianluca Demartini
    Philippe Cudré-Mauroux
    [J]. Information Retrieval Journal, 2015, 18 : 445 - 472
  • [4] Foundations of advanced information visualization for Visual Information (Retrieval) systems
    Rorvig, M
    Hemmje, M
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE, 1999, 50 (09): : 835 - 837
  • [5] IVEA: An information visualization tool for personalized exploratory document collection analysleis
    Thai, VinhTuan
    Handschuh, Siegfried
    Decker, Stefan
    [J]. SEMANTIC WEB: RESEARCH AND APPLICATIONS, PROCEEDINGS, 2008, 5021 : 139 - 153
  • [6] On the evaluation of Geographic Information Retrieval systems
    Palacio, Damien
    Cabanac, Guillaume
    Sallaberry, Christian
    Hubert, Gilles
    [J]. INTERNATIONAL JOURNAL ON DIGITAL LIBRARIES, 2010, 11 (02) : 91 - 109
  • [7] EVALUATION OF INFORMATION-RETRIEVAL SYSTEMS
    FARRADANE, J
    [J]. JOURNAL OF DOCUMENTATION, 1974, 30 (02) : 195 - 209
  • [8] RETRIEVAL-An Online Performance Evaluation Tool for Information Retrieval Methods
    Ioannakis, George
    Koutsoudis, Anestis
    Pratikakis, Ioannis
    Chamzas, Christodoulos
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (01) : 119 - 127
  • [9] Information Visualization for Interactive Information Retrieval
    Hoeber, Orland
    [J]. CHIIR'18: PROCEEDINGS OF THE 2018 CONFERENCE ON HUMAN INFORMATION INTERACTION & RETRIEVAL, 2018, : 371 - 374
  • [10] Information Retrieval across Information Visualization
    Osinska, Veslava
    Bala, Piotr
    Gawarkiewicz, Michal
    [J]. 2012 FEDERATED CONFERENCE ON COMPUTER SCIENCE AND INFORMATION SYSTEMS (FEDCSIS), 2012, : 233 - 239
12345