Sim4IR: The SIGIR 2021 Workshop on Simulation for Information Retrieval Evaluation

被引:2
|
作者
Balog, Krisztian [1 ]
Maxwell, David [2 ]
Thomas, Paul [3 ]
Zhang, Shuo [4 ]
机构
[1] Univ Stavanger, Stavanger, Norway
[2] Delft Univ Technol, Delft, Netherlands
[3] Microsoft, Canberra, ACT, Australia
[4] Bloomberg, London, England
关键词
D O I
10.1145/3404835.3462821
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The use of simulation techniques is not foreign to information retrieval. In the past, simulation has been employed, for example, for constructing test collections and for model performance prediction and analysis in a broad array of information access scenarios. Nevertheless, a standardized methodology for performance evaluation via simulation has not yet been developed. The goal of this workshop is to create a forum for researchers and practitioners to promote methodology development and more widespread use of simulation for evaluation by: (1) identifying problem settings and application scenarios; (2) sharing tools, techniques, and experiences; (3) characterizing potentials and limitations; and (4) developing a research agenda.
引用
下载
收藏
页码:2697 / 2698
页数:2
相关论文
共 43 条
  • [11] SIGIR 2018 Workshop on Learning from Limited or Noisy Data for Information Retrieval
    Zamani, Hamed
    Dehghani, Mostafa
    Diaz, Fernando
    Li, Hang
    Craswell, Nick
    ACM/SIGIR PROCEEDINGS 2018, 2018, : 1439 - 1440
  • [12] MANILA24: SIGIR 2024 Workshop on Information Retrieval for Climate Impact
    van den Hurk, Bart
    de Rijke, Maarten
    Salim, Flora
    PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 3044 - 3046
  • [13] Information Retrieval Evaluation as Search Simulation: A General Formal Framework for IR Evaluation
    Zhang, Yinan
    Liu, Xueqing
    Zhai, ChengXiang
    ICTIR'17: PROCEEDINGS OF THE 2017 ACM SIGIR INTERNATIONAL CONFERENCE THEORY OF INFORMATION RETRIEVAL, 2017, : 193 - 200
  • [14] IR-RAG@ SIGIR24: Information Retrieval's Role in RAG Systems
    Petroni, Fabio
    Siciliano, Federico
    Silvestri, Fabrizio
    Trappolini, Giovanni
    PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 3036 - 3039
  • [15] DRL4IR: 4th Workshop on Deep Reinforcement Learning for Information Retrieval
    Xin, Xin
    Zhao, Xiangyu
    Huang, Jin
    Zhang, Weinan
    Zhao, Li
    Yin, Dawei
    Yang, Grace Hui
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 5304 - 5307
  • [16] A structured model for evaluation of information retrieval (IR)
    Kagolovsky, Y
    Möhr, JR
    MEDINFO '98 - 9TH WORLD CONGRESS ON MEDICAL INFORMATICS, PTS 1 AND 2, 1998, 52 : 171 - 175
  • [17] Introduction to the Special Issue for INFORMS Simulation Society (I-Sim) Workshop, 2021
    Barton, Russell R.
    Nakayama, Marvin K.
    Shanbhag, Uday V.
    Song, Eunhye
    ACM TRANSACTIONS ON MODELING AND COMPUTER SIMULATION, 2024, 34 (02):
  • [18] DRL4IR: 2nd Workshop on Deep Reinforcement Learning for Information Retrieval
    Zhang, Weinan
    Zhao, Xiangyu
    Zhao, Li
    Yin, Dawei
    Yang, Grace Hui
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 2681 - 2684
  • [19] 1st Workshop on Information Retrieval for Understudied Users (IR4U2)
    Pera, Maria Soledad
    Cena, Federica
    Huibers, Theo
    Landoni, Monica
    Mauro, Noemi
    Murgia, Emiliana
    ADVANCES IN INFORMATION RETRIEVAL, ECIR 2024, PT V, 2024, 14612 : 409 - 414
  • [20] DRL4IR: 3rd Workshop on Deep Reinforcement Learning for Information Retrieval
    Zhao, Xiangyu
    Xin, Xin
    Zhang, Weinan
    Zhao, Li
    Yin, Dawei
    Yang, Grace Hui
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 3488 - 3491