Sim4IR: The SIGIR 2021 Workshop on Simulation for Information Retrieval Evaluation

被引:2
|
作者
Balog, Krisztian [1 ]
Maxwell, David [2 ]
Thomas, Paul [3 ]
Zhang, Shuo [4 ]
机构
[1] Univ Stavanger, Stavanger, Norway
[2] Delft Univ Technol, Delft, Netherlands
[3] Microsoft, Canberra, ACT, Australia
[4] Bloomberg, London, England
关键词
D O I
10.1145/3404835.3462821
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The use of simulation techniques is not foreign to information retrieval. In the past, simulation has been employed, for example, for constructing test collections and for model performance prediction and analysis in a broad array of information access scenarios. Nevertheless, a standardized methodology for performance evaluation via simulation has not yet been developed. The goal of this workshop is to create a forum for researchers and practitioners to promote methodology development and more widespread use of simulation for evaluation by: (1) identifying problem settings and application scenarios; (2) sharing tools, techniques, and experiences; (3) characterizing potentials and limitations; and (4) developing a research agenda.
引用
收藏
页码:2697 / 2698
页数:2
相关论文
共 43 条
  • [1] Neu-IR: The SIGIR 2016 Workshop on Neural Information Retrieval
    Craswell, Nick
    Croft, W. Bruce
    Guo, Jiafeng
    Mitra, Bhaskar
    de Rijke, Maarten
    [J]. SIGIR'16: PROCEEDINGS OF THE 39TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2016, : 1245 - 1246
  • [2] Gen-IR @ SIGIR 2023: The First Workshop on Generative Information Retrieval
    Benedict, Gabriel
    Zhang, Ruqing
    Metzler, Donald
    [J]. PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 3460 - 3463
  • [3] Gen-IR@ SIGIR 2024: The Second Workshop on Generative Information Retrieval
    Benedict, Gabriel
    Zhang, Ruqing
    Metzler, Donald
    Yates, Andrew
    Jiang, Ziyan
    [J]. PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 3029 - 3032
  • [4] SIGIR 2017 Workshop on Neural Information Retrieval (Neu-IR'17)
    Craswell, Nick
    Croft, W. Bruce
    de Rijke, Maarten
    Guo, Jiafeng
    Mitra, Bhaskar
    [J]. SIGIR'17: PROCEEDINGS OF THE 40TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2017, : 1431 - 1432
  • [5] SIGIR 2013 Workshop on Modeling User Behavior for Information Retrieval Evaluation
    Clarke, Charles L. A.
    Freund, Luanne
    Smucker, Mark D.
    Yilmaz, Emine
    [J]. SIGIR'13: THE PROCEEDINGS OF THE 36TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH & DEVELOPMENT IN INFORMATION RETRIEVAL, 2013, : 1134 - 1134
  • [6] SIGIR 2024 Workshop on Simulations for Information Access (Sim4IA 2024)
    Schaer, Philipp
    Kreutz, Christin Katharina
    Balog, Krisztian
    Breuer, Timo
    Fuhr, Norbert
    [J]. PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 3058 - 3061
  • [7] SIGIR 2014 Workshop on Semantic Matching in Information Retrieval
    Gonzalo, Julio
    Li, Hang
    Moschitti, Alessandro
    Xu, Jun
    [J]. SIGIR'14: PROCEEDINGS OF THE 37TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2014, : 1296 - 1296
  • [8] The Lucene for Information Access and Retrieval Research (LIARR) Workshop at SIGIR 2017
    Azzopardi, Leif
    Crane, Matt
    Fang, Hui
    Ingersoll, Grant
    Lin, Jimmy
    Moshfeghi, Yashar
    Scells, Harrisen
    Yang, Peilin
    Zuccon, Guido
    [J]. SIGIR'17: PROCEEDINGS OF THE 40TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2017, : 1429 - 1430
  • [9] ReNeuIR at SIGIR 2024: The Third Workshop on Reaching Efficiency in Neural Information Retrieval
    Froebe, Maik
    Mackenzie, Joel
    Mitra, Bhaskar
    Nardini, Franco Maria
    Potthast, Martin
    [J]. PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 3051 - 3054
  • [10] ReNeuIR at SIGIR 2023: The Second Workshop on Reaching Efficiency in Neural Information Retrieval
    Bruch, Sebastian
    Mackenzie, Joel
    Maistro, Maria
    Nardini, Franco Maria
    [J]. PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 3456 - 3459