Session search modeling by partially observable Markov decision process

被引:8
|
作者
Yang, Grace Hui [1 ]
Dong, Xuchu [1 ,2 ]
Luo, Jiyun [1 ]
Zhang, Sicong [1 ]
机构
[1] Georgetown Univ, Dept Comp Sci, Washington, DC 20057 USA
[2] Jilin Univ, Coll Comp Sci & Technol, Changchun, Jilin, Peoples R China
来源
INFORMATION RETRIEVAL JOURNAL | 2018年 / 21卷 / 01期
关键词
Session search; Dynamic IR modeling; POMDP;
D O I
10.1007/s10791-017-9316-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Session search, the task of document retrieval for a series of queries in a session, has been receiving increasing attention from the information retrieval research community. Session search exhibits the properties of rich user-system interactions and temporal dependency. These properties lead to our proposal of using partially observable Markov decision process to model session search. On the basis of a design choice schema for states, actions and rewards, we evaluate different combinations of these choices over the TREC 2012 and 2013 session track datasets. According to the experimental results, practical design recommendations for using PODMP in session search are discussed.
引用
收藏
页码:56 / 80
页数:25
相关论文
共 50 条
  • [31] Partially observable Markov decision process to generate policies in software defect management
    Akbarinasaji, Shirin
    Kavaklioglu, Can
    Basar, Ayse
    Neal, Adam
    JOURNAL OF SYSTEMS AND SOFTWARE, 2020, 163
  • [32] A Partially Observable Markov Decision Process Approach to Residential Home Energy Management
    Hansen, Timothy M.
    Chong, Edwin K. P.
    Suryanarayanan, Siddharth
    Maciejewski, Anthony A.
    Siegel, Howard Jay
    IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (02) : 1271 - 1281
  • [33] Partially Observable Markov Decision Process for Closed-Loop Anesthesia Control
    Borera, Eddy C.
    Moore, Brett L.
    Pyeatt, Larry D.
    20TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE (ECAI 2012), 2012, 242 : 949 - +
  • [34] State Estimation for Mobile Robot using Partially Observable Markov Decision Process
    Institute of Industrial Science, The University of Tokyo, 7-22-1, Roppongi, Minato-ku, Tokyo
    106, Japan
    J. Rob. Mechatronics, 3 (272-277):
  • [35] Autonomous Guidance Through Handwashing Using A Partially Observable Markov Decision Process
    Von Bertoldi, Axel
    Boger, Jennifer
    Hoey, Jesse
    Poupart, Pascal
    Fernie, Geoff
    Boutilier, Craig
    Mihailidis, Alex
    TECHNOLOGY AND AGING, 2008, 21 : 43 - 50
  • [36] A partially-observable markov decision process for dealing with dynamically changing environments
    Chatzis, Sotirios P.
    Kosmopoulos, Dimitrios
    IFIP Advances in Information and Communication Technology, 2014, 436 : 111 - 120
  • [37] Risk Assessment in Transactions Under Threat as Partially Observable Markov Decision Process
    Vassilev, Vassil
    Donchev, Doncho
    Tonchev, Demir
    OPTIMIZATION IN ARTIFICIAL INTELLIGENCE AND DATA SCIENCES, 2022, : 199 - 212
  • [38] A two-state partially observable Markov decision process with three actions
    Ben-Zvi, Tal
    Chernonog, Tatyana
    Avinadav, Tal
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2016, 254 (03) : 957 - 967
  • [39] Expandable-Partially Observable Markov Decision-Process Framework for Modeling and Analysis of Autonomous Vehicle Behavior
    Pouya, Parisa
    Madni, Azad M.
    IEEE SYSTEMS JOURNAL, 2021, 15 (03): : 3714 - 3725
  • [40] Misplaced Item Search in a Warehouse using an RFID-based Partially Observable Markov Decision Process (POMDP) Model
    Hariharan, Sharethram
    Bukkapatnam, Satish T. S.
    2009 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING, 2009, : 443 - +