Session search modeling by partially observable Markov decision process

被引：8

作者：

Yang, Grace Hui ^{[1
]}

Dong, Xuchu ^{[1
,2
]}

Luo, Jiyun ^{[1
]}

Zhang, Sicong ^{[1
]}

机构：

[1] Georgetown Univ, Dept Comp Sci, Washington, DC 20057 USA

[2] Jilin Univ, Coll Comp Sci & Technol, Changchun, Jilin, Peoples R China

来源：

INFORMATION RETRIEVAL JOURNAL | 2018年 / 21卷 / 01期

关键词：

Session search; Dynamic IR modeling; POMDP;

D O I：

10.1007/s10791-017-9316-8

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Session search, the task of document retrieval for a series of queries in a session, has been receiving increasing attention from the information retrieval research community. Session search exhibits the properties of rich user-system interactions and temporal dependency. These properties lead to our proposal of using partially observable Markov decision process to model session search. On the basis of a design choice schema for states, actions and rewards, we evaluate different combinations of these choices over the TREC 2012 and 2013 session track datasets. According to the experimental results, practical design recommendations for using PODMP in session search are discussed.

引用

页码：56 / 80

页数：25

共 50 条

[1] Session search modeling by partially observable Markov decision process
Grace Hui Yang
Xuchu Dong
Jiyun Luo
Sicong Zhang
Information Retrieval Journal, 2018, 21 : 56 - 80
[2] Robust partially observable Markov decision process
Osogami, Takayuki
INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 106 - 115
[3] Autonomous Thermalling as a Partially Observable Markov Decision Process
Guilliard, Iain
Rogahn, Richard J.
Piavis, Jim
Kolobov, Andrey
ROBOTICS: SCIENCE AND SYSTEMS XIV, 2018,
[4] The Query Change Model: Modeling Session Search as a Markov Decision Process
Yang, Hui
Guan, Dongyi
Zhang, Sicong
ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2015, 33 (04)
[5] Partially Observable Markov Decision Process Approximations for Adaptive Sensing
Edwin K. P. Chong
Christopher M. Kreucher
Alfred O. Hero
Discrete Event Dynamic Systems, 2009, 19 : 377 - 422
[6] A PARTIALLY OBSERVABLE MARKOV DECISION-PROCESS WITH LAGGED INFORMATION
KIM, SH
JEONG, BH
JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 1987, 38 (05) : 439 - 446
[7] Mixed reinforcement learning for partially observable Markov decision process
Dung, Le Tien
Komeda, Takashi
Takagi, Motoki
2007 INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE IN ROBOTICS AND AUTOMATION, 2007, : 436 - +
[8] Partially Observable Markov Decision Process Approximations for Adaptive Sensing
Chong, Edwin K. P.
Kreucher, Christopher M.
Hero, Alfred O., III
DISCRETE EVENT DYNAMIC SYSTEMS-THEORY AND APPLICATIONS, 2009, 19 (03): : 377 - 422
[9] Modeling speech using Partially Observable Markov Decision Processes (POMDP)
Jonas, M
2001 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I-VI, PROCEEDINGS: VOL I: SPEECH PROCESSING 1; VOL II: SPEECH PROCESSING 2 IND TECHNOL TRACK DESIGN & IMPLEMENTATION OF SIGNAL PROCESSING SYSTEMS NEURALNETWORKS FOR SIGNAL PROCESSING; VOL III: IMAGE & MULTIDIMENSIONAL SIGNAL PROCESSING MULTIMEDIA SIGNAL PROCESSING - VOL IV: SIGNAL PROCESSING FOR COMMUNICATIONS; VOL V: SIGNAL PROCESSING EDUCATION SENSOR ARRAY & MULTICHANNEL SIGNAL PROCESSING AUDIO & ELECTROACOUSTICS; VOL VI: SIGNAL PROCESSING THEORY & METHODS STUDENT FORUM, 2001, : 4016 - 4016
[10] A partially observable Markov decision process model for bridge inspection and maintenance
Ellis, H
Corotis, RB
Jiang, MX
APPLICATIONS OF STATISTICS AND PROBABILITY: CIVIL ENGINEERING RELIABILITY AND RISK ANALYSIS, VOL 3 - FINAL REPORT, 1996, : 1523 - 1528

← 1 2 3 4 5 →