Can eyes reveal interest? Implicit queries from gaze patterns

被引:0
|
作者
Antti Ajanki
David R. Hardoon
Samuel Kaski
Kai Puolamäki
John Shawe-Taylor
机构
[1] Helsinki University of Technology (TKK),Department of Information and Computer Science, Helsinki Institute for Information Technology
[2] University College London,Department of Computer Science
关键词
Eye movements; Implicit relevance feedback; Information retrieval; Machine learning; Support vector machines;
D O I
暂无
中图分类号
学科分类号
摘要
We study a new research problem, where an implicit information retrieval query is inferred from eye movements measured when the user is reading, and used to retrieve new documents. In the training phase, the user’s interest is known, and we learn a mapping from how the user looks at a term to the role of the term in the implicit query. Assuming the mapping is universal, that is, the same for all queries in a given domain, we can use it to construct queries even for new topics for which no learning data is available. We constructed a controlled experimental setting to show that when the system has no prior information as to what the user is searching, the eye movements help significantly in the search. This is the case in a proactive search, for instance, where the system monitors the reading behaviour of the user in a new topic. In contrast, during a search or reading session where the set of inspected documents is biased towards being relevant, a stronger strategy is to search for content-wise similar documents than to use the eye movements.
引用
收藏
页码:307 / 339
页数:32
相关论文
共 50 条
  • [1] Can eyes reveal interest? Implicit queries from gaze patterns
    Ajanki, Antti
    Hardoon, David R.
    Kaski, Samuel
    Puolamaki, Kai
    Shawe-Taylor, John
    USER MODELING AND USER-ADAPTED INTERACTION, 2009, 19 (04) : 307 - 339
  • [2] I Can See It in Your Eyes: Gaze as an Implicit Cue of Uncanniness and Task Performance in Repeated Interactions With Robots
    Perugia, Giulia
    Paetzel-Pruesmann, Maike
    Alanenpaa, Madelene
    Castellano, Ginevra
    FRONTIERS IN ROBOTICS AND AI, 2021, 8
  • [3] Eyes that bind us: Gaze leading induces an implicit sense of agency
    Stephenson, Lisa J.
    Edwards, S. Gareth
    Howard, Emma E.
    Bayliss, Andrew P.
    COGNITION, 2018, 172 : 124 - 133
  • [4] Local navigation can reveal implicit relations
    Chen, Yingjie
    Qian, Zhenyu
    Woodbury, Robert
    COMPUTER-AIDED ARCHITECTURAL DESIGN FUTURES (CAAD FUTURES) 2007, 2007, : 403 - 416
  • [5] Can Visual Scanpath Reveal Personal Image Memorability? Investigation of HMM Tools for Gaze Patterns Analysis
    Ellahi, Waqas
    Vigier, Toinon
    Le Callet, Patrick
    2020 TWELFTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2020,
  • [6] Gaze patterns reveal aesthetic distance while viewing art
    Marin, Manuela M.
    Leder, Helmut
    ANNALS OF THE NEW YORK ACADEMY OF SCIENCES, 2022, 1514 (01) : 155 - 165
  • [7] Differential Gaze Patterns on Eyes and Mouth During Audiovisual Speech Segmentation
    Lusk, Laina G.
    Mitchel, Aaron D.
    FRONTIERS IN PSYCHOLOGY, 2016, 7
  • [8] From your eyes only: Gaze adaptation from averted eyes and averted heads
    Jenkins, R.
    Keane, J.
    Calder, A. J.
    PERCEPTION, 2007, 36 : 149 - 149
  • [9] Eye gaze patterns reveal how reasoning skills improve with experience
    Guerra-Carrillo, Belen C.
    Bunge, Silvia A.
    NPJ SCIENCE OF LEARNING, 2018, 3 (01)
  • [10] Eye gaze patterns reveal how reasoning skills improve with experience
    Belén C. Guerra-Carrillo
    Silvia A. Bunge
    npj Science of Learning, 3