Gaze-Based Object Segmentation

被引:7
|
作者
Shi, Ran [1 ]
Ngan, Ngi King [1 ,2 ]
Li, Hongliang [2 ]
机构
[1] Chinese Univ Hong Kong, Dept Elect Engn, Shatin, Hong Kong, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Elect Engn, Chengdu 610051, Sichuan, Peoples R China
关键词
Gaze distribution; interactive segmentation; iterative screening; SALIENT OBJECT;
D O I
10.1109/LSP.2017.2739200
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This letter addresses the problem of object segmentation with a gaze map and a group of candidate regions. First, we analyze distribution characteristics of gazes when people look at an image. Then, we summarize different cases of the group of candidate regions. Based on our analysis and summary, we develop three measures to evaluate the likelihood of a candidate region belonging to the target object and a pooling method to create a likelihood map of this object. Finally, the measures and pooling method are integrated with a proposed iterative strategy for generating the segmentation result. Experimental results demonstrate that our method can handle different types of gaze maps and different groups of candidate regions, and the overall performance of our method is better than that of the state-of-the-art method.
引用
收藏
页码:1493 / 1497
页数:5
相关论文
共 50 条
  • [1] Gaze-based Object Detection in the Wild
    Weber, Daniel
    Fuhl, Wolfgang
    Zell, Andreas
    Kasneci, Enkelejda
    2022 SIXTH IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING, IRC, 2022, : 62 - 66
  • [2] A passive BCI for monitoring the intentionality of the gaze-based moving object selection
    Zhao, Darisy G.
    Vasilyev, Anatoly N.
    Kozyrskiy, Bogdan L.
    Melnichuk, Eugeny, V
    Isachenko, Andrey, V
    Velichkovsky, Boris M.
    Shishkin, Sergei L.
    JOURNAL OF NEURAL ENGINEERING, 2021, 18 (02)
  • [3] Gaze-Based Interactive Comics
    Orlov, Pavel
    Gorshkova, Ksenia
    PROCEEDINGS OF THE NORDICHI '16: THE 9TH NORDIC CONFERENCE ON HUMAN-COMPUTER INTERACTION - GAME CHANGING DESIGN, 2016,
  • [4] Gaze-Based Monitoring in the Classroom
    Burch, Michael
    ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, ETRA 2023, 2023,
  • [5] Multimodal Gaze-based Interaction
    Pfeiffer, Thies
    Wachsmuth, Ipke
    AT-AUTOMATISIERUNGSTECHNIK, 2013, 61 (11) : 770 - 776
  • [6] SonoHaptics: An Audio-Haptic Cursor for Gaze-Based Object Selection in XR
    Cho, Hyunsung
    Sendhilnathan, Naveen
    Nebeling, Michael
    Wang, Tianyi
    Padmanabhan, Purnima
    Browder, Jonathan
    Lindlbauer, David
    Jonker, Tanya
    Todi, Kashyap
    PROCEEDINGS OF THE 37TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, USIT 2024, 2024,
  • [7] Dwell time preferences for gaze-based object selection of different object types vary with age
    Remijn, Gerard
    Paulus, Yesaya Tommy
    PERCEPTION, 2022, 51 : 155 - 155
  • [8] Object segmentation in cluttered environment based on gaze tracing and gaze blinking
    Ratsamee, Photchara
    Mae, Yasushi
    Kamiyama, Kazuto
    Horade, Mitsuhiro
    Kojima, Masaru
    Arai, Tatsuo
    ROBOMECH JOURNAL, 2021, 8 (01):
  • [9] Object segmentation in cluttered environment based on gaze tracing and gaze blinking
    Photchara Ratsamee
    Yasushi Mae
    Kazuto Kamiyama
    Mitsuhiro Horade
    Masaru Kojima
    Tatsuo Arai
    ROBOMECH Journal, 8
  • [10] NeighboAR: Efficient Object Retrieval using Proximity- and Gaze-based Object Grouping with an AR System
    Slavuljica A.
    Bektaş K.
    Strecker J.
    Mayer S.
    Proceedings of the ACM on Human-Computer Interaction, 2024, 8 (ETRA)