Enhanced Gaze Following via Object Detection and Human Pose Estimation

被引：13

作者：

Guan, Jian ^{[1
]}

Yin, Liming ^{[2
]}

Sun, Jianguo ^{[1
]}

Qi, Shuhan ^{[2
]}

Wang, Xuan ^{[2
]}

Liao, Qing ^{[2
,3
]}

机构：

[1] Harbin Engn Univ, Coll Comp Sci & Technol, Harbin 150001, Peoples R China

[2] Harbin Inst Technol Shenzhen, Dept Comp Sci & Technol, Shenzhen 518055, Peoples R China

[3] Peng Cheng Lab, Shenzhen 518000, Peoples R China

来源：

MULTIMEDIA MODELING (MMM 2020), PT II | 2020年 / 11962卷

关键词：

Gaze following; Objection detection; Human pose estimation; Deep neural network;

D O I：

10.1007/978-3-030-37734-2_41

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

The aim of gaze following is to estimate the gaze direction, which is useful for the understanding of human behaviour in various applications. However, it is still an open problem that has not been fully studied. In this paper, we present a novel framework for gaze following problem, where both the front/side face case and the back face case are taken into account. For the front/side face case, head pose estimation is applied to estimate the gaze, and then object detection is used to further refine the gaze direction by selecting the object that intersects with the gaze in a certain range. For the back face case, a deep neural network with the human pose information is proposed for gaze estimation. Experiments are carried out to demonstrate the superiority of the proposed method, as compared with the state-of-the-art method.

引用

页码：502 / 513

页数：12

共 50 条

[41] Repetitive assembly action recognition based on object detection and pose estimation
Chen, Chengjun
Wang, Tiannuo
Li, Dongnian
Hong, Jun
JOURNAL OF MANUFACTURING SYSTEMS, 2020, 55 : 325 - 333
[42] Pose Estimation of Flying Object Based on Monocular Camera and Feature Detection
Zheng, Na
Wang, Yuekun
Zhang, Junjie
2018 WRC SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION (WRC SARA), 2018, : 159 - 164
[43] From Contours to 3D Object Detection and Pose Estimation
Payet, Nadia
Todorovic, Sinisa
2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2011, : 983 - 990
[44] A survey on joint object detection and pose estimation using monocular vision
Patil, Aniruddha V.
Rabha, Pankaj
2018 INTERNATIONAL JOINT CONFERENCE ON METALLURGICAL AND MATERIALS ENGINEERING (JCMME 2018), 2019, 277
[45] UAVPNet: A balanced and enhanced UAV object detection and pose recognition network
Shan, Peng
Yang, Ruige
Xiao, Hongming
Zhang, Lin
Liu, Yinghao
Fu, Qiang
Zhao, Yuliang
MEASUREMENT, 2023, 222
[46] Human Pose Estimation via Dynamic Information Transfer
Li, Yihang
Shi, Qingxuan
Song, Jingya
Yang, Fang
ELECTRONICS, 2023, 12 (03)
[47] Human Pose Estimation via an Ultra-Lightweight Pose Distillation Network
Zhang, Shihao
Qiang, Baohua
Yang, Xianyi
Wei, Xuekai
Chen, Ruidong
Chen, Lirui
ELECTRONICS, 2023, 12 (12)
[48] Towards infrared human pose estimation via Transformer
Zhu, Zhilei
Dong, Wanli
Gao, Xiaoming
Peng, Anjie
2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
[49] Human-like object tracking and gaze estimation with PKD android
Wijayasinghe, Indika B.
Miller, Haylie L.
Das, Sumit K.
Bugnariu, Nicoleta L.
Popa, Dan O.
SENSORS FOR NEXT-GENERATION ROBOTICS III, 2016, 9859
[50] Unifying Human Pose Estimation in the Fall Detection Problem
Oleg Egor Surkov
Andrei Seredin
Olesia Kopylov
undefined Kushnir
Pattern Recognition and Image Analysis, 2024, 34 (4) : 1061 - 1073

← 1 2 3 4 5 →