RITnet: Real-time Semantic Segmentation of the Eye for Gaze Tracking

被引：49

作者：

Chaudhary, Aayush K. ^{[1
]}

Kothari, Rakshit ^{[1
]}

Acharya, Manoj ^{[1
]}

Dangi, Shusil ^{[1
]}

Nair, Nitinraj ^{[1
]}

Bailey, Reynold ^{[1
]}

Kanan, Christopher ^{[1
]}

Diaz, Gabriel ^{[1
]}

Pelz, Jeff B. ^{[1
]}

机构：

[1] Rochester Inst Technol, Rochester, NY 14623 USA

来源：

2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW) | 2019年

关键词：

D O I：

10.1109/ICCVW.2019.00568

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Accurate eye segmentation can improve eye-gaze estimation and support interactive computing based on visual attention; however, existing eye segmentation methods suffer from issues such as person-dependent accuracy, lack of robustness, and an inability to be run in real-time. Here, we present the RITnet model, which is a deep neural network that combines U-Net and DenseNet. RITnet is under 1 MB and achieves 95.3% accuracy on the 2019 OpenEDS Semantic Segmentation challenge. Using a GeForce GTX 1080 Ti, RITnet tracks at > 300Hz, enabling real-time gaze tracking applications. Pre-trained models and source code are available (1).

引用

页码：3698 / 3702

页数：5

共 50 条

[11] Real-Time Eye Detection and Tracking
Resheske, Brandon
Tian, Baozhong
[J]. 2015 SSR International Conference on Social Sciences and Information (SSR-SSI 2015), Pt 1, 2015, 10 : 143 - 150
[12] Real-time Semantic Segmentation for Road Scene
Zhang, Xuetao
Chen, Zhenxue
Lu, Dan
Li, Xianming
[J]. 2018 3RD IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (IEEE ICARM), 2018, : 19 - 23
[13] Efficient ConvNet for Real-time Semantic Segmentation
Romera, Eduardo
Alvarez, Jose M.
Bergasa, Luis M.
Arroyo, Roberto
[J]. 2017 28TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV 2017), 2017, : 1789 - 1794
[14] Real-Time Semantic Segmentation with Label Propagation
Sheikh, Rasha
Garbade, Martin
Gall, Juergen
[J]. COMPUTER VISION - ECCV 2016 WORKSHOPS, PT II, 2016, 9914 : 3 - 14
[15] Real-Time Semantic Segmentation With Fast Attention
Hu, Ping
Perazzi, Federico
Heilbron, Fabian Caba
Wang, Oliver
Lin, Zhe
Saenko, Kate
Sclaroff, Stan
[J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (01) : 263 - 270
[16] Rethinking BiSeNet For Real-time Semantic Segmentation
Fan, Mingyuan
Lai, Shenqi
Huang, Junshi
Wei, Xiaoming
Chai, Zhenhua
Luo, Junfeng
Wei, Xiaolin
[J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 9711 - 9720
[17] Real-Time Driving Scene Semantic Segmentation
Wang, Wenfu
Fu, Yongjian
Pan, Zhijie
Li, Xi
Zhuang, Yueting
[J]. IEEE ACCESS, 2020, 8 : 36776 - 36788
[18] Background Subtraction With Real-Time Semantic Segmentation
Zeng, Dongdong
Chen, Xiang
Zhu, Ming
Goesele, Michael
Kuijper, Arjan
[J]. IEEE ACCESS, 2019, 7 : 153869 - 153884
[19] A distributed real time eye-gaze tracking system
García, A
Sánchez, FM
Pérez, A
Pedraza, JL
Méndez, R
Córdoba, ML
Muñoz, ML
[J]. ETFA 2003: IEEE CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION, VOL 2, PROCEEDINGS, 2003, : 545 - 551
[20] Collaborative eye tracking based code review through real-time shared gaze visualization
Shiwei CHENG
Jialing WANG
Xiaoquan SHEN
Yijian CHEN
Anind DEY
[J]. Frontiers of Computer Science., 2022, 16 (03) - 174

← 1 2 3 4 5 →