First-Person Vision

被引:74
|
作者
Kanade, Takeo [1 ]
Hebert, Martial [1 ]
机构
[1] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
基金
美国国家科学基金会;
关键词
Computer vision; eye tracking; object recognition; quality of life technologies; RECOGNITION; TRACKING; MOVEMENT;
D O I
10.1109/JPROC.2012.2200554
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
For understanding the behavior, intent, and environment of a person, the surveillance metaphor is traditional; that is, install cameras and observe the subject, and his/her interaction with other people and the environment. Instead, we argue that the first-person vision (FPV), which senses the environment and the subject's activities from a wearable sensor, is more advantageous with images about the subject's environment as taken from his/her view points, and with readily available information about head motion and gaze through eye tracking. In this paper, we review key research challenges that need to be addressed to develop such FPV systems, and describe our ongoing work to address them using examples from our prototype systems.
引用
收藏
页码:2442 / 2453
页数:12
相关论文
共 50 条
  • [1] First-Person Computational Vision
    Grauman, Kristen
    [J]. FRONTIERS OF ENGINEERING, 2017, : 17 - 24
  • [2] A PREDICTOR OF MOVING OBJECTS FOR FIRST-PERSON VISION
    Sanchez-Matilla, Ricardo
    Cavallaro, Andrea
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2189 - 2193
  • [3] A First-Person Vision Dataset of Office Activities
    Abebe, Girmaw
    Catala, Andreu
    Cavallaro, Andrea
    [J]. MULTIMODAL PATTERN RECOGNITION OF SOCIAL SIGNALS IN HUMAN-COMPUTER-INTERACTION, MPRSS 2018, 2019, 11377 : 27 - 37
  • [4] Fall Detection With a Nonintrusive and First-Person Vision Approach
    Wang, Xueyi
    Talavera, Estefania
    Karastoyanova, Dimka
    Azzopardi, George
    [J]. IEEE SENSORS JOURNAL, 2023, 23 (22) : 28304 - 28317
  • [5] Hierarchical modeling for first-person vision activity recognition
    Abebe, Girmaw
    Cavallaro, Andrea
    [J]. NEUROCOMPUTING, 2017, 267 : 362 - 377
  • [6] Visual Motif Discovery via First-Person Vision
    Yonetani, Ryo
    Kitani, Kris M.
    Sato, Yoichi
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 187 - 203
  • [7] USABILITY OF FIRST-PERSON VISION AMONG OLDER ADULTS AND THEIR SPOUSES
    Matthews, J. T.
    Hebert, M.
    Devyver, M.
    Dodds, A.
    Mecca, L. Person
    Beach, S.
    Schulz, R.
    [J]. GERONTOLOGIST, 2011, 51 : 60 - 60
  • [8] First-person experiments
    Ginsburg, C
    [J]. JOURNAL OF CONSCIOUSNESS STUDIES, 2005, 12 (02) : 22 - 42
  • [9] First-Person Shooter
    Fitzgerald, Adam
    [J]. AMERICAN SCHOLAR, 2015, 84 (01): : 51 - 51
  • [10] Simulation and the first-person
    Peter Carruthers
    [J]. Philosophical Studies, 2009, 144 : 467 - 475