Browsing Group First-Person Videos with 3D Visualization

被引:4
|
作者
Sugita, Yuki [1 ]
Higuchi, Keita [1 ]
Yonetani, Ryo [1 ]
Kamikubo, Rie [1 ]
Sato, Yoichi [1 ]
机构
[1] Univ Tokyo, Tokyo, Japan
关键词
First-person videos; Group activity;
D O I
10.1145/3279778.3279783
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work presents a novel user interface applying 3D visualization to understand complex group activities from multiple first-person videos. The proposed interface is designed to assist video viewers to easily understand the collaborative relationships of group activity based on where the individual worker is located in a workspace and how multiple workers are positioned to one another during the group activity. More specifically, the interface not only shows all recorded first-person videos but also visualizes the 3D position and orientation of each view point (i.e., the 3D position of each worker wearing a head-mounted camera) with a reconstructed 3D model of the workspace. Our user study confirms that the 3D visualization helps video viewers to understand geometric information of a worker and collaborative relationships of group activity easily and accurately.
引用
下载
收藏
页码:55 / 60
页数:6
相关论文
共 50 条
  • [41] Vibrotactile Rendering of Camera Motion for Bimanual Experience of First-Person View Videos
    Gongora, Daniel
    Nagano, Hikaru
    Konyo, Masashi
    Tadokoro, Satoshi
    2017 IEEE WORLD HAPTICS CONFERENCE (WHC), 2017, : 454 - 459
  • [42] Enhancing First-Person View Task Instruction Videos with Augmented Reality Cues
    Lee, Gun A.
    Ahn, Seungjun
    Hoff, William
    Billinghurst, Mark
    2020 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR 2020), 2020, : 498 - 508
  • [43] Fast Unsupervised Ego-Action Learning for First-Person Sports Videos
    Kitani, Kris M.
    Okabe, Takahiro
    Sato, Yoichi
    Sugimoto, Akihiro
    2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011,
  • [44] Residual-Network-Based Supervised Gaze Prediction for First-Person Videos
    Li, Yujie
    Ding, Shuxue
    Li, Xiang
    Tan, Benying
    Kanemura, Atsunori
    IEEE ACCESS, 2019, 7 : 56208 - 56216
  • [45] 3D visualization of WWW semantic content for browsing and query formulation
    Fowler, RH
    Fowler, WAL
    Williams, JL
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 1997, 20 (02) : 135 - 149
  • [46] PANORAMIC IMMERSIVE VIDEOS 3D Production and Visualization Framework
    Sarmiento, W. J.
    Quintero, C.
    SIGMAP 2009: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND MULTIMEDIA APPLICATIONS, 2009, : 173 - 177
  • [47] Ego-Surfing: Person Localization in First-Person Videos Using Ego-Motion Signatures
    Yonetani, Ryo
    Kitani, Kris M.
    Sato, Yoichi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (11) : 2749 - 2761
  • [48] Towards Playing a 3D First-Person Shooter Game Using a Classification Deep Neural Network Architecture
    Serafim, Paulo Bruno S.
    Nogueira, Yuri Lenon B.
    Vidal, Creto A.
    Cavalcante Neto, Joaquim B.
    2017 19TH SYMPOSIUM ON VIRTUAL AND AUGMENTED REALITY (SVR), 2017, : 120 - 126
  • [49] Ego-Exo: Transferring Visual Representations from Third-person to First-person Videos
    Li, Yanghao
    Nagarajan, Tushar
    Xiong, Bo
    Grauman, Kristen
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 6939 - 6949
  • [50] Personal driving diary: Automated recognition of driving events from first-person videos
    Ryoo, M. S.
    Choi, Sunglok
    Joung, Ji Hoon
    Lee, Jae-Yeong
    Yu, Wonpil
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2013, 117 (10) : 1299 - 1312