Holoportation: Virtual 3D Teleportation in Real-time

被引：407

作者：

Orts-Escolano, Sergio ^{[1
]}

Rhemann, Christoph ^{[1
]}

Fanello, Sean ^{[1
]}

Chang, Wayne ^{[1
]}

Kowdle, Adarsh ^{[1
]}

Degtyarev, Yury ^{[1
]}

Kim, David ^{[1
]}

Davidson, Philip ^{[1
]}

Khamis, Sameh ^{[1
]}

Dou, Mingsong ^{[1
]}

Tankovich, Vladimir ^{[1
]}

Loop, Charles ^{[1
]}

Cai, Qin ^{[1
]}

Chou, Philip ^{[1
]}

Mennicken, Sarah ^{[1
]}

Valentin, Julien ^{[1
]}

Pradeep, Vivek ^{[1
]}

Wang, Shenlong ^{[1
]}

Kang, Sing Bing ^{[1
]}

Kohli, Pushmeet ^{[1
]}

Lutchyn, Yuliya ^{[1
]}

Keskin, Cem ^{[1
]}

Izadit, Shahram ^{[1
]}

机构：

[1] Microsoft Res, Redmond, WA 98052 USA

来源：

UIST 2016: PROCEEDINGS OF THE 29TH ANNUAL SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY | 2016年

关键词：

Depth Cameras; 3D capture; Telepresence; Non-rigid reconstruction; Real-time; Mixed Reality; GPU; DISPLAY;

D O I：

10.1145/2984511.2984517

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

We present an end-to-end system for augmented and virtual reality telepresence, called Holoportation. Our system demonstrates high-quality, real-time 3D reconstructions of an entire space, including people, furniture and objects, using a set of new depth cameras. These 3D models can also be transmitted in real-time to remote users. This allows users wearing virtual or augmented reality displays to see, hear and interact with remote participants in 3D, almost as if they were present in the same physical space. From an audio-visual perspective, communicating and interacting with remote users edges closer to face-to-face communication. This paper describes the Holoportation technical system in full, its key interactive capabilities, the application scenarios it enables, and an initial qualitative study of using this new communication medium.

引用

页码：741 / 754

页数：14

共 50 条

[1] 3D virtual colonoscopy with real-time volume rendering
Wan, M
Li, W
Kreeger, K
Bitter, I
Kaufman, A
Liang, ZR
Chen, DQ
Wax, M
[J]. MEDICAL IMAGING 2000: PHYSIOLOGY AND FUNCTION FORM MULTIDIMENSIONAL IMAGES, 2000, 3978 : 165 - 171
[2] Real-time 3D hand tracking in a virtual environment
Smith, KC
Sandin, D
Huang, TS
Eliason, JJ
Baum, GA
[J]. STEREOSCOPIC DISPLAYS AND VIRTUAL REALITY SYSTEMS X, 2003, 5006 : 529 - 543
[3] IT and breast surgery: Real-time 3D virtual navigation
Suzuki, M.
Yamazaki, M.
Shuto, K.
Matsuo, K.
Kosugi, C.
Hirano, A.
Shiragami, R.
Arimitsu, H.
Tanaka, K.
Koda, K.
[J]. EUROPEAN JOURNAL OF CANCER, 2014, 50 : S158 - S158
[4] Real-time 3D
Coco, D
[J]. COMPUTER GRAPHICS WORLD, 1995, 18 (12) : 22 - +
[5] Virtual marionettes: a system and paradigm for real-time 3D animation
Bar-Lev, A
Bruckstein, AM
Elber, G
[J]. VISUAL COMPUTER, 2005, 21 (07): : 488 - 501
[6] Research on virtual real-time 3D space for distance education
Fu Yunqing
Lei Juan
Xian Xiaodong
[J]. ICCSE'2006: PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION: ADVANCED COMPUTER TECHNOLOGY, NEW EDUCATION, 2006, : 373 - 376
[7] Real-time 3D Virtual Dressing Based on Users' Skeletons
Liu, Ting
Li, LingZhi
Zhang, XiWen
[J]. 2017 4TH INTERNATIONAL CONFERENCE ON SYSTEMS AND INFORMATICS (ICSAI), 2017, : 1378 - 1382
[8] Interactivity and educational information in virtual real-time 3D videos
Desfieux, J
Mascarilla, L
Courtellemont, P
[J]. 6TH WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL XIV, PROCEEDINGS: IMAGE, ACOUSTIC, SPEECH AND SIGNAL PROCESSING III, 2002, : 66 - 70
[9] Real-Time Interaction for 3D Pixel Human in Virtual Environment
Deng, Haoke
Zhang, Qimeng
Jin, Hongyu
Kim, Chang-Hun
[J]. APPLIED SCIENCES-BASEL, 2023, 13 (02):
[10] The Method of Real-time Viewshed Analysis on 3D Virtual Earth
Chen Jing
Zeng Fang-min
Dong Shu-tao
[J]. ADVANCED MATERIALS AND INFORMATION TECHNOLOGY PROCESSING, PTS 1-3, 2011, 271-273 : 558 - 562

← 1 2 3 4 5 →