Fast capture of textured full-body avatar with RGB-D cameras

被引:15
|
作者
Lin, Shuai [1 ]
Chen, Yin [2 ]
Lai, Yu-Kun [3 ]
Martin, Ralph R. [3 ]
Cheng, Zhi-Quan [4 ]
机构
[1] Natl Univ Def Technol, Sch Comp, PDL, Changsha, Hunan, Peoples R China
[2] PLA Univ Sci & Technol, Def Engn Sch, Nanjing, Jiangsu, Peoples R China
[3] Cardiff Univ, Sch Comp Sci & Informat, Cardiff, S Glam, Wales
[4] Avatar Sci Co, Changsha, Hunan, Peoples R China
来源
VISUAL COMPUTER | 2016年 / 32卷 / 6-8期
基金
中国国家自然科学基金;
关键词
Full-body avatar; High-quality texture; RGB-depth camera; Global registration; OBJECTS;
D O I
10.1007/s00371-016-1245-9
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present a practical system which can provide a textured full-body avatar within 3 s. It uses sixteen RGB-depth (RGB-D) cameras, ten of which are arranged to capture the body, while six target the important head region. The configuration of the multiple cameras is formulated as a constraint-based minimum set space-covering problem, which is approximately solved by a heuristic algorithm. The camera layout determined can cover the full-body surface of an adult, with geometric errors of less than 5 mm. After arranging the cameras, they are calibrated using a mannequin before scanning real humans. The 16 RGB-D images are all captured within 1 s, which both avoids the need for the subject to attempt to remain still for an uncomfortable period, and helps to keep pose changes between different cameras small. All scans are combined and processed to reconstruct the photorealistic textured mesh in 2 s. During both system calibration and working capture of a real subject, the high-quality RGB information is exploited ton.o assist geometric reconstruction and texture stitching optimizati
引用
收藏
页码:681 / 691
页数:11
相关论文
共 50 条
  • [1] Fast capture of textured full-body avatar with RGB-D cameras
    Shuai Lin
    Yin Chen
    Yu-Kun Lai
    Ralph R. Martin
    Zhi-Quan Cheng
    [J]. The Visual Computer, 2016, 32 : 681 - 691
  • [2] Avatar 1: a fast 3D color full-body capture system
    Cheng Z.-Q.
    Chen Y.
    Song Z.
    Wu T.
    Wang J.
    [J]. Cheng, Zhi-Quan (cheng.zhiquan@avatarscience.com), 1600, Chinese Academy of Sciences (27): : 2509 - 2518
  • [3] Drivable Avatar Clothing: Faithful Full-Body Telepresence with Dynamic Clothing Driven by Sparse RGB-D Input
    Xiang, Donglai
    Prada, Fabian
    Cao, Zhe
    Guo, Kaiwen
    Wu, Chenglei
    Hodgins, Jessica
    Bagautdinov, Timur
    [J]. PROCEEDINGS OF THE SIGGRAPH ASIA 2023 CONFERENCE PAPERS, 2023,
  • [4] Detailed Full-Body Reconstructions of Moving People from Monocular RGB-D Sequences
    Bogo, Federica
    Black, Michael J.
    Loper, Matthew
    Romero, Javier
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 2300 - 2308
  • [5] Motion Capture with High-Speed RGB-D Cameras
    Kim, Jongsung
    Kim, Myunggyu
    [J]. 2014 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), 2014, : 394 - 395
  • [6] A Fast Visual Odometry and Mapping System for RGB-D Cameras
    Silva, Bruno M. F.
    Goncalves, Luiz M. G.
    [J]. 2014 2ND BRAZILIAN ROBOTICS SYMPOSIUM (SBR) / 11TH LATIN AMERICAN ROBOTICS SYMPOSIUM (LARS) / 6TH ROBOCONTROL WORKSHOP ON APPLIED ROBOTICS AND AUTOMATION, 2014, : 55 - 60
  • [7] Easy and Fast Reconstruction of a 3D Avatar with an RGB-D Sensor
    Mao, Aihua
    Zhang, Hong
    Liu, Yuxin
    Zheng, Yinglong
    Li, Guiqing
    Han, Guoqiang
    [J]. SENSORS, 2017, 17 (05)
  • [8] Full-body Avatar Generation for Increased Embodiment
    Kim, Dohyung
    Koo, Jun
    Hwang, Jewoong
    Seo, Minjae
    Jung, Inhyung
    Park, Kyoungju
    [J]. 2024 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS, VRW 2024, 2024, : 1063 - 1065
  • [9] A Catadioptric Extension for RGB-D Cameras
    Endres, Felix
    Sprunk, Christoph
    Kuemmerle, Rainer
    Burgard, Wolfram
    [J]. 2014 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2014), 2014, : 466 - 471
  • [10] Visual SLAM with RGB-D Cameras
    Jin, Qiongyao
    Liu, Yungang
    Man, Yongchao
    Li, Fengzhong
    [J]. PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 4072 - 4077