Network algorithm real-time depth image 3D human recognition for augmented reality

被引:12
|
作者
Huang, Renyong [1 ]
Sun, Mingyi [2 ]
机构
[1] Xihua Univ, Sch Literature & Journalism, Chengdu 610000, Peoples R China
[2] Chengdu Normal Univ, Sch Comp Sci, Chengdu 610000, Peoples R China
关键词
Real-time depth image; Augmented reality; Network algorithm; 3D human recognition; POSE ESTIMATION; SYSTEM; TRACKING; GESTURE;
D O I
10.1007/s11554-020-01045-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper studies the application of augmented reality real-time depth image technology to 3D human motion recognition technology. The accuracy and real-time performance of sensor-based 3D human reconstruction are affected by visual characteristics and illumination changes. Features are not easily extracted and cannot be tracked, leading to failures in the 3D reconstruction of the human body. Based on this system, the sensor-based visual inertial initialization algorithm is studied, which is integrated in the two-frame image time interval to provide accurate initial values for vision-based motion estimation, improve the accuracy of the calculated posture, and finally improve the accuracy of the 3D reconstruction system. Based on the relationship between the depth image and the distance and reflectivity, a model for correcting the distance error and reflectivity error of the depth image is established to improve the accuracy of the depth image, and finally the accuracy of the three-dimensional reconstruction of the human body.
引用
收藏
页码:307 / 319
页数:13
相关论文
共 50 条
  • [31] A Real-Time 3D End-to-End Augmented Reality System (and its Representation Transformations)
    Tytgat, Donny
    Aerts, Maarten
    De Busser, Jeroen
    Lievens, Sammy
    Alface, Patrice Rondao
    Macq, Jean -Francois
    [J]. APPLICATIONS OF DIGITAL IMAGE PROCESSING XXXIX, 2016, 9971
  • [32] Breaking the Plane: Exploring Real-Time Visualization of 3D Surfaces in Augmented Reality with Handwritten Input
    Esparraguera, Liam Franco
    Selberg, Kristoffer
    Lou, Brian
    Sun, Jenny
    Desta, Beza
    Monroy-Hernandez, Andres
    Abtahi, Parastoo
    [J]. EXTENDED ABSTRACTS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2024, 2024,
  • [33] Real-time 3D shape recognition for soft manipulator based on SOM algorithm
    Zou, Shuangquan
    Lyu, Yueyong
    Guan, Qinghua
    Liu, Liwu
    Ma, Guangfu
    [J]. Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 2023, 55 (04): : 8 - 17
  • [34] REAL-TIME DEPTH ESTIMATION FOR IMMERSIVE 3D VIDEOCONFERENCING
    Feldmann, I.
    Waizenegger, W.
    Atzpadin, N.
    Schreer, O.
    [J]. 2010 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON 2010), 2010,
  • [35] Applicability of a Single Depth Sensor in Real-Time 3D Clothes Simulation: Augmented Reality Virtual Dressing Room Using Kinect Sensor
    Adikari, Sasadara B.
    Ganegoda, Naleen C.
    Meegama, Ravinda G. N.
    Wanniarachchi, Indika L.
    [J]. ADVANCES IN HUMAN-COMPUTER INTERACTION, 2020, 2020
  • [36] REAL-TIME DEPTH DIFFUSION FOR 3D SURFACE RECONSTRUCTION
    Varadarajan, Karthik Mahesh
    Vincze, Markus
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 4149 - 4152
  • [37] Real Time 3D Magnetic Field Visualization Based on Augmented Reality
    Liu, Xiaoxu
    Liu, Yue
    Wang, Yongtian
    [J]. 2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2019, : 1052 - 1053
  • [38] PointNet: A 3D Convolutional Neural Network for Real-Time Object Class Recognition
    Garcia-Garcia, A.
    Gomez-Donoso, F.
    Garcia-Rodriguez, J.
    Orts-Escolano, S.
    Cazorla, M.
    Azorin-Lopez, J.
    [J]. 2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 1578 - 1584
  • [39] Real-time 3D human pose recovery from a single depth image using principal direction analysis
    Dong-Luong Dinh
    Lim, Myeong-Jun
    Nguyen Duc Thang
    Lee, Sungyoung
    Kim, Tae-Seong
    [J]. APPLIED INTELLIGENCE, 2014, 41 (02) : 473 - 486
  • [40] Real-time 3D human pose recovery from a single depth image using principal direction analysis
    Dong-Luong Dinh
    Myeong-Jun Lim
    Nguyen Duc Thang
    Sungyoung Lee
    Tae-Seong Kim
    [J]. Applied Intelligence, 2014, 41 : 473 - 486