Multi-Person 3D Pose Estimation in Mobile Edge Computing Devices for Real-Time Applications

被引:2
|
作者
Hossain, Md. Imtiaz [1 ]
Akhter, Sharmen [1 ]
Hossain, Md. Delowar [1 ]
Hong, Choong Seon [1 ]
Huh, Eui-Nam [1 ]
机构
[1] Kyung Hee Univ, Dept Comp Sci & Engn, Yongin, South Korea
基金
新加坡国家研究基金会;
关键词
RRMPs; Lightweight Architecture; Depthwise Separable Convolutions; Pose Inference; 3D Pose Estimations; Mobile Edge Computing; Residual Connection;
D O I
10.1109/ICOIN56518.2023.10049033
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the last few years, real-time 3D pose estimation from RGB monocular images on Mobile Edge Computing devices has drawn immense attraction due to the ability to estimate, infer and transfer 3D motion and pose in VR, AR, gaming, animation and so on. However, estimating motion under occlusion is very challenging. Though a number of effective and efficient approaches have been proposed to deal with this issue, there is still a demand for robust occlusion-aware multi-person 3D pose and motion estimation under occlusion in real-world scenarios. In this paper, we propose a one-shot occlusion-aware real-time 3D pose estimation and inference approach called RRMP. Our proposed RRMP performs both 2D and 3D pose estimation and is composed of three sequential stages: 1) the residual to render a multi-level perspective for each individual people, 2) the initial stage, and 3) the refinement stages. As our goal is to estimate the pose in real-time for mobile edge computing devices, the RRMP is designed using Depthwise Separable Convolutions (DSCs) that perform with an average of 40 fps in real-time execution. Our extensive results and analysis depict that the proposed RRMP improves the performances of the existing state-of-the-art methods. Our RRMP technique can be deployed into any existing state-of-the-art works for further improving the robustness in terms of occlusion.
引用
收藏
页码:673 / 677
页数:5
相关论文
共 50 条
  • [1] Light3DPose: Real-time Multi-Person 3D Pose Estimation from Multiple Views
    Elmi, Alessi
    Mazzini, Davide
    Tortella, Pietro
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2755 - 2762
  • [2] Real-Time Multi-Person Video-Based Pose Estimation
    Yan Fenting
    Wang Peng
    Lu Zhigang
    Ding Zhe
    Qiao Mengyu
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (02)
  • [3] Multi-person 3D Pose Estimation and Tracking in Sports
    Bridgeman, Lewis
    Volino, Marco
    Guillemaut, Jean-Yves
    Hilton, Adrian
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 2487 - 2496
  • [4] Multi-Person 3D Pose Estimation With Occlusion Reasoning
    Chen, Xipeng
    Zhang, Junzheng
    Wang, Keze
    Wei, Pengxu
    Lin, Liang
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 878 - 889
  • [5] AnimePose: Multi-person 3D pose estimation and animation
    Kumarapu, Laxman
    Mukherjee, Prerana
    [J]. PATTERN RECOGNITION LETTERS, 2021, 147 : 16 - 24
  • [6] Real-time multi-camera 3D human pose estimation at the edge for industrial applications
    Boldo, Michele
    De Marchi, Mirco
    Martini, Enrico
    Aldegheri, Stefano
    Quaglia, Davide
    Fummi, Franco
    Bombieri, Nicola
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252
  • [7] Real-time 2D Multi-Person Pose Estimation on CPU: Lightweight OpenPose
    Osokin, Daniil
    [J]. ICPRAM: PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS, 2019, : 744 - 748
  • [8] MobileHumanPose: Toward real-time 3D human pose estimation in mobile devices
    Choi, Sangbum
    Choi, Seokeon
    Kim, Changick
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 2328 - 2338
  • [9] REAL-TIME 3D HAND-OBJECT POSE ESTIMATION FOR MOBILE DEVICES
    Yin, Yue
    McCarthy, Chris
    Rezazadegan, Dana
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3288 - 3292
  • [10] Real-Time Marker-Less Multi-person 3D Pose Estimation in RGB-Depth Camera Networks
    Carraro, Marco
    Munaro, Matteo
    Burke, Jeff
    Menegatti, Emanuele
    [J]. INTELLIGENT AUTONOMOUS SYSTEMS 15, IAS-15, 2019, 867 : 534 - 545