Multi-Person 3D Pose Estimation in Mobile Edge Computing Devices for Real-Time Applications

被引:1
|
作者
Hossain, Md. Imtiaz [1 ]
Akhter, Sharmen [1 ]
Hossain, Md. Delowar [1 ]
Hong, Choong Seon [1 ]
Huh, Eui-Nam [1 ]
机构
[1] Kyung Hee Univ, Dept Comp Sci & Engn, Yongin, South Korea
基金
新加坡国家研究基金会;
关键词
RRMPs; Lightweight Architecture; Depthwise Separable Convolutions; Pose Inference; 3D Pose Estimations; Mobile Edge Computing; Residual Connection;
D O I
10.1109/ICOIN56518.2023.10049033
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the last few years, real-time 3D pose estimation from RGB monocular images on Mobile Edge Computing devices has drawn immense attraction due to the ability to estimate, infer and transfer 3D motion and pose in VR, AR, gaming, animation and so on. However, estimating motion under occlusion is very challenging. Though a number of effective and efficient approaches have been proposed to deal with this issue, there is still a demand for robust occlusion-aware multi-person 3D pose and motion estimation under occlusion in real-world scenarios. In this paper, we propose a one-shot occlusion-aware real-time 3D pose estimation and inference approach called RRMP. Our proposed RRMP performs both 2D and 3D pose estimation and is composed of three sequential stages: 1) the residual to render a multi-level perspective for each individual people, 2) the initial stage, and 3) the refinement stages. As our goal is to estimate the pose in real-time for mobile edge computing devices, the RRMP is designed using Depthwise Separable Convolutions (DSCs) that perform with an average of 40 fps in real-time execution. Our extensive results and analysis depict that the proposed RRMP improves the performances of the existing state-of-the-art methods. Our RRMP technique can be deployed into any existing state-of-the-art works for further improving the robustness in terms of occlusion.
引用
收藏
页码:673 / 677
页数:5
相关论文
共 50 条
  • [31] Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimation
    Liu, Qihao
    Zhang, Yi
    Bai, Song
    Yuille, Alan
    [J]. COMPUTER VISION - ECCV 2022, PT V, 2022, 13665 : 497 - 517
  • [32] End-to-End Feature Pyramid Network for Real-Time Multi-Person Pose Estimation
    Luo, Dingli
    Du, Songlin
    Ikenaga, Takeshi
    [J]. PROCEEDINGS OF MVA 2019 16TH INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS (MVA), 2019,
  • [33] AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time
    Fang, Hao-Shu
    Li, Jiefeng
    Tang, Hongyang
    Xu, Chao
    Zhu, Haoyi
    Xiu, Yuliang
    Li, Yong-Lu
    Lu, Cewu
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (06) : 7157 - 7173
  • [34] Real-Time Multi-Person Pose Tracking using Data Assimilation
    Buizza, Caterina
    Fischer, Tobias
    Demiris, Yiannis
    [J]. 2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 438 - 447
  • [35] RF-based Multi-view Pose Machine for Multi-Person 3D Pose Estimation
    Xie, Chunyang
    Zhang, Dongheng
    Wu, Zhi
    Yu, Cong
    Hu, Yang
    Sun, Qibin
    Chen, Yan
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2669 - 2674
  • [36] Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo
    Lin, Jiahao
    Lee, Gim Hee
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 11881 - 11890
  • [37] VTP: volumetric transformer for multi-view multi-person 3D pose estimation
    Yuxing Chen
    Renshu Gu
    Ouhan Huang
    Gangyong Jia
    [J]. Applied Intelligence, 2023, 53 : 26568 - 26579
  • [38] MVPose: Realtime Multi-Person Pose Estimation Using Motion Vector on Mobile Devices
    Zhang, Jinrui
    Zhang, Deyu
    Yang, Huan
    Liu, Yunxin
    Ren, Ju
    Xu, Xiaohui
    Jia, Fucheng
    Zhang, Yaoxue
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (06) : 3508 - 3524
  • [39] VTP: volumetric transformer for multi-view multi-person 3D pose estimation
    Chen, Yuxing
    Gu, Renshu
    Huang, Ouhan
    Jia, Gangyong
    [J]. APPLIED INTELLIGENCE, 2023, 53 (22) : 26568 - 26579
  • [40] RPM 2.0: RF-Based Pose Machines for Multi-Person 3D Pose Estimation
    Xie, Chunyang
    Zhang, Dongheng
    Wu, Zhi
    Yu, Cong
    Hu, Yang
    Chen, Yan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (01) : 490 - 503