GERRS: Removing Ghost Effects from Real-World Scenarios in 3D Pose estimation via Zero-shot Inference Approach

被引:0
|
作者
Hossain, Md Imtiaz [1 ]
Akhter, Sharmen [1 ]
Mahbub, Md Nosin Lbna [1 ]
Hossain, Md Delowar [1 ]
Yang, Sungjun [2 ]
Huh, Eui-Nam [1 ]
机构
[1] Kyung Hee Univ, Comp Sci & Engn, Yongin, South Korea
[2] SIGONGtech, Seongnam Si, Gyeonggi Do, South Korea
关键词
Pose Estimation; Ghost effect; 3D Pose Estimation; Background Subtraction;
D O I
10.1109/CSCI62032.2023.00192
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the realm of computer vision, 3D pose estimation algorithms have achieved remarkable proficiency in controlled benchmark datasets. However, their performance often falters when confronted with the complexities of real-world monocular video scenarios. One of the most formidable challenges in this context is the presence of intricate and unpredictable backgrounds. These backgrounds, due to their uncertain textures, are frequently misinterpreted as human subjects, giving rise to the persistent and vexing "ghost effect." This phenomenon not only distorts the accuracy of pose estimation but also hinders its applicability in various practical settings. In response to this conundrum, we present GERRS, a plug-in-play and innovative zero-shot technique designed to address the "ghost effect" problem by effectively managing uncertain textures. GERRS integrates four core components: moving human detection, motion detection, background texture pre-processing, and 3D pose estimation. This comprehensive approach has been subjected to rigorous validation, which has conclusively demonstrated its unparalleled efficacy in mitigating the ghost effect. Our method brings a remarkable enhancement to the accuracy of 3D pose estimation in real-world monocular RGB videos, marking a significant stride towards the realization of robust and reliable pose estimation in dynamic and unpredictable environments. The proposed approach can be incorporated with any existing 3D pose estimation approaches to enhance the performance of the pretrained approach. By tackling the "ghost effect" headon, GERRS holds the promise of revolutionizing the field of computer vision, opening doors to more precise and dependable applications in a wide range of domains, from augmented reality to robotics.
引用
收藏
页码:1177 / 1183
页数:7
相关论文
共 3 条
  • [1] Zero-Shot 3D Pose Estimation of Unseen Object by Two-step RGB-D Fusion
    Duan, Guifang
    Cheng, Shuai
    Liu, Zhenyu
    Zheng, Yanglun
    Su, Yunhai
    Tan, Jianrong
    NEUROCOMPUTING, 2024, 597
  • [2] Zero-Shot Autonomous Vehicle Policy Transfer: From Simulation to Real-World via Adversarial Learning
    Chalaki, Behdad
    Beaver, Logan E.
    Remer, Ben
    Jang, Kathy
    Vinitsky, Eugene
    Bayen, Alexandre M.
    Malikopoulos, Andreas A.
    2020 IEEE 16TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION (ICCA), 2020, : 35 - 40
  • [3] FreeMan: Towards Benchmarking 3D Human Pose Estimation under Real-World Conditions
    Wang, Jiong
    Yang, Fengyu
    Li, Bingliang
    Gou, Wenbo
    Yan, Danqi
    Zeng, Ailing
    Gao, Yijun
    Wang, Junle
    Jing, Yanqing
    Zhang, Ruimao
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 21978 - 21988