Attention! A Lightweight 2D Hand Pose Estimation Approach

被引:40
|
作者
Santavas, Nicholas [1 ]
Kansizoglou, Ioannis [1 ]
Bampis, Loukas [1 ]
Karakasis, Evangelos [1 ]
Gasteratos, Antonios [1 ]
机构
[1] Democritus Univ Thrace, Lab Robot & Automat, Dept Prod & Management Engn, Xanthi 67100, Greece
关键词
Pose estimation; Computer architecture; Feature extraction; Two dimensional displays; Sensors; Convolution; Task analysis; 2D hand pose estimation; holistic regression; self-attention; human pose estimation;
D O I
10.1109/JSEN.2020.3018172
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vision based human pose estimation is an non-invasive technology for Human-Computer Interaction (HCI). The direct use of the hand as an input device provides an attractive interaction method, with no need for specialized sensing equipment, such as exoskeletons, gloves etc, but a camera. Traditionally, HCI is employed in various applications spreading in areas including manufacturing, surgery, entertainment industry and architecture, to mention a few. Deployment of vision based human pose estimation algorithms can give a breath of innovation to these applications. In this article, we present a novel Convolutional Neural Network architecture, reinforced with a Self-Attention module. Our proposed model can be deployed on an embedded system due to its lightweight nature with just 1.9 Million parameters. The source code and qualitative results are publicly available.
引用
收藏
页码:11488 / 11496
页数:9
相关论文
共 50 条
  • [1] A lightweight 2D Pose Machine with attention enhancement
    Schirmer, Luiz
    Lucio, Djalma
    Raposo, Alberto
    Velho, Luiz
    Lopes, Helio
    [J]. 2020 33RD SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2020), 2020, : 324 - 331
  • [2] Lightweight 2D Human Pose Estimation Based on Joint Channel Coordinate Attention Mechanism
    Li, Zuhe
    Xue, Mengze
    Cui, Yuhao
    Liu, Boyi
    Fu, Ruochong
    Chen, Haoran
    Ju, Fujiao
    [J]. ELECTRONICS, 2024, 13 (01)
  • [3] Optimized convolutional pose machine for 2D hand pose estimation
    Pan, Tianhong
    Wang, Zheng
    Fan, Yuan
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 83
  • [4] Lightweight 2D Human Pose Estimation for Fitness Coaching System
    Jeon, Hobeom
    Yoon, Youngwoo
    Kim, Dohyung
    [J]. 2021 36TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC), 2021,
  • [5] 3D Hand Shape and Pose Estimation based on 2D Hand Keypoints
    Drosakis, Drosakis
    Argyros, Antonis
    [J]. PROCEEDINGS OF THE 16TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2023, 2023, : 148 - 153
  • [6] Nonparametric Structure Regularization Machine for 2D Hand Pose Estimation
    Chen, Yifei
    Ma, Haoyu
    Kong, Deying
    Yan, Xiangyi
    Wu, Jianbao
    Fan, Wei
    Xie, Xiaohui
    [J]. 2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 370 - 379
  • [7] Efficient 2D Keypoint-based Hand Pose Estimation
    Hsiao, Shan-Chien
    Chiu, Ching-Te
    [J]. 2021 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI 2021), 2021, : 1648 - 1652
  • [8] Knowledge Distillation for Lightweight 2D Single-Person Pose Estimation
    Zhang, Shihao
    Qiang, Baohua
    Yang, Xianyi
    Zhou, Mingliang
    Chen, Ruidong
    [J]. JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2023, 32 (03)
  • [9] SDFPoseGraphNet: Spatial Deep Feature Pose Graph Network for 2D Hand Pose Estimation
    Salman, Sartaj Ahmed
    Zakir, Ali
    Takahashi, Hiroki
    [J]. SENSORS, 2023, 23 (22)
  • [10] An enhanced self-attention and A2J approach for 3D hand pose estimation
    Mei-Ying Ng
    Chin-Boon Chng
    Wai-Kin Koh
    Chee-Kong Chui
    Matthew Chin-Heng Chua
    [J]. Multimedia Tools and Applications, 2022, 81 : 41661 - 41676