Lightweight Cross-Fusion Network on Human Pose Estimation for Edge Device

被引:1
|
作者
Zhu, Xian [1 ]
Zeng, Xiaoqin [1 ,2 ]
Ma, Wei [3 ,4 ]
机构
[1] Hohai Univ, Coll Comp & Informat, Nanjing 210098, Peoples R China
[2] Nanjing Univ Sci & Technol, Zijin Coll, Dept Comp Sci, Nanjing 210046, Peoples R China
[3] Nanjing Univ, Dept Comp Sci & Technol, State Key Lab Novel Software Technol, Nanjing 210093, Peoples R China
[4] Nanjing Inst Tourism & Hospitality, Nanjing 211100, Peoples R China
关键词
Cross-fusion network; human pose estimation; lightweight;
D O I
10.1109/ACCESS.2021.3065574
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The deployment of human pose estimation on edge devices are essential task in computer vision. Due to memory and storage space limitations, it is difficult for edge devices to maintain implementing Convolutional Neural Networks, which deployed large-scale terminal platforms with abundant computing resources. This paper proposed novel Lightweight Cross-fusion Network on Human Pose Estimation with information sharing. Using state-of-the-art efficient neural architecture, and Ghost Net, as the backbone, which are gradually applying a cross-information fusion network for key points extraction in the baseline and strengthen phases. As a result, the computational cost significantly reduced, while maintaining feature confidence more accurate and predicting key points heatmaps more precisely. The network model entirely executed on edge devices, and extensive self-comparison experiments evaluated the architecture's effectiveness. The MS COCO 2017 dataset proved that the cross-fusion network is superior than other lightweight structures for pose estimation.
引用
收藏
页码:134899 / 134907
页数:9
相关论文
共 50 条
  • [41] Lightweight cattle pose estimation with fusion of reparameterization and an attention mechanism
    Zhao, Enming
    Chen, Bobo
    Zhao, Hongyi
    Liu, Guangyu
    Jiang, Jianbo
    Li, Yanpeng
    Zhang, Jilei
    Luo, Chuang
    [J]. PLOS ONE, 2024, 19 (08):
  • [42] Pairwise Guided Multilayer Cross-Fusion Network for Bird Image Recognition
    Lei, Jingsheng
    Jin, Yao
    Huang, Liya
    Ji, Yuan
    Yang, Shengying
    [J]. ELECTRONICS, 2023, 12 (18)
  • [43] POSTER: A Pyramid Cross-Fusion Transformer Network for Facial Expression Recognition
    Zheng, Ce
    Mendieta, Matias
    Chen, Chen
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 3138 - 3147
  • [44] A Lightweight Two-End Feature Fusion Network for Object 6D Pose Estimation
    Zuo, Ligang
    Xie, Lun
    Pan, Hang
    Wang, Zhiliang
    [J]. MACHINES, 2022, 10 (04)
  • [45] Lightweight human pose estimation: CVC-net
    Xiaofei Qin
    Haiyang Guo
    Changxiang He
    Xuedian Zhang
    [J]. Multimedia Tools and Applications, 2022, 81 : 17615 - 17637
  • [46] Lightweight human pose estimation: CVC-net
    Qin, Xiaofei
    Guo, Haiyang
    He, Changxiang
    Zhang, Xuedian
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (13) : 17615 - 17637
  • [47] PCFN: Progressive Cross-Modal Fusion Network for Human Pose Transfer
    Yu, Wei
    Li, Yanping
    Wang, Rui
    Cao, Wenming
    Xiang, Wei
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (07) : 3369 - 3382
  • [48] LGCANet: lightweight hand pose estimation network based on HRNet
    Pan, Xiaoying
    Li, Shoukun
    Wang, Hao
    Wang, Beibei
    Wang, Haoyi
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (13): : 19351 - 19373
  • [49] A lightweight convolutional neural network for pose estimation of a planar model
    Ocegueda-Hernandez, Vladimir
    Roman-Godinez, Israel
    Mendizabal-Ruiz, Gerardo
    [J]. MACHINE VISION AND APPLICATIONS, 2022, 33 (03)
  • [50] A lightweight convolutional neural network for pose estimation of a planar model
    Vladimir Ocegueda-Hernández
    Israel Román-Godínez
    Gerardo Mendizabal-Ruiz
    [J]. Machine Vision and Applications, 2022, 33