Lightweight Cross-Fusion Network on Human Pose Estimation for Edge Device

被引:1
|
作者
Zhu, Xian [1 ]
Zeng, Xiaoqin [1 ,2 ]
Ma, Wei [3 ,4 ]
机构
[1] Hohai Univ, Coll Comp & Informat, Nanjing 210098, Peoples R China
[2] Nanjing Univ Sci & Technol, Zijin Coll, Dept Comp Sci, Nanjing 210046, Peoples R China
[3] Nanjing Univ, Dept Comp Sci & Technol, State Key Lab Novel Software Technol, Nanjing 210093, Peoples R China
[4] Nanjing Inst Tourism & Hospitality, Nanjing 211100, Peoples R China
关键词
Cross-fusion network; human pose estimation; lightweight;
D O I
10.1109/ACCESS.2021.3065574
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The deployment of human pose estimation on edge devices are essential task in computer vision. Due to memory and storage space limitations, it is difficult for edge devices to maintain implementing Convolutional Neural Networks, which deployed large-scale terminal platforms with abundant computing resources. This paper proposed novel Lightweight Cross-fusion Network on Human Pose Estimation with information sharing. Using state-of-the-art efficient neural architecture, and Ghost Net, as the backbone, which are gradually applying a cross-information fusion network for key points extraction in the baseline and strengthen phases. As a result, the computational cost significantly reduced, while maintaining feature confidence more accurate and predicting key points heatmaps more precisely. The network model entirely executed on edge devices, and extensive self-comparison experiments evaluated the architecture's effectiveness. The MS COCO 2017 dataset proved that the cross-fusion network is superior than other lightweight structures for pose estimation.
引用
收藏
页码:134899 / 134907
页数:9
相关论文
共 50 条
  • [31] HYPERSPECTRAL IMAGE DENOISING BASED ON PARALLEL CROSS-FUSION NETWORK
    Gong, Zhuoran
    Gao, Feng
    Dong, Junyu
    Qi, Lin
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1528 - 1531
  • [32] Cross View Fusion for 3D Human Pose Estimation
    Qiu, Haibo
    Wang, Chunyu
    Wang, Jingdong
    Wang, Naiyan
    Zeng, Wenjun
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 4341 - 4350
  • [33] Human pose estimation based on cross-view feature fusion
    Sun, Dandan
    Wang, Siqi
    Xia, Hailun
    Zhang, Changan
    Gao, Jianlong
    Mao, Mingyu
    [J]. VISUAL COMPUTER, 2024, 40 (09): : 6581 - 6597
  • [34] Improved lightweight human pose estimation algorithm
    Wang Ming-he
    Xu Wang-ming
    Jiang Hao-kun
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2023, 38 (07) : 955 - 963
  • [35] Human pose estimation based on lightweight basicblock
    Yanping Li
    Ruyi Liu
    Xiangyang Wang
    Rui Wang
    [J]. Machine Vision and Applications, 2023, 34
  • [36] Lightweight Human Pose Estimation with Attention Mechanism
    Chu Xiaoshuai
    Ji Ruirui
    Dong Danyang
    Xi Yuzhuo
    [J]. FOURTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING, ICGIP 2022, 2022, 12705
  • [37] Human pose estimation based on lightweight basicblock
    Li, Yanping
    Liu, Ruyi
    Wang, Xiangyang
    Wang, Rui
    [J]. MACHINE VISION AND APPLICATIONS, 2023, 34 (01)
  • [38] Lightweight Full-Flow Bidirectional Fusion Network for 6D Pose Estimation
    Lin, Haotian
    Li, Yongchang
    Jiang, Jing
    Qin, Guangjun
    [J]. Computer Engineering and Applications, 2024, 60 (22) : 282 - 291
  • [39] Lightweight Image Super-resolution Reconstruction Based on Cross-fusion of Spatial Features
    Zhao, Xiaoqiang
    Cheng, Wei
    [J]. Binggong Xuebao/Acta Armamentarii, 2024, 45 (04): : 1273 - 1284
  • [40] SLBNet: Shallow and Lightweight Bilateral Network for Pose Estimation
    Zhou, Maolin
    Sun, Wanhu
    Yang, Fan
    Zhang, Sheng
    [J]. 2021 14TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2021), 2021,