A dance movement quality evaluation model using transformer encoder and convolutional neural network

被引:0
|
作者
Qu, Jiping [1 ]
机构
[1] East China Univ Technol, Sch Literature Law & Art, Nanchang 330013, Peoples R China
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
TransCNN-DSSS model; Dance movement evaluation; Dynamic flow; Static flow; Transformer; Convolutional neural network; RECOGNITION;
D O I
10.1038/s41598-024-83608-9
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The purpose of this study is to put forward a new evaluation model of dance movement quality to deal with the subjectivity and inconsistency in traditional evaluation methods. In view of the complexity and diversity of dance art and the widespread popularity of dance videos on social media, it is particularly urgent to develop an automatic and efficient tool for evaluating the quality of dance movements. Therefore, this study puts forward the Transformer Convolutional Neural Network with Dynamic and Static Streams (TransCNN-DSSS) model, which combines the analysis of dynamic flow and static flow, and makes use of the advantages of Transformer and Convolutional Neural Network (CNN) to deeply analyze and evaluate the dance movements. The core of the model is Quality Score Decoupling (QSD), which decouples and weights different quality dimensions of dance movements through attention mechanism, such as accuracy, fluency and expressiveness. Score Prediction module (SPM) uses Transformer network to further process the fused features, and outputs the final evaluation score through the full connection layer. In the experimental part, the TransCNN-DSSS model is trained and tested on the marked dance movement dataset. The performance of the model is evaluated by accuracy, recall and F1 score. The results show that the model has achieved 90% accuracy, 89% recall and F1 score of 0.90 in the task of evaluating the quality of dance movements. These results prove the effectiveness and reliability of the model. In addition, the adaptability test of the model in different dance styles also shows good generalization ability. The research contribution of this study is to put forward a new evaluation model of dance movement quality, which provides an objective and automatic evaluation tool for dance teaching, competition scoring and fans.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] Intelligent Quality Inspection of Customer Service Voice Based on Convolutional Neural Network and Transformer
    Li, Xiang-Na
    Xu, Fang
    Li, Xue-Dong
    Ma, Bin
    Pan, Zhen-Xiang
    Kou, Shu-Feng
    Yuan, Zhao-Jun
    Journal of Network Intelligence, 2024, 9 (04): : 2457 - 2470
  • [32] Residual Encoder and Convolutional Decoder Neural Network for Glioma Segmentation
    Pawar, Kamlesh
    Chen, Zhaolin
    Shah, N. Jon
    Egan, Gary
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2017, 2018, 10670 : 263 - 273
  • [33] Evaluation of different convolutional neural network encoder-decoder architectures for breast mass segmentation
    Isosalo, Antti
    Mustonen, Henrik
    Turunen, Topi
    Ipatti, Pieta S.
    Reponen, Jarmo
    Nieminen, Miika T.
    Inkinen, Satu I.
    MEDICAL IMAGING 2022: IMAGING INFORMATICS FOR HEALTHCARE, RESEARCH, AND APPLICATIONS, 2022, 12037
  • [34] Using Hybrid Transformer and Convolutional Neural Network for Malware Detection in Internet of Things
    Guo, Yanhui
    Du, Chunlai
    Mustafaoglu, Zelal
    Sengur, Abdulkadir
    Garg, Harish
    Polat, Kemal
    Koundal, Deepika
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2025,
  • [35] Integration of Convolutional Neural Network and Vision Transformer for gesture recognition using sEMG
    Liu, Xiaoguang
    Hu, Lijian
    Tie, Liang
    Jun, Li
    Wang, Xiaodong
    Liu, Xiuling
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 98
  • [36] Performance evaluation of convolutional neural network and vision transformer models for groundwater potential mapping
    Sadeghi, Behnam
    Alesheikh, Ali Asghar
    Jafari, Ali
    Rezaie, Fatemeh
    JOURNAL OF HYDROLOGY, 2025, 654
  • [37] Transformer Encoder Enhanced by an Adaptive Graph Convolutional Neural Network for Prediction of Aero-Engines' Remaining Useful Life
    Ma, Meng
    Wang, Zhizhen
    Zhong, Zhirong
    AEROSPACE, 2024, 11 (04)
  • [38] STCP: Synergistic Transformer and Convolutional Neural Network for Pansharpening
    Su, Zhao
    Yang, Yong
    Huang, Shuying
    Wan, Weiguo
    Sun, Jiancheng
    Tu, Wei
    Chen, Changjie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [39] Efficient steganalysis using convolutional auto encoder network to ensure original image quality
    Ayaluri, Mallikarjuna Reddy
    Reddy, Sudheer K.
    Konda, Srinivasa Reddy
    Chidirala, Sudharshan Reddy
    PEERJ COMPUTER SCIENCE, 2021, 7 : 1 - 11
  • [40] Audio signal quality enhancement using multi-layered convolutional neural network based auto encoder-decoder
    Raj, Shivangi
    Prakasam, P.
    Gupta, Shubham
    INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY, 2021, 24 (02) : 425 - 437