A new intonation quality evaluation method based on self-supervised learning

被引:0
|
作者
Wang, Wei [1 ,2 ]
Zhang, Ning [2 ]
Peng, Weishi [3 ]
Liu, Zhengqi [4 ]
机构
[1] Xi An Jiao Tong Univ, Sch Humanities & Social Sci, Xian, Peoples R China
[2] Xian Conservatory Mus, Int Collaborat Innovat Ctr Mus Intelligence, Xian, Peoples R China
[3] People Armed Police Engn Univ, Sch Equipment Management & Support, Xian, Shaanxi, Peoples R China
[4] Northwest Univ, Sch Informat Sci & Technol, Xian, Shaanxi, Peoples R China
关键词
Music practice; intonation evaluation; self-supervised learning; deep neural network; audio feature extraction;
D O I
10.3233/JIFS-230165
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Intonation evaluation is an important precondition that offers guidance to music practices. This paper present a new intonation quality evaluation method based on self-supervised learning to solve the fuzzy evaluation problem at the critical intonations. Firstly, the effective features of audios are automatically extracted by a self-supervised learning-based deep neural network. Secondly, the intonation evaluation of the single tones and pitch intervals are carried out by combining with the key local features of the audios. Finally, the intonation evaluation method characterized by physical calculations, which simulates and enhances the manual assessment. Experimental results show that the proposed method achieved the accuracy of 93.38%, which is the average value of multiple experimental results obtained by randomly assigning audio data, which is much higher than that of the frequency-based intonation evaluation method(37.5%). In addition, this method has been applied in music teaching for the first time and delivers visual evaluation results.
引用
收藏
页码:989 / 1000
页数:12
相关论文
共 50 条
  • [1] A New Self-supervised Method for Supervised Learning
    Yang, Yuhang
    Ding, Zilin
    Cheng, Xuan
    Wang, Xiaomin
    Liu, Ming
    [J]. INTERNATIONAL CONFERENCE ON COMPUTER VISION, APPLICATION, AND DESIGN (CVAD 2021), 2021, 12155
  • [2] A New Deep Learning Method with Self-Supervised Learning for Delineation of the Electrocardiogram
    Wu, Wenwen
    Huang, Yanqi
    Wu, Xiaomei
    [J]. ENTROPY, 2022, 24 (12)
  • [3] No Reference Image Quality Assessment Based on Self-supervised Learning
    Wei, Zhen
    Deng, Wanyu
    Li, Qirui
    Xu, Huijiao
    [J]. ADVANCES IN NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, ICNC-FSKD 2022, 2023, 153 : 849 - 858
  • [4] Online Evaluation Method of CVT Internal Insulation Abnormality Based on Self-Supervised Learning
    He, Jun
    Zhou, Zhihao
    Tong, Chao
    Li, Fan
    Rao, Fangxi
    Xu, Qiu
    [J]. ENERGIES, 2023, 16 (12)
  • [5] An Evaluation of Self-supervised Learning for Portfolio Diversification
    Yang, Yongxin
    Hospedales, Timothy M.
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT III, 2023, 14256 : 283 - 294
  • [6] Image quality assessment based on self-supervised learning and knowledge distillation
    Sang, Qingbing
    Shu, Ziru
    Liu, Lixiong
    Hu, Cong
    Wu, Qin
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 90
  • [7] Clustering and Retraining Based Self-Supervised Speech Representation Learning Method
    Zhang, Wenlin
    Liu, Xuepeng
    Niu, Tong
    Yang, Xukui
    Qu, Dan
    [J]. Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2022, 35 (05): : 461 - 471
  • [8] An Emotion Recognition Method Based On Feature Fusion and Self-Supervised Learning
    Cao, Xuanmeng
    Sun, Ming
    [J]. 2023 2ND ASIA CONFERENCE ON ALGORITHMS, COMPUTING AND MACHINE LEARNING, CACML 2023, 2023, : 216 - 221
  • [9] A Method of Analysis on Consumer Behavior Characteristics Based on Self-supervised Learning
    Liu, Bin
    Guo, Wei
    Lu, Xudong
    Xu, Meng
    Cui, Lizhen
    [J]. COMPUTER SUPPORTED COOPERATIVE WORK AND SOCIAL COMPUTING, CHINESECSCW 2019, 2019, 1042 : 605 - 617
  • [10] Self-Supervised Representation Learning for Video Quality Assessment
    Jiang, Shaojie
    Sang, Qingbing
    Hu, Zongyao
    Liu, Lixiong
    [J]. IEEE TRANSACTIONS ON BROADCASTING, 2023, 69 (01) : 118 - 129