Automatic Label Calibration for Singing Annotation Using Fully Convolutional Neural Network

被引:4
|
作者
Fu, Xiao [1 ]
Deng, Hangyu [1 ]
Hu, Jinglu [1 ]
机构
[1] Waseda Univ, Grad Sch Informat & Prod & Syst, 2-7 Hibikino, Kitakyushu, Fukuoka 8080135, Japan
关键词
music information retrieval; label calibration; singing annotation; convolutional neural network; TRANSCRIPTION; GAME; GO;
D O I
10.1002/tee.23804
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Accurately-labeled data is crucial for the training of machine learning models. For singing-related tasks in the music information retrieval field, accurately-labeled data is limited because annotating singing is time-consuming. Several studies create vocal datasets using a two-step annotation method which creates coarse labels first and then executes a manual calibration procedure. However, manually calibrating coarsely-labeled singing data is expensive and time-consuming. To address this problem, in this study we propose a singing-label calibration framework, which aims to automatically calibrate the coarsely-labeled singing data with higher accuracy. This framework contains a data augmentation method to generate training and testing data, a reasonable data preprocessing method to handle music audio and symbolic labels, a fully-convolutional neural network to estimate the difference between coarse labels and accurate labels, and a novel calibration function to correct the coarse labels. Various experiments are conducted to examine the effect of our research. The results show that our model can highly reduce the cost time and slightly increase the labeling accuracy of the manual calibration process. (C) 2023 Institute of Electrical Engineers of Japan. Published by Wiley Periodicals LLC.
引用
收藏
页码:945 / 952
页数:8
相关论文
共 50 条
  • [1] A Framework With a Fully Convolutional Neural Network for Semi-Automatic Colon Polyp Annotation
    Qadir, Hemin Ali
    Solhusvik, Johannes
    Bergsland, Jacob
    Aabakken, Lars
    Balasingham, Ilangko
    IEEE ACCESS, 2019, 7 : 169537 - 169547
  • [2] AUTOMATIC MUSCLE PERIMYSIUM ANNOTATION USING DEEP CONVOLUTIONAL NEURAL NETWORK
    Sapkota, Manish
    Xing, Fuyong
    Su, Hai
    Yang, Lin
    2015 IEEE 12TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2015, : 205 - 208
  • [3] Fully Automated Multi-label Image Annotation by Convolutional Neural Network and Adaptive Thresholding
    Le, Hoa M.
    Thi-Oanh Nguyen
    Dung Ngo-Tien
    PROCEEDINGS OF THE SEVENTH SYMPOSIUM ON INFORMATION AND COMMUNICATION TECHNOLOGY (SOICT 2016), 2016, : 323 - 330
  • [4] Automatic Annotation Algorithm of Medical Radiological Images using Convolutional Neural Network
    Li, Xiaofeng
    Wang, Yanwei
    Cai, Yingjie
    Wang, Yanwei (xianxinyue@163.com), 1600, Elsevier B.V. (152): : 158 - 165
  • [5] Automatic Annotation Algorithm of Medical Radiological Images using Convolutional Neural Network
    Li, Xiaofeng
    Wang, Yanwei
    Cai, Yingjie
    PATTERN RECOGNITION LETTERS, 2021, 152 : 158 - 165
  • [6] Prediction of Uncertainty Estimation and Confidence Calibration Using Fully Convolutional Neural Network
    Gasmi, Karim
    Ben Ammar, Lassaad
    Elshammari, Hmoud
    Yahya, Fadwa
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (02): : 2557 - 2573
  • [7] Fully Automatic Atrial Fibrosis Assessment Using a Multilabel Convolutional Neural Network
    Razeghi, Orod
    Sim, Iain
    Roney, Caroline H.
    Karim, Rashed
    Chubb, Henry
    Whitaker, John
    O'Neill, Louisa
    Mukherjee, Rahul
    Wright, Matthew
    O'Neill, Mark
    Williams, Steven E.
    Niederer, Steven
    CIRCULATION-CARDIOVASCULAR IMAGING, 2020, 13 (12) : E011512
  • [8] Deep Convolutional Neural Network with KNN Regression for Automatic Image Annotation
    Bensaci, Ramla
    Khaldi, Belal
    Aiadi, Oussama
    Benchabana, Ayoub
    APPLIED SCIENCES-BASEL, 2021, 11 (21):
  • [9] Fully automatic image colorization based on Convolutional Neural Network
    Varga, Domonkos
    Sziranyi, Tamas
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 3691 - 3696
  • [10] Large scale automatic image annotation based on convolutional neural network
    Wang, Ronggui
    Xie, Yunfei
    Yang, Juan
    Xue, Lixia
    Hu, Min
    Zhang, Qingyang
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 49 : 213 - 224