UNSUPERVISED MUSICAL TIMBRE TRANSFER FOR NOTIFICATION SOUNDS

被引:2
|
作者
Yang, Jing [1 ]
Cinquin, Tristan [1 ]
Soros, Gabor [2 ]
机构
[1] Swiss Fed Inst Technol, Dept Comp Sci, Zurich, Switzerland
[2] Nokia Bell Labs, Budapest, Hungary
关键词
Audio style transfer; musical timbre transfer; sound notification; human-machine interface;
D O I
10.1109/ICASSP39728.2021.9414760
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
We present a method to transform artificial notification sounds into various musical timbres. To tackle the issues of ambiguous timbre definition, the lack of paired notification-music sample sets, and the lack of sufficient training data of notifications, we adapt the problem for a cycle-consistent generative adversarial network and train it with unpaired samples from the source and the target domains. In addition, instead of training the network with notification sound samples, we train it with video game music samples that share similar timbral features. Through a number of experiments, we discuss the efficacy of the model in transferring the timbre of monophonic and even homophonic notifications while preserving their original melody envelopes. We envision notification timbre transfer as a way of less distracting information delivery, and we demonstrate example music pieces augmented with notifications after timbre transfer.
引用
收藏
页码:3735 / 3739
页数:5
相关论文
共 50 条
  • [1] Fast recognition of musical sounds based on timbre
    Agus, Trevor R.
    Suied, Clara
    Thorpe, Simon J.
    Pressnitzer, Daniel
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2012, 131 (05): : 4124 - 4133
  • [2] Analysis and Modeling of Timbre Perception Features in Musical Sounds
    Jiang, Wei
    Liu, Jingyu
    Zhang, Xiaoyi
    Wang, Shuang
    Jiang, Yujian
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (03):
  • [3] Reviewing the Definition of Timbre as it Pertains to the Perception of Speech and Musical Sounds
    Patterson, Roy D.
    Walters, Thomas C.
    Monaghan, Jessica J. M.
    Gaudrain, Etienne
    [J]. NEUROPHYSIOLOGICAL BASES OF AUDITORY PERCEPTION, 2010, : 223 - 233
  • [4] The Correspondence of Music Emotion and Timbre in Sustained Musical Instrument Sounds
    Wu, Bin
    Horner, Andrew
    Lee, Chung
    [J]. JOURNAL OF THE AUDIO ENGINEERING SOCIETY, 2014, 62 (10): : 663 - 675
  • [5] Dynamic Spectral Envelope Modeling for Timbre Analysis of Musical Instrument Sounds
    Burred, Juan Jose
    Roebel, Axel
    Sikora, Thomas
    [J]. IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2010, 18 (03): : 663 - 674
  • [6] Musical timbre style transfer with diffusion model
    Huang, Hong
    Man, Junfeng
    Li, Luyao
    Zeng, Rongke
    [J]. PEERJ COMPUTER SCIENCE, 2024, 10
  • [7] TOPOGRAPHIC EEG ACTIVATIONS DURING TIMBRE AND PITCH DISCRIMINATION TASKS USING MUSICAL SOUNDS
    AUZOU, P
    EUSTACHE, F
    ETEVENON, P
    PLATEL, H
    RIOUX, P
    LAMBERT, J
    LECHEVALIER, B
    ZARIFIAN, E
    BARON, JC
    [J]. NEUROPSYCHOLOGIA, 1995, 33 (01) : 25 - 37
  • [8] Musical Composition Style Transfer via Disentangled Timbre Representations
    Hung, Yun-Ning
    Chiang, I-Tung
    Chen, Yi-An
    Yang, Yi-Hsuan
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 4697 - 4703
  • [9] AN INVESTIGATION OF MUSICAL TIMBRE
    MALLOCH, SN
    CAMPBELL, AM
    [J]. JOURNAL DE PHYSIQUE IV, 1994, 4 (C5): : 589 - 592
  • [10] On the timbre of chaotic algorithmic sounds
    Sotiropoulos, Dimitrios A.
    Sotiropoulos, Anastasios D.
    Sotiropoulos, Vaggelis D.
    [J]. CHAOS THEORY: MODELING, SIMULATION AND APPLICATIONS, 2011, : 379 - 387