Sound Texture Perception via Statistics of the Auditory Periphery: Evidence from Sound Synthesis

被引:231
|
作者
McDermott, Josh H. [1 ,2 ]
Simoncelli, Eero P. [1 ,2 ,3 ]
机构
[1] NYU, Howard Hughes Med Inst, New York, NY 10003 USA
[2] NYU, Ctr Neural Sci, New York, NY 10003 USA
[3] NYU, Courant Inst Math Sci, New York, NY 10003 USA
关键词
COCKTAIL PARTY; AMPLITUDE-MODULATION; RECEPTIVE-FIELDS; DISCRIMINATION; SPEECH; MECHANISMS; FREQUENCY; RESPONSES; MASKING; CONTEXT;
D O I
10.1016/j.neuron.2011.06.032
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Rainstorms, insect swarms, and galloping horses produce "sound textures"-the collective result of many similar acoustic events. Sound textures are distinguished by temporal homogeneity, suggesting they could be recognized with time-averaged statistics. To test this hypothesis, we processed real-world textures with an auditory model containing filters tuned for sound frequencies and their modulations, and measured statistics of the resulting decomposition. We then assessed the realism and recognizability of novel sounds synthesized to have matching statistics. Statistics of individual frequency channels, capturing spectral power and sparsity, generally failed to produce compelling synthetic textures; however, combining them with correlations between channels produced identifiable and natural-sounding textures. Synthesis quality declined if statistics were computed from biologically implausible auditory models. The results suggest that sound texture perception is mediated by relatively simple statistics of early auditory representations, presumably computed by downstream neural populations. The synthesis methodology offers a powerful tool for their further investigation.
引用
收藏
页码:926 / 940
页数:15
相关论文
共 50 条
  • [41] Auditory perception is influenced by the orientation of the trunk relative to a sound source
    Chiara Occhigrossi
    Michael Brosch
    Giorgia Giommetti
    Roberto Panichi
    Giampietro Ricci
    Aldo Ferraresi
    Mauro Roscini
    Vito Enrico Pettorossi
    Mario Faralli
    Experimental Brain Research, 2021, 239 : 1223 - 1234
  • [42] AUDITORY-PERCEPTION AND FETAL REACTION TO REACT TO SOUND STIMULATION
    QUERLEU, D
    RENARD, X
    CREPIN, G
    JOURNAL DE GYNECOLOGIE OBSTETRIQUE ET BIOLOGIE DE LA REPRODUCTION, 1981, 10 (04): : 307 - 314
  • [43] AUDITORY DISTANCE PERCEPTION AND PROBLEM OF IN HEAD LOCALIZATION OF SOUND IMAGES
    LAWS, P
    ACUSTICA, 1973, 29 (05): : 243 - 259
  • [44] Psychological Aspects of Auditory Range Perception in Rotational Sound Motion
    Niu, Huan
    Xie, Lingyun
    PSYCHOLOGICAL REPORTS, 2024, 127 : 214 - 215
  • [45] Auditory reachability: An affordance approach to the perception of sound source distance
    Rosenblum, LD
    Wuestefeld, AP
    Anderson, KL
    ECOLOGICAL PSYCHOLOGY, 1996, 8 (01) : 1 - 24
  • [46] Sound mass, auditory perception, and 'post-tone' music
    Noble, Jason
    McAdams, Stephen
    JOURNAL OF NEW MUSIC RESEARCH, 2020, 49 (03) : 231 - 251
  • [47] Role of mammalian auditory cortex in the perception of elementary sound properties
    Talwar, SK
    Musial, PG
    Gerstein, GL
    JOURNAL OF NEUROPHYSIOLOGY, 2001, 85 (06) : 2350 - 2358
  • [48] Categories of Auditory Perception and Non-Speech Sound at the Interface
    Chardin, Ivan
    2008 CONFERENCE ON HUMAN SYSTEM INTERACTIONS, VOLS 1 AND 2, 2008, : 621 - 626
  • [49] An Auditory Phantom Percept That Does Not Impair External Sound Perception
    Clayton, Kameron K.
    Koops, Elouise A.
    JOURNAL OF NEUROSCIENCE, 2021, 41 (08): : 1622 - 1624
  • [50] Auditory cortex ensembles jointly encode sound and locomotion speed to support sound perception during movement
    Vivaldo, Carlos Arturo
    Lee, Joonyeup
    Shorkey, Maryclaire
    Keerthy, Ajay
    Rothschild, Gideon
    PLOS BIOLOGY, 2023, 21 (08)