Visualized voices: A case study of audio-visual synesthesia

被引:12
|
作者
Fernay, Louise [1 ]
Reby, David [1 ]
Ward, Jamie [1 ,2 ]
机构
[1] Univ Sussex, Sch Psychol, Brighton BN1 9QH, E Sussex, England
[2] Univ Sussex, Sackler Ctr Consciousness Sci, Brighton BN1 9QH, E Sussex, England
关键词
Synesthesia; Phoneme; Voice; Space; Color; Synaesthesia; SPEEDED CLASSIFICATION; COLOR SYNAESTHESIA; PITCH; PERCEPTION; SIZE;
D O I
10.1080/13554794.2010.547863
中图分类号
R74 [神经病学与精神病学];
学科分类号
摘要
We report a single case study of a synesthete (PS) who has complex visual experiences from sounds, including human voices. Different vowel sounds from different speakers and modified to be of different pitch (f0) were presented to PS and controls who were asked to draw an (abstract) visual image of the sound noting colors, sizes, and locations. PS tended to be more consistent over time than controls. For both PS and controls, the pitch of the vowel influenced the choice of luminance (higher pitch being lighter) and vertical position (higher pitch being higher in space). However, the gender of the speaker influenced the size of the 'image' independently of pitch (vowels from males being larger).
引用
收藏
页码:50 / 56
页数:7
相关论文
共 50 条
  • [1] The research on Digital audio-visual synesthesia
    Zhang, Yu
    Liu, Xiang
    [J]. 10TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION (ICCSE 2015), 2015, : 186 - 189
  • [2] VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices
    Kadandale, Venkatesh S.
    Montesinos, Juan F.
    Haro, Gloria
    [J]. INTERSPEECH 2022, 2022, : 3128 - 3132
  • [3] Research on emotional semantic retrieval of attention mechanism oriented to audio-visual synesthesia
    Wang, Weixing
    Li, Qianqian
    Xie, Jingwen
    Hu, Ningfeng
    Wang, Ziao
    Zhang, Ning
    [J]. NEUROCOMPUTING, 2023, 519 : 194 - 204
  • [4] Lemon's Pitch: An Attempt to Induce Audio-Visual Synesthesia in Live Music Performances
    Giordano, Giulio
    Casais, Mafalda
    [J]. ADVANCES IN DESIGN AND DIGITAL COMMUNICATION II, 2022, 19 : 296 - 311
  • [5] INSTRUCTION WITH AN AUDIO-VISUAL RESPONSE TEACHING MACHINE - CASE STUDY
    FOOTE, BL
    [J]. ENGINEERING EDUCATION, 1971, 62 (01): : 58 - &
  • [6] An audio-visual distance for audio-visual speech vector quantization
    Girin, L
    Foucher, E
    Feng, G
    [J]. 1998 IEEE SECOND WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, 1998, : 523 - 528
  • [7] Catching audio-visual mice:: The extrapolation of audio-visual speed
    Hofbauer, MM
    Wuerger, SM
    Meyer, GF
    Röhrbein, F
    Schill, K
    Zetzsche, C
    [J]. PERCEPTION, 2003, 32 : 96 - 96
  • [8] An audio-visual speech recognition with a new mandarin audio-visual database
    Liao, Wen-Yuan
    Pao, Tsang-Long
    Chen, Yu-Te
    Chang, Tsun-Wei
    [J]. INT CONF ON CYBERNETICS AND INFORMATION TECHNOLOGIES, SYSTEMS AND APPLICATIONS/INT CONF ON COMPUTING, COMMUNICATIONS AND CONTROL TECHNOLOGIES, VOL 1, 2007, : 19 - +
  • [9] "Mickey Mousing" in the Brain: Motion-Sound Synesthesia and the Subcortical Substrate of Audio-Visual Integration
    Laeng, Bruno
    Flaaten, Camilla Barthel
    Walle, Kjersti Maehlum
    Hochkeppler, Anne
    Specht, Karsten
    [J]. FRONTIERS IN HUMAN NEUROSCIENCE, 2021, 15
  • [10] AUDIO-VISUAL EDUCATION
    Brickman, William W.
    [J]. SCHOOL AND SOCIETY, 1948, 67 (1739): : 320 - 326