Visualized voices: A case study of audio-visual synesthesia

被引:12
|
作者
Fernay, Louise [1 ]
Reby, David [1 ]
Ward, Jamie [1 ,2 ]
机构
[1] Univ Sussex, Sch Psychol, Brighton BN1 9QH, E Sussex, England
[2] Univ Sussex, Sackler Ctr Consciousness Sci, Brighton BN1 9QH, E Sussex, England
关键词
Synesthesia; Phoneme; Voice; Space; Color; Synaesthesia; SPEEDED CLASSIFICATION; COLOR SYNAESTHESIA; PITCH; PERCEPTION; SIZE;
D O I
10.1080/13554794.2010.547863
中图分类号
R74 [神经病学与精神病学];
学科分类号
摘要
We report a single case study of a synesthete (PS) who has complex visual experiences from sounds, including human voices. Different vowel sounds from different speakers and modified to be of different pitch (f0) were presented to PS and controls who were asked to draw an (abstract) visual image of the sound noting colors, sizes, and locations. PS tended to be more consistent over time than controls. For both PS and controls, the pitch of the vowel influenced the choice of luminance (higher pitch being lighter) and vertical position (higher pitch being higher in space). However, the gender of the speaker influenced the size of the 'image' independently of pitch (vowels from males being larger).
引用
收藏
页码:50 / 56
页数:7
相关论文
共 50 条
  • [31] A Case of Catathrenia Captured on Polysomnography with Audio-Visual Recording
    Devarajan, Anusha
    Roderick, Miranda R.
    Miller, Bernie W.
    Ruoff, Chad M.
    [J]. AMERICAN JOURNAL OF RESPIRATORY AND CRITICAL CARE MEDICINE, 2022, 206 (10) : 1281 - 1283
  • [32] Measuring the visual in audio-visual input
    Pujadas, Georgia
    Munoz, Carmen
    [J]. ITL-INTERNATIONAL JOURNAL OF APPLIED LINGUISTICS, 2023, 174 (02) : 263 - 290
  • [33] A Robust Audio-visual Speech Recognition Using Audio-visual Voice Activity Detection
    Tamura, Satoshi
    Ishikawa, Masato
    Hashiba, Takashi
    Takeuchi, Shin'ichi
    Hayamizu, Satoru
    [J]. 11TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2010 (INTERSPEECH 2010), VOLS 3 AND 4, 2010, : 2702 - +
  • [34] Audio-visual speech enhancement with AVCDCN (audio-visual codebook dependent cepstral normalization)
    Deligne, S
    Potamianos, G
    Neti, C
    [J]. SAM2002: IEEE SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP PROCEEDINGS, 2002, : 68 - 71
  • [35] Audio-visual speech experience with age influences perceived audio-visual asynchrony in speech
    Alm, Magnus
    Behne, Dawn
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2013, 134 (04): : 3001 - 3010
  • [36] Audio-visual spatial alignment improves integration in the presence of a competing audio-visual stimulus
    Fleming, Justin T.
    Noyce, Abigail L.
    Shinn-Cunningham, Barbara G.
    [J]. NEUROPSYCHOLOGIA, 2020, 146
  • [37] A JOINT AUDIO-VISUAL APPROACH TO AUDIO LOCALIZATION
    Jensen, Jesper Rindom
    Christensen, Mads Graesboll
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 454 - 458
  • [38] EXPERIMENT IN AUDIO AND AUDIO-VISUAL GROUP THERAPY
    GORDON, MT
    [J]. BRITISH JOURNAL OF DISORDERS OF COMMUNICATION, 1969, 4 (01): : 83 - 88
  • [39] Audio-Visual Person Authentication with Multiple Visualized-Speech Features and Multiple Face Profiles
    Das, Amitava
    Manyam, Ohil K.
    Tapaswi, Makarand
    [J]. SIXTH INDIAN CONFERENCE ON COMPUTER VISION, GRAPHICS & IMAGE PROCESSING ICVGIP 2008, 2008, : 39 - 46
  • [40] Spatial alignment between faces and voices improves selective attention to audio-visual speech
    Fleming, Justin T.
    Maddox, Ross K.
    Shinn-Cunningham, Barbara G.
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2021, 150 (04): : 3085 - 3100