Sound Source Localization in Reverberant Environment using Visual information

被引:7
|
作者
Lee, Byoung-gi [1 ]
Choi, JongSuk [1 ]
Kim, Daijin [2 ]
Kim, Munsang [3 ]
机构
[1] Korea Inst Sci & Technol, Ctr Cognit Robot Res, Seoul, South Korea
[2] Pohang Univ Sci & Technol, Dept Comp Sci & Engn, Seoul, South Korea
[3] Korea Adv Inst Sci & Technol, Ctr Intelligent Robot, Seoul, South Korea
关键词
TRACKING;
D O I
10.1109/IROS.2010.5650729
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, many researchers have carried out works on audio-video integration. It is worth exploring because service robots are supposed to interact with human beings using both visual and auditory sensors. In this paper, we propose an audio-video method for sound source localization in reverberant environment. Using visual information from a vision camera, we could train our audio localizer to distinguish a real source from fake sources and improved the performance of audio localizer in reverberant environment.
引用
收藏
页码:3542 / 3547
页数:6
相关论文
共 50 条
  • [1] Accurate sound source localization in a reverberant environment using multiple acoustic sensors
    Atmoko, H.
    Tan, D. C.
    Tian, G. Y.
    Fazenda, Bruno
    [J]. MEASUREMENT SCIENCE AND TECHNOLOGY, 2008, 19 (02)
  • [2] REAL TIME HUMANOID SOUND SOURCE LOCALIZATION AND TRACKING IN A HIGHLY REVERBERANT ENVIRONMENT
    Usman, Muhammad
    Keyrouz, Fakheredine
    Diepold, Klaus
    [J]. ICSP: 2008 9TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, VOLS 1-5, PROCEEDINGS, 2008, : 2658 - 2661
  • [3] Real-time source separation based on sound localization in a reverberant environment
    Aoki, M
    Furuya, K
    [J]. NEURAL NETWORKS FOR SIGNAL PROCESSING XII, PROCEEDINGS, 2002, : 475 - 484
  • [4] Sound source localization in reverberant environments using an outlier elimination algorithm
    Jan, EE
    Flanagan, J
    [J]. ICSLP 96 - FOURTH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, PROCEEDINGS, VOLS 1-4, 1996, : 1321 - 1324
  • [5] SOUND SOURCE LOCALIZATION IN A REVERBERANT ROOM USING HARMONIC BASED MUSIC
    Birnie, Lachlan
    Abhayapala, Thushara D.
    Chen, Hanchi
    Samarasinghe, Prasanga N.
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 651 - 655
  • [6] Modeling the precedence effect for sound localization in reverberant environment
    Huang, J
    Ohnishi, N
    Sugie, N
    [J]. JOINT CONFERENCE - 1996: IEEE INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE & IMEKO TECHNICAL COMMITTEE 7, CONFERENCE PROCEEDINGS, VOLS I AND II: QUALITY MEASUREMENTS: THE INDISPENSABLE BRIDGE BETWEEN THEORY AND REALITY (NO MEASUREMENTS? NO SCIENCE!), 1996, : 633 - 636
  • [7] Using sound source localization in a home environment
    Bian, XH
    Abowd, GD
    Rehg, JM
    [J]. PERVASIVE COMPUTING, PROCEEDINGS, 2005, 3468 : 19 - 36
  • [8] Effect of source spectrum on sound localization in an everyday reverberant room
    Ihlefeld, Antje
    Shinn-Cunningham, Barbara G.
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2011, 130 (01): : 324 - 333
  • [9] Acoustic source localization in a reverberant environment by average beamforming
    Castellini, Paolo
    Sassaroli, Andrea
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2010, 24 (03) : 796 - 808
  • [10] A Maximum a Posteriori Sound Source Localization in Reverberant and Noisy Conditions
    Choi, Jinho
    Yoo, Chang D.
    [J]. 11TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2010 (INTERSPEECH 2010), VOLS 3 AND 4, 2010, : 2770 - 2773