Improving Semi-supervised Deep Neural Network. for Keyword Search in Low Resource Languages

被引：0
|
作者：
Hsiao, Roger [1 ]
Ng, Tim [1 ]
Le Zhang [1 ]
Ranjan, Shivesh [1 ]
机构：
[1] Raytheon BBN Technol, 10 Moulton St, Cambridge, MA 02138 USA
来源：
15TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2014), VOLS 1-4 | 2014年
关键词：
semi-supervised training; deep neural network; keyword search;
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
In this work, we investigate how to improve semi-supervised DNN for low resource languages where the initial systems may have high error rate. We propose using semi-supervised MLP features for DNN training, and we also explore using confidence to improve semi-supervised cross entropy and sequence training. The work conducted in this paper was evaluated under the IARPA Babel program for the keyword spotting tasks. We focus on the limited condition where there are around 10 hours of supervised data for training.
引用
收藏
页码：1088 / 1091
页数：4
相关论文
共 50 条
  • [1] DISCRIMINATIVE SEMI-SUPERVISED TRAINING FOR KEYWORD SEARCH IN LOW RESOURCE LANGUAGES
    Hsiao, Roger
    Ng, Tim
    Grezl, Frantisek
    Karakos, Damianos
    Tsakalidis, Stavros
    Long Nguyen
    Schwartz, Richard
    2013 IEEE WORKSHOP ON AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING (ASRU), 2013, : 440 - 445
  • [2] Semi-Supervised Methods for Improving Keyword Search of Unseen Terms
    Novotney, Scott
    Bulyko, Ivan
    Schwartz, Rich
    Khudanpur, Sanjeev
    Kimball, Owen
    13TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2012 (INTERSPEECH 2012), VOLS 1-3, 2012, : 1214 - 1217
  • [3] DEEP NEURAL NETWORK FEATURES AND SEMI-SUPERVISED TRAINING FOR LOW RESOURCE SPEECH RECOGNITION
    Thomas, Samuel
    Seltzer, Michael L.
    Church, Kenneth
    Hermansky, Hynek
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 6704 - 6708
  • [4] Semi-supervised topic classification for low resource languages
    Liu, Daben
    McVeety, Sam
    Prasad, Rohit
    Natarajan, Prem
    2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, : 5093 - 5096
  • [5] Rapid Update of Multilingual Deep Neural Network for Low-Resource Keyword Search
    Ni, Chongjia
    Wang, Lei
    Leung, Cheung-Chi
    Rao, Feng
    Lug, Li
    Ma, Bin
    Li, Haizhou
    17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, : 3698 - 3702
  • [6] Semi-Supervised Neural Architecture Search
    Luo, Renqian
    Tan, Xu
    Wang, Rui
    Qin, Tao
    Chen, Enhong
    Liu, Tie-Yan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [7] Decoupled Deep Neural Network for Semi-supervised Semantic Segmentation
    Hong, Seunghoon
    Noh, Hyeonwoo
    Han, Bohyung
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [8] Improving Speech Recognition and Keyword Search for Low Resource Languages Using Web Data
    Mendels, Gideon
    Cooper, Erica
    Soto, Victor
    Hirschberg, Julia
    Gales, Mark
    Knill, Kate
    Ragni, Anton
    Wang, Haipeng
    16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5, 2015, : 829 - 833
  • [9] Multi-softmax Deep Neural Network for Semi-supervised Training
    Su, Hang
    Xu, Haihua
    16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5, 2015, : 3239 - 3243
  • [10] SEMI-SUPERVISED TERM-WEIGHTED VALUE RESCORING FOR KEYWORD SEARCH
    Audhkhasi, Kartik
    Sethy, Abhinav
    Ramabhadran, Bhuvana
    Narayanan, Shrikanth S.
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
12345