A Geometric Perspective of Large-Margin Training of Gaussian Models

被引:10
|
作者
Xiao, Lin [1 ]
Deng, Li [2 ]
机构
[1] Microsoft Res, Machine Learning Grp, Redmond, WA USA
[2] Microsoft Res, Speech Technol Grp, Redmond, WA USA
关键词
Ellipsoids; Training; Hidden Markov models; Optimization; Support vector machines; Covariance matrix; Error analysis; SPEECH RECOGNITION;
D O I
10.1109/MSP.2010.938085
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Large-margin techniques have been studied intensively by the machine learning community to balance the empirical error rate on the training set and the generalization ability on the test set. However, they have been mostly developed together with generic discriminative models such as support vector machines (SVMs) and are often difficult to apply in parameter estimation problems for generative models such as Gaussians and hidden Markov models. The difficulties lie in both the formulation of the training criteria and the development of efficient optimization algorithms. © 2010 IEEE.
引用
收藏
页码:118 / 123
页数:6
相关论文
共 50 条
  • [31] Scalable Large-Margin Structured Learning: Theory and Algorithms
    Huang, Liang
    Zhao, Kai
    [J]. 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2015), 2015, : 19 - 20
  • [32] Large-Margin Softmax Loss for Convolutional Neural Networks
    Liu, Weiyang
    Wen, Yandong
    Yu, Zhiding
    Yang, Meng
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [33] Large-Margin Metric Learning for Constrained Partitioning Problems
    Lajugie, Remi
    Arlot, Sylvain
    Bach, Francis
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 32 (CYCLE 1), 2014, 32
  • [34] Efficient Private Algorithms for Learning Large-Margin Halfspaces
    Huy Le Nguyen
    Ullman, Jonathan
    Zakynthinou, Lydia
    [J]. ALGORITHMIC LEARNING THEORY, VOL 117, 2020, 117 : 704 - 724
  • [35] Large Margin Gaussian Mixture Models with Differential Privacy
    Pathak, Manas A.
    Raj, Bhiksha
    [J]. IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2012, 9 (04) : 463 - 469
  • [36] Large Margin Gaussian mixture models for speaker identification
    Jourani, Reda
    Daoudi, Khalid
    Andre-Obrecht, Regine
    Aboutajdine, Driss
    [J]. 11TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2010 (INTERSPEECH 2010), VOLS 1-2, 2010, : 1441 - +
  • [37] Large-margin Distribution Machine-based regression
    Rastogi, Reshma
    Anand, Pritam
    Chandra, Suresh
    [J]. Neural Computing and Applications, 2020, 32 (08) : 3633 - 3648
  • [38] A flexible probabilistic framework for large-margin mixture of experts
    Archit Sharma
    Siddhartha Saxena
    Piyush Rai
    [J]. Machine Learning, 2019, 108 : 1369 - 1393
  • [39] Large-Margin Learning of Compact Binary Image Encodings
    Paisitkriangkrai, Sakrapee
    Shen, Chunhua
    van den Hengel, Anton
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (09) : 4041 - 4054
  • [40] Large-Margin Feature Adaptation for Automatic Speech Recognition
    Cheng, Chih-Chieh
    Sha, Fei
    Saul, Lawrence K.
    [J]. 2009 IEEE WORKSHOP ON AUTOMATIC SPEECH RECOGNITION & UNDERSTANDING (ASRU 2009), 2009, : 87 - +