On Large Margin Hierarchical Classification With Multiple Paths

被引:16
|
作者
Wang, Junhui [1 ]
Shen, Xiaotong [2 ]
Pan, Wei [3 ]
机构
[1] Univ Illinois, Dept Math Stat & Comp Sci, Chicago, IL 60607 USA
[2] Univ Minnesota, Sch Stat, Minneapolis, MN 55455 USA
[3] Univ Minnesota, Div Biostat, Minneapolis, MN 55455 USA
关键词
Directed acyclic graph; Functional genomics; Generalization; Structured learning; Tuning; VECTOR; ALGORITHMS; REGRESSION;
D O I
10.1198/jasa.2009.tm08084
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Hierarchical classification is critical to knowledge management and exploration. as is gene function prediction and document categorization. In hierarchical classification, an input is classified according to a structured hierarchy. In such a situation, the central issue is how to effectively utilize the interclass relationship to improve the generalization performance of flat classification ignoring such dependency. In this article, we propose a novel large margin method through constraints characterizing a multipath hierarchy, where class membership can be nonexclusive. The proposed method permits a treatment of various losses for hierarchical classification. For implementation. we focus on the symmetric difference loss and two large margin classifiers: support vector machines and psi-learning. Finally, theoretical and numerical analyses are conducted, in addition to an application to gene function prediction. They suggest that the proposed method achieves the desired objective and outperforms strong competitors ill the literature.
引用
收藏
页码:1213 / 1223
页数:11
相关论文
共 50 条
  • [1] Large Margin Hierarchical Classification with Mutually Exclusive Class Membership
    Wang, Huixin
    Shen, Xiaotong
    Pan, Wei
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2011, 12 : 2721 - 2748
  • [2] Large margin learning of hierarchical semantic similarity for image classification
    Chang, Ju Yong
    Lee, Kyoung Mu
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2015, 132 : 3 - 11
  • [3] Large-margin classification with multiple decision rules
    Kimes, Patrick K.
    Hayes, David Neil
    Marron, J. S.
    Liu, Yufeng
    [J]. STATISTICAL ANALYSIS AND DATA MINING, 2016, 9 (02) : 89 - 105
  • [4] HIERARCHICAL DISTANCE METRIC LEARNING FOR LARGE MARGIN NEAREST NEIGHBOR CLASSIFICATION
    Sun, Shiliang
    Chen, Qiaona
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2011, 25 (07) : 1073 - 1087
  • [5] Hierarchical large-margin Gaussian mixture models for phonetic classification
    Chang, Hung-An
    Glass, James R.
    [J]. 2007 IEEE WORKSHOP ON AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING, VOLS 1 AND 2, 2007, : 272 - 277
  • [6] Hierarchical learning of large-margin metrics for large-scale image classification
    Lei, Hao
    Mei, Kuizhi
    Xin, Jingmin
    Dong, Peixiang
    Fan, Jianping
    [J]. NEUROCOMPUTING, 2016, 208 : 46 - 58
  • [7] Hierarchical Spectral Clustering based Large Margin Classification of Visually Correlated Categories
    Bose, Digbalay
    Chaudhuri, Subhasis
    [J]. TENTH INDIAN CONFERENCE ON COMPUTER VISION, GRAPHICS AND IMAGE PROCESSING (ICVGIP 2016), 2016,
  • [8] MULTIPLE METRIC LEARNING FOR LARGE MARGIN kNN CLASSIFICATION OF TIME SERIES
    Do, Cao-Tri
    Douzal-Chouakria, Ahlame
    Marie, Sylvain
    Rombaut, Michele
    [J]. 2015 23RD EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2015, : 2346 - 2350
  • [9] Large margin classification for moving targets
    Kivinen, J
    Smola, AJ
    Williamson, RC
    [J]. ALGORITHMIC LEARNING THEORY, PROCEEDINGS, 2002, 2533 : 113 - 127
  • [10] An evolutionary algorithm for large margin classification
    Motta Goulart, Renan
    Hasenclever Borges, Carlos Cristiano
    Fonseca Neto, Raul
    [J]. SOFT COMPUTING, 2021, 25 (11) : 7593 - 7607