On Large Margin Hierarchical Classification With Multiple Paths

被引:16
|
作者
Wang, Junhui [1 ]
Shen, Xiaotong [2 ]
Pan, Wei [3 ]
机构
[1] Univ Illinois, Dept Math Stat & Comp Sci, Chicago, IL 60607 USA
[2] Univ Minnesota, Sch Stat, Minneapolis, MN 55455 USA
[3] Univ Minnesota, Div Biostat, Minneapolis, MN 55455 USA
关键词
Directed acyclic graph; Functional genomics; Generalization; Structured learning; Tuning; VECTOR; ALGORITHMS; REGRESSION;
D O I
10.1198/jasa.2009.tm08084
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Hierarchical classification is critical to knowledge management and exploration. as is gene function prediction and document categorization. In hierarchical classification, an input is classified according to a structured hierarchy. In such a situation, the central issue is how to effectively utilize the interclass relationship to improve the generalization performance of flat classification ignoring such dependency. In this article, we propose a novel large margin method through constraints characterizing a multipath hierarchy, where class membership can be nonexclusive. The proposed method permits a treatment of various losses for hierarchical classification. For implementation. we focus on the symmetric difference loss and two large margin classifiers: support vector machines and psi-learning. Finally, theoretical and numerical analyses are conducted, in addition to an application to gene function prediction. They suggest that the proposed method achieves the desired objective and outperforms strong competitors ill the literature.
引用
收藏
页码:1213 / 1223
页数:11
相关论文
共 50 条
  • [21] Multicategory large margin classification with unequal costs
    Zheng, Qingle
    Che, Yuezhang
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2022, 51 (04) : 1801 - 1813
  • [22] A Parameterless Mixture Model for Large Margin Classification
    Torres, Luiz C. B.
    Castro, Cristiano L.
    Braga, Antonio P.
    [J]. 2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [23] Fuzzy large margin distribution machine for classification
    Dong, Denghao
    Feng, Minyu
    Kurths, Juergen
    Zhang, Libo
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (05) : 1891 - 1905
  • [24] Large Margin Classification Using the Perceptron Algorithm
    Yoav Freund
    Robert E. Schapire
    [J]. Machine Learning, 1999, 37 : 277 - 296
  • [25] Convergence of large margin separable linear classification
    Zhang, T
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 13, 2001, 13 : 357 - 363
  • [26] VARIABILITY REGULARIZATION IN LARGE-MARGIN CLASSIFICATION
    Mansjur, Dwi Sianto
    Wada, Ted S.
    Juang, Biing-Hwang
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, : 1956 - 1959
  • [27] Fuzzy large margin distribution machine for classification
    Denghao Dong
    Minyu Feng
    Jürgen Kurths
    Libo Zhang
    [J]. International Journal of Machine Learning and Cybernetics, 2024, 15 : 1891 - 1905
  • [28] Large-Margin Classification in Hyperbolic Space
    Cho, Hyunghoon
    DeMeo, Benjamin
    Peng, Jian
    Berger, Bonnie
    [J]. 22ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 89, 2019, 89
  • [29] Large Margin Image Set Representation and Classification
    Wang, Jim Jing-Yan
    Alzahrani, Majed
    Gao, Xin
    [J]. PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 1797 - 1803
  • [30] Large margin classification using the perceptron algorithm
    Freund, Y
    Schapire, RE
    [J]. MACHINE LEARNING, 1999, 37 (03) : 277 - 296