Boosting for Correlated Binary Classification

被引:7
|
作者
Adewale, Adeniyi J. [1 ]
Dinu, Irina [2 ]
Yasui, Yutaka [2 ]
机构
[1] Merck Res Labs, N Wales, PA 19454 USA
[2] Univ Alberta, Sch Publ Hlth, Dept Publ Hlth Sci, Edmonton, AB T6G 2G3, Canada
关键词
Functional gradient descent; Likelihood optimization; LogitBoost; Matched-pair; Penalized quasi-likelihood (PQL); LONGITUDINAL DATA-ANALYSIS; MIXED MODELS; REGRESSION;
D O I
10.1198/jcgs.2009.07118
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Boosting is a successful method for dealing with problems of high-dimensional classification of independent data. However, existing variants do not address the correlations in the context of longitudinal or cluster study-designs with measurements collected across two or more time points or in clusters. This article presents two new variants of boosting with a focus on high-dimensional classification problems with matched-pair binary responses or, more generally, any correlated binary responses. The first method is based on the generic functional gradient descent algorithm and the second method is based on a direct likelihood optimization approach. The performance and the computational requirements of the algorithms were evaluated using simulations. Whereas the performance of the two methods is similar, the computational efficiency of the generic-functional-gradient-descent-based algorithm far exceeds that of the direct-likelihood-optimization-based algorithm. The former method is illustrated using data on gene expression changes in de novo and relapsed childhood acute lymphoblastic leukemia. Computer code implementing the algorithms and the relevant dataset are available online as supplemental materials.
引用
收藏
页码:140 / 153
页数:14
相关论文
共 50 条
  • [1] Selection of binary variables and classification by boosting
    Park, Junyong
    Wilbur, Jayson D.
    Ghosh, Jayanta K.
    Nakatsu, Cindy H.
    Ackerman, Corinne
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2007, 36 (04) : 855 - 869
  • [2] Quantum speedup in adaptive boosting of binary classification
    XiMing Wang
    YueChi Ma
    Min-Hsiu Hsieh
    Man-Hong Yung
    Science China Physics, Mechanics & Astronomy, 2021, 64
  • [3] Quantum speedup in adaptive boosting of binary classification
    XiMing Wang
    YueChi Ma
    Min-Hsiu Hsieh
    Man-Hong Yung
    Science China(Physics,Mechanics & Astronomy), 2021, 64 (02) : 55 - 64
  • [4] Quantum speedup in adaptive boosting of binary classification
    Wang, XiMing
    Ma, YueChi
    Hsieh, Min-Hsiu
    Yung, Man-Hong
    SCIENCE CHINA-PHYSICS MECHANICS & ASTRONOMY, 2021, 64 (02)
  • [5] Quantum speedup in adaptive boosting of binary classification
    XiMing Wang
    YueChi Ma
    MinHsiu Hsieh
    ManHong Yung
    Science China(Physics,Mechanics & Astronomy), 2021, (02) : 55 - 64
  • [6] Review of Bagging and Boosting Classification Performance on Unbalanced Binary Classification
    Singhal, Yash
    Jain, Ayushi
    Batra, Shrey
    Varshney, Yash
    Rathi, Megha
    PROCEEDINGS OF THE 2018 IEEE 8TH INTERNATIONAL ADVANCE COMPUTING CONFERENCE (IACC 2018), 2018, : 338 - 343
  • [7] Gender classification based on boosting Local Binary Pattern
    Sun, Ning
    Zheng, Wenming
    Sun, Changyin
    Zou, Cairong
    Zhao, Li
    ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 2, PROCEEDINGS, 2006, 3972 : 194 - 201
  • [8] QBoost: Predicting quantiles with boosting for regression and binary classification
    Zheng, Songfeng
    EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (02) : 1687 - 1697
  • [9] Boosting Based Conditional Quantile Estimation for Regression and Binary Classification
    Zheng, Songfeng
    ADVANCES IN SOFT COMPUTING - MICAI 2010, PT II, 2010, 6438 : 67 - 79
  • [10] Remote Sensing Data Binary Classification Using Boosting with Simple Classifiers
    Artur Nowakowski
    Acta Geophysica, 2015, 63 : 1447 - 1462