BAYESIAN MULTIPLE INSTANCE CLASSIFICATION BASED ON HIERARCHICAL PROBIT REGRESSION

被引:0
|
作者
Xiong, Danyi [1 ]
Park, Seongoh [2 ]
Lim, Johan [3 ]
Wang, Tao [4 ]
Wang, Xinlei [5 ]
机构
[1] Southern Methodist Univ, Dept Stat Sci, Dallas, TX 75275 USA
[2] Sungshin Womens Univ, Dept Stat, Seoul, South Korea
[3] Seoul Natl Univ, Dept Stat, Seoul, South Korea
[4] UT Southwestern Med Ctr, Quantitat Biomed Res Ctr, Peter ODonnell Jr Sch Publ Hlth, Dallas, TX USA
[5] Univ Texas Arlington, Dept Math, Arlington, TX 76019 USA
来源
ANNALS OF APPLIED STATISTICS | 2024年 / 18卷 / 01期
基金
新加坡国家研究基金会;
关键词
Binary classification; Bayesian inference; Gibbs sampling; primary instance; weakly supervised learning; BINARY; CANCER; MODELS;
D O I
10.1214/23-AOAS1780
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In multiple instance learning (MIL), the response variable is predicted by features (or covariates) of one or more instances, which are collectively denoted as a bag. Learning the relationship between bags and instances is challenging because of the unknown and possibly complicated data generating mechanism regarding how instances contribute to the bag label. MIL has been applied to solve a variety of real -world problems, which have been mostly focused on supervised tasks, such as molecule activity prediction, protein binding affinities prediction, object detection, and computer -aided diagnosis. However, to date, the majority of the off -the -shelf MIL methods are developed in the computer science domain, and they focus on improving the prediction performance while spending little effort on explainability of the algorithm. In this article a Bayesian multiple instance learning model, based on probit regression (MICProB), is proposed, which contributes a significant portion to the suite of statistical methodologies for MIL. MICProB is composed of two nested probit regression models, where the inner model is estimated for predicting primary instances, which are considered as the "important" ones that determine the bag label, and the outer model is for predicting bag -level responses based on the primary instances estimated by the inner model. The posterior distribution of MICProB can be conveniently approximated using a Gibbs sampler, and the prediction for new bags can be performed in a fully integrated Bayesian way. We evaluate the performance of MICProB against 15 benchmark methods and demonstrate its competitiveness in simulation and real -data examples. In addition to its capability of identifying primary instances, as compared to existing optimization -based approaches, MICProB also enjoys great advantages in providing a transparent model structure, straightforward statistical inference of quantities related to model parameters, and favorable interpretability of covariate effects on the bag -level response.
引用
收藏
页码:80 / 99
页数:20
相关论文
共 50 条
  • [31] Combining Instance-Based Learning and Logistic Regression for Multilabel Classification
    Cheng, Weiwei
    Huellermeier, Eyke
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT I, 2009, 5781 : 6 - 6
  • [32] Combining instance-based learning and logistic regression for multilabel classification
    Weiwei Cheng
    Eyke Hüllermeier
    Machine Learning, 2009, 76 : 211 - 225
  • [33] IBLStreams: a system for instance-based classification and regression on data streams
    Shaker, Ammar
    Huellermeier, Eyke
    EVOLVING SYSTEMS, 2012, 3 (04) : 235 - 249
  • [34] Sparse Bayesian variable selection in multinomial probit regression model with application to high-dimensional data classification
    Yang Aijun
    Jiang Xuejun
    Xiang Liming
    Lin Jinguan
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2017, 46 (12) : 6137 - 6150
  • [35] Multiple-Instance Ordinal Regression
    Xiao, Yanshan
    Liu, Bo
    Hao, Zhifeng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (09) : 4398 - 4413
  • [36] Bayesian binary kernel probit model for microarray based cancer classification and gene selection
    Chakraborty, Sounak
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2009, 53 (12) : 4198 - 4209
  • [37] A Bayesian hierarchical logistic regression model of multiple informant family health histories
    Jielu Lin
    Melanie F. Myers
    Laura M. Koehly
    Christopher Steven Marcum
    BMC Medical Research Methodology, 19
  • [38] A Bayesian hierarchical logistic regression model of multiple informant family health histories
    Lin, Jielu
    Myers, Melanie F.
    Koehly, Laura M.
    Marcum, Christopher Steven
    BMC MEDICAL RESEARCH METHODOLOGY, 2019, 19 (1)
  • [39] Fast pedestrian detection based on multiple instance Hierarchical HOG Matrices
    Cheng, Guang
    Meng, Long
    Lin, Xinggang
    2013 INTERNATIONAL CONFERENCE ON OPTICAL INSTRUMENTS AND TECHNOLOGY: OPTOELECTRONIC IMAGING AND PROCESSING TECHNOLOGY, 2013, 9045
  • [40] Towards Hierarchical Regional Transformer-based Multiple Instance Learning
    Cersovsky, Josef
    Mohammadi, Sadegh
    Kainmueller, Dagmar
    Hoehne, Johannes
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 3954 - 3962