BAYESIAN MULTIPLE INSTANCE CLASSIFICATION BASED ON HIERARCHICAL PROBIT REGRESSION

被引:0
|
作者
Xiong, Danyi [1 ]
Park, Seongoh [2 ]
Lim, Johan [3 ]
Wang, Tao [4 ]
Wang, Xinlei [5 ]
机构
[1] Southern Methodist Univ, Dept Stat Sci, Dallas, TX 75275 USA
[2] Sungshin Womens Univ, Dept Stat, Seoul, South Korea
[3] Seoul Natl Univ, Dept Stat, Seoul, South Korea
[4] UT Southwestern Med Ctr, Quantitat Biomed Res Ctr, Peter ODonnell Jr Sch Publ Hlth, Dallas, TX USA
[5] Univ Texas Arlington, Dept Math, Arlington, TX 76019 USA
来源
ANNALS OF APPLIED STATISTICS | 2024年 / 18卷 / 01期
基金
新加坡国家研究基金会;
关键词
Binary classification; Bayesian inference; Gibbs sampling; primary instance; weakly supervised learning; BINARY; CANCER; MODELS;
D O I
10.1214/23-AOAS1780
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In multiple instance learning (MIL), the response variable is predicted by features (or covariates) of one or more instances, which are collectively denoted as a bag. Learning the relationship between bags and instances is challenging because of the unknown and possibly complicated data generating mechanism regarding how instances contribute to the bag label. MIL has been applied to solve a variety of real -world problems, which have been mostly focused on supervised tasks, such as molecule activity prediction, protein binding affinities prediction, object detection, and computer -aided diagnosis. However, to date, the majority of the off -the -shelf MIL methods are developed in the computer science domain, and they focus on improving the prediction performance while spending little effort on explainability of the algorithm. In this article a Bayesian multiple instance learning model, based on probit regression (MICProB), is proposed, which contributes a significant portion to the suite of statistical methodologies for MIL. MICProB is composed of two nested probit regression models, where the inner model is estimated for predicting primary instances, which are considered as the "important" ones that determine the bag label, and the outer model is for predicting bag -level responses based on the primary instances estimated by the inner model. The posterior distribution of MICProB can be conveniently approximated using a Gibbs sampler, and the prediction for new bags can be performed in a fully integrated Bayesian way. We evaluate the performance of MICProB against 15 benchmark methods and demonstrate its competitiveness in simulation and real -data examples. In addition to its capability of identifying primary instances, as compared to existing optimization -based approaches, MICProB also enjoys great advantages in providing a transparent model structure, straightforward statistical inference of quantities related to model parameters, and favorable interpretability of covariate effects on the bag -level response.
引用
收藏
页码:80 / 99
页数:20
相关论文
共 50 条
  • [21] Augmentation Samplers for Multinomial Probit Bayesian Additive Regression Trees
    Xu, Yizhen
    Hogan, Joseph
    Daniels, Michael
    Kantor, Rami
    Mwangi, Ann
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2024,
  • [22] Bayesian skew-probit regression for binary response data
    Bazan, Jorge L.
    Romeo, Jose S.
    Rodrigues, Josemar
    BRAZILIAN JOURNAL OF PROBABILITY AND STATISTICS, 2014, 28 (04) : 467 - 482
  • [23] The analysis of bayesian probit regression of binary and polychotomous response data
    Department of Mathematics, Teachers' Training Faculty Tehran South Branch, Islamic Azad University, Tehran, Iran
    Int. J. Eng. Trans. B Applic., 2007, 3 (237-248):
  • [24] Text Classification Based on a Novel Bayesian Hierarchical Model
    Zhou, Shibin
    Li, Kan
    Liu, Yushu
    FIFTH INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, VOL 2, PROCEEDINGS, 2008, : 218 - 221
  • [25] Variational Bayesian multinomial probit regression with gaussian process priors
    Girolami, Mark
    Rogers, Simon
    NEURAL COMPUTATION, 2006, 18 (08) : 1790 - 1817
  • [26] Data augmentation strategies for the Bayesian spatial probit regression model
    Berrett, Candace
    Calder, Catherine A.
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2012, 56 (03) : 478 - 490
  • [27] Ordered probit Bayesian additive regression trees for ordinal data
    Lee, Jaeyong
    Hwang, Beom Seuk
    STAT, 2024, 13 (01):
  • [28] Scalable Bayesian p-generalized probit and logistic regression
    Ding, Zeyu
    Omlor, Simon
    Ickstadt, Katja
    Munteanu, Alexander
    ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2024,
  • [29] THE ANALYSIS OF BAYESIAN PROBIT REGRESSION OF BINARY AND POLYCHOTOMOUS RESPONSE DATA
    Nasrollahzadeh, Shadi
    INTERNATIONAL JOURNAL OF ENGINEERING, 2007, 20 (03): : 237 - 248
  • [30] Combining instance-based learning and logistic regression for multilabel classification
    Cheng, Weiwei
    Huellermeier, Eyke
    MACHINE LEARNING, 2009, 76 (2-3) : 211 - 225