Active learning algorithm using the maximum weighted log-likelihood estimator

被引:28
|
作者
Kanamori, T [1 ]
Shimodaira, H [1 ]
机构
[1] Tokyo Inst Technol, Dept Math & Comp Sci, Meguro Ku, Tokyo 1528552, Japan
关键词
active learning; maximum weighted log-likelihood estimator; optimal experimental design; integrated mean square error;
D O I
10.1016/S0378-3758(02)00234-3
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We study the problems of constructing designs for the regression problems. Our aim is to estimate the mean value of the response variable. The distribution of the independent variable is appropriately chosen from among the continuous designs so as to decrease the integrated mean square error (IMSE) of the fitted values. When we use the design, we face obstacles such that the true regression function may not belong to the statistical model, that is the model is misspecified. In the case of misspecification, the estimation of the mean value of response variable by using the design has bias. We suggest a new method to construct the design which does not have the bias even when the statistical model is misspecified. On the standard construction of the design, the maximum log-likelihood estimator (mle) is used. On the other hand, we use the maximum weighted log-likelihood estimator (mwle). The design with mle increase the bias in the case of misspecification. The mwle corrects the mle and decreases the bias term of IMSE. We give some numerical experiments and illustrate the efficiency of the proposed methods. (C) 2002 Elsevier B.V. All rights reserved.
引用
收藏
页码:149 / 162
页数:14
相关论文
共 50 条
  • [1] Marginal Weighted Maximum Log-likelihood for Efficient Learning of Perturb-and-Map models
    Shpakova, Tatiana
    Bach, Francis
    Osokin, Anton
    [J]. UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2018, : 279 - 289
  • [2] A pseudo-empirical log-likelihood estimator using scrambled responses
    Singh, Sarjinder
    Kim, Jong-Min
    [J]. STATISTICS & PROBABILITY LETTERS, 2011, 81 (03) : 345 - 351
  • [3] On tests for global maximum of the log-likelihood function
    Blatt, Doron
    Hero, Alfred O., III
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2007, 53 (07) : 2510 - 2525
  • [4] Spatial extreme quantile estimation using a weighted log-likelihood approach
    Carreau, Julie
    Girard, Stephane
    [J]. JOURNAL OF THE SFDS, 2011, 152 (03): : 66 - 82
  • [5] A maximum log-likelihood approach to voice activity detection
    Gauci, Oliver
    Debono, Carl J.
    Micallef, Paul
    [J]. 2008 3RD INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS, CONTROL AND SIGNAL PROCESSING, VOLS 1-3, 2008, : 383 - 387
  • [6] On Quantization of Log-Likelihood Ratios for Maximum Mutual Information
    Bauer, Andreas Winkel
    Matz, Gerald
    [J]. 2015 IEEE 16TH INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (SPAWC), 2015, : 316 - 320
  • [7] Estimating the Expectation of the Log-Likelihood with Censored Data for Estimator Selection
    Benoit Liquet
    Daniel Commenges
    [J]. Lifetime Data Analysis, 2004, 10 : 351 - 367
  • [8] Selecting a semi-parametric estimator by the expected log-likelihood
    Liquet, B
    Commenges, D
    [J]. PROBABILITY, STATISTICS AND MODELLING IN PUBLIC HEALTH, 2006, : 332 - +
  • [9] Estimating the expectation of the log-likelihood with censored data for estimator selection
    Liquet, B
    Commenges, D
    [J]. LIFETIME DATA ANALYSIS, 2004, 10 (04) : 351 - 367
  • [10] Fast active contour tracking algorithm based on log-likelihood image segmentation
    Yang, Hua
    Chen, Shanjing
    Zeng, Kai
    Zhang, Hong
    [J]. Qiangjiguang Yu Lizishu/High Power Laser and Particle Beams, 2012, 24 (02): : 321 - 326