An algorithm for information projection to an affine subspace

被引:0
|
作者
D. V. Vinogradov
机构
[1] Russian Academy of Sciences,Institute of Informatics Problems
[2] Russian State University for the Humanities,undefined
关键词
KL-distance; positive orthant; affine subspace; exponential family; maximum likelihood estimates;
D O I
10.3103/S0005105516030109
中图分类号
学科分类号
摘要
We investigate an algorithm to find a point of an affine subspace in the positive orthant such that it is the closest one to the original point with respect to the Kullback–Leibler distance. This problem is solved by means of the classical Darroch–Ratcliff algorithm (see [1]), while we use ideas of the information geometry founded by Chentsov (see [2]) and Csiszar (see [3]). The main theorem of the present work proves the convergence of that algorithm (the method of the proof is different from previous ones). The proposed algorithm can be applied, e.g., to find the maximum likelihood estimates in an exponential family (see the last section of the paper).
引用
收藏
页码:133 / 138
页数:5
相关论文
共 50 条
  • [41] A Stochastic Model for a Pseudo Affine Projection Algorithm
    de Almeida, Sergio J. M.
    Bermudez, Jose Carlos M.
    Bershad, Neil J.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2009, 57 (01) : 107 - 118
  • [42] A sparse block exact affine projection algorithm
    Rombouts, G
    Moonen, M
    IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, 2002, 10 (02): : 100 - 108
  • [43] Efficient Implementation of the Affine Projection Sign Algorithm
    Ni, Jingen
    Li, Feng
    IEEE SIGNAL PROCESSING LETTERS, 2012, 19 (01) : 24 - 26
  • [44] A fast instrumental variable affine projection algorithm
    Maouche, K
    Slock, DTM
    PROCEEDINGS OF THE 1998 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-6, 1998, : 1481 - 1484
  • [45] INTERMITTENTLY-UPDATED AFFINE PROJECTION ALGORITHM
    Albu, Felix
    Rotaru, Marius
    Arablouei, Reza
    Dogancay, Kutluyil
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 585 - 589
  • [46] Interval-Extraction Affine Projection Algorithm
    Han, Hongyu
    Zhang, Sheng
    Huang, Fuyi
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1632 - 1636
  • [47] Error Coded Affine Projection Like Algorithm
    Rodriguez, A.
    Sanchez, J. C.
    Avalos, J. G.
    2015 INTERNATIONAL CONFERENCE ON MECHATRONICS, ELECTRONICS, AND AUTOMOTIVE ENGINEERING (ICMEAE 2015), 2015, : 70 - 75
  • [48] Affine projection algorithm with adaptive error constraint
    Choi, Y-S
    ELECTRONICS LETTERS, 2012, 48 (20) : 1265 - +
  • [49] A block exact fast affine projection algorithm
    Tanaka, M
    Makino, S
    Kojima, J
    IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, 1999, 7 (01): : 79 - 86
  • [50] A Theory on the Convergence Behavior of the Affine Projection Algorithm
    Kim, Seong-Eun
    Lee, Jae-Woo
    Song, Woo-Jin
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2011, 59 (12) : 6233 - 6239