SEQUENTIAL ALGORITHMS FOR PARAMETER-ESTIMATION BASED ON THE KULLBACK-LEIBLER INFORMATION MEASURE

被引：45

作者：

WEINSTEIN, E ^{[1
]}

FEDER, M ^{[1
]}

OPPENHEIM, AV ^{[1
]}

机构：

[1] MIT,DEPT ELECT ENGN & COMP SCI,CAMBRIDGE,MA 02139

来源：

IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING | 1990年 / 38卷 / 09期

关键词：

D O I：

10.1109/29.60089

中图分类号：

O42 [声学];

学科分类号：

070206 ; 082403 ;

摘要：

Methods of stochastic approximation are used to convert iterative algorithms for maximizing the Kullback-Leibler information measure into sequential algorithms. Special attention is given to the case of incomplete data, and several algorithms are presented to deal with situations of this kind. The application of these algorithms to the identification of finite impulse response (FIR) systems is considered. Issues such as convergence properties of the proposed algorithms, choice of initial conditions, the limit distribution, and the associated regularity conditions are beyond the scope of this correspondence. However, the existing literature on stochastic approximation, together with the ideas presented in this correspondence should provide the starting point for such analyses. © 1990 IEEE

引用

页码：1652 / 1654

页数：3

共 50 条

[31] Minimization of the Kullback-Leibler Divergence for Nonlinear Estimation
Darling, Jacob E.
DeMars, Kyle J.
[J]. JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 2017, 40 (07) : 1739 - 1748
[32] Unsupervised Weight Parameter Estimation for Exponential Mixture Distribution based on Symmetric Kullback-Leibler Divergence
Uchida, Masato
[J]. 2014 JOINT 7TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 15TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS), 2014, : 1126 - 1129
[33] AN IMPROVEMENT OF VARIABLE SAMPLING PLANS BASED ON KULLBACK-LEIBLER INFORMATION
ARIZONO, I
OHTA, H
[J]. INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 1987, 25 (09) : 1393 - 1400
[34] An iterative approach to variable selection based on the Kullback-Leibler information
Hughes, AW
King, ML
[J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1999, 28 (05) : 1043 - 1057
[35] Nonparametric Estimation of Kullback-Leibler Information Illustrated by Evaluating Goodness of Fit
Viele, Kert
[J]. BAYESIAN ANALYSIS, 2007, 2 (02): : 239 - 280
[36] MINIMIZATION OF THE KULLBACK-LEIBLER DIVERGENCE FOR NONLINEAR ESTIMATION
Darling, Jacob E.
DeMars, Kyle J.
[J]. ASTRODYNAMICS 2015, 2016, 156 : 213 - 232
[37] Inference of intrinsic spiking irregularity based on the Kullback-Leibler information
Koyama, Shinsuke
Shinomoto, Shigeru
[J]. BIOSYSTEMS, 2007, 89 (1-3) : 69 - 73
[38] ON GENERALIZED CUMULATIVE INFORMATION OF KULLBACK-LEIBLER TYPE
Ciumara, Roxana
Panait, Ioana Ileana
[J]. PROCEEDINGS OF THE ROMANIAN ACADEMY SERIES A-MATHEMATICS PHYSICS TECHNICAL SCIENCES INFORMATION SCIENCE, 2018, 19 (04): : 529 - 536
[39] KULLBACK-LEIBLER INFORMATION MEASURE FOR STUDYING CONVERGENCE-RATES OF DENSITIES AND DISTRIBUTIONS
MEYER, ME
GOKHALE, DV
[J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 1993, 39 (04) : 1401 - 1409
[40] Kullback-Leibler divergence measure of intermittency: Application to turbulence
Granero-Belinchon, Carlos
Roux, Stephane G.
Garnier, Nicolas B.
[J]. PHYSICAL REVIEW E, 2018, 97 (01):

← 1 2 3 4 5 →