Properties of the Cross Entropy Between ARMA Processes

被引：0

作者：

Grivel, Eric ^{[1
]}

机构：

[1] Bordeaux Univ, INP Bordeaux ENSEIRB MATMECA, IMS, UMR CNRS 5218, Talence, France

来源：

GEOMETRIC SCIENCE OF INFORMATION | 2019年 / 11712卷

关键词：

Cross entropy; Jeffreys divergence; Kullback-Leibler divergence; ARMA processes; JEFFREYS DIVERGENCE;

D O I：

10.1007/978-3-030-26980-7_39

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this paper, we propose to analyze the properties of the cross entropy between the probability density functions of k consecutive samples of wide-sense stationary Gaussian ARMA processes. It is shown that, when k increases, the cross entropy has a transient behavior before tending to an affine function of k whose slope is defined by the so-called asymptotic increment. The latter depends on the parameters of the processes and can be a reasonable choice to characterize the cross entropy. Some illustrations are then given.

引用

页码：377 / 386

页数：10

共 50 条

[41] A NOTE ON SPECTRAL ESTIMATION FOR ARMA PROCESSES
HANNAGAN, GM
THOMSON, PJ
[J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 1983, 18 (2-3) : 87 - 92
[42] A NOTE ON STRONG MIXING OF ARMA PROCESSES
ATHREYA, KB
PANTULA, SG
[J]. STATISTICS & PROBABILITY LETTERS, 1986, 4 (04) : 187 - 190
[43] A METHOD FOR ADAPTIVE ESTIMATION OF ARMA PROCESSES
GUO, L
CHEN, HF
[J]. SYSTEMS & CONTROL LETTERS, 1988, 11 (05) : 351 - 356
[44] Risk sensitive identification of ARMA processes
Gerencsér, L
Michaletzky, G
[J]. DIRECTIONS IN MATHEMATICAL SYSTEMS THEORY AND OPTIMIZATION, 2003, 286 : 141 - 157
[45] Renyi Cross-Entropy Measures for Common Distributions and Processes with Memory
Thierrin, Ferenc Cole
Alajaji, Fady
Linder, Tamas
[J]. ENTROPY, 2022, 24 (10)
[46] Stationary ARMA solutions to linear rational expectations models with stationary ARMA exogenous processes
DeNardis, S
[J]. MANCHESTER SCHOOL OF ECONOMIC AND SOCIAL STUDIES, 1996, 64 (01): : 38 - 53
[47] Covariance estimation in time varying ARMA processes
Wiesel, Ami
Globerson, Amir
[J]. 2012 IEEE 7TH SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP (SAM), 2012, : 357 - 360
[48] MULTIVARIATE PERIODIC ARMA(1, 1) PROCESSES
BARTOLINI, P
SALAS, JD
OBEYSEKERA, JTB
[J]. WATER RESOURCES RESEARCH, 1988, 24 (08) : 1237 - 1246
[49] A NOTE ON NONSTATIONARY ARMA PROCESSES WITH INFINITE VARIANCE
NASSIUMA, D
[J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1991, 20 (5-6) : 1821 - 1826
[50] A Note on Backward Prediction for Multivariate ARMA Processes
Mohammadpour, M.
[J]. IRANIAN JOURNAL OF SCIENCE AND TECHNOLOGY TRANSACTION A-SCIENCE, 2017, 41 (A1): : 231 - 235

← 1 2 3 4 5 →