A Dynamic Mixture Model for Unsupervised Tail Estimation without Threshold Selection

被引:5
|
作者
Arnoldo Frigessi
Ola Haug
Håvard Rue
机构
[1] Norwegian Computing Center,Department of Mathematical Sciences
[2] University of Oslo,undefined
[3] Norwegian Computing Center,undefined
[4] The Norwegian University for Science and Technology,undefined
关键词
peaks over threshold; Danish fire loss data; shape parameter; heavy tailed distribution; maximum likelihood; mixture models;
D O I
10.1023/A:1024072610684
中图分类号
学科分类号
摘要
Exceedances over high thresholds are often modeled by fitting a generalized Pareto distribution (GPD) on R+. It is difficult to select the threshold, above which the GPD assumption is enough solid and enough data is available for inference. We suggest a new dynamically weighted mixture model, where one term of the mixture is the GPD, and the other is a light-tailed density distribution. The weight function varies on R+ in such a way that for large values the GPD component is predominant and thus takes the role of threshold selection. The full data set is used for inference on the parameters present in the two component distributions and in the weight function. Maximum likelihood provides estimates with approximate standard deviations. Our approach has been successfully applied to simulated data and to the (previously studied) Danish fire loss data set. We compare the new dynamic mixture method to Dupuis' robust thresholding approach in peaks-over-threshold inference. We discuss robustness with respect to the choice of the light-tailed component and the form of the weight function. We present encouraging simulation results that indicate that the new approach can be useful in unsupervised tail estimation, especially in heavy tailed situations and for small percentiles.
引用
收藏
页码:219 / 235
页数:16
相关论文
共 50 条
  • [1] An Unsupervised Feature Selection Dynamic Mixture Model for Motion Segmentation
    Thanh Minh Nguyen
    Wu, Qingming Jonathan
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (03) : 1210 - 1225
  • [2] Unsupervised selection and estimation of finite mixture models
    Figueiredo, MAT
    Jain, AK
    [J]. 15TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, PROCEEDINGS: PATTERN RECOGNITION AND NEURAL NETWORKS, 2000, : 87 - 90
  • [3] Unsupervised feature and model selection for generalized Dirichlet mixture models
    Boutemedjet, Sabri
    Bouguila, Nizar
    Ziou, Djemel
    [J]. IMAGE ANALYSIS AND RECOGNITION, PROCEEDINGS, 2007, 4633 : 330 - +
  • [4] Unsupervised Segmentation of Spectral Images with a Spatialized Gaussian Mixture Model and Model Selection
    Cohen, S. X.
    Le Pennec, E.
    [J]. OIL AND GAS SCIENCE AND TECHNOLOGY-REVUE D IFP ENERGIES NOUVELLES, 2014, 69 (02): : 245 - 259
  • [5] Bayesian estimation and model selection of threshold spatial Durbin model
    Zhu, Yanli
    Han, Xiaoyi
    Chen, Ying
    [J]. ECONOMICS LETTERS, 2020, 188
  • [6] High-dimensional unsupervised selection and estimation of a finite generalized Dirichlet mixture model based on minimum message length
    Bouguila, Nizar
    Ziou, Djemel
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (10) : 1716 - 1731
  • [7] Robust Variable Selection and Estimation in Threshold Regression Model
    Bo-wen Li
    Yun-qi Zhang
    Nian-sheng Tang
    [J]. Acta Mathematicae Applicatae Sinica, English Series, 2020, 36 : 332 - 346
  • [8] Robust Variable Selection and Estimation in Threshold Regression Model
    Bo-wen LI
    Yun-qi ZHANG
    Nian-sheng TANG
    [J]. Acta Mathematicae Applicatae Sinica, 2020, 36 (02) : 332 - 346
  • [9] Robust Variable Selection and Estimation in Threshold Regression Model
    Li, Bo-wen
    Zhang, Yun-qi
    Tang, Nian-sheng
    [J]. ACTA MATHEMATICAE APPLICATAE SINICA-ENGLISH SERIES, 2020, 36 (02): : 332 - 346
  • [10] Unsupervised selection of a finite Dirichlet mixture model: An MML-based approach
    Bouguila, Nizar
    Ziou, Djemel
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2006, 18 (08) : 993 - 1009