A new model selection criterion based on information geometry

被引:0
|
作者
Liu, YH [1 ]
Luo, SW [1 ]
Li, AJ [1 ]
Yu, HB [1 ]
机构
[1] Beijing Jiaotong Univ, Dept Comp Sci, Beijing 100044, Peoples R China
关键词
model selection; information geometry; geometric complexity; geometric fitness;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a new model selection criterion based on information geometry-Information Geometric Model Selection Criterion (IGMSC) which is reparametrization invariant, and gives the proof IGMSC computes the geometric complexity of the model by regarding the model space as the manifold and estimates the model-data geometric fitness by using the divergence between the true distribution and the asymptotic distribution, enduing complexity and fitness with clear geometric significance. IGMSC gives the theoretic support of model selection in the framework of information geometry.
引用
收藏
页码:1562 / 1565
页数:4
相关论文
共 50 条
  • [1] Model information metric based on selection criterion
    Duan, XJ
    Du, XY
    Wang, ZM
    2002 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-4, PROCEEDINGS, 2002, : 467 - 471
  • [2] INFORMATION CRITERION IN MODEL SELECTION
    KLEIN, RW
    ECONOMICS LETTERS, 1979, 3 (03) : 243 - 248
  • [3] A residual-information-based criterion for model order selection
    Duan, XJ
    Du, XY
    Wang, ZM
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2003, 22 (05) : 465 - 474
  • [4] A Residual-Information-Based Criterion for Model Order Selection
    Xiaojun Duan
    Xiaoyong Du
    Zhengming Wang
    Circuits, Systems and Signal Processing, 2003, 22 : 465 - 474
  • [5] A modified information criterion for model selection
    Dunder, Emre
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2021, 50 (11) : 2710 - 2721
  • [6] Subspace information criterion for model selection
    Sugiyama, M
    Ogawa, H
    NEURAL COMPUTATION, 2001, 13 (08) : 1863 - 1889
  • [7] Geometric information criterion for model selection
    Kanatani, K
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 1998, 26 (03) : 171 - 189
  • [8] Geometric Information Criterion for Model Selection
    Kenichi Kanatani
    International Journal of Computer Vision, 1998, 26 : 171 - 189
  • [9] A New Criterion for Model Selection
    Hoang Pham
    MATHEMATICS, 2019, 7 (12)
  • [10] A ROBUST CONSISTENT INFORMATION CRITERION FOR MODEL SELECTION BASED ON EMPIRICAL LIKELIHOOD
    Chen, Chixiang
    Wang, Ming
    Wu, Rongling
    Li, Runze
    STATISTICA SINICA, 2022, 32 (03) : 1205 - 1223