Determine the optimal parameter for Information Bottleneck method

被引:0
|
作者
Li, Gang
Liu, Dong
Ye, Yangdong
Rong, Jia
机构
[1] Deakin Univ, Sch Engn & Infomat Technol, Geelong, Vic 3125, Australia
[2] Zhengzhou Univ, Sch Informat Engn, Zhengzhou, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A natural question in Information Bottleneck method is how many "groups" are appropriate. The dependency on prior knowledge restricts the applications of many Information Bottleneck algorithms. In this paper we aim to remove this dependency by formulating the parameter choosing as a model selection problem, and solve it using the minimum message length principle. Empirical results in the documentation clustering scenario indicates that the proposed method works well for the determination of the optimal parameter value for information bottleneck method.
引用
收藏
页码:1005 / 1009
页数:5
相关论文
共 50 条
  • [1] Finding the optimal cardinality value for information bottleneck method
    Li, Gang
    Liu, Dong
    Tu, Yiqing
    Ye, Yangdong
    [J]. ADVANCED DATA MINING AND APPLICATIONS, PROCEEDINGS, 2006, 4093 : 594 - 605
  • [2] A Method to Determine Interval Estimation of Optimal Ridge Parameter
    Yao, Jie
    [J]. INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS & STATISTICS, 2016, 54 (01): : 135 - 140
  • [3] The Parameter Estimate Method to Determine the Optimal Thickness for DSSC Electrode
    Tian, Hanmin
    Chen, Aihua
    Duan, Wenfeng
    Yang, Ruixia
    Tian, Fenglan
    [J]. MATERIALS FOR ENERGY CONVERSION AND STORAGE, 2012, 519 : 57 - +
  • [4] THE INFORMATION BOTTLENECK METHOD FOR OPTIMAL PREDICTION OF MULTILEVEL AGENT-BASED SYSTEMS
    Lamarche-Perrin, Robin
    Banisch, Sven
    Olbrich, Eckehard
    [J]. ADVANCES IN COMPLEX SYSTEMS, 2016, 19 (1-2):
  • [5] Learning Optimal Primary Capsules by Information Bottleneck
    Hu, Ming-fei
    Liu, Jian-wei
    Li, Wei-min
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT I, 2021, 12891 : 519 - 528
  • [6] Learning Optimal Representations with the Decodable Information Bottleneck
    Dubois, Yann
    Kiela, Douwe
    Schwab, David J.
    Vedantam, Ramakrishna
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [7] An optimal information method for mobile manipulator dynamic parameter identification
    Sujan, VA
    Dubowsky, S
    [J]. IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2003, 8 (02) : 215 - 225
  • [8] Theory and Application of the Information Bottleneck Method
    Lewandowsky, Jan
    Bauch, Gerhard
    [J]. ENTROPY, 2024, 26 (03)
  • [9] Optimal prediction with resource constraints using the information bottleneck
    Sachdeva, Vedant
    Mora, Thierry
    Walczak, Aleksandra M.
    Palmer, Stephanie E.
    [J]. PLOS COMPUTATIONAL BIOLOGY, 2021, 17 (03)
  • [10] A-optimal design method to determine the regularization parameter of coseismic slip distribution inversion
    Wang, Leyang
    Gu, Wangwang
    [J]. GEOPHYSICAL JOURNAL INTERNATIONAL, 2020, 221 (01) : 440 - 450