A conditional-logical approach to minimum cross-entropy

被引:0
|
作者
Kern-Isberner, G [1 ]
机构
[1] Fernuniversitat Hagen, Fachbereich Informat, D-58084 Hagen, Germany
关键词
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The principle of minimum cross-entropy (ME-principle) is often used in the AI-areas of knowledge representation and uncertain reasoning as an elegant and powerful tool to build up complete probability distributions when only partial knowledge is available. The inputs it may be applied to are a prior distribution P and some new information R, and it yields as a result the one distribution P* that satisfies R and is closest to P in an information-theoretic sense. More generally, it provides a "best" solution to the problem "How to adjust P to R?" In this paper, we show in a rather direct and constructive manner that adjusting P to R by means of this principle follows a simple and intelligible conditional-logical pattern. The scheme that underlies ME-adjustment is made obvious, and in a generalized form, it provides a straightforward conditional-logical approach to the adaptation problem. We introduce the idea of a functional concept and show how the demands for logical consistency and representation invariance influence the functions involved. Finally, the ME-distribution arises as the only solution which follows the simple adaptation scheme given and satisfies these three assumptions. So a characterization of the ME-principle within a conditional-logical framework will have been achieved, and its logical mechanisms will be revealed clearly.
引用
收藏
页码:237 / 248
页数:12
相关论文
共 50 条
  • [21] DERIVATION OF REGRESSION FORMULAS USING THE MINIMUM CROSS-ENTROPY PRINCIPLE
    CYRANSKI, JF
    [J]. INFORMATION SCIENCES, 1982, 26 (03) : 257 - 265
  • [22] AXIOMATIC DERIVATION OF THE PRINCIPLE OF MAXIMUM-ENTROPY AND THE PRINCIPLE OF MINIMUM CROSS-ENTROPY
    SHORE, JE
    JOHNSON, RW
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 1980, 26 (01) : 26 - 37
  • [23] Cross-Entropy Approach for Computing a Pareto Fronts
    Sebaa, Karim
    [J]. UKSIM-AMSS 15TH INTERNATIONAL CONFERENCE ON COMPUTER MODELLING AND SIMULATION (UKSIM 2013), 2013, : 61 - 66
  • [24] Minimum cross-entropy methods for rare-event simulation
    Ridder, Ad
    Rubinstein, Reuven
    [J]. SIMULATION-TRANSACTIONS OF THE SOCIETY FOR MODELING AND SIMULATION INTERNATIONAL, 2007, 83 (11): : 769 - 784
  • [25] Minimum cross-entropy reconstruction for synthetic aperture radar imagery
    Grippa, M
    Woodhouse, IH
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2005, 26 (05) : 967 - 980
  • [26] MINIMUM CROSS-ENTROPY SPECTRAL-ANALYSIS AND PREWHITENING METHODS
    BURR, RL
    [J]. IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1987, 35 (10): : 1473 - 1473
  • [27] MINIMUM CROSS-ENTROPY SPECTRAL-ANALYSIS OF MULTIPLE SIGNALS
    JOHNSON, RW
    SHORE, JE
    [J]. IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1983, 31 (03): : 574 - 582
  • [28] Multiobjective Optimization Using Cross-Entropy Approach
    Sebaa, Karim
    Tlemcani, Abdelhalim
    Bouhedda, Mounir
    Henini, Noureddine
    [J]. JOURNAL OF OPTIMIZATION, 2013, 2013
  • [29] Dynamic Cross-Entropy
    Aur, Dorian
    Vila-Rodriguez, Fidel
    [J]. JOURNAL OF NEUROSCIENCE METHODS, 2017, 275 : 10 - 18
  • [30] Constrained non-linear programming: A minimum cross-entropy algorithm
    Das, NC
    Mazumder, SK
    De, K
    [J]. ENGINEERING OPTIMIZATION, 1999, 31 (04) : 479 - 487