A unified matrix representation for calculating entropy quantities

被引:2
|
作者
Al-Sammak, A. J. [1 ]
机构
[1] Univ Bahrain, Dept Elect & Elect Engn, Isa Town, Bahrain
关键词
entropy calculations; information theory; matrix representation;
D O I
10.7227/IJEEE.43.2.6
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
In this paper a unified framework for presenting various entropy quantities needed in information theory is given. This method allows an easy, elegant and compact presentation and lends itself to easy implementation using standard mathematical/engineering software. Examples illustrating the use of this technique are given together with a general MATLAB program for calculating entropies as well as the channel capacity. The technique was preferred over classical representations by undergraduate students taking a first course on digital communications.
引用
收藏
页码:164 / 172
页数:9
相关论文
共 50 条
  • [31] Calculating Time-Integral Quantities in Depletion Calculations
    Isotalo, Aarno
    NUCLEAR SCIENCE AND ENGINEERING, 2016, 183 (03) : 421 - 429
  • [32] Pseudotensor Applied to Numerical Relativity in Calculating Global Quantities
    Tsai, Chung-Chin
    Lin, Chun-Yu
    Yo, Hwei-Jang
    CHINESE JOURNAL OF PHYSICS, 2015, 53 (06)
  • [33] Matrix representation of the conditional entropy for incremental feature selection on multi-source data
    Huang, Yanyong
    Guo, Kejun
    Yi, Xiuwen
    Li, Zhong
    Li, Tianrui
    INFORMATION SCIENCES, 2022, 591 : 263 - 286
  • [34] Entropy and complexity of finite sequences as fluctuating quantities
    Jiménez-Montaño, MA
    Ebeling, W
    Pohl, T
    Rapp, PE
    BIOSYSTEMS, 2002, 64 (1-3) : 23 - 32
  • [35] SUBJECT REPRESENTATION AND ENTROPY
    IYER, H
    INTERNATIONAL CLASSIFICATION, 1992, 19 (01): : 15 - 18
  • [36] Nother conserved quantities and entropy in General Relativity
    Allemandi, G
    Fatibene, L
    Ferraris, M
    Francaviglia, M
    Raiteri, M
    RECENT DEVELOPMENTS IN GENERAL RELATIVITY, GENOA 2000, 2002, : 75 - 91
  • [37] Entropy and Its Correlations with Other Related Quantities
    Wu, Jing
    Guo, Zeng-Yuan
    ENTROPY, 2014, 16 (02): : 1089 - 1100
  • [38] NONEQUILIBRIUM EXPRESSIONS FOR ENTROPY AND OTHER THERMODYNAMIC QUANTITIES
    DUFOUR, CG
    JOURNAL OF STATISTICAL PHYSICS, 1977, 17 (02) : 61 - 70
  • [39] Conserved quantities, entropy and the dS/CFT correspondence
    Mann, RB
    Ghezelbash, AM
    THEORETICAL PHYSICS: MRST 2002: A TRIBUTE TO GEORGE LEIBBRANDT, 2002, 646 : 217 - 222
  • [40] Entropy, approximation quantities and the asymptotics of the modulus of continuity
    Richter, C
    MATHEMATISCHE NACHRICHTEN, 1999, 198 : 179 - 188