Minimax Renyi Redundancy

被引：4
|
作者：
Yagli, Semih [1 ]
Altug, Yucel [2 ]
Verdu, Sergio [1 ]
机构：
[1] Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA
[2] Natera Inc, San Carlos, CA 94070 USA
来源：
IEEE TRANSACTIONS ON INFORMATION THEORY | 2018年 / 64卷 / 05期
基金：
美国国家科学基金会;
关键词：
Universal lossless compression; generalized redundancy-capacity theorem; minimax redundancy; minimax regret; Jeffreys' prior; risk aversion; Renyi divergence; alpha-mutual information; DATA-COMPRESSION; RISK-AVERSION; INFORMATION; ASYMPTOTICS; STRATEGIES;
D O I：
10.1109/TIT.2018.2803070
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
The redundancy for universal lossless compression of discrete memoryless sources in Campbell's setting is characterized as a minimax Renyi divergence, which is shown to be equal to the maximal alpha-mutual information via a generalized redundancy-capacity theorem. Special attention is placed on the analysis of the asymptotics of minimax Renyi divergence, which is determined up to a term vanishing in blocklength.
引用
收藏
页码：3715 / 3733
页数：19
相关论文
共 50 条
  • [1] Minimax Renyi Redundancy
    Yagli, Semih
    Altug, Yucel
    Verdu, Sergio
    2017 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2017,
  • [2] The precise minimax redundancy
    Drmota, M
    Szpankowski, W
    ISIT: 2002 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, PROCEEDINGS, 2002, : 35 - 35
  • [3] THE RENYI REDUNDANCY OF GENERALIZED HUFFMAN CODES
    BLUMER, AC
    MCELIECE, RJ
    IEEE TRANSACTIONS ON INFORMATION THEORY, 1988, 34 (05) : 1242 - 1249
  • [4] Minimax Redundancy for Large Alphabets
    Szpankowski, Wojciech
    Weinberger, Marcelo J.
    2010 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, 2010, : 1488 - 1492
  • [5] Precise minimax redundancy and regret
    Drmota, M
    Szpankowski, W
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2004, 50 (11) : 2686 - 2707
  • [6] Minimax redundancy for the class of memoryless sources
    Xie, Q
    Barron, AR
    IEEE TRANSACTIONS ON INFORMATION THEORY, 1997, 43 (02) : 646 - 657
  • [7] Precise minimax redundancy for Markov sources
    Jacquet, P
    Szpankowski, W
    2003 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY - PROCEEDINGS, 2003, : 78 - 78
  • [8] Markov types and minimax redundancy for Markov sources
    Jacquet, P
    Szpankowski, W
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2004, 50 (07) : 1393 - 1402
  • [9] The minimax distortion redundancy in noisy source coding
    Dembo, A
    Weissman, T
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2003, 49 (11) : 3020 - 3030
  • [10] The minimax distortion redundancy in noisy source coding
    Dembo, A
    Weissman, T
    ISIT: 2002 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, PROCEEDINGS, 2002, : 318 - 318
12345