Minimum Expected Length of Fixed-to-Variable Lossless Compression of Memoryless Sources

被引：0

作者：

Szpankowski, Wojciech ^{[1
]}

Verdu, Sergio ^{[2
]}

机构：

[1] Purdue Univ, Dept Comp Sci, W Lafayette, IN 47907 USA

[2] Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA

来源：

2009 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, VOLS 1- 4 | 2009年

关键词：

ENTROPY; BOUNDS;

D O I：

10.1109/ISIT.2009.5205737

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

Conventional wisdom states that the minimum expected length for fixed-to-variable length encoding of an n-block memoryless source with entropy H grows as nH+O(1). However, this performance is obtained under the constraint that the code assigned to the whole n-block is a prefix code. Dropping this unnecessary constraint we show that the minimum expected length grows as nH - 1/2 log n + O(1) unless the source is equiprobable.

引用

页码：369 / +

页数：3

共 50 条

[1] Minimum Expected Length of Fixed-to-Variable Lossless Compression Without Prefix Constraints
Szpankowski, Wojciech
Verdu, Sergio
[J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2011, 57 (07) : 4017 - 4025
[2] VARIABLE-TO-FIXED LENGTH CODES ARE BETTER THAN FIXED-TO-VARIABLE LENGTH CODES FOR MARKOV SOURCES
ZIV, J
[J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 1990, 36 (04) : 861 - 863
[3] Threshold of Overflow Probability Using Smooth Max-Entropy in Lossless Fixed-to-Variable Length Source Coding for General Sources
Saito, Shota
Matsushima, Toshiyasu
[J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2016, E99A (12): : 2286 - 2290
[4] Fixed-to-Variable Length Distribution Matching
Amjad, Rana Ali
Boecherer, Georg
[J]. 2013 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2013, : 1511 - 1515
[5] Non-Asymptotic Bounds for Optimal Fixed-to-Variable Lossless Compression without Prefix Constraints
Sason, Igal
Verdu, Sergio
[J]. 2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2018, : 2211 - 2215
[6] Almost Instantaneous Fixed-to-Variable Length Codes
Yamamoto, Hirosuke
Tsuchihashi, Masato
Honda, Junya
[J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2015, 61 (12) : 6432 - 6443
[7] Fixed-to-Variable Length Resolution Coding for Target Distributions
Boecherer, Georg
Amjad, Rana Ali
[J]. 2013 IEEE INFORMATION THEORY WORKSHOP (ITW), 2013,
[8] Fixed-length lossy compression in the finite blocklength regime: discrete memoryless sources
Kostina, Victoria
Verdu, Sergio
[J]. 2011 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2011, : 41 - 45
[9] Fixed-to-variable length source coding using turbo codes
Haghighat, Javad
Hamouda, Walaa
Soleymani, M. Reza
[J]. 2006 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS DESIGN AND IMPLEMENTATION, 2006, : 215 - 219
[10] On the Overflow Probability of Fixed-to-Variable Length Codes with Side Information
Nomura, Ryo
Matsushima, Toshiyasu
[J]. 2010 DATA COMPRESSION CONFERENCE (DCC 2010), 2010, : 548 - 548

← 1 2 3 4 5 →