On the AEP of word-valued sources

被引：9
|
作者：
Nishiara, M [1 ]
Morita, H [1 ]
机构：
[1] Univ Electrocommun, Grad Sch Informat Syst, Chofu, Tokyo 1828585, Japan
来源：
IEEE TRANSACTIONS ON INFORMATION THEORY | 2000年 / 46卷 / 03期
关键词：
AEP; entropy rate; information source class; lossless data compression; string parsing;
D O I：
10.1109/18.841193
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
We consider a new class of information sources called word-valued sources in order to investigate coding algorithms based upon string parsing. A word-valued source is defined as a pair of an independent and identically distributed (i.i.d.) source with a countable alphabet and a function that maps each symbol into a finite sequence over a finite alphabet. A word-valued source is a nonstationary process and has countable states. Lf the function of a word-valued source is prefix-free, the entropy rate is characterized with a simple expression and the AEP (Asymptotic Equipartition Property) holds.
引用
收藏
页码：1116 / 1120
页数：5
相关论文
共 50 条
  • [1] Word-Valued Sources: An Ergodic Theorem, an AEP, and the Conservation of Entropy
    Timo, Roy
    Blackmore, Kim
    Hanlen, Leif
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 56 (07) : 3139 - 3148
  • [2] On the Entropy Rate of Word-Valued Sources
    Timo, R.
    Blackmore, K.
    Hanlen, L.
    2007 AUSTRALASIANTELECOMMUNICATION NETWORKS AND APPLICATIONS CONFERENCE, 2007, : 399 - +
  • [3] Word segmentation for the sequences emitted from a word-valued source
    School of Science and Engineering, Waseda University, Okubo 3-4-1, Shinjuku-ku, Tokyo, 169-8555, Japan
    CIT: IEEE Int Conf Comput Inf Technol, (662-667):
  • [4] Word segmentation for the sequences emitted from a word-valued source
    Ishida, Takashi
    Matsushima, Toshiyasu
    Hirasawa, Shigeichi
    2007 CIT: 7TH IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY, PROCEEDINGS, 2007, : 662 - 667
  • [5] Properties of a word-valued source with a non-prefix-free word set
    Ishida, Takashi
    Goto, Masayuki
    Matsushima, Toshiyasu
    Hirasawa, Shigeichi
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2006, E89A (12) : 3710 - 3723
  • [6] On strong limit theorems for general information sources with an application to AEP
    Wang, Zhong-Zhi
    Yang, Shan-Shan
    Jiang, Hai-Feng
    Ding, Fang-Qing
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2021, 50 (06) : 1387 - 1399
  • [7] Real-valued syntactic word vectors
    Basirat, A.
    Nivre, J.
    JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 2020, 32 (04) : 557 - 579
  • [8] Individualism: an investigation into the sources of the word
    Behrent, Michael C.
    FRENCH STUDIES, 2019, 73 (04) : 668 - 669
  • [9] SOURCES OF INFORMATION IN WORD PERCEPTION
    CLAXTON, GL
    CANADIAN JOURNAL OF PSYCHOLOGY-REVUE CANADIENNE DE PSYCHOLOGIE, 1975, 29 (04): : 292 - 301
  • [10] 2 BILATERAL SOURCES OF THE LATE AEP AS IDENTIFIED BY A SPATIO-TEMPORAL DIPOLE MODEL
    SCHERG, M
    VONCRAMON, D
    ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1985, 62 (01): : 32 - 44
12345