A space and time efficient algorithm for constructing compressed suffix arrays

被引:38
|
作者
Hon, Wing-Kai [1 ]
Lam, Tak-Wah
Sadakane, Kunihiko
Sung, Wing-Kin
Yiu, Siu-Ming
机构
[1] Univ Hong Kong, Dept Comp Sci, Hong Kong, Hong Kong, Peoples R China
[2] Kyushu Univ, Dept Comp Sci & Commun Engn, Fukuoka 812, Japan
[3] Natl Univ Singapore, Sch Comp, Singapore 117548, Singapore
关键词
text indexing; pattern matching; compression; construction;
D O I
10.1007/s00453-006-1228-8
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With the first human DNA being decoded into a sequence of about 2.8 billion characters, much biological research has been centered on analyzing this sequence. Theoretically speaking, it is now feasible to accommodate an index for human DNA in the main memory so that any pattern can be located efficiently. This is due to the recent breakthrough on compressed suffix arrays, which reduces the space requirement from O (n log n) bits to O (n) bits. However, Constructing compressed suffix arrays is still not an easy task because we still have to compute suffix arrays first and need a working memory of O (n log it) bits (i.e., more than 13 gigabytes for human DNA). This paper initiates the study of constructing compressed suffix arrays directly from the text. The main contribution is a construction algorithm that uses only O (n) bits of working memory, and the time complexity is O (n log n). Our construction algorithm is also time and space efficient for texts with large alphabets such as Chinese or Japanese. Precisely, when the alphabet size is vertical bar Sigma vertical bar, the working space is O (n log vertical bar Sigma vertical bar) bits, and the time complexity remains O (n log n), which is independent of vertical bar Sigma vertical bar.
引用
收藏
页码:23 / 36
页数:14
相关论文
共 50 条
  • [1] A Space and Time Efficient Algorithm for Constructing Compressed Suffix Arrays
    Wing-Kai Hon
    Tak-Wah Lam
    Kunihiko Sadakane
    Wing-Kin Sung
    Siu-Ming Yiu
    Algorithmica, 2007, 48 : 23 - 36
  • [2] Constructing compressed suffix arrays with large alphabets
    Hon, WK
    Lam, TW
    Sadakane, K
    Sung, WK
    ALGORITHMS AND COMPUTATION, PROCEEDINGS, 2003, 2906 : 240 - 249
  • [3] Space efficient linear time construction of suffix arrays
    Ko, P
    Aluru, S
    COMBINATORIAL PATTERN MATCHING, PROCEEDINGS, 2003, 2676 : 200 - 210
  • [4] Space efficient linear time construction of suffix arrays
    Ko, Pang
    Aluru, Srinivas
    JOURNAL OF DISCRETE ALGORITHMS, 2005, 3 (2-4) : 143 - 156
  • [5] Constructing suffix arrays in linear time
    Kim, Dong Kyue
    Sim, Jeong Seop
    Park, Heejin
    Park, Kunsoo
    JOURNAL OF DISCRETE ALGORITHMS, 2005, 3 (2-4) : 126 - 142
  • [6] Time-space trade-offs for compressed suffix arrays
    Rao, SS
    INFORMATION PROCESSING LETTERS, 2002, 82 (06) : 307 - 311
  • [7] Time and space efficient search for small alphabets with suffix arrays
    Sim, JS
    FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, PT 1, PROCEEDINGS, 2005, 3613 : 1102 - 1107
  • [8] A quick tour on suffix arrays and compressed suffix arrays
    Grossi, Roberto
    THEORETICAL COMPUTER SCIENCE, 2011, 412 (27) : 2964 - 2973
  • [9] A fast algorithm for constructing suffix arrays for DNA alphabets
    Rabea, Zeinab
    El-Metwally, Sara
    Elmougy, Samir
    Zakaria, Magdi
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (07) : 4659 - 4668
  • [10] Collapsing the Hierarchy of Compressed Data Structures: Suffix Arrays in Optimal Compressed Space
    Kempa, Dominik
    Kociumaka, Tomasz
    2023 IEEE 64TH ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, FOCS, 2023, : 1877 - 1886