A space and time efficient algorithm for constructing compressed suffix arrays

被引:38
|
作者
Hon, Wing-Kai [1 ]
Lam, Tak-Wah
Sadakane, Kunihiko
Sung, Wing-Kin
Yiu, Siu-Ming
机构
[1] Univ Hong Kong, Dept Comp Sci, Hong Kong, Hong Kong, Peoples R China
[2] Kyushu Univ, Dept Comp Sci & Commun Engn, Fukuoka 812, Japan
[3] Natl Univ Singapore, Sch Comp, Singapore 117548, Singapore
关键词
text indexing; pattern matching; compression; construction;
D O I
10.1007/s00453-006-1228-8
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With the first human DNA being decoded into a sequence of about 2.8 billion characters, much biological research has been centered on analyzing this sequence. Theoretically speaking, it is now feasible to accommodate an index for human DNA in the main memory so that any pattern can be located efficiently. This is due to the recent breakthrough on compressed suffix arrays, which reduces the space requirement from O (n log n) bits to O (n) bits. However, Constructing compressed suffix arrays is still not an easy task because we still have to compute suffix arrays first and need a working memory of O (n log it) bits (i.e., more than 13 gigabytes for human DNA). This paper initiates the study of constructing compressed suffix arrays directly from the text. The main contribution is a construction algorithm that uses only O (n) bits of working memory, and the time complexity is O (n log n). Our construction algorithm is also time and space efficient for texts with large alphabets such as Chinese or Japanese. Precisely, when the alphabet size is vertical bar Sigma vertical bar, the working space is O (n log vertical bar Sigma vertical bar) bits, and the time complexity remains O (n log n), which is independent of vertical bar Sigma vertical bar.
引用
收藏
页码:23 / 36
页数:14
相关论文
共 50 条
  • [21] A Categorization Theorem on Suffix Arrays with Applications to Space Efficient Text Indexes
    He, Meng
    Munro, J. Ian
    Rao, S. Srinivasa
    PROCEEDINGS OF THE SIXTEENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, 2005, : 23 - 32
  • [22] Compressed suffix arrays and suffix trees with applications to text indexing and string matching
    Grossi, R
    Vitter, JS
    SIAM JOURNAL ON COMPUTING, 2005, 35 (02) : 378 - 407
  • [23] The Adaptive Suffix Tree: A Space Efficient Sequence Learning Algorithm
    Gunasinghe, Upuli
    Alahakoon, Damminda
    2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [24] Space-Efficient Construction Algorithm for the Circular Suffix Tree
    Hon, Wing-Kai
    Ku, Tsung-Han
    Shah, Rahul
    Thankachan, Sharma V.
    COMBINATORIAL PATTERN MATCHING, 2013, 7922 : 142 - 152
  • [25] Space-Efficient Construction Algorithm for the Circular Suffix Tree
    Hon, Wing-Kai
    Ku, Tsung-Han
    Shah, Rahul
    Thankachan, Sharma V.
    2013 DATA COMPRESSION CONFERENCE (DCC), 2013, : 496 - 496
  • [26] New text indexing functionalities of the compressed suffix arrays
    Sadakane, K
    JOURNAL OF ALGORITHMS-COGNITION INFORMATICS AND LOGIC, 2003, 48 (02): : 294 - 313
  • [27] gsufsort: constructing suffix arrays, LCP arrays and BWTs for string collections
    Felipe A. Louza
    Guilherme P. Telles
    Simon Gog
    Nicola Prezza
    Giovanna Rosone
    Algorithms for Molecular Biology, 15
  • [28] Approximate string matching using compressed suffix arrays
    Huynh, TND
    Hon, WK
    Lam, TW
    Sung, WK
    THEORETICAL COMPUTER SCIENCE, 2006, 352 (1-3) : 240 - 249
  • [29] gsufsort: constructing suffix arrays, LCP arrays and BWTs for string collections
    Louza, Felipe A.
    Telles, Guilherme P.
    Gog, Simon
    Prezza, Nicola
    Rosone, Giovanna
    ALGORITHMS FOR MOLECULAR BIOLOGY, 2020, 15 (01)
  • [30] Improved and extended locating functionality on compressed suffix arrays
    Gog, Simon
    Navarro, Gonzalo
    Petri, Matthias
    JOURNAL OF DISCRETE ALGORITHMS, 2015, 32 : 53 - 63