A DICTIONARY RETRIEVAL ALGORITHM USING 2 TRIE STRUCTURES

被引:1
|
作者
MORIMOTO, K
IRIGUCHI, H
AOE, J
机构
[1] Faculty of Engineering, Tokushima University, Tokushima
关键词
NATURAL LANGUAGE PROCESSING; TRIE STRUCTURE; SEARCHING TECHNIQUE; DICTIONARY SEARCHING;
D O I
10.1002/scj.4690260209
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The trie has the feature that the retrieval can be executed with the character symbols composing the key as the unit, and a high-speed retrieval is realized independently of the total number of keys. Consequently, it used frequently in the search of the natural language dictionary and in other problems. A problem, however, is that the number of trie states increases with the enlargement of the key set, which necessitates a larger memory capacity. To remedy this point, DAWG (Directed Acyclic Word-Graph) is proposed, where the common suffix of the tries is compressed. Then, a new problem arises in that the record information cannot be determined uniquely for the key. For this problem, this paper introduces a new structure, where the number of states is reduced by merging the common suffixes of the tries, while determining uniquely the record information for the key. The algorithm for retrieval, insertion and deletion of the key is proposed for the structure. In the proposed method, the set of keys is represented using two tries. One of the tries memorizes the prefix of the minimum length that can discriminate uniquely between the key from other keys. The other trie stores the suffixes of the remaining keys in order to merge the common suffix. A simulation is executed for various sets of keys such as Chinese character called Kanji, alphabets and Japanese Katakana characters, and it is seen that the number of states is reduced by approximately 30 to 65 percent for the key set of 50,000 words, compared to the ordinary trie.
引用
收藏
页码:85 / 97
页数:13
相关论文
共 50 条
  • [21] A dynamic construction algorithm for the Compact Patricia trie using the hierarchical structure
    Jung, M
    Shishibori, M
    Tanaka, Y
    Aoe, J
    INFORMATION PROCESSING & MANAGEMENT, 2002, 38 (02) : 221 - 236
  • [22] THE VARIANCE OF A PARTIAL MATCH RETRIEVAL IN A MULTIDIMENSIONAL SYMMETRICAL TRIE
    SCHACHINGER, W
    RANDOM STRUCTURES & ALGORITHMS, 1995, 7 (01) : 81 - 95
  • [23] GPU R-Trie: Dictionary with ultra fast lookup
    Kaczmarski, Krzysztof
    Wolant, Albert
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2019, 31 (19):
  • [24] Image Retrieval Algorithm based on Compressed Sensing and Dictionary Learning Methods
    Yang, Xu
    Sun, Ruiting
    Yu, Chenning
    PROCEEDINGS OF THE 2017 5TH INTERNATIONAL CONFERENCE ON MACHINERY, MATERIALS AND COMPUTING TECHNOLOGY (ICMMCT 2017), 2017, 126 : 587 - 594
  • [25] Enhanced KStore With the Use of Dictionary and Trie for Retail Business Data
    Li, Jiandong
    Huang, Runhe
    PROCEEDINGS OF 2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA ANALYSIS (ICBDA), 2016, : 99 - 103
  • [26] Fast feature selection algorithm for neighborhood rough set model based on Bucket and Trie structures
    Benouini, Rachid
    Batioua, Imad
    Ezghari, Soufiane
    Zenkouar, Khalid
    Zahi, Azeddine
    GRANULAR COMPUTING, 2020, 5 (03) : 329 - 347
  • [27] Fast feature selection algorithm for neighborhood rough set model based on Bucket and Trie structures
    Rachid Benouini
    Imad Batioua
    Soufiane Ezghari
    Khalid Zenkouar
    Azeddine Zahi
    Granular Computing, 2020, 5 : 329 - 347
  • [28] Trie Compact Representation using Double-array Structures with String Labels
    Kanda, Shunsuke
    Fuketa, Masao
    Morita, Kazuhiro
    Aoe, Jun-ichi
    2015 IEEE 8TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL INTELLIGENCE AND APPLICATIONS (IWCIA) PROCEEDINGS, 2015, : 3 - 8
  • [29] Compressing Virtual Forwarding Information Bases Using the Trie-folding Algorithm
    Mihalka, Bence
    Koroesi, Attila
    Retvari, Gabor
    ADVANCES IN COMMUNICATION NETWORKING, 2014, 8846 : 121 - 133
  • [30] A retrieval algorithm for TanSat XCO2 observation: Retrieval experiments using GOSAT data
    LIU Yi
    YANG DongXu
    CAI ZhaoNan
    Science Bulletin, 2013, (13) : 1520 - 1523