n-Gram-based indexing for Korean text retrieval

Two groups of indexing methods and morpheme-based indexing have been investigated in the literature of Korean text retrieval. The word-based indexing eliminates the suffix of a word, and generates its remaining stem as an index term. The index term is often a compound noun, which results in the serious decrease of retrieval effectiveness. The morpheme-based indexing overcomes the problem of compound nouns by decomposing a compound noun into simple nouns. It, however, requires a large dictionary and complex linguistic knowledge. In this paper we propose a new indexing method based on n-gram-based indexing is considerably faster than the morpheme-based indexing, and also provides better retrieval effectiveness. (C) 1999 Elsevier Science Ltd. All rights reserved.