Automatic new word extraction method

被引:0
|
作者
Shi, Q
Shen, LQ
Chai, HX
机构
关键词
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
New words are very difficult to be extracted automatically for those languages where there is no word boundary in written texts, such as Chinese, Japanese etc. In this paper, we present a statistical method to extract new words from a large amount of corpus with no word boundary. Based on Generalized Suffix Tree (GST) data structure we define NWP (New Word Pattern) and SBP (Segmentation Boundary Pattern) to separate input strings into small pieces, and offer a practical and efficient algorithm to get the proper words from GST.
引用
收藏
页码:865 / 868
页数:4
相关论文
共 50 条
  • [41] A NEW FEATURE SELECTION METHOD BASED ON CONCEPT EXTRACTION IN AUTOMATIC CHINESE TEXT CLASSIFICATION
    Liao, Shasha
    Jiang, Minghu
    NEW MATHEMATICS AND NATURAL COMPUTATION, 2007, 3 (03) : 331 - 347
  • [42] Automatic word processing: A new forum for hypnotic expression
    Anbar, RD
    AMERICAN JOURNAL OF CLINICAL HYPNOSIS, 2001, 44 (01) : 27 - 36
  • [43] AUTOMATIC NEW WORD ACQUISITION - SPELLING FROM ACOUSTICS
    ALLEVA, F
    LEE, KF
    SPEECH AND NATURAL LANGUAGE, 1989, : 266 - 270
  • [44] A geometric method for automatic extraction of sulcal fundi
    Kao, C. -Y.
    Hofer, M.
    Sapiro, G.
    Stern, J.
    Rottenberg, D. A.
    2006 3RD IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: MACRO TO NANO, VOLS 1-3, 2006, : 1168 - +
  • [45] An Automatic Extraction Method of Surveillance Visual Context
    Liang, Haozhe
    Xu, Shukui
    Li, Guohui
    INTELLIGENCE COMPUTATION AND EVOLUTIONARY COMPUTATION, 2013, 180 : 733 - 741
  • [46] Research on automatic extraction method of thermal discharge
    Zhu, Xiu-Fang
    Li, Yuan
    Zhongguo Huanjing Kexue/China Environmental Science, 2023, 43 (11): : 6115 - 6122
  • [47] A geometric method for automatic extraction of sulcal fundi
    Kao, Chiu-Yen
    Hofer, Michael
    Sapiro, Guillermo
    Stern, Josh
    Rehm, Kelly
    Rottenberg, David A.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2007, 26 (04) : 530 - 540
  • [48] CrackDex: Universal and Automatic DEX Extraction Method
    Jiang, Zhongqing
    Zhou, Anmin
    Liu, Liang
    Jia, Peng
    Liu, Luping
    Zuo, Zheng
    PROCEEDINGS OF 2017 IEEE 7TH INTERNATIONAL CONFERENCE ON ELECTRONICS INFORMATION AND EMERGENCY COMMUNICATION (ICEIEC), 2017, : 53 - 60
  • [49] AUTOMATIC SOLVENT EXTRACTION APPARATUS AND METHOD FOR URANIUM
    KIENBERGER, CA
    ANALYTICAL CHEMISTRY, 1957, 29 (11) : 1721 - 1722
  • [50] An Automatic Extraction Method of Cerebrovascular Centerline for MRA
    Du, Chencheng
    Li, Ping'an
    Wang, Kehao
    PROCEEDINGS OF 2016 5TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT), 2016, : 730 - 734