A maximum entropy approach to natural language processing

被引:28
|
作者
Berger, AL [1 ]
DellaPietra, SA [1 ]
DellaPietra, VJ [1 ]
机构
[1] RENAISSANCE TECHNOL, STONY BROOK, NY USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The concept of maximum entropy can be traced back along multiple threads to Biblical times. Only recently, however, have computers become powerful enough to permit the widescale application of this concept to real world problems in statistical estimation and pattern recognition. In this paper, we describe a method for statistical modeling based on maximum entropy. We present a maximum-likelihood approach for automatically constructing maximum entropy models and describe how to implement this approach efficiently, using as examples several problems in natural language processing.
引用
收藏
页码:39 / 71
页数:33
相关论文
共 50 条
  • [21] A field theoretical approach to medical natural language processing
    Taira, Ricky K.
    Bashyarn, Vijayaraghavan
    Kangarloo, Hooshang
    IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, 2007, 11 (04): : 364 - 375
  • [22] AN APPROACH TO KNOWLEDGE ACQUISITION FOR NATURAL-LANGUAGE PROCESSING
    WEISCHEDEL, RM
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 1989, 197 : 20 - CINF
  • [23] Natural Language Processing for Arabic Metaphors: A Conceptual Approach
    Alkhatib, Manar
    Shaalan, Khaled
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT SYSTEMS AND INFORMATICS 2016, 2017, 533 : 170 - 181
  • [24] A natural language processing approach for avoidance of feature interactions
    Charnois, T
    FEATURE INTERACTIONS IN TELECOMMUNICATION NETWORKS IV, 1997, : 347 - 363
  • [25] Quality of legislation and compliance: a natural language processing approach
    Osnabrugge, Moritz
    Vannoni, Matia
    POLITICAL SCIENCE RESEARCH AND METHODS, 2024,
  • [26] Big data for Natural Language Processing: A streaming approach
    Agerri, Rodrigo
    Artola, Xabier
    Beloki, Zuhaitz
    Rigau, German
    Soroa, Aitor
    KNOWLEDGE-BASED SYSTEMS, 2015, 79 : 36 - 42
  • [27] Pattern Mining with Natural Language Processing: An Exploratory Approach
    Mendes, Ana Cristina
    Antunes, Claudia
    MACHINE LEARNING AND DATA MINING IN PATTERN RECOGNITION, 2009, 5632 : 266 - +
  • [28] A Natural Language Processing Approach to Social License Management
    Boutilier, Robert G.
    Bahr, Kyle
    SUSTAINABILITY, 2020, 12 (20) : 1 - 12
  • [29] AN EXPERT SYSTEM APPROACH TO NATURAL-LANGUAGE PROCESSING
    METZLER, DP
    NOREAULT, T
    HAAS, DF
    COSIC, C
    PROCEEDINGS OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE, 1985, 22 : 301 - 307
  • [30] An improved maximum entropy language model
    Fang, GL
    Wen, G
    2002 6TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS, VOLS I AND II, 2002, : 1083 - 1086