A maximum entropy approach to natural language processing

被引：28
|
作者：
Berger, AL [1 ]
DellaPietra, SA [1 ]
DellaPietra, VJ [1 ]
机构：
[1] RENAISSANCE TECHNOL, STONY BROOK, NY USA
来源：
COMPUTATIONAL LINGUISTICS | 1996年 / 22卷 / 01期
关键词：
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
The concept of maximum entropy can be traced back along multiple threads to Biblical times. Only recently, however, have computers become powerful enough to permit the widescale application of this concept to real world problems in statistical estimation and pattern recognition. In this paper, we describe a method for statistical modeling based on maximum entropy. We present a maximum-likelihood approach for automatically constructing maximum entropy models and describe how to implement this approach efficiently, using as examples several problems in natural language processing.
引用
收藏
页码：39 / 71
页数：33
相关论文
共 50 条
  • [1] Learning to parse natural language with maximum entropy models
    Ratnaparkhi, A
    MACHINE LEARNING, 1999, 34 (1-3) : 151 - 175
  • [2] Learning to Parse Natural Language with Maximum Entropy Models
    Adwait Ratnaparkhi
    Machine Learning, 1999, 34 : 151 - 175
  • [3] Bayesian and Maximum Entropy Approach in data processing
    Lv, W.
    Tong, L.
    Tian, Y.
    2006 INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CIRCUITS AND SYSTEMS PROCEEDINGS, VOLS 1-4: VOL 1: SIGNAL PROCESSING, 2006, : 344 - +
  • [4] Using the Maximum Entropy Method for Natural Language Processing: Category Estimation, Feature Extraction, and Error Correction
    Murata, Masaki
    Uchimoto, Kiyotaka
    Utiyama, Masao
    Ma, Qing
    Nishimura, Ryo
    Watanabe, Yasuhiko
    Doi, Kouichi
    Torisawa, Kentaro
    COGNITIVE COMPUTATION, 2010, 2 (04) : 272 - 279
  • [5] Using the Maximum Entropy Method for Natural Language Processing: Category Estimation, Feature Extraction, and Error Correction
    Masaki Murata
    Kiyotaka Uchimoto
    Masao Utiyama
    Qing Ma
    Ryo Nishimura
    Yasuhiko Watanabe
    Kouichi Doi
    Kentaro Torisawa
    Cognitive Computation, 2010, 2 : 272 - 279
  • [6] A maximum entropy approach to adaptive statistical language modelling
    Rosenfeld, R
    COMPUTER SPEECH AND LANGUAGE, 1996, 10 (03): : 187 - 228
  • [7] Applications of Maximum Entropy Rankers to Problems in Spoken Language Processing
    Sproat, Richard
    Hall, Keith
    15TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2014), VOLS 1-4, 2014, : 761 - 764
  • [8] Maximum entropy approach to adaptive statistical language modelling
    Carnegie Mellon Univ, Pittsburgh, United States
    Comput Speech Lang, 3 (187-228):
  • [9] Language as a biomarker for psychosis: A natural language processing approach
    Corcoran, Cheryl M.
    Mittal, Vijay A.
    Bearden, Carrie E.
    Gur, Raquel E.
    Hitczenko, Kasia
    Bilgrami, Zarina
    Savic, Aleksandar
    Cecchi, Guillermo A.
    Wolff, Phillip
    SCHIZOPHRENIA RESEARCH, 2020, 226 : 158 - 166
  • [10] Comparison of alignment templates and maximum entropy models for natural language understanding
    Bender, O
    Macherey, K
    Och, FJ
    Ney, H
    EACL 2003: 10TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE, 2003, : 11 - 18
12345