A maximum entropy approach to natural language processing

被引：28

作者：

Berger, AL ^{[1
]}

DellaPietra, SA ^{[1
]}

DellaPietra, VJ ^{[1
]}

机构：

[1] RENAISSANCE TECHNOL, STONY BROOK, NY USA

来源：

COMPUTATIONAL LINGUISTICS | 1996年 / 22卷 / 01期

关键词：

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

The concept of maximum entropy can be traced back along multiple threads to Biblical times. Only recently, however, have computers become powerful enough to permit the widescale application of this concept to real world problems in statistical estimation and pattern recognition. In this paper, we describe a method for statistical modeling based on maximum entropy. We present a maximum-likelihood approach for automatically constructing maximum entropy models and describe how to implement this approach efficiently, using as examples several problems in natural language processing.

引用

页码：39 / 71

页数：33

共 50 条

[31] Entropy minimization within the maximum entropy approach
Vakarin, E. V.
Badiali, J. P.
4TH INTERNATIONAL WORKSHOP ON STATISTICAL PHYSICS AND MATHEMATICS FOR COMPLEX SYSTEMS (SPMCS2014), 2015, 604
[32] Maximum Entropy Processing of Seismic Waveform Segments: A Novel Approach to Spectral Estimation
Arora, S. K.
DISASTER ADVANCES, 2009, 2 (03): : 30 - 35
[33] Optimized approach to maximum entropy
Alter-Gartenberg, R
Park, SK
NONLINEAR IMAGE PROCESSING IX, 1998, 3304 : 2 - 13
[34] Maximum entropy approach to reliability
Du, Yi-Mu
Ma, Yu-Han
Wei, Yuan-Fa
Guan, Xuefei
Sun, C. P.
PHYSICAL REVIEW E, 2020, 101 (01)
[35] The evolutionary approach to entropy: Reconciling Georgescu-Roegen's natural philosophy with the maximum entropy framework
Herrmann-Pillath, Carsten
ECOLOGICAL ECONOMICS, 2011, 70 (04) : 606 - 616
[36] A Natural Language Processing Approach for Instruction Set Architecture Identification
Sahabandu, Dinuka
Mertoguno, J. Sukarno
Poovendran, Radha
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 4086 - 4099
[37] Emerging Approach of Natural Language Processing in Opinion Mining: A Review
Kim, Tai-hoon
UBIQUITOUS COMPUTING AND MULTIMEDIA APPLICATIONS, 2010, 75 : 121 - 128
[38] Natural Language Processing approach to NLP Meta model automation
Amirhosseini, Mohammad Hossein
Kazemian, Hassan B.
Ouazzane, Karim
Chandler, Chris
2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018, : 186 - 193
[39] Towards an evolutionary-based approach for natural language processing
Manzoni, Luca
Jakobovic, Domagoj
Mariot, Luca
Picek, Stjepan
Castelli, Mauro
GECCO'20: PROCEEDINGS OF THE 2020 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2020, : 985 - 993
[40] In defence of a linguistic-aware approach to natural language processing
Perinan Pascual, Carlos
ONOMAZEIN, 2012, (26): : 13 - 48

← 1 2 3 4 5 →