Genre as noise: noise in genre

被引:7
|
作者
Stubbe, Andrea [2 ]
Ringlstetter, Christoph [1 ]
Schulz, Klaus U. [2 ]
机构
[1] Univ Alberta, Dept Comp Sci, AICML, Edmonton, AB T6G 2E8, Canada
[2] Univ Munich, CIS, D-80538 Munich, Germany
关键词
genre hierarchies; features; genre classification; error dictionaries; noisy corpora;
D O I
10.1007/s10032-007-0060-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Given a specific information need, documents of the wrong genre can be considered as noise. From this perspective, genre classification helps to separate relevant documents from noise. Orthographic errors represent a second, finer notion of noise. Since specific genres often include documents with many errors, an interesting question is whether this "micro-noise" can help to classify genre. In this paper we consider both problems. After introducing a comprehensive hierarchy of genres, we present an intuitive method to build specialized and distinctive classifiers that also work for very small training corpora. Special emphasis is given to the selection of intelligent high-level features. We then investigate the correlation between genre and micro noise. Using special error dictionaries, we estimate the typical error rates for each genre. Finally, we test if the error rate of a document represents a useful feature for genre classification.
引用
收藏
页码:199 / 209
页数:11
相关论文
共 50 条