PoS-tagging the Web in Portuguese. National varieties, text typologies and spelling systems

被引:0
|
作者
Garcia, Marcos [1 ]
Gamallo, Pablo [1 ]
Gayo, Iria [2 ]
Pousada Cruz, Miguel A. [3 ]
机构
[1] Univ Santiago de Compostela, CiTIUS, Santiago De Compostela, Spain
[2] Cilenis Language Technol, Santiago, Spain
[3] Univ Santiago de Compostela, Santiago De Compostela, Spain
来源
关键词
PoS-tagging; Portuguese; Web as Corpus; Spelling Agreement;
D O I
暂无
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
The great amount of text produced every day in the Web turned it as one of the main sources for obtaining linguistic corpora, that are further analyzed with Natural Language Processing techniques. On a global scale, languages such as Portuguese -official in 9 countries- appear on the Web in several varieties, with lexical, morphological and syntactic (among others) differences. Besides, a unified spelling system for Portuguese has been recently approved, and its implementation process has already started in some countries. However, it will last several years, so different varieties and spelling systems coexist. Since PoS-taggers for Portuguese are specifically built for a particular variety, this work analyzes different training corpora and lexica combinations aimed at building a model with high-precision annotation in several varieties and spelling systems of this language. Moreover, this paper presents different dictionaries of the new orthography (Spelling Agreement) as well as a new freely available testing corpus, containing different varieties and textual typologies.
引用
收藏
页码:95 / 101
页数:7
相关论文
共 2 条
  • [1] POS-Tagging Enhanced Korean Text Summarization
    Liu, Wuying
    Wang, Lin
    [J]. INTELLIGENT COMPUTING METHODOLOGIES, ICIC 2017, PT III, 2017, 10363 : 425 - 435
  • [2] Defining a state-of-the-art POS-tagging environment for Brazilian Portuguese clinical texts
    de Oliveira L.F.A.
    e Oliveira L.E.S.
    Gumiel Y.B.
    Carvalho D.R.
    Moro C.M.C.
    [J]. Research on Biomedical Engineering, 2020, 36 (03): : 267 - 276