Overview of the DravidianCodeMix 2021 Shared Task on Sentiment Detection in Tamil, Malayalam, and Kannada

被引：38

作者：

Priyadharshini, Ruba ^{[1
]}

Chakravarthi, Bharathi Raja ^{[2
]}

Thavareesan, Sajeetha ^{[3
]}

Chinnappa, Dhivya ^{[4
]}

Thenmozhi, Durairaj ^{[5
]}

Ponnusamy, Rahul ^{[6
]}

机构：

[1] ULTRA Arts & Sci Coll, Madurai, Tamil Nadu, India

[2] Natl Univ Ireland, Insight SFI Res Ctr Data Analyt, Galway, Ireland

[3] Eastern Univ, Chenkalady, Sri Lanka

[4] Thomson Reuters, Eagan, MN USA

[5] Sri Sivasubramaniya Nadar Coll Engn, Chennai, Tamil Nadu, India

[6] Indian Inst Informat Technol & Management Kerala, Thiruvananthapuram, Kerala, India

来源：

FIRE 2021: PROCEEDINGS OF THE 13TH ANNUAL MEETING OF THE FORUM FOR INFORMATION RETRIEVAL EVALUATION | 2021年

关键词：

Hate speech; datasets; evaluation; deep learning;

D O I：

10.1145/3503162.3503177

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We present the results of the Dravidian-CodeMix shared task1 held at FIRE 2021, a track on sentiment analysis for Dravidian Languages in Code-Mixed Text. We describe the task, its organization, and the submitted systems. This shared task is the continuation of last year's Dravidian-CodeMix shared task2 held at FIRE 2020. This year's tasks included code-mixing at the intra-token and inter-token levels. In addition to Tamil, Malayalam and Kannada were also introduced. We received 22 systems for Tamil-English, 15 systems for Malayalam-English, and 15 for Kannada-English. The top systems for Tamil-English, Malayalam-English and Kannada-English scored weighted average F1-score of 0.711, 0.804, and 0.630, respectively. In summary, the quality and quantity of the submission show that there is great interest in Dravidian languages in code-mixed setting and state of the art in this domain still needs improvement.

引用

页码：4 / 6

页数：3

共 16 条

[1] Findings of Shared Task on Offensive Language Identification in Tamil and Malayalam
Kumaresan, Prasanna Kumar
Premjith, B.
Sakuntharaj, Ratnasingam
Thavareesan, Sajeetha
Navaneethakrishnan, Subalalitha Chinnaudayar
Madasamy, Anand Kumar
Chakravarthi, Bharathi Raja
McCrae, John P.
FIRE 2021: PROCEEDINGS OF THE 13TH ANNUAL MEETING OF THE FORUM FOR INFORMATION RETRIEVAL EVALUATION, 2021, : 16 - 18
[2] Overview of FakeDeS at IberLEF 2021: Fake News Detection in Spanish Shared Task
Gomez-Adorno, Helena
Pablo Posadas-Duran, Juan
Bel Enguix, Gemma
Porto Capetillo, Claudia
PROCESAMIENTO DEL LENGUAJE NATURAL, 2021, (67): : 223 - 231
[3] Overview of the IALP 2016 Shared Task on Dimensional Sentiment Analysis for Chinese Words
Yu, Liang-Chih
Lee, Lung-Hao
Wong, Kam-Fai
PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP), 2016, : 156 - 160
[4] Overview of the IDPT Task on Irony Detection in Portuguese at IberLEF 2021
Correa, Ulisses B.
Coelho, Leonardo
Santos, Leonardo
de Freitas, Larissa A.
PROCESAMIENTO DEL LENGUAJE NATURAL, 2021, (67): : 269 - 276
[5] Overview of the EmoEvalEs task on emotion detection for Spanish at IberLEF 2021
Miriam Plaza-del-Arco, Flor
Maria Jimenez-Zafra, Salud
Montejo-Raez, Arturo
Dolores Molina-Gonzalez, M.
Alfonso Urena-Lopez, L.
Teresa Martin-Valdivia, M.
PROCESAMIENTO DEL LENGUAJE NATURAL, 2021, (67): : 155 - 161
[6] Multilingual Protest News Detection - Shared Task 1, CASE 2021
Hurriyetoglu, Ali
Mutlu, Osman
Yoruk, Erdem
Liza, Farhana Ferdousi
Kumar, Ritesh
Ratan, Shyam
CASE 2021: THE 4TH WORKSHOP ON CHALLENGES AND APPLICATIONS OF AUTOMATED EXTRACTION OF SOCIO-POLITICAL EVENTS FROM TEXT (CASE), 2021, : 79 - 91
[7] Overview of NLPCC Shared Task 4: Stance Detection in Chinese Microblogs
Xu, Ruifeng
Zhou, Yu
Wu, Dongyin
Gui, Lin
Du, Jiachen
Xue, Yun
NATURAL LANGUAGE UNDERSTANDING AND INTELLIGENT APPLICATIONS (NLPCC 2016), 2016, 10102 : 907 - 916
[8] Overview of The Shared Task on Homophobia and Transphobia Detection in Social Media Comments
Chakravarthi, Bharathi Raja
Priyadharshini, Ruba
Thenmozhi, Durairaj
McCrae, John Phillip
Buitelaar, Paul
Ponnusamy, Rahul
Kumaresan, Prasanna Kumar
PROCEEDINGS OF THE SECOND WORKSHOP ON LANGUAGE TECHNOLOGY FOR EQUALITY, DIVERSITY AND INCLUSION (LTEDI 2022), 2022, : 369 - 377
[9] Overview of the Shared Task on Hope Speech Detection for Equality, Diversity, and Inclusion
Chakravarthi, Bharathi Raja
Muralidaran, Vigneshwaran
Priyadharshini, Ruba
Navaneethakrishnan, Subalalitha Chinnaudayar
McCrae, John Philip
Angel Garcia-Cumbreras, Miguel
Maria Jimenez-Zafra, Salud
Valencia-Garcia, Rafael
Kumaresan, Prasanna Kumar
Ponnusamy, Rahul
Garcia-Baena, Daniel
Antonio Garcia-Diaz, Jose
PROCEEDINGS OF THE SECOND WORKSHOP ON LANGUAGE TECHNOLOGY FOR EQUALITY, DIVERSITY AND INCLUSION (LTEDI 2022), 2022, : 378 - 388
[10] Attention Based Shared Representation for Multi-task Stance Detection and Sentiment Analysis
Chauhan, Dushyant Singh
Kumar, Rohan
Ekbal, Asif
NEURAL INFORMATION PROCESSING, ICONIP 2019, PT V, 2019, 1143 : 661 - 669

← 1 2 →