UMUTeam at SemEval-2024 Task 10: Discovering and Reasoning about Emotions in Conversation using Transformers

被引:0
|
作者
Pan, Ronghao [1 ]
Antonio Garcia-Diaz, Jose [1 ]
Roldan, Diego [2 ]
Valencia-Garcia, Rafael [1 ]
机构
[1] Univ Murcia, Fac Informat, Campus Espinardo, Murcia 30100, Spain
[2] DANTIA Tecnol SL, Parque Empresarial Jerez 10, Cadiz 11407, Spain
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
These notes describe the participation of the UMUTeam in EDiReF, the 10th shared task of SemEval 2024. The goal is to develop systems for detecting and inferring emotional changes in the conversation. The task was divided into three related subtasks: (i) Emotion Recognition in Conversation (ERC) in Hindi-English code-mixed conversations, (ii) Emotion Flip Reasoning (EFR) in Hindi-English code-mixed conversations, and (iii) EFR in English conversations. We were involved in all three and our approach is based on a fine-tuning approach with different pre-trained models. After evaluation, we found BERT to be the best model for ERC and EFR and with this model we achieved the thirteenth best result with an F1 score of 43% in Subtask 1, the sixth best in Subtask 2 with an F1 score of 26% and the fifteenth best in Subtask 3 with an F1 score of 22%.
引用
收藏
页码:703 / 709
页数:7
相关论文
共 50 条
  • [1] LinguisTech at SemEval-2024 Task 10: Emotion Discovery and Reasoning its Flip in Conversation
    Alexandru, Mihaela
    Ciocoiu, Calina-Georgiana
    Maniga, Ioana
    Ungureanu, Octavian
    Gifu, Daniela
    Trandabat, Diana
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 412 - 419
  • [2] Transformers at SemEval-2024 Task 5: Legal Argument Reasoning Task in Civil Procedure using RoBERTa
    Singhal, Kriti
    Bedi, Jatin
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 969 - 972
  • [3] UCSC NLP at SemEval-2024 Task 10: Emotion Discovery and Reasoning its Flip in Conversation (EDiReF)
    Au, Steven
    Krogh, Decker
    Ubale, Esha
    Wan, Neng
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1492 - 1497
  • [4] UMUTeam at SemEval-2024 Task 8: Combining Transformers and Syntax Features for Machine-Generated Text Detection
    Pan, Ronghao
    Antonio Garcia-Diaz, Jose
    Jose Vivancos-Vicente, Pedro
    Valencia-Garcia, Rafael
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 697 - 702
  • [5] TransMistral at SemEval-2024 Task 10: Using Mistral 7B for Emotion Discovery and Reasoning its Flip in Conversation
    Siino, Marco
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 298 - 304
  • [6] SSN_Semeval10 at SemEval-2024 Task 10: Emotion Discovery and Reasoning its Flip in Conversations
    Rajesh, Antony A.
    Abirami, Supriya A.
    Aravindan, Chandrabose
    Kumar, Senthil B.
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 553 - 557
  • [7] INGEOTEC at SemEval-2024 Task 1: Bag of Words and Transformers
    Moctezuma, Daniela
    Tellez, Eric S.
    Graff, Mario
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1155 - 1159
  • [8] SemEval-2024 Task 5: Argument Reasoning in Civil Procedure
    Held, Lena
    Habernal, Ivan
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 2027 - 2038
  • [9] INGEOTEC at SemEval-2024 Task 10: Bag of Words Classifiers
    Graff, Mario
    Tellez, Eric S.
    Paredes, Mireya
    Moctezuma, Daniela
    Ortiz-Bejar, Jose
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1115 - 1120
  • [10] GAVx at SemEval-2024 Task 10: Emotion Flip Reasoning via Stacked Instruction Finetuning of LLMs
    Vy Nguyen
    Zhang, Xiuzhen
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 326 - 336