Team QUST at SemEval-2024 Task 8: A Comprehensive Study of Monolingual and Multilingual Approaches for Detecting AI-generated Text

被引:0
|
作者
Xu, Xiaoman [1 ]
Li, Xiangrun [1 ]
Wang, Taihang [1 ]
Tian, Jianxiang [1 ]
Jiang, Ye [1 ]
机构
[1] Qingdao Univ Sci & Technol, Coll Informat Sci & Technol, Qingdao, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents the participation of team QUST in Task 8 SemEval 2024. We first performed data augmentation and cleaning on the dataset to enhance model training efficiency and accuracy. In the monolingual task, we evaluated traditional deep-learning methods, multiscale positive-unlabeled framework (MPU), fine-tuning, adapters and ensemble methods. Then, we selected the top-performing models based on their accuracy from the monolingual models and evaluated them in subtasks A and B. The final model construction employed a stacking ensemble that combined fine-tuning with MPU. Our system achieved 8th (scored 8th in terms of accuracy, officially ranked 13th) place in the official test set in multilingual settings of subtask A. We release our system code at:https://github.com/warmth27/SemEval2024_QUST
引用
收藏
页码:463 / 470
页数:8
相关论文
共 50 条
  • [21] PetKaz at SemEval-2024 Task 8: Can Linguistics Capture the Specifics of LLM-generated Text?
    Petukhova, Kseniia
    Kazakov, Roman
    Kochmar, Ekaterina
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1140 - 1147
  • [22] NewbieML at SemEval-2024 Task 8: Ensemble Approach for Multidomain Machine-Generated Text Detection
    Tran, Bao
    Nhi Tran
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 354 - 360
  • [23] AIpom at SemEval-2024 Task 8: Detecting AI-produced Outputs in M4
    Shirnin, Alexander
    Andreev, Nikita
    Mikhailov, Vladislav
    Artemova, Ekaterina
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1667 - 1672
  • [24] UMUTeam at SemEval-2024 Task 8: Combining Transformers and Syntax Features for Machine-Generated Text Detection
    Pan, Ronghao
    Antonio Garcia-Diaz, Jose
    Jose Vivancos-Vicente, Pedro
    Valencia-Garcia, Rafael
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 697 - 702
  • [25] DeepPavlov at SemEval-2024 Task 8: Leveraging Transfer Learning for Detecting Boundaries of Machine-Generated Texts
    Voznyuk, Anastasia
    Konovalov, Vasily
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1821 - 1829
  • [26] CLULab-UofA at SemEval-2024 Task 8: Detecting Machine-Generated Text Using Triplet-Loss-Trained Text Similarity and Text Classification
    Rezaei, MohammadHossein
    Kwon, Yeaeun
    Sanayei, Reza
    Singh, Abhyuday
    Bethard, Steven
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1498 - 1504
  • [27] Team Unibuc - NLP at SemEval-2024 Task 8: Transformer and Hybrid Deep Learning Based Models for Machine-Generated Text Detection
    Marchitan, Teodor-George
    Creanga, Claudiu
    Dinu, Liviu P.
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 403 - 411
  • [28] nowhash at SemEval-2024 Task 4: Exploiting Fusion of Transformers for Detecting Persuasion Techniques in Multilingual Memes
    Chowdhury, Abu Nowhash
    Ptaszynski, Michal
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 133 - 138
  • [29] iimasNLP at SemEval-2024 Task 8: Unveiling structure-aware language models for automatic generated text identification
    Valdez, Andric
    Gomez-Adorno, Helena
    Marquez, Fernando
    Pantaleon, Jorge
    Bel-Enguix, Gemma
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1110 - 1114
  • [30] SINAI at SemEval-2024 Task 8: Fine-tuning onWords and Perplexity as Features for Detecting Machine Written Text
    Gutierrez-Megias, Alberto J.
    Urena-Lopez, L. Alfonso
    Martinez-Camara, Eugenio
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1505 - 1510