MasonTigers at SemEval-2024 Task 8: Performance Analysis of Transformer-based Models on Machine-Generated Text Detection

被引:0
|
作者
Puspo, Sadiya Sayara Chowdhury [1 ]
Raihan, Md Nishat [1 ]
Goswami, Dhiman [1 ]
Bin Emran, Al Nahian [1 ]
Ganguly, Amrita [1 ]
Uzuner, Ozlem [1 ]
机构
[1] George Mason Univ, Fairfax, VA 22030 USA
来源
PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024 | 2024年
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents the MasonTigers' entry to the SemEval-2024 Task 8 - Multigenerator, Multidomain, and Multilingual BlackBox Machine-Generated Text Detection. The task encompasses Binary Human-Written vs. Machine-Generated Text Classification (Track A), Multi-Way Machine-Generated Text Classification (Track B), and Human-Machine Mixed Text Detection (Track C). Our best performing approaches utilize mainly the ensemble of discriminator transformer models along with sentence transformer and statistical machine learning approaches in specific cases. Moreover, zero-shot prompting and fine-tuning of FLAN-T5 are used for Track A and B.
引用
收藏
页码:1364 / 1372
页数:9
相关论文
共 50 条
  • [21] TrustAI at SemEval-2024 Task 8: A Comprehensive Analysis of Multi-domain Machine Generated Text Detection Techniques
    Urlana, Ashok
    Saibewar, Aditya
    Garlapati, Bala Mallikarjunarao
    Kumar, Charaka Vinayak
    Singh, Ajeet Kumar
    Chalamala, Srinivasa Rao
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 927 - 934
  • [22] DeepPavlov at SemEval-2024 Task 8: Leveraging Transfer Learning for Detecting Boundaries of Machine-Generated Texts
    Voznyuk, Anastasia
    Konovalov, Vasily
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1821 - 1829
  • [23] AlphaIntellect at SemEval-2024 Task 6: Detection of Hallucinations in Generated Text
    Choudhury, Sohan
    Saha, Priyam
    Ray, Subharthi
    Das, Shankha Shubhra
    Das, Dipankar
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 952 - 958
  • [24] USTC-BUPT at SemEval-2024 Task 8: Enhancing Machine-Generated Text Detection via Domain Adversarial Neural Networks and LLM Embeddings
    Guo, Zikang
    Jiao, Kaijie
    Yao, Xingyu
    Wan, Yuning
    Li, Haoran
    Xu, Benfeng
    Zhang, Licheng
    Wang, Quan
    Zhang, Yongdong
    Mao, Zhendong
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1511 - 1522
  • [25] CLULab-UofA at SemEval-2024 Task 8: Detecting Machine-Generated Text Using Triplet-Loss-Trained Text Similarity and Text Classification
    Rezaei, MohammadHossein
    Kwon, Yeaeun
    Sanayei, Reza
    Singh, Abhyuday
    Bethard, Steven
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1498 - 1504
  • [26] CUNLP at SemEval-2024 Task 8: Classify Human and AI Generated Text
    Pranjal, Aggarwal
    Deepanshu, Sachdeva
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1 - 6
  • [27] Groningen team D at SemEval-2024 Task 8: Exploring data generation and a combined model for fine-tuning LLMs for Multidomain Machine-Generated Text Detection
    Brekhof, Thijs
    Liu, Xuanyi
    Ruitenbeek, Joris
    Top, Niels
    Zhou, Yuwen
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 391 - 398
  • [28] SCaLAR at SemEval-2024 Task 8: Unmasking the machine : Exploring the power of RoBERTa Ensemble for Detecting Machine Generated Text
    Kumar, Anand M.
    Abhin, B.
    Murali, Sidhaarth Sredharan
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1135 - 1139
  • [29] AISPACE at SemEval-2024 task 8: A Class-balanced Soft-voting System for Detecting Multi-generator Machine-generated Text
    Gu, Renhua
    Meng, Xiangfeng
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 1476 - 1481
  • [30] NootNoot at SemEval-2024 Task 8: Fine-tuning Language Models for AI vs Human Generated Text detection
    Bahad, Sankalp
    Bhaskar, Yash
    Krishnamurthy, Parameswari
    PROCEEDINGS OF THE 18TH INTERNATIONAL WORKSHOP ON SEMANTIC EVALUATION, SEMEVAL-2024, 2024, : 918 - 921