Emojis as anchors to detect Arabic offensive language and hate speech

被引:4
|
作者
Mubarak, Hamdy [1 ]
Hassan, Sabit [2 ]
Chowdhury, Shammur Absar [1 ]
机构
[1] Hamad Bin Khalifa Univ, Qatar Comp Res Inst, Doha, Qatar
[2] Univ Pittsburgh, Sch Comp & Informat, Pittsburgh, PA USA
关键词
Offensive language; Hate speech; Emojis; Text classification; Social media analysis;
D O I
10.1017/S1351324923000402
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce a generic, language-independent method to collect a large percentage of offensive and hate tweets regardless of their topics or genres. We harness the extralinguistic information embedded in the emojis to collect a large number of offensive tweets. We apply the proposed method on Arabic tweets and compare it with English tweets-analyzing key cultural differences. We observed a constant usage of these emojis to represent offensiveness throughout different timespans on Twitter. We manually annotate and publicly release the largest Arabic dataset for offensive, fine-grained hate speech, vulgar, and violence content. Furthermore, we benchmark the dataset for detecting offensiveness and hate speech using different transformer architectures and perform in-depth linguistic analysis. We evaluate our models on external datasets-a Twitter dataset collected using a completely different method, and a multi-platform dataset containing comments from Twitter, YouTube, and Facebook, for assessing generalization capability. Competitive results on these datasets suggest that the data collected using our method capture universal characteristics of offensive language. Our findings also highlight the common words used in offensive communications, common targets for hate speech, specific patterns in violence tweets, and pinpoint common classification errors that can be attributed to limitations of NLP models. We observe that even state-of-the-art transformer models may fail to take into account culture, background, and context or understand nuances present in real-world data such as sarcasm.
引用
收藏
页码:1436 / 1457
页数:22
相关论文
共 50 条
  • [41] Framing Hate: Moral Foundations, Party Cues, and (In)Tolerance of Offensive Speech
    Armstrong, Grant M.
    Wronski, Julie
    [J]. JOURNAL OF SOCIAL AND POLITICAL PSYCHOLOGY, 2019, 7 (02) : 695 - 725
  • [42] A comparison of text preprocessing techniques for hate and offensive speech detection in Twitter
    Anna Glazkova
    [J]. Social Network Analysis and Mining, 13
  • [43] Hate is in the air! But where? Introducing an algorithm to detect hate speech in digital microenvironments
    Miro-Llinares, Fernando
    Moneva, Asier
    Esteve, Miriam
    [J]. CRIME SCIENCE, 2018, 7 (01)
  • [44] Overview of the HASOC Track at FIRE 2020: Hate Speech and Offensive Language Identification in Tamil, Malayalam, Hindi, English and German
    Mandl, Thomas
    Modha, Sandip
    Kumar, Anand M.
    Chakravarthi, Bharathi Raja
    [J]. PROCEEDINGS OF THE 12TH ANNUAL MEETING OF THE FORUM FOR INFORMATION RETRIEVAL EVALUATION (FIRE 2020), 2020, : 29 - 32
  • [45] Detection of Hate Speech and Offensive Language CodeMix Text in Dravidian Languages Using Cost-Sensitive Learning Approach
    Sreelakshmi, K.
    Premjith, B.
    Chakravarthi, Bharathi Raja
    Soman, K. P.
    [J]. IEEE ACCESS, 2024, 12 : 20064 - 20090
  • [46] Offensive language and hate speech detection using deep learning in football news live streaming chat on YouTube in Thailand
    Pookpanich, Peerat
    Siriborvornratanakul, Thitirat
    [J]. SOCIAL NETWORK ANALYSIS AND MINING, 2024, 14 (01)
  • [47] Offensive language and hate speech detection using deep learning in football news live streaming chat on YouTube in Thailand
    Peerat Pookpanich
    Thitirat Siriborvornratanakul
    [J]. Social Network Analysis and Mining, 14
  • [48] Application-specific word embeddings for hate and offensive language detection
    Claver P. Soto
    Gustavo M. S. Nunes
    José Gabriel R. C. Gomes
    Nadia Nedjah
    [J]. Multimedia Tools and Applications, 2022, 81 : 27111 - 27136
  • [49] Application-specific word embeddings for hate and offensive language detection
    Soto, Claver P.
    Nunes, Gustavo M. S.
    Gomes, Jose Gabriel R. C.
    Nedjah, Nadia
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (19) : 27111 - 27136
  • [50] Arabic Offensive Language Classification: Leveraging Transformer, LSTM, and SVM
    Rasheed, Areeg Fahad
    Zarkoosh, M.
    Abbas, Safa F.
    Al-Azzawi, Sana Sabah
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLIED NETWORK TECHNOLOGIES, ICMLANT, 2023, : 115 - 120