Unveiling disguised toxicity: A novel pre-processing module for enhanced content moderation

被引:0
|
作者
Chan, Johnny [1 ]
Li, Yuming [1 ]
机构
[1] Univ Auckland, Private Bag 92019, Auckland 1142, New Zealand
关键词
Natural language processing; Text pre-processing; Toxic text detection;
D O I
10.1016/j.mex.2024.102668
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This study introduces "Specialis Revelio, " a sophisticated text pre-processing module aimed at enhancing the detection of disguised toxic content in online communications. Through a blend of conventional and novel pre-processing methods, this module significantly improves the accuracy of existing toxic text detection tools, addressing the challenge of content that is deliberately altered to evade standard detection methods. center dot Integration with Existing Systems: "Specialis Revelio " is designed to augment popular toxic text classifiers, enhancing their ability to detect and filter toxic content more effectively. center dot Innovative Pre-processing Methods: The module combines traditional pre-processing steps like lowercasing and stemming with advanced strategies, including the handling of adversarial examples and typo correction, to reveal concealed toxicity. center dot Validation through Comparative Study: Its effectiveness was validated via a comparative analysis against widely used APIs, demonstrating a marked improvement in the detection of various toxic text indicators.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] A novel pre-processing procedure for enhanced feature extraction and characterization of electromyogram signals
    Powar, Omkar S.
    Chemmangat, Krishnan
    Figarado, Sheron
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2018, 42 : 277 - 286
  • [2] Application of OpenGL technology in pre-processing module of foundry CAE system
    Tao, Yongjin
    Chen, Liliang
    Liu, Ruixiang
    Yang, Chong
    Tezhong Zhuzao Ji Youse Hejin/Special Casting & Nonferrous Alloys, 2001, (06):
  • [3] An Enhanced Pre-Processing Model for Big Data Processing: A Quality Framework
    Lincy, Blessy Trencia S. S.
    Kumar, N. Suresh
    2017 IEEE INTERNATIONAL CONFERENCE ON INNOVATIONS IN GREEN ENERGY AND HEALTHCARE TECHNOLOGIES (IGEHT), 2017,
  • [4] Design and Implementation of Robust Low Power ECG Pre-processing Module
    Tripathi, Kirti
    Sohal, Harsh
    Jain, Shruti
    IETE JOURNAL OF RESEARCH, 2022, 68 (04) : 2716 - 2722
  • [5] A Study of the Data Pre-Processing Module of the Dendritic Cell Evolutionary Algorithm
    Chelly, Zeineb
    Elouedi, Zied
    2014 INTERNATIONAL CONFERENCE ON CONTROL, DECISION AND INFORMATION TECHNOLOGIES (CODIT), 2014, : 634 - 639
  • [6] A Novel Signal Pre-processing Circuit for Prospecting Apparatus
    Gong, Chenglong
    Tian, Jinming
    Feng, Yuan
    Liu, Yongqiang
    2011 CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-6, 2011, : 3544 - 3547
  • [7] A Novel Method Of ISAR Image Pre-processing For Ship
    Shang, Shize
    Li, Ming
    Hou, Yingni
    Chen, Li
    Yang, Yuhao
    Sun, Jun
    2016 IEEE INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION AND COMMUNICATION TECHNOLOGY ICEICT 2016 PROCEEDINGS, 2016, : 262 - 265
  • [8] A Simplistic and Novel Technique for ECG Signal Pre-Processing
    Gupta, Varun
    Mittal, Monika
    Mittal, Vikas
    IETE JOURNAL OF RESEARCH, 2024, 70 (01) : 815 - 826
  • [9] A robust QRS detection using novel pre-processing techniques and kurtosis based enhanced efficiency
    Sharma, Lakhan Dev
    Sunkaria, Ramesh Kumar
    MEASUREMENT, 2016, 87 : 194 - 204
  • [10] Pre-processing Image Database for Efficient Content Based Image Retrieval
    Jenni, Kommineni
    Mandala, Satria
    2014 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2014, : 968 - 972