A Federated Convolution Transformer for Fake News Detection

被引:0
|
作者
Djenouri, Youcef [1 ,2 ,3 ]
Belbachir, Ahmed Nabil [4 ]
Michalak, Tomasz [3 ,5 ]
Srivastava, Gautam [6 ,7 ,8 ]
机构
[1] Univ South Eastern Norway, N-3616 Kongsberg, Norway
[2] Norwegian Res Ctr, N-0166 Oslo, Norway
[3] IDEAS NCBR, PL-00801 Warsaw, Poland
[4] Norwegian Res Ctr, N-4886 Grimstad, Norway
[5] Univ Warsaw, PL-00927 Warsaw, Poland
[6] Brandon Univ, Dept Math & Comp Sci, Brandon, MB R7A 6A9, Canada
[7] China Med Univ, Res Ctr Interneural Comp, Taichung 404, Taiwan
[8] Lebanese Amer Univ, Dept Comp Sci & Math, Beirut 11022801, Lebanon
关键词
Fake news; Federated learning; Feature extraction; Data models; Transformers; Convolution; Spatiotemporal phenomena; Fake news detection; federated learning; transformers; convolution neural network; IoT; MODEL;
D O I
10.1109/TBDATA.2023.3325746
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We present a novel approach to detect fake news in Internet of Things (IoT) applications. By investigating federated learning and trusted authority methods, we address the issue of data security during training. Simultaneously, by investigating convolution transformers and user clustering, we deal with multi-modality issues in fake news data. First, we use dense embedding and the k-means algorithm to cluster users into groups that are similar to one another. We then develop a local model for each user using their local data. The server then receives the local models of users along with clustering information, and a trusted authority verifies their integrity there. We use two different types of aggregation in place of conventional federated learning systems. The initial step is to combine all users' models to create a single global model. The second step entails compiling each user's model into a local model of comparable users. Both models are supplied to users, who then select the most suitable model for identifying fake news. By conducting extensive experiments using Twitter data, we demonstrate that the proposed method outperforms various baselines, where it achieves an average accuracy of 0.85 in comparison to others that do not exceed 0.81.
引用
收藏
页码:214 / 225
页数:12
相关论文
共 50 条
  • [1] Hindi fake news detection using transformer ensembles
    Praseed, Amit
    Rodrigues, Jelwin
    Thilagam, P. Santhi
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 119
  • [2] Multi-modal transformer for fake news detection
    Yang, Pingping
    Ma, Jiachen
    Liu, Yong
    Liu, Meng
    [J]. MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (08) : 14699 - 14717
  • [3] Indonesia's Fake News Detection using Transformer Network
    Awalina, Aisyah
    Fawaid, Jibran
    Krisnabayu, Rifky Yunus
    Yudistira, Novanto
    [J]. PROCEEDINGS OF 2021 INTERNATIONAL CONFERENCE ON SUSTAINABLE INFORMATION ENGINEERING AND TECHNOLOGY, SIET 2021, 2021, : 247 - 251
  • [4] FIND: Privacy-Enhanced Federated Learning for Intelligent Fake News Detection
    Lian, Zhuotao
    Zhang, Chen
    Su, Chunhua
    Dharejo, Fayaz Ali
    Almutiq, Mutiq
    Memon, Muhammad Hammad
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (04) : 5005 - 5014
  • [5] A Hybrid Transformer-Based Model for Optimizing Fake News Detection
    Al-Quayed, Fatima
    Javed, Danish
    Jhanjhi, N.Z.
    Humayun, Mamoona
    Alnusairi, Thanaa S.
    [J]. IEEE Access, 2024, 12 : 160822 - 160834
  • [6] Federated Learning in the Detection of Fake News Using Deep Learning as a Basic Method
    Machova, Kristina
    Mach, Marian
    Balara, Viliam
    [J]. SENSORS, 2024, 24 (11)
  • [7] THE COMBINATION OF CONVOLUTION NEURAL NETWORKS AND DEEP NEURAL NETWORKS FOR FAKE NEWS DETECTION
    Jawad, Zainab A.
    Obaid, Ahmed J.
    [J]. JOURNAL OF ENGINEERING SCIENCE AND TECHNOLOGY, 2023, 18 (01): : 814 - 826
  • [8] Fake news detection based on news content and social contexts: a transformer-based approach
    Shaina Raza
    Chen Ding
    [J]. International Journal of Data Science and Analytics, 2022, 13 : 335 - 362
  • [9] Fake news detection based on news content and social contexts: a transformer-based approach
    Raza, Shaina
    Ding, Chen
    [J]. INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2022, 13 (04) : 335 - 362
  • [10] SCATE: Shared Cross Attention Transformer Encoders for Multimodal Fake News Detection
    Sachan, Tanmay
    Pinnaparaju, Nikhil
    Gupta, Manish
    Varma, Vasudeva
    [J]. PROCEEDINGS OF THE 2021 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING, ASONAM 2021, 2021, : 399 - 406