Robustness evaluation of trust and reputation systems using a deep reinforcement learning approach

被引:2
|
作者
Bidgoly, Amir Jalaly [1 ]
Arabi, Fereshteh [1 ]
机构
[1] Univ Qom, Dept Informat Technol & Comp Engn, Qom, Iran
关键词
Trust and reputation; Robustness; Attacks; Deep reinforcement learning; QUANTITATIVE VERIFICATION; MODEL; MANAGEMENT; FRAMEWORK;
D O I
10.1016/j.cor.2023.106250
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
One of the biggest challenges facing trust and reputation systems (TRSs) is evaluating their ability to withstand various attacks, as these systems are vulnerable to multiple types of attacks. While simulation methods have been used to evaluate TRSs, they are limited because they cannot detect new attacks and do not ensure the system's overall robustness. To address this limitation, verification methods have been proposed that can examine the entire state space and detect all possible attacks. However, these methods are not always practical for large models and real environments because they suffer from the state space explosion problem. To tackle this issue, we propose a deep reinforcement learning approach for evaluating the robustness of TRSs. In this approach, an agent can learn how to attack a system and find the best attack plan without prior knowledge. Additionally, our method avoids the state space explosion problem because it uses a deep Q-network instead of storing and examining the entire state space. We tested our proposed method on five well-known reputation models, assessing various attack goals such as selfishness, maliciousness, competition, and slandering. The results showed that our method was successful in identifying the best attack plan and executing it successfully in the system, demonstrating its effectiveness in evaluating the robustness of TRSs.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Deep Reinforcement Learning for Swarm Systems
    Huettenrauch, Maximilian
    Sosic, Adrian
    Neumann, Gerhard
    JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [42] A Reinforcement Learning Approach to Enhance the Trust Level of MANETs
    Jinarajadasa, Gihani
    Rupasinghe, Lakmal
    Murray, Iain
    2018 NATIONAL INFORMATION TECHNOLOGY CONFERENCE (NITC), 2018,
  • [43] OSCAR: a Contention Window Optimization approach using Deep Reinforcement Learning
    Grasso, Christian
    Raftopoulos, Raoul
    Schembra, Giovanni
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 459 - 465
  • [44] A Fast Approach to Satellite Range Rescheduling Using Deep Reinforcement Learning
    Liang, Jun
    Liu, Jian-Ping
    Sun, Qing
    Zhu, Yue-He
    Zhang, Yi-Chuan
    Song, Jian-Guo
    He, Bo-Yong
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (06) : 9390 - 9403
  • [45] Decision Making in Monopoly Using a Hybrid Deep Reinforcement Learning Approach
    Bonjour, Trevor
    Haliem, Marina
    Alsalem, Aala
    Thomas, Shilpa
    Li, Hongyu
    Aggarwal, Vaneet
    Kejriwal, Mayank
    Bhargava, Bharat
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (06): : 1335 - 1344
  • [46] A Transfer Approach Using Graph Neural Networks in Deep Reinforcement Learning
    Yang, Tianpei
    You, Heng
    Hao, Jianye
    Zheng, Yan
    Taylor, Matthew E.
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16352 - 16360
  • [47] Path Following Control for UAV Using Deep Reinforcement Learning Approach
    Yintao Zhang
    Youmin Zhang
    Ziquan Yu
    Guidance,Navigation and Control, 2021, (01) : 95 - 112
  • [48] Training and Evaluation of Deep Policies Using Reinforcement Learning and Generative Models
    Ghadirzadeh, Ali
    Poklukar, Petra
    Arndt, Karol
    Finn, Chelsea
    Kyrki, Ville
    Kragic, Danica
    Björkman, Mårten
    Journal of Machine Learning Research, 2022, 23
  • [49] Routing in congested baggage handling systems using deep reinforcement learning
    Sorensen, Rene Arendt
    Nielsen, Michael
    Karstoft, Henrik
    INTEGRATED COMPUTER-AIDED ENGINEERING, 2020, 27 (02) : 139 - 152
  • [50] Falsification of Cyber-Physical Systems Using Deep Reinforcement Learning
    Akazaki, Takumi
    Liu, Shuang
    Yamagata, Yoriyuki
    Duan, Yihai
    Hao, Jianye
    FORMAL METHODS, 2018, 10951 : 456 - 465