Robustness evaluation of trust and reputation systems using a deep reinforcement learning approach

被引:2
|
作者
Bidgoly, Amir Jalaly [1 ]
Arabi, Fereshteh [1 ]
机构
[1] Univ Qom, Dept Informat Technol & Comp Engn, Qom, Iran
关键词
Trust and reputation; Robustness; Attacks; Deep reinforcement learning; QUANTITATIVE VERIFICATION; MODEL; MANAGEMENT; FRAMEWORK;
D O I
10.1016/j.cor.2023.106250
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
One of the biggest challenges facing trust and reputation systems (TRSs) is evaluating their ability to withstand various attacks, as these systems are vulnerable to multiple types of attacks. While simulation methods have been used to evaluate TRSs, they are limited because they cannot detect new attacks and do not ensure the system's overall robustness. To address this limitation, verification methods have been proposed that can examine the entire state space and detect all possible attacks. However, these methods are not always practical for large models and real environments because they suffer from the state space explosion problem. To tackle this issue, we propose a deep reinforcement learning approach for evaluating the robustness of TRSs. In this approach, an agent can learn how to attack a system and find the best attack plan without prior knowledge. Additionally, our method avoids the state space explosion problem because it uses a deep Q-network instead of storing and examining the entire state space. We tested our proposed method on five well-known reputation models, assessing various attack goals such as selfishness, maliciousness, competition, and slandering. The results showed that our method was successful in identifying the best attack plan and executing it successfully in the system, demonstrating its effectiveness in evaluating the robustness of TRSs.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Model checking of robustness properties in trust and reputation systems
    Ghasempouri, Seyed Asgary
    Ladani, Behrouz Tork
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 108 : 302 - 319
  • [2] Robustness Verification of Deep Reinforcement Learning Based Control Systems Using Reward Martingales
    Zhi, Dapeng
    Wang, Peixin
    Chen, Cheng
    Zhang, Min
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 18, 2024, : 19992 - 20000
  • [3] Robustness and performance of Deep Reinforcement Learning
    Al-Nima, Raid Rafi Omar
    Han, Tingting
    Al-Sumaidaee, Saadoon Awad Mohammed
    Chen, Taolue
    Woo, Wai Lok
    APPLIED SOFT COMPUTING, 2021, 105
  • [4] Deception, Robustness and Trust in Big Data Fueled Deep Learning Systems
    Liu, Ling
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 3 - 3
  • [5] Adversarial Robustness of Deep Reinforcement Learning Based Dynamic Recommender Systems
    Wang, Siyu
    Cao, Yuanjiang
    Chen, Xiaocong
    Yao, Lina
    Wang, Xianzhi
    Sheng, Quan Z.
    FRONTIERS IN BIG DATA, 2022, 5
  • [6] Certified Adversarial Robustness for Deep Reinforcement Learning
    Lutjen, Bjorn
    Everett, Michael
    How, Jonathan P.
    CONFERENCE ON ROBOT LEARNING, VOL 100, 2019, 100
  • [7] Fuzzy Approach for the Evaluation of Trust and Reputation of Services
    Ludwig, Simone A.
    Pulimi, Venkat
    Hnativ, Andriy
    2009 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOLS 1-3, 2009, : 115 - 120
  • [8] An Experimental Testbed for Evaluation of Trust and Reputation Systems
    Kerr, Reid
    Cohen, Robin
    TRUST MANAGEMENT III, 2009, 300 : 252 - 266
  • [9] Methods for reliability evaluation of trust and reputation systems
    Janiszewski, Marek B.
    PHOTONICS APPLICATIONS IN ASTRONOMY, COMMUNICATIONS, INDUSTRY, AND HIGH-ENERGY PHYSICS EXPERIMENTS 2016, 2016, 10031
  • [10] On the Robustness of Controlled Deep Reinforcement Learning for Slice Placement
    Jose Jurandir Alves Esteves
    Amina Boubendir
    Fabrice Guillemin
    Pierre Sens
    Journal of Network and Systems Management, 2022, 30