Backdoor Attacks on Multi-Agent Reinforcement Learning-based Spectrum Management

被引:1
|
作者
Zhang, Hongyi [1 ]
Liu, Mingqian [1 ]
Chen, Yunfei [2 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Shanxi, Peoples R China
[2] Univ Durham, Dept Engn, South Rd, Durham DH1 3LE, England
关键词
multi-agent; deep reinforcement learning; backdoor attacks; spectrum management;
D O I
10.1109/GLOBECOM54140.2023.10437779
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Effective spectrum management control through multi-agent deep reinforcement learning holds promising potential for advancing wireless communication systems. However, backdoor attacks can compromise the integrity and security of multi-agent deep reinforcement learning models, allowing attackers to manipulate their behaviour and cause significant damage to the system. In this paper, we have defined a four-step process for designing a general backdoor in spectrum management based on multi-agent deep reinforcement learning, which involves searching for the most observed channels, determining the backdoor power limit, selecting feasible poisoned channels, and setting up induced rewards. Experimental results demonstrate the effectiveness of this attack, which allows the system to perform spectrum management without triggering the backdoor. However, when the backdoor is triggered, it results in severe communication interruptions. Overall, this paper contributes to the field of secure and reliable spectrum management by providing insights into the impact of backdoor attacks on deep learning-based systems.
引用
收藏
页码:3361 / 3365
页数:5
相关论文
共 50 条
  • [1] MARNet: Backdoor Attacks Against Cooperative Multi-Agent Reinforcement Learning
    Chen, Yanjiao
    Zheng, Zhicong
    Gong, Xueluan
    [J]. IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2023, 20 (05) : 4188 - 4198
  • [2] Multi-Agent Reinforcement Learning-Based Distributed Dynamic Spectrum Access
    Albinsaid, Hasan
    Singh, Keshav
    Biswas, Sudip
    Li, Chih-Peng
    [J]. IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2022, 8 (02) : 1174 - 1185
  • [3] MAPS: Multi-agent Reinforcement Learning-based Portfolio Management System
    Lee, Jinho
    Kim, Raehyun
    Yi, Seok-Won
    Kang, Jaewoo
    [J]. PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 4520 - 4526
  • [4] Resilience enhancement of multi-agent reinforcement learning-based demand response against adversarial attacks
    Zeng, Lanting
    Qiu, Dawei
    Sun, Mingyang
    [J]. APPLIED ENERGY, 2022, 324
  • [5] Adversarial attacks in consensus-based multi-agent reinforcement learning
    Figura, Martin
    Kosaraju, Krishna Chaitanya
    Gupta, Vijay
    [J]. 2021 AMERICAN CONTROL CONFERENCE (ACC), 2021, : 3050 - 3055
  • [6] Multi-Agent Reinforcement Learning-based Distributed Economic Dispatch Considering Network attacks and Uncertain Costs
    Mao, Dong
    Ding, Lifu
    Zhang, Chen
    Rao, Hanyu
    Yan, Gangfeng
    [J]. PROCEEDINGS OF THE 2021 IEEE 16TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2021), 2021, : 469 - 474
  • [7] Multi-Agent Reinforcement Learning-Based Decentralized Spectrum Access in Vehicular Networks With Emergent Communication
    Xiang, Ping
    Shan, Hangguan
    Su, Zhou
    Zhang, Zhaoyang
    Chen, Chen
    Li, Er-Ping
    [J]. IEEE COMMUNICATIONS LETTERS, 2023, 27 (01) : 195 - 199
  • [8] Multi-Agent Reinforcement Learning-Based Resource Allocation for UAV Networks
    Cui, Jingjing
    Liu, Yuanwei
    Nallanathan, Arumugam
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (02) : 729 - 743
  • [9] Scalable Multi-Agent Reinforcement Learning-Based Distributed Channel Access
    Chen, Zhenyu
    Sun, Xinghua
    [J]. ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 453 - 458
  • [10] Multi-agent Reinforcement Learning-Based UAS Control for Logistics Environments
    Jo, Hyungeun
    Lee, Hoeun
    Jeon, Sangwoo
    Kaliappan, Vishnu Kumar
    Nguyen, Tuan Anh
    Min, Dugki
    Lee, Jae-Woo
    [J]. PROCEEDINGS OF THE 2021 ASIA-PACIFIC INTERNATIONAL SYMPOSIUM ON AEROSPACE TECHNOLOGY (APISAT 2021), VOL 2, 2023, 913 : 963 - 972