Low load DIDS task scheduling based on Q-learning in edge computing environment

被引:14
|
作者
Zhao, Xu [1 ,2 ,3 ]
Huang, Guangqiu [1 ]
Gao, Ling [2 ]
Li, Maozhen [3 ]
Gao, Quanli [2 ]
机构
[1] Xian Univ Architecture & Technol, Sch Management, Xian 710055, Peoples R China
[2] Xian Polytech Univ, Sch Comp Sci, Xian 710048, Peoples R China
[3] Brunel Univ London, Dept Elect & Elect Engn, Uxbridge UB8 3PH, Middx, England
关键词
Reinforcement learning; Intrusion detection; Task scheduling; Q-learning; NETWORK INTRUSION DETECTION; DETECTION SYSTEMS; INTERNET; OPTIMIZATION; ALLOCATION; SECURITY;
D O I
10.1016/j.jnca.2021.103095
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Edge computing, as a new computing model, is facing new challenges in network security while developing rapidly. Due to the limited performance of edge nodes, the distributed intrusion detection system (DIDS), which relies on high-performance devices in cloud computing, needs to be improved to low load to detect packets nearby the network edge. This paper proposes a low load DIDS task scheduling method based on Q-Learning algorithm in reinforcement learning, which can dynamically adjust scheduling strategies according to network changes in the edge computing environment to keep the overall load of DIDS at a low level, while maintaining a balance between the two contradictory indicators of low load and packet loss rate. Simulation experiments show that the proposed method has better low-load performance than other scheduling methods, and indicators such as malicious feature detection rate are not significantly reduced.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Fragmented Task Scheduling for Load-Balanced Fog Computing Based on Q-Learning
    Razaq, Mian Muaz
    Rahim, Shahnila
    Tak, Byungchul
    Peng, Limei
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [2] Q-Learning based SFC deployment on Edge Computing Environment
    Pandey, Suman
    Hong, James Won-Ki
    Yoo, Jae-Hyoung
    [J]. APNOMS 2020: 2020 21ST ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (APNOMS), 2020, : 220 - 226
  • [3] Q-learning based dynamic task scheduling for energy-efficient cloud computing
    Ding, Ding
    Fan, Xiaocong
    Zhao, Yihuan
    Kang, Kaixuan
    Yin, Qian
    Zeng, Jing
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 108 : 361 - 371
  • [4] A Request Scheduling Optimization Mechanism Based on Deep Q-Learning in Edge Computing Environments
    Zhang, Yaqiang
    Li, Rengang
    Zhao, Yaqian
    Li, Ruyang
    [J]. IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM WKSHPS 2021), 2021,
  • [5] A Task Scheduling Algorithm Based on Q-Learning for WSNs
    Zhang, Benhong
    Wu, Wensheng
    Bi, Xiang
    Wang, Yiming
    [J]. COMMUNICATIONS AND NETWORKING, CHINACOM 2018, 2019, 262 : 521 - 530
  • [6] A scheduling scheme in the cloud computing environment using deep Q-learning
    Tong, Zhao
    Chen, Hongjian
    Deng, Xiaomei
    Li, Kenli
    Li, Keqin
    [J]. INFORMATION SCIENCES, 2020, 512 (512) : 1170 - 1191
  • [7] Environment Aware Adaptive Q-Learning to Deploy SFC on Edge Computing
    Pandey, Suman
    Hong, James W.
    Yoo, Jae-Hyung
    [J]. 2020 16TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT (CNSM), 2020,
  • [8] Optimization method of task uninstallation in mobile edge computing environment combining improved deep Q-learning and transmission learning
    Zhao, Lihong
    Wang, Shuqin
    Ding, Xiaomei
    [J]. Discover Applied Sciences, 2025, 7 (01)
  • [9] Load Balancing and Energy Saving Algorithm Based on Deep Q-Learning in Mobile Edge Computing
    Ma, Li
    Cui, Xinyu
    Li, Yang
    [J]. 2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 3736 - 3741
  • [10] Adaptive packet scheduling in IoT environment based on Q-learning
    Kim, Donghyun
    Lee, Taeho
    Kim, Sejun
    Lee, Byungjun
    Youn, Hee Yong
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2020, 11 (06) : 2225 - 2235