Deep reinforcement learning with dual-Q and Kolmogorov-Arnold Networks for computation offloading in Industrial IoT

被引:0
|
作者
Wu, Jinru
Du, Ruizhong [1 ]
Wang, Ziyuan
机构
[1] Hebei Univ, Sch Cyber Secur & Comp, Baoding 071000, Hebei, Peoples R China
关键词
Industrial internet of things; Mobile edge computing; Computation offloading; Security; Deep reinforcement learning;
D O I
10.1016/j.comnet.2024.110987
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In the industrial internet of things, the rapid development of smart mobile devices and 5G network technology has driven the application of mobile edge computing, reducing the delay in task computation offloading to some extent. However, the increasing complexity of the IIoT environment presents challenges for communication management and offloading performance. To achieve efficient computation offloading communication, we designed a cloud-edge-device IIoT system model, utilizing Voronoi diagrams to partition the service areas of edge servers, thereby adapting to the complex IIoT environment and improving communication efficiency. Additionally, considering that different offloading strategies may result in varying levels of offloading security risks, we developed a principal component analysis-based offloading security evaluation model (PCA-OSEM) to analyze potential security risks during the offloading process and identify key factors. Finally, to optimize offloading strategies to reduce offloading delay and security risks, we proposed a dual-Q with Kolmogorov- Arnold networks in deep reinforcement learning computation offloading (D2KCO). This method enhances the neural network's approximation capability and training stability. Experimental results show that the proposed PCA-OSEM is effective, and the D2KCO method can reduce offloading delay by 13% and 23.52% compared to the D3PG and DDPG algorithms, respectively, while also reducing security risks.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Dual-Q network deep reinforcement learning-based computation offloading method for industrial internet of things
    Du, Ruizhong
    Wu, Jinru
    Gao, Yan
    JOURNAL OF SUPERCOMPUTING, 2024, 80 (17): : 25590 - 25615
  • [2] Simulating fish autonomous swimming behaviours using deep reinforcement learning based on Kolmogorov-Arnold Networks
    Li, Tao
    Zhang, Chunze
    Zhang, Guibin
    Zhou, Qin
    Hou, Ji
    Diao, Wei
    Meng, Wanwan
    Zhang, Xujin
    BIOINSPIRATION & BIOMIMETICS, 2025, 20 (02)
  • [3] Secure Computation Offloading in Blockchain Based IoT Networks With Deep Reinforcement Learning
    Nguyen, Dinh C.
    Pathirana, Pubudu N.
    Ding, Ming
    Seneviratne, Aruna
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (04): : 3192 - 3208
  • [4] Multiagent Deep Reinforcement Learning for Vehicular Computation Offloading in IoT
    Zhu, Xiaoyu
    Luo, Yueyi
    Liu, Anfeng
    Bhuiyan, Md Zakirul Alam
    Zhang, Shaobo
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (12) : 9763 - 9773
  • [5] A deep machine learning algorithm for construction of the Kolmogorov-Arnold representation
    Polar, A.
    Poluektov, M.
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 99
  • [6] CKAN: Convolutional Kolmogorov-Arnold Networks Model for Intrusion Detection in IoT Environment
    Abd Elaziz, Mohamed
    Fares, Ibrahim Ahmed
    Aseeri, Ahmad O.
    IEEE ACCESS, 2024, 12 : 134837 - 134851
  • [7] Deep Reinforcement Learning Aided Computation Offloading and Resource Allocation for IoT
    Gong, Yongkang
    Wang, Jingjing
    Nie, Tianzheng
    2020 IEEE COMPUTING, COMMUNICATIONS AND IOT APPLICATIONS (COMCOMAP), 2021,
  • [8] Secure IoT sensor networks through advanced anomaly detection with Kolmogorov-Arnold Networks (KANs)
    Mishra, Shreshtha
    Jain, Usha
    MICROSYSTEM TECHNOLOGIES-MICRO-AND NANOSYSTEMS-INFORMATION STORAGE AND PROCESSING SYSTEMS, 2025,
  • [9] Classifying IoT Botnet Attacks With Kolmogorov-Arnold Networks: A Comparative Analysis of Architectural Variations
    Do, Phuc Hao
    Le, Tran Duc
    Dinh, Truong Duy
    Pham, Van Dai
    IEEE ACCESS, 2025, 13 : 16072 - 16093
  • [10] Error bounds for deep ReLU networks using the Kolmogorov-Arnold superposition theorem
    Montanelli, Hadrien
    Yang, Haizhao
    NEURAL NETWORKS, 2020, 129 : 1 - 6