An Adaptive Control Algorithm Based on Q-Learning for UHF Passive RFID Robots in Dynamic Scenarios

被引:0
|
作者
Wang, Honggang [1 ,2 ]
Yu, Ruixue [1 ,2 ]
Pan, Ruoyu [1 ,2 ]
Pei, Peidong [1 ,2 ]
Han, Zhao [1 ,2 ]
Zhang, Nanfeng [3 ]
Yang, Jingfeng [4 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Commun & Informat Engn, Xian 710121, Peoples R China
[2] Xian Univ Posts & Telecommun, Sch Artificial Intelligence, Xian 710121, Peoples R China
[3] Huangpu Customs Dist Technol Ctr, Guangzhou 510730, Peoples R China
[4] Guangzhou Inst Ind Intelligence, Guangzhou 511458, Peoples R China
关键词
RFID robots; dynamic scenarios; identification state; adaptive control; Q-learning;
D O I
10.3390/math10193574
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
The Identification State (IS) of Radio Frequency Identification (RFID) robot systems changes continuously with the environment, so improving the identification efficiency of RFID robot systems requires adaptive control of system parameters through real-time evaluation of the IS. This paper first expounds on the important roles of the real-time evaluation of the IS and adaptive control of parameters in the RFID robot systems. Secondly, a method for real-time evaluation of the IS of UHF passive RFID robot systems in dynamic scenarios based on principal component analysis (PCA)-K-Nearest Neighbor (KNN) is proposed and establishes an experimental scene to complete algorithm verification. The results show that the accuracy of the real-time evaluation method of IS based on PCA-KNN is 92.4%, and the running time of a single data is 0.258 ms, compared with other algorithms. The proposed evaluation method has higher accuracy and shorter running time. Finally, this paper proposes a Q-learning-based adaptive control algorithm for RFID robot systems. This method dynamically controls the reader's transmission power and the robot's moving speed according to the IS fed back by the system; compared with the default parameters, the adaptive control algorithm effectively improves the identification rate of the system, the power consumption under the adaptive parameters is reduced by 36.4%, and the time spent decreases by 29.7%.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Q-LEARNING BASED CONTROL ALGORITHM FOR HTTP ADAPTIVE STREAMING
    Martin, Virginia
    Cabrera, Julian
    Garcia, Narciso
    [J]. 2015 VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2015,
  • [2] Dynamic fuzzy Q-Learning and control of mobile robots
    Deng, C
    Er, MJ
    Xu, J
    [J]. 2004 8TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION, VOLS 1-3, 2004, : 2336 - 2341
  • [3] Incremental Q-learning strategy for adaptive PID control of mobile robots
    Carlucho, Ignacio
    De Paula, Mariano
    Villar, Sebastian A.
    Acosta, Gerardo G.
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2017, 80 : 183 - 199
  • [4] Adaptive PID controller based on Q-learning algorithm
    Shi, Qian
    Lam, Hak-Keung
    Xiao, Bo
    Tsai, Shun-Hung
    [J]. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2018, 3 (04) : 235 - 244
  • [5] Adaptive Traffic Control Algorithm Based on Back-Pressure and Q-Learning
    Maipradit, Arnan
    Gao, Juntao
    Kawakami, Tomoya
    Ito, Minoru
    [J]. 2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 1995 - 1999
  • [6] An Algorithm Based on Q-learning for Solving Frequency Assignment in RFID Systems
    Hu Shengbo
    [J]. 2008 CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-11, 2008, : 225 - 229
  • [7] Power Control Algorithm Based on Q-Learning in Femtocell
    Li Yun
    Tang Ying
    Liu Hanxiao
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2019, 41 (11) : 2557 - 2564
  • [8] Ramp Metering Control Based on the Q-Learning Algorithm
    Ivanjko, Edouard
    Necoska, Daniela Koltovska
    Greguric, Martin
    Vujic, Miroslav
    Jurkovic, Goran
    Mandzuka, Sadko
    [J]. CYBERNETICS AND INFORMATION TECHNOLOGIES, 2015, 15 (05) : 88 - 97
  • [9] Power Control Algorithm Based on Q-Learning in Femtocell
    Li, Yun
    Tang, Ying
    Liu, Hanxiao
    [J]. Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2019, 41 (11): : 2557 - 2564
  • [10] Q-Learning Based Distributed Adaptive Algorithm for Topological Stability
    Huang, Qing-Dong
    Shi, Bin-Yu
    Guo, Min-Peng
    Yuan, Run-Zhi
    Chen, Chen
    [J]. Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2020, 49 (02): : 262 - 268