Adaptive deep Q learning network with reinforcement learning for crime prediction

被引:6
|
作者
Devi, J. Vimala [1 ]
Kavitha, K. S. [2 ]
机构
[1] Cambridge Inst Technol, Dept Comp Sci & Engn, Bengaluru 560036, Karnataka, India
[2] Dayananda Sagar Coll Engn, Dept Comp Sci & Engn, Bengaluru 560078, Karnataka, India
关键词
Adaptive deep recurrent Q learning network (DRQN) model; Crime prediction model; Gated recurrent unit; Markov decision process; Reinforcement learning;
D O I
10.1007/s12065-021-00694-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Crime prediction models are very useful for the police force to prevent crimes from happening and to reduce the crime rate of the city. Existing crime prediction models are not efficient in handling the data imbalance and have an overfitting problem. In this research, an adaptive DRQN model is proposed to develop a robust crime prediction model. The proposed adaptive DRQN model includes the application of GRU instead of LSTM unit to store the relevant features for the effective classification of Sacramento city crime data. The storage of relevant features for a long time helps to handle the data imbalance problem and irrelevant features are eliminated to avoid overfitting problems. Adaptive agents based on the MDP are applied to adaptively learn the input data and provide effective predictions. The reinforcement learning method is applied in the proposed adaptive DRQN model to select the optimal state value and to identify the best reward value. The proposed adaptive DRQN model has an MAE of 36.39 which is better than the existing Recurrent Q-Learning model has 38.82 MAE.
引用
收藏
页码:685 / 696
页数:12
相关论文
共 50 条
  • [1] Adaptive deep Q learning network with reinforcement learning for crime prediction
    J. Vimala Devi
    K. S. Kavitha
    [J]. Evolutionary Intelligence, 2023, 16 : 685 - 696
  • [2] Deep Reinforcement Learning: From Q-Learning to Deep Q-Learning
    Tan, Fuxiao
    Yan, Pengfei
    Guan, Xinping
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2017), PT IV, 2017, 10637 : 475 - 483
  • [3] Deep Reinforcement Learning for Adaptive Learning Systems
    Li, Xiao
    Xu, Hanchen
    Zhang, Jinming
    Chang, Hua-hua
    [J]. JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2023, 48 (02) : 220 - 243
  • [4] Deep Q-Learning Based Reinforcement Learning Approach for Network Intrusion Detection
    Alavizadeh, Hooman
    Alavizadeh, Hootan
    Jang-Jaccard, Julian
    [J]. COMPUTERS, 2022, 11 (03)
  • [5] Deep Reinforcement Learning with Double Q-Learning
    van Hasselt, Hado
    Guez, Arthur
    Silver, David
    [J]. THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 2094 - 2100
  • [6] DDNSAS: Deep reinforcement learning based deep Q-learning network for smart agriculture system
    Devarajan, Ganesh Gopal
    Nagarajan, Senthil Murugan
    Ramana, T. V.
    Vignesh, T.
    Ghosh, Uttam
    Alnumay, Waleed
    [J]. SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2023, 39
  • [7] Deep Reinforcement Learning. Case Study: Deep Q-Network
    Vrejoiu, Mihnea Horia
    [J]. ROMANIAN JOURNAL OF INFORMATION TECHNOLOGY AND AUTOMATIC CONTROL-REVISTA ROMANA DE INFORMATICA SI AUTOMATICA, 2019, 29 (03): : 65 - 78
  • [8] Deep Reinforcement Learning Pairs Trading with a Double Deep Q-Network
    Brim, Andrew
    [J]. 2020 10TH ANNUAL COMPUTING AND COMMUNICATION WORKSHOP AND CONFERENCE (CCWC), 2020, : 222 - 227
  • [9] Leveraging transfer learning with deep learning for crime prediction
    Butt, Umair Muneer
    Letchmunan, Sukumar
    Hassan, Fadratul Hafinaz
    Koh, Tieng Wei
    [J]. PLOS ONE, 2024, 19 (04):
  • [10] DEEP REINFORCEMENT LEARNING FOR VIDEO PREDICTION
    Ho, Yung-Han
    Cho, Chuan-Yuan
    Peng, Wen-Hsiao
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 604 - 608