Continual Reinforcement Learning for Intelligent Agricultural Management under Climate Changes

被引:1
|
作者
Wang, Zhaoan [1 ]
Jha, Kishlay [2 ]
Xiao, Shaoping [1 ]
机构
[1] Univ Iowa, Iowa Technol Inst, Dept Mech Engn, Iowa City, IA 52242 USA
[2] Univ Iowa, Dept Elect & Comp Engn, Iowa City, IA 52242 USA
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 81卷 / 01期
基金
美国国家科学基金会;
关键词
Continual learning; reinforcement learning; agricultural management; climate variability; NEURAL-NETWORKS;
D O I
10.32604/cmc.2024.055809
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Climate change poses significant challenges to agricultural management, particularly in adapting to extreme weather conditions that impact agricultural production. Existing works with traditional Reinforcement Learning (RL) methods often falter under such extreme conditions. To address this challenge, our study introduces a novel approach by integrating Continual Learning (CL) with RL to form Continual Reinforcement Learning (CRL), enhancing the adaptability of agricultural management strategies. Leveraging the Gym-DSSAT simulation environment, our research enables RL agents to learn optimal fertilization strategies based on variable weather conditions. By incorporating CL algorithms, such as Elastic Weight Consolidation (EWC), with established RL techniques like Deep Q-Networks (DQN), we developed a framework in which agents can learn and retain knowledge across diverse weather scenarios. The CRL approach was tested under climate variability to assess the robustness and adaptability of the induced policies, particularly under extreme weather events like severe droughts. Our results showed that continually learned policies exhibited superior adaptability and performance compared to optimal policies learned through the conventional RL methods, especially in challenging conditions of reduced rainfall and increased temperatures. This pioneering work, which combines CL with RL to generate adaptive policies for agricultural management, is expected to make significant advancements in precision agriculture in the era of climate change.
引用
收藏
页码:1319 / 1336
页数:18
相关论文
共 50 条
  • [41] An Intelligent IoT Based Traffic Light Management System: Deep Reinforcement Learning
    Damadam, Shima
    Zourbakhsh, Mojtaba
    Javidan, Reza
    Faroughi, Azadeh
    SMART CITIES, 2022, 5 (04): : 1293 - 1311
  • [42] Real-Time Intelligent Autonomous Intersection Management Using Reinforcement Learning
    Gunarathna, Udesh
    Karunasekera, Shanika
    Borovica-Gajic, Renata
    Tanin, Egemen
    2022 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2022, : 135 - 144
  • [43] Intelligent Energy Management of Vehicular Solar Idle Reduction Systems with Reinforcement Learning
    Hosseini, Seyed Mohammad
    Majdabadi, Mehrdad Mastali
    Azad, Nasser L.
    Wen, John Z.
    Raghavan, Arvind Kothandaraman
    2018 IEEE VEHICLE POWER AND PROPULSION CONFERENCE (VPPC), 2018,
  • [44] Application of Reinforcement Learning in Decision-Making Management of Intelligent Unmanned System
    Wei N.
    Wang G.
    Binggong Xuebao/Acta Armamentarii, 2022, 43 : 164 - 169
  • [45] Intelligent energy management strategy for hybrid electric vehicles using reinforcement learning
    Devaraj T.B.
    Kottoor C.N.R.
    Australian Journal of Electrical and Electronics Engineering, 2024, 21 (01): : 1 - 10
  • [46] Sustainable Water Management in Cities under Climate Changes
    Mrowiec, Maciej
    Ociepa, Ewa
    Malmur, Robert
    Deska, Iwona
    PROBLEMY EKOROZWOJU, 2018, 13 (01): : 133 - 138
  • [47] Deep Reinforcement Learning for Intelligent Communications
    Tan J.-J.
    Liang Y.-C.
    Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2020, 49 (02): : 169 - 181
  • [48] Reinforcement Learning for Intelligent Penetration Testing
    Ghanem, Mohamed C.
    Chen, Thomas M.
    PROCEEDINGS OF THE 2018 SECOND WORLD CONFERENCE ON SMART TRENDS IN SYSTEMS, SECURITY AND SUSTAINABILITY (WORLDS4), 2018, : 185 - 192
  • [49] An Intelligent Transient Stability Assessment Framework With Continual Learning Ability
    Li, Xin
    Yang, Zeguo
    Guo, Panfeng
    Cheng, Jiangzhou
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (12) : 8131 - 8141
  • [50] Adaptation strategies for agricultural water management under climate change in Europe
    Iglesias, Ana
    Garrote, Luis
    AGRICULTURAL WATER MANAGEMENT, 2015, 155 : 113 - 124