Continual Reinforcement Learning for Intelligent Agricultural Management under Climate Changes

被引:1
|
作者
Wang, Zhaoan [1 ]
Jha, Kishlay [2 ]
Xiao, Shaoping [1 ]
机构
[1] Univ Iowa, Iowa Technol Inst, Dept Mech Engn, Iowa City, IA 52242 USA
[2] Univ Iowa, Dept Elect & Comp Engn, Iowa City, IA 52242 USA
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 81卷 / 01期
基金
美国国家科学基金会;
关键词
Continual learning; reinforcement learning; agricultural management; climate variability; NEURAL-NETWORKS;
D O I
10.32604/cmc.2024.055809
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Climate change poses significant challenges to agricultural management, particularly in adapting to extreme weather conditions that impact agricultural production. Existing works with traditional Reinforcement Learning (RL) methods often falter under such extreme conditions. To address this challenge, our study introduces a novel approach by integrating Continual Learning (CL) with RL to form Continual Reinforcement Learning (CRL), enhancing the adaptability of agricultural management strategies. Leveraging the Gym-DSSAT simulation environment, our research enables RL agents to learn optimal fertilization strategies based on variable weather conditions. By incorporating CL algorithms, such as Elastic Weight Consolidation (EWC), with established RL techniques like Deep Q-Networks (DQN), we developed a framework in which agents can learn and retain knowledge across diverse weather scenarios. The CRL approach was tested under climate variability to assess the robustness and adaptability of the induced policies, particularly under extreme weather events like severe droughts. Our results showed that continually learned policies exhibited superior adaptability and performance compared to optimal policies learned through the conventional RL methods, especially in challenging conditions of reduced rainfall and increased temperatures. This pioneering work, which combines CL with RL to generate adaptive policies for agricultural management, is expected to make significant advancements in precision agriculture in the era of climate change.
引用
收藏
页码:1319 / 1336
页数:18
相关论文
共 50 条
  • [11] The Intelligent Path Planning System of Agricultural Robot via Reinforcement Learning
    Yang, Jiachen
    Ni, Jingfei
    Li, Yang
    Wen, Jiabao
    Chen, Desheng
    SENSORS, 2022, 22 (12)
  • [12] Learning to Navigate for Mobile Robot with Continual Reinforcement Learning
    Wang, Ning
    Zhang, Dingyuan
    Wang, Yong
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 3701 - 3706
  • [13] THE EFFECTIVENESS OF WORLD MODELS FOR CONTINUAL REINFORCEMENT LEARNING
    Kessler, Samuel
    Ostaszewski, Mateusz
    Bortkiewicz, Michal
    Zarski, Mateusz
    Wolczyk, Maciej
    Parker-Holder, Jack
    Roberts, Stephen J.
    Milos, Piotr
    CONFERENCE ON LIFELONG LEARNING AGENTS, VOL 232, 2023, 232 : 184 - 204
  • [14] Towards Continual Reinforcement Learning: A Review and Perspectives
    Khetarpal, Khimya
    Riemer, Matthew
    Rish, Irina
    Precup, Doina
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2022, 75 : 1401 - 1476
  • [15] COOM: A Game Benchmark for Continual Reinforcement Learning
    Tomilin, Tristan
    Fang, Meng
    Zhang, Yudi
    Pechenizkiy, Mykola
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [16] Avalanche RL: A Continual Reinforcement Learning Library
    Lucchesi, Nicolo
    Carta, Antonio
    Lomonaco, Vincenzo
    Bacciu, Davide
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT I, 2022, 13231 : 524 - 535
  • [17] LOSS OF PLASTICITY IN CONTINUAL DEEP REINFORCEMENT LEARNING
    Abbas, Zaheer
    Zhao, Rosie
    Modayil, Joseph
    White, Adam
    Machado, Marlos C.
    CONFERENCE ON LIFELONG LEARNING AGENTS, VOL 232, 2023, 232 : 620 - 636
  • [18] Continual Reinforcement Learning for Quadruped Robot Locomotion
    Gai, Sibo
    Lyu, Shangke
    Zhang, Hongyin
    Wang, Donglin
    ENTROPY, 2024, 26 (01)
  • [19] Towards Continual Reinforcement Learning: A Review and Perspectives
    Khetarpal, Khimya
    Riemer, Matthew
    Rish, Irina
    Precup, Doina
    Journal of Artificial Intelligence Research, 2022, 75 : 1401 - 1476
  • [20] Intelligent Energy Management System for Microgrids using Reinforcement Learning
    Kumar, Polamarasetty P.
    Nuvvula, Ramakrishna S. S.
    Shezan, Sk. A.
    Hushein, R.
    Babu, J. M.
    Ahammed, Syed Riyaz
    Ali, Ahmed
    12TH INTERNATIONAL CONFERENCE ON SMART GRID, ICSMARTGRID 2024, 2024, : 329 - 335