Continual Reinforcement Learning for Intelligent Agricultural Management under Climate Changes

被引:1
|
作者
Wang, Zhaoan [1 ]
Jha, Kishlay [2 ]
Xiao, Shaoping [1 ]
机构
[1] Univ Iowa, Iowa Technol Inst, Dept Mech Engn, Iowa City, IA 52242 USA
[2] Univ Iowa, Dept Elect & Comp Engn, Iowa City, IA 52242 USA
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 81卷 / 01期
基金
美国国家科学基金会;
关键词
Continual learning; reinforcement learning; agricultural management; climate variability; NEURAL-NETWORKS;
D O I
10.32604/cmc.2024.055809
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Climate change poses significant challenges to agricultural management, particularly in adapting to extreme weather conditions that impact agricultural production. Existing works with traditional Reinforcement Learning (RL) methods often falter under such extreme conditions. To address this challenge, our study introduces a novel approach by integrating Continual Learning (CL) with RL to form Continual Reinforcement Learning (CRL), enhancing the adaptability of agricultural management strategies. Leveraging the Gym-DSSAT simulation environment, our research enables RL agents to learn optimal fertilization strategies based on variable weather conditions. By incorporating CL algorithms, such as Elastic Weight Consolidation (EWC), with established RL techniques like Deep Q-Networks (DQN), we developed a framework in which agents can learn and retain knowledge across diverse weather scenarios. The CRL approach was tested under climate variability to assess the robustness and adaptability of the induced policies, particularly under extreme weather events like severe droughts. Our results showed that continually learned policies exhibited superior adaptability and performance compared to optimal policies learned through the conventional RL methods, especially in challenging conditions of reduced rainfall and increased temperatures. This pioneering work, which combines CL with RL to generate adaptive policies for agricultural management, is expected to make significant advancements in precision agriculture in the era of climate change.
引用
收藏
页码:1319 / 1336
页数:18
相关论文
共 50 条
  • [31] Optimization Algorithm of Intelligent Warehouse Management System Based on Reinforcement Learning
    Zhou J.
    Journal of Electrical Systems, 2024, 20 (01) : 219 - 231
  • [32] RISK MANAGEMENT IN AGRICULTURE UNDER CLIMATE CHANGES
    Njegomir, Vladimir
    Tepavac, Rajko
    Bikicki, Tamara
    EKONOMIKA POLJOPRIVREDA-ECONOMICS OF AGRICULTURE, 2016, 63 (04): : 1403 - 1416
  • [33] Intelligent Cruise Guidance and Vehicle Resource Management With Deep Reinforcement Learning
    Sun, Guolin
    Liu, Kai
    Boateng, Gordon Owusu
    Liu, Guisong
    Jiang, Wei
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (05) : 3574 - 3585
  • [34] Intelligent Residential Energy Management System Using Deep Reinforcement Learning
    Mathew, Alwyn
    Roy, Abhijit
    Mathew, Jimson
    IEEE SYSTEMS JOURNAL, 2020, 14 (04): : 5362 - 5372
  • [35] Towards Continual Reinforcement Learning through Evolutionary Meta-Learning
    Grbic, Djordje
    Risi, Sebastian
    PROCEEDINGS OF THE 2019 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE COMPANION (GECCCO'19 COMPANION), 2019, : 119 - 120
  • [36] Continual Learning Under Language Shift
    Gogoulou, Evangelia
    Lesort, Timothee
    Boman, Magnus
    Nivre, Joakim
    TEXT, SPEECH, AND DIALOGUE, TSD 2024, PT I, 2024, 15048 : 71 - 84
  • [37] SELF-ACTIVATING NEURAL ENSEMBLES FOR CONTINUAL REINFORCEMENT LEARNING
    Powers, Sam
    Xing, Eliot
    Gupta, Abhinav
    CONFERENCE ON LIFELONG LEARNING AGENTS, VOL 199, 2022, 199
  • [38] Solving Continual Combinatorial Selection via Deep Reinforcement Learning
    Song, Hyungseok
    Jang, Hyeryung
    Tran, Hai H.
    Yoon, Se-eun
    Son, Kyunghwan
    Yun, Donggyu
    Chung, Hyoju
    Yi, Yung
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 3467 - 3474
  • [39] Neural Manifold Modulated Continual Reinforcement Learning for Musculoskeletal Robots
    Chen, Jiahao
    Chen, Ziyu
    Yao, Chaojing
    Qiao, Hong
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (01) : 86 - 99
  • [40] Continual Vision-based Reinforcement Learning with Group Symmetries
    Liu, Shiqi
    Xu, Mengdi
    Huang, Peide
    Zhang, Xilun
    Liu, Yongkang
    Oguchi, Kentaro
    Zhao, Ding
    CONFERENCE ON ROBOT LEARNING, VOL 229, 2023, 229