DRLIC: Deep Reinforcement Learning for Irrigation Control

被引:10
|
作者
Ding, Xianzhong [1 ]
Du, Wan [1 ]
机构
[1] Univ Calif Merced, Merced, CA 95343 USA
基金
美国国家科学基金会;
关键词
INFILTRATION; PREDICTION;
D O I
10.1109/IPSN54338.2022.00011
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Agricultural irrigation is a major consumer of freshwater. Current irrigation systems used in the field are not efficient, since they are mainly based on soil moisture sensors' measurement and growers' experience, but not future soil moisture loss. It is hard to predict soil moisture loss, as it depends on a variety of factors, such as soil texture, weather and plants' characteristics. To improve irrigation efficiency, this paper presents DRLIC, a deep reinforcement learning (DRL)-based irrigation system. DRLIC uses a neural network (DRL control agent) to learn an optimal control policy that takes both current soil moisture measurement and future soil moisture loss into account. We define an irrigation reward function that facilitates the control agent to learn from past experience. Sometimes, our DRL control agent may output an unsafe action (e.g., irrigating too much water or too little). To prevent any possible damage to plants' health, we adopt a safe mechanism that leverages a soil moisture predictor to estimate each action's performance. If it is unsafe, we will perform a relatively-conservative action instead. Finally, we develop a real-world irrigation system that is composed of sprinklers, sensing and control nodes, and a wireless network. We deploy DRLIC in our testbed composed of six almond trees. Through a 15-day in-field experiment, we find that DRLIC can save up to 9.52% of water over a widely-used irrigation scheme.
引用
收藏
页码:41 / 53
页数:13
相关论文
共 50 条
  • [21] Robust Deep Reinforcement Learning for Quadcopter Control
    Deshpande, Aditya M.
    Minai, Ali A.
    Kumar, Manish
    [J]. IFAC PAPERSONLINE, 2021, 54 (20): : 90 - 95
  • [22] Deep reinforcement learning for inventory control: A roadmap
    Boute, Robert N.
    Gijsbrechts, Joren
    van Jaarsveld, Willem
    Vanvuchelen, Nathalie
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2022, 298 (02) : 401 - 412
  • [23] Satellite Attitude Control with Deep Reinforcement Learning
    Gao, Duozhi
    Zhang, Haibo
    Li, Chuanjiang
    Gao, Xinzhou
    [J]. 2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 4095 - 4101
  • [24] Neural Malware Control with Deep Reinforcement Learning
    Wang, Yu
    Stokes, Jack W.
    Marinescu, Mady
    [J]. MILCOM 2019 - 2019 IEEE MILITARY COMMUNICATIONS CONFERENCE (MILCOM), 2019,
  • [25] Distributed deep reinforcement learning for simulation control
    Pawar, Suraj
    Maulik, Romit
    [J]. MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2021, 2 (02):
  • [26] Deep reinforcement learning control of hydraulic fracturing
    Bangi, Mohammed Saad Faizan
    Kwon, Joseph Sang-Il
    [J]. COMPUTERS & CHEMICAL ENGINEERING, 2021, 154
  • [27] Benchmarking Deep Reinforcement Learning for Continuous Control
    Duan, Yan
    Chen, Xi
    Houthooft, Rein
    Schulman, John
    Abbeel, Pieter
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [28] Experience Selection in Deep Reinforcement Learning for Control
    de Bruin, Tim
    Kober, Jens
    Tuyls, Karl
    Babuska, Robert
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2018, 19
  • [29] Reinforcement Learning Control for Water-Efficient Agricultural Irrigation
    Sun, Lijia
    Yang, Yanxiang
    Hu, Jiang
    Porter, Dana
    Marek, Thomas
    Hillyer, Charles
    [J]. 2017 15TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS AND 2017 16TH IEEE INTERNATIONAL CONFERENCE ON UBIQUITOUS COMPUTING AND COMMUNICATIONS (ISPA/IUCC 2017), 2017, : 1334 - 1341
  • [30] Deep Learning for Control: a non-Reinforcement Learning View
    Matei, Ion
    Minhas, Raj
    Zhenirovskyy, Maksym
    de Kleer, Johan
    Rai, Rahul
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 2942 - 2948