Data-Efficient Control Barrier Function Refinement

被引:2
|
作者
Dai, Bolun [1 ]
Huang, Heming [1 ]
Krishnamurthy, Prashanth [1 ]
Khorrami, Farshad [1 ]
机构
[1] NYU, Tandon Sch Engn, Elect & Comp Engn Dept, Control Robot Res Lab, Brooklyn, NY 11201 USA
关键词
D O I
10.23919/ACC55779.2023.10156295
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Control barrier functions (CBFs) have been widely used for synthesizing controllers in safety-critical applications. When used as a safety filter, a CBF provides a simple and computationally efficient way to obtain safe controls from a possibly unsafe performance controller. Despite its conceptual simplicity, constructing a valid CBF is well known to be challenging, especially for high-relative degree systems under nonconvex constraints. Recently, work has been done to learn a valid CBF from data based on a handcrafted CBF (HCBF). Even though the HCBF gives a good initialization point, it still requires a large amount of data to train the CBF network. In this work, we propose a new method to learn more efficiently from the collected data through a novel prioritized data sampling strategy. A priority score is computed from the loss value of each data point. Then, a probability distribution based on the priority score of the data points is used to sample data and update the learned CBF. Using our proposed approach, we can learn a valid CBF that recovers a larger portion of the true safe set using a smaller amount of data. The effectiveness of our method is demonstrated in simulation on a two-link arm.
引用
收藏
页码:3675 / 3680
页数:6
相关论文
共 50 条
  • [1] Data-Efficient Reinforcement Learning for Malaria Control
    Zou, Lixin
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 507 - 513
  • [2] Data-efficient safe learning and control with on-board sensors: Bayesian meta-learning and barrier function based approach
    Hashimoto, Wataru
    Hashimoto, Kazumune
    Wachi, Akifumi
    Shen, Xun
    Kishida, Masako
    Takai, Shigemasa
    [J]. ADVANCED ROBOTICS, 2024,
  • [3] Data-Efficient Reinforcement Learning for Variable Impedance Control
    Anand, Akhil S.
    Kaushik, Rituraj
    Gravdahl, Jan Tommy
    Abu-Dakka, Fares J.
    [J]. IEEE ACCESS, 2024, 12 : 15631 - 15641
  • [4] Gaussian Processes for Data-Efficient Learning in Robotics and Control
    Deisenroth, Marc Peter
    Fox, Dieter
    Rasmussen, Carl Edward
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (02) : 408 - 423
  • [5] Data-efficient Deep Reinforcement Learning for Vehicle Trajectory Control
    Frauenknecht, Bernd
    Ehlgen, Tobias
    Trimpe, Sebastian
    [J]. 2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 894 - 901
  • [6] Data-Efficient Reinforcement Learning with Probabilistic Model Predictive Control
    Kamthe, Sanket
    Deisenroth, Marc Peter
    [J]. INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 84, 2018, 84
  • [7] Data-Efficient Autotuning With Bayesian Optimization: An Industrial Control Study
    Neumann-Brosig, Matthias
    Marco, Alonso
    Schwarzmann, Dieter
    Trimpe, Sebastian
    [J]. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2020, 28 (03) : 730 - 740
  • [8] Data-efficient autotuning with bayesian optimization: An industrial control study
    Neumann-Brosig, Matthias
    Marco, Alonso
    Schwarzmann, Dieter
    Trimpe, Sebastian
    [J]. IEEE Transactions on Control Systems Technology, 2020, 28 (03): : 730 - 740
  • [9] Data-Efficient Learning Control of Continuum Robots in Constrained Environments
    Mo, Hangjie
    Wei, Ruofeng
    Kong, Xiaowen
    Zhai, Yujia
    Liu, Yunhui
    Sun, Dong
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, : 1 - 12
  • [10] Data-Efficient Graph Learning
    Ding, Kaize
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 20, 2024, : 22663 - 22663