Reinforcement learning of biomimetic navigation: a model problem for sperm chemotaxis

被引:1
|
作者
Mohamed, Omar [1 ]
Tsang, Alan C. H. [1 ]
机构
[1] Univ Hong Kong, Dept Mech Engn, Pokfulam Rd, Hong Kong, Peoples R China
来源
EUROPEAN PHYSICAL JOURNAL E | 2024年 / 47卷 / 09期
关键词
FLUID SHEAR; EVOLUTION; FLOW;
D O I
10.1140/epje/s10189-024-00451-6
中图分类号
O64 [物理化学(理论化学)、化学物理学];
学科分类号
070304 ; 081704 ;
摘要
Motile biological cells can respond to local environmental cues and exhibit various navigation strategies to search for specific targets. These navigation strategies usually involve tuning of key biophysical parameters of the cells, such that the cells can modulate their trajectories to move in response to the detected signals. Here we introduce a reinforcement learning approach to modulate key biophysical parameters and realize navigation strategies reminiscent to those developed by biological cells. We present this approach using sperm chemotaxis toward an egg as a paradigm. By modulating the trajectory curvature of a sperm cell model, the navigation strategies informed by reinforcement learning are capable to resemble sperm chemotaxis observed in experiments. This approach provides an alternative method to capture biologically relevant navigation strategies, which may inform the necessary parameter modulations required for obtaining specific navigation strategies and guide the design of biomimetic micro-robotics.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] AUTONOMOUS PORT NAVIGATION WITH RANGING SENSORS USING MODEL-BASED REINFORCEMENT LEARNING
    Herremans, Siemen
    Anwar, Ali
    Troch, Arne
    Ravijts, Ian
    Vangeneugden, Maarten
    Mercelis, Siegfried
    Hellinckx, Peter
    PROCEEDINGS OF ASME 2023 42ND INTERNATIONAL CONFERENCE ON OCEAN, OFFSHORE & ARCTIC ENGINEERING, OMAE2023, VOL 5, 2023,
  • [42] Deep Reinforcement Learning Visual Navigation Model Integrating Memory- prediction Mechanism
    Xiao, Qian
    Yi, Pengfei
    Liu, Rui
    Dong, Jing
    Zhou, Dongsheng
    Zhang, Qiang
    PROCEEDINGS OF THE 2021 IEEE 24TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2021, : 109 - 114
  • [43] Model inductive bias enhanced deep reinforcement learning for robot navigation in crowded environments
    Chen, Man
    Huang, Yongjie
    Wang, Weiwen
    Zhang, Yao
    Xu, Lei
    Pan, Zhisong
    COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (05) : 6965 - 6982
  • [44] A Model-free Mapless Navigation Method for Mobile Robot Using Reinforcement Learning
    Lv Qiang
    Duo Nanxun
    Lin Huican
    Wei Heng
    PROCEEDINGS OF THE 30TH CHINESE CONTROL AND DECISION CONFERENCE (2018 CCDC), 2018, : 3410 - 3415
  • [45] Virtual musculoskeletal arm and robotic arm driven by a biomimetic model of sensorimotor cortex with reinforcement learning
    Dura-Bernal, Salvador
    Chadderdon, George L.
    Neymotin, Samuel A.
    Zhou, Xianlian
    Przekwas, Andrzej
    Francis, Joseph T.
    Lytton, William W.
    2013 IEEE SIGNAL PROCESSING IN MEDICINE AND BIOLOGY SYMPOSIUM (SPMB), 2013,
  • [46] Survival-Oriented Reinforcement Learning Model: An Effcient and Robust Deep Reinforcement Learning Algorithm for Autonomous Driving Problem
    Ye, Changkun
    Ma, Huimin
    Zhang, Xiaoqin
    Zhang, Kai
    You, Shaodi
    IMAGE AND GRAPHICS (ICIG 2017), PT II, 2017, 10667 : 417 - 429
  • [47] Mammalian sperm hyperactivation regulates navigation via physical boundaries and promotes pseudo-chemotaxis
    Zaferani, Meisam
    Suarez, Susan S.
    Abbaspourrad, Alireza
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2021, 118 (44)
  • [48] Deep Reinforcement Learning for Mapless Robot Navigation Systems
    Oliveira, Iure Rosa L.
    Brandao, Alexandre S.
    2023 LATIN AMERICAN ROBOTICS SYMPOSIUM, LARS, 2023 BRAZILIAN SYMPOSIUM ON ROBOTICS, SBR, AND 2023 WORKSHOP ON ROBOTICS IN EDUCATION, WRE, 2023, : 331 - 336
  • [49] Explainable navigation system using fuzzy reinforcement learning
    Bautista-Montesano, Rolando
    Bustamante-Bello, Rogelio
    Ramirez-Mendoza, Ricardo A.
    INTERNATIONAL JOURNAL OF INTERACTIVE DESIGN AND MANUFACTURING - IJIDEM, 2020, 14 (04): : 1411 - 1428
  • [50] Flock Navigation by Coordinated Shepherds via Reinforcement Learning
    Hasan, Yazied
    Baxter, John E. G.
    Salcedo, Cesar A.
    Delgado, Elena
    Tapia, Lydia
    ALGORITHMIC FOUNDATIONS OF ROBOTICS XV, 2023, 25 : 454 - 469