Stochastic dynamic programming based approaches to sensor resource management

被引:0
|
作者
Washburn, RB [1 ]
Schneider, MK [1 ]
Fox, JJ [1 ]
机构
[1] Alphatech Inc, Fus Technol & Syst Div, Burlington, MA USA
关键词
sensor resource management; dynamic programming; Gittins index; multi-armed bandit;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper describes a stochastic dynamic programming based approach to solve Sensor Resource Management (SRM) problems such as occur in tracking multiple targets with electronically scanned, multi-mode radar Specifically, it formulates the SRM problem as a stochastic scheduling problem and develops approximate solutions based on the Gittins index rule. Novel results include a hybrid state stochastic model for the information dynamics of tracked targets, an exact index rule solution of the SRM problem for a simplified tracking model, and use of approximate dynamic programming to extend the index rule solution to more realistic models.
引用
收藏
页码:608 / 615
页数:4
相关论文
共 50 条
  • [21] Discussion of dynamic programming and linear programming approaches to stochastic control and optimal stopping in continuous time
    Stockbridge, R. H.
    [J]. METRIKA, 2014, 77 (01) : 137 - 162
  • [22] Approximate stochastic dynamic programming for sensor scheduling to track multiple targets
    Li, Y.
    Krakow, L. W.
    Chong, E. K. P.
    Groom, K. N.
    [J]. DIGITAL SIGNAL PROCESSING, 2009, 19 (06) : 978 - 989
  • [23] Dynamic Ocean Management: Identifying the Critical Ingredients of Dynamic Approaches to Ocean Resource Management
    Lewison, Rebecca L.
    Hobday, Alistair J.
    Maxwell, Sara
    Hazen, Elliott
    Hartog, Jason R.
    Dunn, Daniel C.
    Briscoe, Dana
    Fossette, Sabrina
    O'Keefe, Catherine E.
    Barnes, Michele
    Abecassis, Melanie
    Bograd, Steven
    Bethoney, N. David
    Bailey, Helen
    Wiley, David
    Andrews, Samantha
    Hazen, Lucie
    Crowder, Larry B.
    [J]. BIOSCIENCE, 2015, 65 (05) : 486 - 498
  • [24] A neuro-dynamic programming approach for stochastic reservoir management
    Boukhtouta, A
    Lamond, BF
    [J]. WATER RESOURCES MANAGEMENT II, 2003, 8 : 311 - 320
  • [25] A Stochastic Dynamic Programming Analysis of Farmland Investment and Financial Management
    Lohano, Heman D.
    King, Robert P.
    [J]. CANADIAN JOURNAL OF AGRICULTURAL ECONOMICS-REVUE CANADIENNE D AGROECONOMIE, 2009, 57 (04): : 575 - 600
  • [26] Dynamic Stochastic Programming Tools for Individual Asset Liability Management
    Dempster, M. A. H.
    [J]. 2014 IEEE CONFERENCE ON COMPUTATIONAL INTELLIGENCE FOR FINANCIAL ENGINEERING & ECONOMICS (CIFER), 2014, : IX - IX
  • [27] A stochastic dynamic programming model for stream water quality management
    P. P. Mujumdar
    Pavan Saxena
    [J]. Sadhana, 2004, 29 : 477 - 497
  • [28] A stochastic programming model for dynamic portfolio management with financial derivatives
    Barro, Diana
    Consigli, Giorgio
    Varun, Vivek
    [J]. JOURNAL OF BANKING & FINANCE, 2022, 140
  • [29] A stochastic dynamic programming model for stream water quality management
    Mujumdar, PP
    Saxena, P
    [J]. SADHANA-ACADEMY PROCEEDINGS IN ENGINEERING SCIENCES, 2004, 29 (5): : 477 - 497
  • [30] Optimal Management of an Annual Weed: A Stochastic Dynamic Programming Approach
    Baxter, P. W. J.
    Wilcox, C.
    McCarthy, M. A.
    Possingham, H. P.
    [J]. MODSIM 2007: INTERNATIONAL CONGRESS ON MODELLING AND SIMULATION: LAND, WATER AND ENVIRONMENTAL MANAGEMENT: INTEGRATED SYSTEMS FOR SUSTAINABILITY, 2007, : 2223 - 2229