Necessary conditions of optimization for partially observed controlled diffusions

被引:2
|
作者
Charalambous, CD
Hibey, JL
机构
[1] McGill Univ, Dept Elect Engn, Montreal, PQ H3A 2A7, Canada
[2] Univ Colorado, Dept Elect Engn, Denver, CO 80217 USA
关键词
stochastic control; minimum principle; partially observable diffusions; nonlinear filtering; measure-valued decompositions;
D O I
10.1137/S0363012994259379
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Necessary conditions are derived for stochastic partially observed control problems when the control enters the drift coefficient and correlation between signal and observation noise is allowed. The problem is formulated as one of complete information, but instead of considering directly the equation satisfied by the unnormalized conditional density of nonlinear filtering, measure-valued decompositions are used to decompose it into two processes. The minimum principle and the stochastic partial differential equation satisfied by the adjoint process are then derived, and the optimality conditions are shown to be the exact necessary conditions derived by Bensoussan [Maximum principle and dynamic programming approaches of the optimal control of partially observed diffusions, Stochastics, 9 (1983), pp. 169-222; Stochastic Control of Partially Observable Systems, Cambridge University Press, Cambridge, UK, 1992] when the correlation is zero.
引用
收藏
页码:1676 / 1700
页数:25
相关论文
共 50 条
  • [41] THE NECESSARY CONDITIONS FOR AN EXTREMUM IN NONSMOOTH OPTIMIZATION
    MORDUKHOVICH, BS
    DOKLADY AKADEMII NAUK SSSR, 1985, 283 (04): : 816 - 822
  • [42] GENERAL NECESSARY CONDITIONS FOR OPTIMIZATION PROBLEMS
    HALKIN, H
    NEUSTADT, LW
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1966, 56 (04) : 1066 - &
  • [43] Optimization of stochastic uncertain systems: Large deviations and robustness for partially observable diffusions
    Charalmbous, C
    Rezaei, F
    PROCEEDINGS OF THE 2004 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 2004, : 3152 - 3157
  • [44] NECESSARY AND SUFFICIENT CONDITIONS IN CONSTRAINED OPTIMIZATION
    HANSON, MA
    MOND, B
    MATHEMATICAL PROGRAMMING, 1987, 37 (01) : 51 - 58
  • [45] NECESSARY CONDITIONS FOR OPTIMIZATION WITH MATRIX IMPULSES
    BARBASHINA, EE
    DIFFERENTIAL EQUATIONS, 1981, 17 (04) : 391 - 398
  • [46] Optimization Based Methods for Partially Observed Chaotic Systems
    Paulin, Daniel
    Jasra, Ajay
    Crisan, Dan
    Beskos, Alexandros
    FOUNDATIONS OF COMPUTATIONAL MATHEMATICS, 2019, 19 (03) : 485 - 559
  • [47] Clustering partially observed graphs via convex optimization
    1600, Microtome Publishing (15):
  • [48] Optimization Based Methods for Partially Observed Chaotic Systems
    Daniel Paulin
    Ajay Jasra
    Dan Crisan
    Alexandros Beskos
    Foundations of Computational Mathematics, 2019, 19 : 485 - 559
  • [49] Clustering Partially Observed Graphs via Convex Optimization
    Chen, Yudong
    Jalali, Ali
    Sanghavi, Sujay
    Xu, Huan
    JOURNAL OF MACHINE LEARNING RESEARCH, 2014, 15 : 2213 - 2238
  • [50] Pointwise Second-Order Necessary Conditions for Stochastic Optimal Control with Jump Diffusions
    Abdelhak Ghoul
    Mokhtar Hafayed
    Imad Eddine Lakhdari
    Shahlar Meherrem
    Communications in Mathematics and Statistics, 2023, 11 : 741 - 766