MODELING AND APPROXIMATIONS FOR STOCHASTIC SYSTEMS WITH STATE-DEPENDENT SINGULAR CONTROLS AND WIDE-BAND NOISE

被引:2
|
作者
Kushner, Harold J. [1 ]
机构
[1] Brown Univ, Providence, RI 02912 USA
关键词
singular stochastic control; wide-band noise driven systems; optimal stochastic control; approximation of stochastic systems; NUMERICAL-METHODS;
D O I
10.1137/120899340
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Singular controls are usually idealizations of controls that are large and occur over a small but nonzero amount of time, or else are limits of a sequence of small impulses occurring close together. When these control terms are multiplied by a function of the state, it is what we call "state-dependence." Because of this state-dependence, there usually are problems in using standard weak convergence arguments to validate the limits and show that the costs for the limit well approximate those for the physical model. Such sequences of controls and solutions are not usually tight in the Skorokhod topology, the usual one used in weak convergence work. We are concerned with such problems when the driving noise is a wide bandwidth process, which greatly complicates the analysis. Owing to the state-dependence, in the limit we can get what we call multiple simultaneous impulses (MSIs), each of which is characterized as the limit of a sequence of state-dependent control actions over a time interval that collapses to zero, and great care is needed to characterize the limit controls and process paths to show that there is an optimal control for the limit model and to determine which is nearly optimal for the prelimit physical models. The treatment uses an adaptation of the versatile time-stretching method to deal with the controls, together with the powerful perturbed test function method, to handle the wide bandwidth noise.
引用
收藏
页码:311 / 338
页数:28
相关论文
共 50 条
  • [1] Modeling and Approximations for Stochastic Systems with State-Dependent Singular Controls and Wide-Band Noise
    Kushner, Harold J.
    [J]. 2012 IEEE 51ST ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2012, : 1451 - 1458
  • [2] NEARLY OPTIMAL STATE FEEDBACK CONTROLS FOR STOCHASTIC-SYSTEMS WITH WIDE-BAND NOISE DISTURBANCES
    KUSHNER, HJ
    RUNGGALDIER, W
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1987, 25 (02) : 298 - 315
  • [3] NEARLY OPTIMAL STATE FEEDBACK CONTROLS FOR STOCHASTIC-SYSTEMS WITH WIDE-BAND NOISE DISTURBANCES
    KUSHNER, HJ
    RUNGGALDIER, W
    [J]. LECTURE NOTES IN CONTROL AND INFORMATION SCIENCES, 1986, 83 : 471 - 482
  • [4] Some remarks on stability of stochastic singular systems with state-dependent noise
    Zhang, Weihai
    Zhao, Yong
    Sheng, Li
    [J]. AUTOMATICA, 2015, 51 : 273 - 277
  • [5] New results on stability of singular stochastic Markov jump systems with state-dependent noise
    Zhao, Yong
    Zhang, Weihai
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2016, 26 (10) : 2169 - 2186
  • [6] NEARLY OPTIMAL CONTROLS FOR SINGULARLY PERTURBED WIDE-BAND NOISE SYSTEMS
    RAMACHANDRAN, KM
    [J]. STOCHASTIC ANALYSIS AND APPLICATIONS, 1995, 13 (03) : 335 - 353
  • [7] ON THE INTERPLAY OF SINGULAR PERTURBATIONS AND WIDE-BAND STOCHASTIC FLUCTUATIONS
    ELANSARY, M
    KHALIL, H
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1986, 24 (01) : 83 - 94
  • [8] Stochastic approximation with state-dependent noise
    Chen, HF
    [J]. SCIENCE IN CHINA SERIES E-TECHNOLOGICAL SCIENCES, 2000, 43 (05): : 531 - 541
  • [9] A Class of Stochastic Hybrid Systems with State-Dependent Switching Noise
    Leth, John
    Rasmussen, Jakob G.
    Schioler, Henrik
    Wisniewski, Rafael
    [J]. 2012 IEEE 51ST ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2012, : 4737 - 4744
  • [10] Stochastic H∞ Filtering for Pantograph Systems with State-dependent Noise
    Huang, Yulin
    Yan, Zhiguo
    Zheng, Hongyun
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND LOGISTICS (ICAL), 2012, : 601 - 605