Language:   Search:   Contact
Zentralblatt MATH has released its new interface!
For an improved author identification, see the new author database of ZBMATH.

Query:
Fill in the form and click »Search«...
Format:
Display: entries per page entries
Zbl 0967.93097
Bensoussan, A.; Menaldi, J.L.
Stochastic hybrid control.
(English)
[J] J. Math. Anal. Appl. 249, No.1, 261-288 (2000). ISSN 0022-247X

The authors consider a complicated version of controlled stochastic systems. The time $t$ is measured continuously. The state of the system is represented by a continuous variable $x$ and a discrete variable $n$. Also, the control has two parts, a continuous type control $v$ that is a measurable stochastic process and a discrete-type (or impulse) control $k$ that is a sequence of random variables. The key point is the set-interface $D$ of which only the boundary is really used. Minimal and maximal set-interfaces are considered. When the state reaches the minimal set, a mandatory impulse (jump or switch) takes place, while if the state belongs to a maximal set, an optional impulse (jump or switch) may be applied, upon decision of the controller. Switching and jumps can be autonomous or totally controlled. A discounted marginal cost of the form $f(x(t),n(t),v(t))\exp(-\int_{0}^{t}c(x(s),n(s),v(s)) ds)$ is introduced and a control problem consists in its minimization. The authors demonstrate that the dynamic programming approach leads to some involved quasi-variational inequality. If the system is non-degenerate then the classic treatment can be used for the solution of the control problem, otherwise, a way is to use the so-called viscosity solutions that are described in the last part of the paper.
[Yu.S.Mishura (Ky{\" i}v)]
MSC 2000:
*93E20 Optimal stochastic control (systems)
93B12 Variable structure systems
49L25 Viscosity solutions

Keywords: stochastic hybrid model; control; jump; switch; discounted cost; dynamic programming; quasi-variational inequalities; viscosity solutions

Highlights
Master Server