Advanced Search

Query:

Fill in the form and click »Search«...

Format:

Display: entries per page entries

Zbl 0967.93097
Bensoussan, A.; Menaldi, J.L.
Stochastic hybrid control. (English)
[J] J. Math. Anal. Appl. 249, No.1, 261-288 (2000). ISSN 0022-247X

The authors consider a complicated version of controlled stochastic systems. The time $t$ is measured continuously. The state of the system is represented by a continuous variable $x$ and a discrete variable $n$. Also, the control has two parts, a continuous type control $v$ that is a measurable stochastic process and a discrete-type (or impulse) control $k$ that is a sequence of random variables. The key point is the set-interface $D$ of which only the boundary is really used. Minimal and maximal set-interfaces are considered. When the state reaches the minimal set, a mandatory impulse (jump or switch) takes place, while if the state belongs to a maximal set, an optional impulse (jump or switch) may be applied, upon decision of the controller. Switching and jumps can be autonomous or totally controlled. A discounted marginal cost of the form $f(x(t),n(t),v(t))\exp(-\int_{0}^{t}c(x(s),n(s),v(s)) ds)$ is introduced and a control problem consists in its minimization. The authors demonstrate that the dynamic programming approach leads to some involved quasi-variational inequality. If the system is non-degenerate then the classic treatment can be used for the solution of the control problem, otherwise, a way is to use the so-called viscosity solutions that are described in the last part of the paper.
[Yu.S.Mishura (Ky{\" i}v)]

MSC 2000:: *93E20 Optimal stochastic control (systems)
93B12 Variable structure systems
49L25 Viscosity solutions

Keywords: stochastic hybrid model; control; jump; switch; discounted cost; dynamic programming; quasi-variational inequalities; viscosity solutions

Comment on this Item PDF MathML XML ASCII DVI PS BibTeX Online Ordering Article Journal

	Scientific prize winners of the ICM 2010
	Overhang
	Lie groups, physics and geometry. An introduction for physicists, engineers and chemists.

Advanced Search

Zentralblatt MATH Berlin [Germany]