×

Necessary and sufficient conditions for near-optimality in stochastic control of FBSDEs. (English) Zbl 1191.93142

Summary: We consider control problems for systems governed by a nonlinear forward backward stochastic differential equation. We establish necessary as well as sufficient conditions for near optimality, satisfied by all near optimal controls. These conditions are described by two adjoint processes, corresponding to the forward and backward components and a nearly maximum condition on the Hamiltonian. The proof of the main result is based on Ekeland’s variational principle and some estimates on the state and the adjoint processes with respect to the control variable. As is well known, optimal controls may fail to exist even in simple cases. This justifies the use of near optimal controls, which exist under minimal assumptions and are sufficient in most practical cases. Moreover, since there are many nearly optimal controls, it is possible to choose suitable ones, that are convenient for implementation.

MSC:

93E20 Optimal stochastic control
49J52 Nonsmooth analysis
49J55 Existence of optimal solutions to problems involving randomness
62H10 Multivariate distribution of statistics
49K45 Optimality conditions for problems involving randomness
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Pardoux, E.; Peng, S., Adapted solution of a backward stochastic differential equation, Systems Control Lett., 14, 1, 55-61 (1990) · Zbl 0692.93064
[2] Pardoux, E., Weak convergence and homogenization of semilinear PDEs, (Clarke, F. H.; Stern, R. J., Nonlinear Analysis, Differential Equations and Control (1999), Kluwer Academic Publishers), 503-549 · Zbl 0959.60049
[3] El Karoui, N.; Peng, S.; Quenez, M. C., Backward stochastic differential equations in finance, Math. Finance, 7, 1-71 (1997) · Zbl 0884.90035
[4] Dokuchaev, N.; Zhou, X. Y., Stochastic controls with terminal contingent conditions, J. Math. Anal. Appl., 238, 143-165 (1999) · Zbl 0937.93053
[5] Peng, S., Backward stochastic differential equation and application to optimal control, Appl. Math. Optim., 27, 125-144 (1993) · Zbl 0769.60054
[6] Xu, W., Stochastic maximum principle for optimal control problem of forward and backward, J. Aust. Math. Soc. Ser. B, 37, 172-1785 (1995)
[7] Peng, S.; Wu, Z., Fully coupled forward backward stochastic differential equations and application to optimal control, SIAM J. Control Optim., 37, 3, 825-843 (1999) · Zbl 0931.60048
[8] Ekeland, I., Non convex minimisation problems, Bull. Amer. Math. Soc., NS, 1, 324-353 (1979)
[9] Yong, J.; Zhou, X. Y., Stochastic Controls, Hamiltonian Systems and HJB Equations (1999), Springer Verlag · Zbl 0943.93002
[10] Elliott, R. J.; Kohlmann, M., The variational principle and stochastic optimal control, Stochastics, 3, 229-241 (1980) · Zbl 0434.49009
[11] Mezerdi, B., Necessary conditions for optimality for a diffusion with non smooth drift, Stochastics, 24, 305-326 (1988) · Zbl 0651.93077
[12] Bahlali, K.; Mezerdi, B.; Ouknine, Y., The maximum principle for optimal control of diffusions with non-smooth coefficients, Stoch. Stoch. Rep., 57, 303-316 (1996) · Zbl 0891.93079
[13] Zhou, X. Y., Stochastic near-optimal controls: Necessary and sufficient conditions for near-optimality, SIAM.J. Control Optim., 36, 3, 929-947 (1998) · Zbl 0914.93073
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.