×

OPTCON: An algorithm for the optimal control of nonlinear stochastic models. (English) Zbl 0782.93095

The authors describe a new algorithm for the optimal control of nonlinear dynamic control that allows for additive uncertainty as well as for the presence of a stochastic parameter vector in the system equations. The first step consists in approximating the time-invariant nonlinear system by a time-varying linear system. Then the key idea is to use Bellman’s principle of optimality to solve the problem. These two steps are repeated until convergence is reached or the number of iterations is larger than a prespectified number. Applications to two small econometric models for Austria are displayed.

MSC:

93E20 Optimal stochastic control

Software:

OPTCON
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] M. Aoki,Optimal Control and System Theory in Dynamic Economic Analysis (North-Holland, New York, 1976). · Zbl 0349.90030
[2] G.C. Chow,Analysis and Control of Dynamic Economic Systems (Wiley, New York, 1975). · Zbl 0314.90001
[3] G.C. Chow,Econometric Analysis by Control Methods (Wiley, New York, 1981). · Zbl 0529.90017
[4] P. Coomes, PLEM: A computer program – passive learning stochastic control for reduced-form econometric models, Discussion paper 85-4, Center for Economic Research, University of Texas, Austin (1985).
[5] D.A. Kendrick,Stochastic Control for Economic Models (McGraw-Hill, New York, 1981). · Zbl 0478.93003
[6] D.A. Kendrick,Feedback: A New Framework for Macroeconomic Policy (Kluwer, Dordrecht, 1988).
[7] D.A. Kendrick and P. Coomes, DUAL, A program for quadratic-linear stochastic control problems, Discussion paper 84-15, Center for Economic Research, University of Texas, Austin (1984).
[8] E.C. MacRae, Matrix derivatives with an application to an adaptive linear decision problem, Ann. Statist. 2(1974)337. · Zbl 0285.26013 · doi:10.1214/aos/1176342667
[9] E.C. MacRae, An adaptive learning rule for multiperiod decision problems, Econometrica 43(1975)893. · Zbl 0324.90002 · doi:10.2307/1911332
[10] J. Matulka and R. Neck, Optimal control of nonlinear stochastic macroeconometric models: An algorithm and an economic example, in:Econometric Decision Models: New Methods of Modeling and Applications, ed. J. Gruber (Berlin, 1991) p. 57.
[11] R. Neck, Stochastic control theory and its applications to models of operations research and economics, in:Symulacyjne Modele Przedsiebiorstw, ed. L. Piecuch (Cracow, 1989) p. 137.
[12] R. Neck and J. Matulka, Stochastic optimum control of macroeconometric models using the algorithm OPTCON, Working Paper, Vienna University of Economics and Business Administration, Vienna, Austria (1991). · Zbl 0805.90020
[13] A.L. Norman, First order dual control, Ann. Econ. Social Measurement 5(1976)311. · Zbl 0329.57002
[14] C.S. Tapiero,Applied Stochastic Models and Control in Management (North-Holland, Amsterdam, 1988). · Zbl 1116.90300
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.