×

Excess payoff dynamics and other well-behaved evolutionary dynamics. (English) Zbl 1116.91019

Summary: We consider a model of evolution in games in which agents occasionally receive opportunities to switch strategies, choosing between them using a probabilistic rule. Both the rate at which revision opportunities arrive and the probabilities with which each strategy is chosen are functions of current normalized payoffs. We call the aggregate dynamics induced by this model excess payoff dynamics. We show that every excess payoff dynamic is well-behaved: regardless of the underlying game, each excess payoff dynamic admits unique solution trajectories that vary continuously with the initial state, identifies rest points with Nash equilibria, and respects a basic payoff monotonicity property. We show how excess payoff dynamics can be used to construct well-behaved modifications of imitative dynamics, and relate them to two other well-behaved dynamics based on projections.

MSC:

91A22 Evolutionary games
37N40 Dynamical systems in optimization and economics
91A10 Noncooperative games
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Benaïm, M.; Weibull, J. W., Deterministic approximation of stochastic evolution in games, Econometrica, 71, 873-903 (2003) · Zbl 1152.91350
[2] U. Berger, J. Hofbauer, The Brown-von Neumann-Nash dynamics, Unpublished manuscript, Vienna University of Economics and University of Vienna, 2000.; U. Berger, J. Hofbauer, The Brown-von Neumann-Nash dynamics, Unpublished manuscript, Vienna University of Economics and University of Vienna, 2000. · Zbl 1150.91002
[3] Binmore, K. J.; Samuelson, L., Evolutionary drift and equilibrium selection, Rev. Econ. Stud., 66, 363-393 (1999) · Zbl 0948.91007
[4] Björnerstedt, J.; Weibull, J. W., Nash equilibrium and evolution by imitation, (Arrow, K. J.; etal., The Rational Foundations of Economic Behavior (1996), St. Martin’s Press: St. Martin’s Press New York)
[5] G.W. Brown, J. von Neumann, Solutions of games by differential equations, in: H.W. Kuhn, A.W. Tucker (Eds.), Contributions to the Theory of Games I, Annals of Mathematics Studies, vol. 24, Princeton University Press, Princeton, NJ, 1950.; G.W. Brown, J. von Neumann, Solutions of games by differential equations, in: H.W. Kuhn, A.W. Tucker (Eds.), Contributions to the Theory of Games I, Annals of Mathematics Studies, vol. 24, Princeton University Press, Princeton, NJ, 1950. · Zbl 0041.25502
[6] Dupuis, P.; Nagurney, A., Dynamical systems and variational inequalities, Ann. Oper. Res., 44, 9-42 (1993) · Zbl 0785.93044
[7] J.C. Ely, W.H. Sandholm, Evolution in Bayesian games I: theory, Games Econ. Behav., forthcoming.; J.C. Ely, W.H. Sandholm, Evolution in Bayesian games I: theory, Games Econ. Behav., forthcoming. · Zbl 1127.91004
[8] Friedman, D., Evolutionary games in economics, Econometrica, 59, 637-666 (1991) · Zbl 0745.90012
[9] Friesz, T. L.; Bernstein, D.; Mehta, N. J.; Tobin, R. L.; Ganjalizadeh, S., Day-to-day dynamic network disequilibria and idealized traveler information systems, Operations Res., 42, 1120-1136 (1994) · Zbl 0823.90037
[10] Fudenberg, D.; Levine, D. K., Theory of Learning in Games (1998), MIT Press: MIT Press Cambridge · Zbl 0939.91004
[11] Gilboa, I.; Matsui, A., Social stability and equilibrium, Econometrica, 59, 859-867 (1991) · Zbl 0728.90099
[12] Gul, F.; Pearce, D.; Stacchetti, E., A bound on the proportion of pure strategy equilibria in generic games, Math. Operations Res., 18, 548-552 (1993) · Zbl 0804.90144
[13] Hartman, P.; Stampacchia, G., On some nonlinear elliptic differential functional equations, Acta Math., 115, 271-310 (1966) · Zbl 0142.38102
[14] Hirriart-Urruty, J.-B.; Lemaréchal, C., Convex Analysis and Minimization Algorithms I (1993), Springer: Springer Berlin
[15] J. Hofbauer, Stability for the best response dynamics, Unpublished manuscript, University of Vienna, 1995.; J. Hofbauer, Stability for the best response dynamics, Unpublished manuscript, University of Vienna, 1995.
[16] Hofbauer, J., From Nash and Brown to Maynard Smithequilibria, dynamics, and ESS, Selection, 1, 81-88 (2000)
[17] J. Hofbauer, E. Hopkins, Learning in perturbed asymmetric games, Games Econ. Behav., forthcoming.; J. Hofbauer, E. Hopkins, Learning in perturbed asymmetric games, Games Econ. Behav., forthcoming. · Zbl 1099.91028
[18] Hofbauer, J.; Sandholm, W. H., On the global convergence of stochastic fictitious play, Econometrica, 70, 2265-2294 (2002) · Zbl 1141.91336
[19] J. Hofbauer, W.H. Sandholm, Evolution in games with randomly disturbed payoffs, Unpublished manuscript, University College London and University of Wisconsin, 2004.; J. Hofbauer, W.H. Sandholm, Evolution in games with randomly disturbed payoffs, Unpublished manuscript, University College London and University of Wisconsin, 2004. · Zbl 1142.91343
[20] Hofbauer, J.; Weibull, J. W., Evolutionary selection against dominated strategies, J. Econ. Theory, 71, 558-573 (1996) · Zbl 0877.90098
[21] Hopkins, E., A note on best response dynamics, Games Econ. Behav., 29, 138-150 (1999) · Zbl 1131.91307
[22] R. Lahkar, W.H. Sandholm, The projection dynamic, Unpublished manuscript, University of Wisconsin, 2004.; R. Lahkar, W.H. Sandholm, The projection dynamic, Unpublished manuscript, University of Wisconsin, 2004.
[23] Matsui, A., Best response dynamics and socially stable strategies, J. Econ. Theory, 57, 343-362 (1992) · Zbl 0773.90103
[24] Nachbar, J. H., ‘Evolutionary’ selection dynamics in gamesconvergence and limit properties, Int. J. Game Theory, 19, 59-89 (1990) · Zbl 0699.90109
[25] Nagurney, A.; Zhang, D., Projected Dynamical Systems and Variational Inequalities with Applications (1996), Kluwer Academic Publishers: Kluwer Academic Publishers Boston
[26] Nash, J. F., Non-cooperative games, Ann. Math., 54, 287-295 (1951) · Zbl 0045.08202
[27] Ritzberger, K.; Weibull, J. W., Evolutionary selection in normal form games, Econometrica, 63, 1371-1399 (1995) · Zbl 0841.90127
[28] Samuelson, L.; Zhang, J., Evolutionary stability in asymmetric games, J. Econ. Theory, 5, 363-391 (1992) · Zbl 0770.90096
[29] Sandholm, W. H., Potential games with continuous player sets, J. Econ. Theory, 97, 81-108 (2001) · Zbl 0990.91005
[30] Sandholm, W. H., Evolutionary implementation and congestion pricing, Rev. Econ. Stud., 69, 667-689 (2002) · Zbl 1025.91002
[31] Sandholm, W. H., Evolution and equilibrium under inexact information, Games Econ. Behav., 44, 343-378 (2003) · Zbl 1089.91007
[32] Schlag, K. H., Why imitate, and if so, how? A boundedly rational approach to multiarmed bandits, J. Econ. Theory, 78, 130-156 (1998) · Zbl 0895.90003
[33] Skyrms, B., The Dynamics of Rational Deliberation (1990), Harvard University Press: Harvard University Press Cambridge · Zbl 0797.90002
[34] Smirnov, G. V., Introduction to the Theory of Differential Inclusions (2002), American Mathematical Society: American Mathematical Society Providence, RI · Zbl 0992.34001
[35] Swinkels, J. M., Adjustment dynamics and rational play in games, Games Econ. Behav., 5, 455-484 (1993) · Zbl 0805.90132
[36] Taylor, P. D.; Jonker, L., Evolutionarily stable strategies and game dynamics, Math. Biosci., 40, 145-156 (1978) · Zbl 0395.90118
[37] Weibull, J. W., Evolutionary Game Theory (1995), MIT Press: MIT Press Cambridge · Zbl 0879.90206
[38] Weibull, J. W., The work of John Nash in game theory, J. Econ. Theory, 69, 153-185 (1996) · Zbl 0853.90146
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.