×

A Monte Carlo estimation of the entropy for Markov chains. (English) Zbl 1115.62011

Summary: We introduce an estimate of the entropy \(\mathbb{E}_{p^t}(\log p^t)\) of the marginal density \(p^{t}\) of a (eventually inhomogeneous) Markov chain at time \(t \geq 1\). This estimate is based on a double Monte Carlo integration over simulated i.i.d. copies of the Markov chain, whose transition density kernel is supposed to be known. The technique is extended to compute the external entropy \(\mathbb{E}_{p_1^t}(\log p^t)\), where the \(p_{1}^{t}s\) are the successive marginal densities of another Markov process at time \(t\). We prove, under mild conditions, weak consistency and asymptotic normality of both estimators. The strong consistency is also obtained under stronger assumptions. These estimators can be used to study by simulation the convergence of \(p^{t}\) to its stationary distribution. Potential applications for this work are presented: (1) a diagnostic by simulation of the stability property of a Markovian dynamical system with respect to various initial conditions; (2) a study of the rate in the central limit theorem for i.i.d. random variables. Simulated examples are provided as illustration.

MSC:

62B10 Statistical aspects of information-theoretic topics
60F05 Central limit and other weak theorems
60J10 Markov chains (discrete-time Markov processes on discrete state spaces)
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] I. A. Ahmad, and P. E. Lin, ”A nonparametric estimation of the entropy for absolutely continuous distributions,” IEEE Transactions on Information Theory vol. 36 pp. 688–692, 1989. · Zbl 0672.62005 · doi:10.1109/18.30996
[2] K. Ball, F. Barthe, and A. Naor, ”Entropy jumps in the presence of a spectral gap,” Duke Mathematical Journal vol. 119 no. 1 pp. 41–63, 2003. · Zbl 1036.94003 · doi:10.1215/S0012-7094-03-11912-2
[3] P. Del Moral, and A. Guionnet, ”Central limit theorem for nonlinear filtering and interacting particle systems,” Annals of Applied Probability vol. 9 no. 2 pp. 275–297, 1999. · Zbl 0938.60022 · doi:10.1214/aoap/1029962742
[4] P. Del Moral, M. Ledoux, and L. Miclo, ”Contraction properties of Markov kernels,” Probability Theory and Related Fields vol. 126 pp. 395–420, 2003. · Zbl 1030.60060 · doi:10.1007/s00440-003-0270-6
[5] P. P. B. Eggermont, and V. N. LaRiccia, ”Best asymptotic normality of the kernel density entropy estimator for smooth densities,” IEEE Transactions on Information Theory vol. 45 no. 4 pp. 1321–1326, 1999. · Zbl 0959.62005 · doi:10.1109/18.761291
[6] D. K. Fuk, and S. V. Nagaev, ”Probability inequalities for sums of independent random variables,” Theory of Probability and its Applications vol. 16 pp. 643–660, 1971; vol. 21 p. 875, 1976. · Zbl 0259.60024
[7] E. L. Lehmann, Nonparametrics: Statistical Methods Based on Rank, Holden-Day Series in Probability and Statistics, McGraw-Hill: New York, 1975.
[8] B. Y. Levit, ”Asymptotically efficient estimation of nonlinear functionals,” Problems of Information Transmission vol. 41 pp. 204–209, 1978. · Zbl 0422.62034
[9] L. Miclo, ”Remarques sur l’hypercontractivité et l’évolution de l’entropie des chaînes de Markov finies, Séminaire de Probabilités XXXI.” In Lecture Notes in Mathematics, pp. 136–168, Springer: Berlin Heidelberg New York, 1997. · Zbl 0882.60065
[10] V. Petrov, Limit Theorems of Probability Theory, Oxford Science: Oxford, UK, 1995. · Zbl 0826.60001
[11] M. Seoh, and M. Hallin, ”When does Edgeworth beat Berry and Esséen? Numerical evaluations of Edgeworth expansions,” Journal of Statistical Planning and Inference vol. 63 no. 1 pp. 19–38, 1997. · Zbl 0948.62008 · doi:10.1016/S0378-3758(96)00198-X
[12] R. J. Serfling, ”Approximation theorems of mathematical statistics,” In Wiley Series in Probability and Mathematical Statistics, Wiley: New York, 1980. · Zbl 0538.62002
[13] A. B. Tsybakov, and E. C. Van Der Meulen, ”Root t consistent estimators of entropy for densities with unbounded support,” Scandinavian Journal of Statistics, vol. 23 pp. 75–83, 1994. · Zbl 0866.62004
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.