×

Mutual information functions versus correlation functions. (English) Zbl 1086.82554

Summary: This paper studies one application of mutual information to symbolic sequences: the mutual information function \(M(d)\). This function is compared with the more frequently used correlation function \(\Gamma(d)\). An exact relation between \(M(d)\) and \(\Gamma(d)\) is derived for binary sequences. For sequences with more than two symbols, no such general relation exists; in particular, \(\Gamma(d)=0\) may or may not lead to \(M(d)=0\). This linear, but not general, independence between symbols separated by a distance is studied for ternary sequences. Also included is the estimation of the finite-size effect on calculating mutual information. Finally, the concept of “symbolic noise” is discussed.

MSC:

82C03 Foundations of time-dependent statistical mechanics
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] C. E. Shannon, The mathematical theory of communication,Bell Syst. Tech. J. 27:379-423 (1948). · Zbl 1154.94303
[2] A. Fraser and H. Swinney, Independent coordinates for strange attractors from mutual information,Phys. Rev. A 33:1134-1140 (1986). · Zbl 1184.37027 · doi:10.1103/PhysRevA.33.1134
[3] A. Fraser, Reconstructing attractors from scalar time series: A comparison of singular system and redundancy criteria,Physics D 34:391-404 (1989). · Zbl 0709.94626 · doi:10.1016/0167-2789(89)90263-7
[4] C. E. Shannon, Prediction and entropy of printed English,Bell Syst. Tech. J. 1951:50-64. · Zbl 1165.94313
[5] B. Hayes, A progress report on the fine art of turning literature into drivel, Computer Recreations,Sci. Am. 249(5):18-28 (1983). · doi:10.1038/scientificamerican1183-18
[6] L. Gatlin,Information Theory and the Living System (Columbia University Press, 1972).
[7] S. Wolfram, ed.,Theory and Application of Cellular Automata (World Scientific, 1986). · Zbl 0609.68043
[8] G. J. Chaitin, Toward a mathematical definition of ?life,? inThe Maximum Entropy Formalism, Levine and Tribus, eds. (MIT Press, 1979).
[9] R. Shaw,The Dripping Faucet as a Model Chaotic System (Aerial Press, 1984). · Zbl 0842.58059
[10] P. Grassberger, Towards a quantitative theory of self-organized complexity,Int. J. Theor. Phys. 25:907-938 (1986). · Zbl 0605.94003 · doi:10.1007/BF00668821
[11] S. Karlin and H. Taylor,A Second Course in Stochastic Processes (Academic Press, 1981); S. Karlin,A First Course in Stochastic Processes (Academic Press, 1968).
[12] J. E. Hopcroft and J. D. Ullman,Introduction to Automata Theory, Languages, and Computation (Addison-Welsey, 1979). · Zbl 0426.68001
[13] W. Li, Power spectra of regular languages and cellular automata,Complex Syst. 1(1):107-130 (1987). · Zbl 0825.68469
[14] H. Herzel, Complexity of symbolic sequences,Syst. Anal. Model. Simul. 5(5):435-444 (1988). · Zbl 0651.92014
[15] M. Gardner, Mathematical Games: White and brown music, fractal curves and 1/f fluctuations,Sci. Am. 238(4):16-32 (1978). · doi:10.1038/scientificamerican0478-16
[16] W. Li, Mutual information functions of natural language texts, Santa Fe Institute preprint, SFI-89-008 (1989).
[17] V. M. Alekseev and M. V. Yacobson, Symbolic dynamics and hyperbolic dynamical systems,Phys. Rep. 75:287-325 (1981). · doi:10.1016/0370-1573(81)90186-1
[18] A. Lindenmayer, Mathematical models for cellular interactions in development I. Filaments with one-sided inputs,J. Theor. Biol. 18:280-299 (1968). · doi:10.1016/0022-5193(68)90079-9
[19] W. Li, Spatial 1/f spectra in open dynamical systems,Europhys. Lett. 10(5):395-400 (1989). · doi:10.1209/0295-5075/10/5/001
[20] W. Li, Expansion-modification systems: Another model for 1/f spectra, preprint (1990).
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.