×

Information theoretical properties of Tsallis entropies. (English) Zbl 1111.94008

Summary: A chain rule and a subadditivity for the entropy of type \(\beta\), which is one of the nonadditive entropies, were derived by Daróczy. In this paper, we study the further relations among Tsallis type entropies which are typical nonadditive entropies. The chain rule is generalized by showing it for Tsallis relative entropy and the nonadditive entropy. We show some inequalities related to Tsallis entropies, especially the strong subadditivity for Tsallis type entropies and the subadditivity for the nonadditive entropies. The subadditivity and the strong subadditivity naturally lead to define Tsallis mutual entropy and Tsallis conditional mutual entropy, respectively, and then we show again chain rules for Tsallis mutual entropies. We give properties of entropic distances in terms of Tsallis entropies. Finally we show parametrically extended results based on information theory.

MSC:

94A15 Information theory (general)
82B03 Foundations of equilibrium statistical mechanics
94A17 Measures of information, entropy
PDFBibTeX XMLCite
Full Text: DOI arXiv

References:

[1] DOI: 10.1007/BF01016429 · Zbl 1082.82501
[2] Tsallis C., Nonextensive Statistical Mechanics and Its Applications (2001) · Zbl 0994.82001
[3] DOI: 10.1073/pnas.0503807102 · Zbl 1155.82300
[4] DOI: 10.1063/1.532107 · Zbl 0897.94007
[5] DOI: 10.1016/S0375-9601(00)00337-6 · Zbl 1223.82003
[6] DOI: 10.1109/TIT.2004.831749 · Zbl 1298.94040
[7] DOI: 10.1109/TIT.2005.855606 · Zbl 1298.94038
[8] DOI: 10.1016/S0019-9958(70)80040-7 · Zbl 0205.46901
[9] Havrda J. H., Kybernetika 3 pp 30– (1967)
[10] DOI: 10.1063/1.533119 · Zbl 1057.82501
[11] DOI: 10.1063/1.533119 · Zbl 1057.82501
[12] DOI: 10.1016/S0378-4371(00)00476-3 · Zbl 0971.94505
[13] DOI: 10.1103/PhysRevE.63.046105
[14] DOI: 10.1103/PhysRevE.66.046134
[15] Rényi A., Proceedings of the Fourth Berkeley Symposium on Mathematical and Statistical Probability 1 pp 547– (1961)
[16] Rényi A., Wahrscheinlichkeitsrechnung. Mit einem Anhang über Informationsteorie (1962)
[17] Aczél J., On Measures of Information and Their Characterizations (1975) · Zbl 0345.94022
[18] DOI: 10.1002/0471200611
[19] DOI: 10.1103/PhysRevE.58.1442
[20] DOI: 10.1143/JPSJ.67.3658 · Zbl 0943.82021
[21] DOI: 10.1103/PhysRevLett.83.1711 · Zbl 1042.82502
[22] DOI: 10.1063/1.1805729 · Zbl 1064.82001
[23] DOI: 10.1016/S0019-9958(61)80055-7 · Zbl 0103.35805
[24] Horibe Y., Information Entropy Theory (1989)
[25] DOI: 10.1088/0305-4470/31/40/010 · Zbl 0933.94011
[26] DOI: 10.1088/0305-4470/36/18/319
[27] Hardy G. H., Inequality (1952)
[28] DOI: 10.1002/j.1538-7305.1948.tb00917.x
[29] DOI: 10.1002/j.1538-7305.1948.tb00917.x
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.