×

Nonasymptotic universal smoothing factors, kernel complexity and Yatracos classes. (English) Zbl 0897.62035

Summary: We introduce a method to select a smoothing factor for kernel density estimation such that, for all densities in all dimensions, the \(L_1\) error of the corresponding kernel estimate is not larger than three times the error of the estimate with the optimal smoothing factor plus a constant times \(\sqrt{\log n/n}\), where \(n\) is the sample size, and the constant depends only on the complexity of the kernel used in the estimate.
The result is nonasymptotic, that is, the bound is valid for each \(n\). The estimate uses ideas from the minimum distance estimation work of Y. G. Yatracos [ibid. 13, 768-774 (1985; Zbl 0576.62057)]. As the inequality is uniform with respect to all densities, the estimate is asymptotically minimax optimal (modulo a constant) over many function classes.

MSC:

62G07 Density estimation

Citations:

Zbl 0576.62057
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Akaike, H. (1954). An approximation to the density function. Ann. Inst. Statist. Math. 6 127-132. · Zbl 0058.12302 · doi:10.1007/BF02900741
[2] Devroy e, L. (1982). Bounds for the uniform deviation of empirical measures. J. Multivariate Anal. 12 72-79. · Zbl 0492.60006 · doi:10.1016/0047-259X(82)90083-5
[3] Devroy e, L. (1987). A Course in Density Estimation. Birkhäuser, Boston. · Zbl 0617.62043
[4] Devroy e, L. (1988). Asy mptotic performance bounds for the kernel estimate. Ann. Statist. 16 1162-1179. · Zbl 0671.62041 · doi:10.1214/aos/1176350953
[5] Devroy e, L. (1997). Universal smoothing factor selection in density estimation: theory and practice. Test. · Zbl 0949.62026 · doi:10.1007/BF02564701
[6] Devroy e, L. and Gy örfi, L. (1985). Nonparametric Density Estimation. The L1 View. Wiley, New York. · Zbl 0546.62015
[7] Devroy e, L., Gy örfi, L. and Lugosi, G. (1996). A Probabilistic Theory of Pattern Recognition. Springer, New York. · Zbl 0853.68150
[8] Devroy e, L. and Lugosi, G. (1996). A universally acceptable smoothing factor for kernel density estimation. Ann. Statist. 24 2499-2512. · Zbl 0867.62024 · doi:10.1214/aos/1032181164
[9] Parzen, E. (1962). On the estimation of a probability density function and the mode. Ann. Math. Statist. 33 1065-1076. · Zbl 0116.11302 · doi:10.1214/aoms/1177704472
[10] Rosenblatt, M. (1956). Remarks on some nonparametric estimates of a density function. Ann. Math. Statist. 27 832-837. · Zbl 0073.14602 · doi:10.1214/aoms/1177728190
[11] Vapnik, V. N. and Chervonenkis, A. Ya. (1971). On the uniform convergence of relative frequencies of events to their probabilities. Theory Probab. Appl. 16 264-280. · Zbl 0247.60005 · doi:10.1137/1116025
[12] Yatracos, Y. G. (1985). Rates of convergence of minimum distance estimators and Kolmogorov’s entropy. Ann. Statist. 13 768-774. · Zbl 0576.62057 · doi:10.1214/aos/1176349553
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.