Advanced Search

Query:

Fill in the form and click »Search«...

Format:

Display: entries per page entries

Zbl 1200.62149
Hall, Peter; Miller, Hugh
Modeling the variability of rankings. (English)
[J] Ann. Stat. 38, No. 5, 2652-2677 (2010). ISSN 0090-5364

Summary: For better or for worse, rankings of institutions, such as universities, schools and hospitals, play an important role today in conveying information about relative performance. They inform policy decisions and budgets, and are often reported in the media. While overall rankings can vary markedly over relatively short time periods, it is not unusual to find that the ranks of a small number of ``highly performing'' institutions remain fixed, even when the data on which the rankings are based are extensively revised, and even when a large number of new institutions are added to the competition. We endeavor to model this phenomenon. In particular, we interpret as a random variable the value of the attribute on which the ranking should ideally be based. More precisely, if $p$ items are to be ranked then the true, but unobserved, attributes are taken to be values of $p$ independent and identically distributed variates. However, each attribute value is observed only with noise, and via a sample of size roughly equal to $n$, say. These noisy approximations to the true attributes are the quantities that are actually ranked. We show that, if the distribution of the true attributes is light-tailed (e.g., normal or exponential) then the number of institutions whose ranking is correct, even after recalculation using new data and even after many new institutions are added, is essentially fixed. Formally, $p$ is taken to be of order $n^C$ for any fixed $C > 0$, and the number of institutions whose ranking is reliable depends very little on $p$. On the other hand, cases where the number of reliable rankings increases significantly when new institutions are added are those for which the distribution of the true attributes is relatively heavy-tailed, for example, with tails that decay like $x - \alpha $ for some $\alpha > 0$. These properties and others are explored analytically, under general conditions. A numerical study links the results to outcomes for real-data problems.

MSC 2000:: *62P99 Appl. of statistics
65C60 Computational problems in statistics
62G99 Nonparametric inference
62G32 Statistics of extreme values; tail inference
62E20 Asymptotic distribution theory in statistics
62P25 Appl. of statistics to social sciences

Keywords: bootstrap; exponential distribution; exponential tails; extreme values; order statistics; Pareto distribution; performance rankings; regularly varying tails

Comment on this Item PDF MathML XML ASCII DVI PS BibTeX Online Ordering Article Journal Journal

	Scientific prize winners of the ICM 2010
	Overhang
	Lie groups, physics and geometry. An introduction for physicists, engineers and chemists.

Advanced Search

Zentralblatt MATH Berlin [Germany]