×

A direct approach to false discovery rates. (English) Zbl 1090.62073

Summary: Multiple-hypothesis testing involves guarding against much more complicated errors than single-hypothesis testing. Whereas we typically control the type I error rate for a single-hypothesis test, a compound error rate is controlled for multiple-hypotheses tests. For example, controlling the false discovery rate FDR traditionally involves intricate sequential \(p\)-value rejection methods based on the observed data. Whereas a sequential \(p\)-value method fixes the error rate and estimates its corresponding rejection region, we propose the opposite approach – we fix the rejection region and then estimate its corresponding error rate. This new approach offers increased applicability, accuracy and power.
We apply the methodology to both the positive false discovery rate pFDR and FDR, and provide evidence for its benefits. It is shown that pFDR is probably the quantity of interest over FDR. Also discussed is the calculation of the q-value, the pFDR analogue of the \(p\)-value, which eliminates the need to set the error rate beforehand as is traditionally done. Some simple numerical examples are presented that show that this new approach can yield an increase of over eight times in power compared with the Y. Benjamini and Y. Hochberg FDR method [ibid. 57, No. 1, 289–300 (1995; Zbl 0809.62014)].

MSC:

62J15 Paired and multiple comparisons; multiple testing
62L99 Sequential statistical methods

Citations:

Zbl 0809.62014
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Benjamini, Controlling the false discovery rate: a practical and powerful approach to multiple testing, J. R. Statist. Soc. 57 pp 289– (1995) · Zbl 0809.62014
[2] â (2000) On the adaptive control of the false discovery rate in multiple testing with independent statistics. J. Educ. Behav. Statist., 25, 60â83.
[3] Benjamini, A step-down multiple-hypothesis procedure that controls the false discovery rate under independence, J. Statist. Planng Inf. 82 pp 163– (1999) · Zbl 1063.62558
[4] Efron, An Introduction to the Bootstrap (1993)
[5] Efron, Empirical Bayes analysis of a microarray experiment, J. Am. Statist. Ass. 96 pp 1151– (2001) · Zbl 1073.62511
[6] Friedman, The role of statistics in the data revolution, Int. Statist. Rev. 69 pp 5– (2001)
[7] Storey (2001)
[8] Storey (2001)
[9] Tusher, Significance analysis of microarrays applied to transcriptional responses to ionizing radiation, Proc. Natn. Acad. Sci. USA 98 pp 5116– (2001) · Zbl 1012.92014
[10] Yekutieli, Resampling-based false discovery rate controlling multiple test procedures for correlated test statistics, J. Statist. Planng Inf. 82 pp 171– (1999) · Zbl 1063.62563
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.