Back to Search
Start Over
Post hoc confidence bounds on false positives using reference families
- Source :
- Annals of Statistics, Annals of Statistics, Institute of Mathematical Statistics, 2020, 48 (3), pp.1281-1303. ⟨10.1214/19-AOS1847⟩, Annals of Statistics, Institute of Mathematical Statistics, In press, Annals of Statistics, 2020, 48 (3), pp.1281-1303. ⟨10.1214/19-AOS1847⟩, Ann. Statist. 48, no. 3 (2020), 1281-1303
- Publication Year :
- 2020
- Publisher :
- HAL CCSD, 2020.
-
Abstract
- We follow a post hoc, “user-agnostic” approach to false discovery control in a large-scale multiple testing framework, as introduced by Genovese and Wasserman [J. Amer. Statist. Assoc. 101 (2006) 1408–1417], Goeman and Solari [Statist. Sci. 26 (2011) 584–597]: the statistical guarantee on the number of correct rejections must hold for any set of candidate items, possibly selected by the user after having seen the data. To this end, we introduce a novel point of view based on a family of reference rejection sets and a suitable criterion, namely the joint familywise error rate over that family (JER for short). First, we establish how to derive post hoc bounds from a given JER control and analyze some general properties of this approach. We then develop procedures for controlling the JER in the case where reference regions are $p$-value level sets. These procedures adapt to dependencies and to the unknown quantity of signal (via a step-down principle). We also show interesting connections to confidence envelopes of Meinshausen [Scand. J. Stat. 33 (2006) 227–237]; Genovese and Wasserman [J. Amer. Statist. Assoc. 101 (2006) 1408–1417], the closed testing based approach of Goeman and Solari [Statist. Sci. 26 (2011) 584–597] and to the higher criticism of Donoho and Jin [Ann. Statist. 32 (2004) 962–994]. Our theoretical statements are supported by numerical experiments.
- Subjects :
- Statistics and Probability
Theoretical computer science
Post hoc
01 natural sciences
Set (abstract data type)
010104 statistics & probability
Simes inequality
[MATH.MATH-ST]Mathematics [math]/Statistics [math.ST]
Confidence bounds
False positive paradox
Point (geometry)
0101 mathematics
Control (linguistics)
Mathematics
post hoc inference
multiple testing
SIGNAL (programming language)
dependence
16. Peace & justice
Multiple comparisons problem
family-wise error rate
62H15
higher criticism
Statistics, Probability and Uncertainty
step-down algorithm
[STAT.ME]Statistics [stat]/Methodology [stat.ME]
62G10
Subjects
Details
- Language :
- English
- ISSN :
- 00905364 and 21688966
- Database :
- OpenAIRE
- Journal :
- Annals of Statistics, Annals of Statistics, Institute of Mathematical Statistics, 2020, 48 (3), pp.1281-1303. ⟨10.1214/19-AOS1847⟩, Annals of Statistics, Institute of Mathematical Statistics, In press, Annals of Statistics, 2020, 48 (3), pp.1281-1303. ⟨10.1214/19-AOS1847⟩, Ann. Statist. 48, no. 3 (2020), 1281-1303
- Accession number :
- edsair.doi.dedup.....da48ad57f4962e2d13dc75523eb262bf