Back to Search
Start Over
Equivalence Testing and the Second Generation P-Value
- Source :
- Meta-Psychology. 4
- Publication Year :
- 2020
- Publisher :
- Linnaeus University, 2020.
-
Abstract
- To move beyond the limitations of null-hypothesis tests, statistical approaches have been developed where the observed data are compared against a range of values that are equivalent to the absence of a meaningful effect. Specifying a range of values around zero allows researchers to statistically reject the presence of effects large enough to matter, and prevents practically insignificant effects from being interpreted as a statistically significant difference. We compare the behavior of the recently proposed second generation p-value (Blume, D’Agostino McGowan, Dupont, & Greevy, 2018) with the more established Two One-Sided Tests (TOST) equivalence testing procedure (Schuirmann, 1987). We show that the two approaches yield almost identical results under optimal conditions. Under suboptimal conditions (e.g., when the confidence interval is wider than the equivalence range, or when confidence intervals are asymmetric) the second generation p-value becomes difficult to interpret. The second generation p-value is interpretable in a dichotomous manner (i.e., when the SGPV equals 0 or 1 because the confidence intervals lies completely within or outside of the equivalence range), but this dichotomous interpretation does not require calculations. We conclude that equivalence tests yield more consistent p-values, distinguish between datasets that yield the same second generation p-value, and allow for easier control of Type I and Type II error rates.
- Subjects :
- bepress|Life Sciences|Research Methods in Life Sciences
Statistics
Statistical inference
Range (statistics)
PsyArXiv|Meta-science
General Medicine
p-value
Equivalence (measure theory)
Confidence interval
Interpretation (model theory)
Statistical hypothesis testing
Type I and type II errors
Mathematics
Subjects
Details
- ISSN :
- 20032714
- Volume :
- 4
- Database :
- OpenAIRE
- Journal :
- Meta-Psychology
- Accession number :
- edsair.doi.dedup.....54ea6ce01fc7c03ccb366298a0e2499b
- Full Text :
- https://doi.org/10.15626/mp.2018.933