Back to Search Start Over

Equivalence Testing and the Second Generation P-Value

Authors :
Daniel Lakens
Marie Delacre
Source :
Meta-Psychology. 4
Publication Year :
2020
Publisher :
Linnaeus University, 2020.

Abstract

To move beyond the limitations of null-hypothesis tests, statistical approaches have been developed where the observed data are compared against a range of values that are equivalent to the absence of a meaningful effect. Specifying a range of values around zero allows researchers to statistically reject the presence of effects large enough to matter, and prevents practically insignificant effects from being interpreted as a statistically significant difference. We compare the behavior of the recently proposed second generation p-value (Blume, D’Agostino McGowan, Dupont, & Greevy, 2018) with the more established Two One-Sided Tests (TOST) equivalence testing procedure (Schuirmann, 1987). We show that the two approaches yield almost identical results under optimal conditions. Under suboptimal conditions (e.g., when the confidence interval is wider than the equivalence range, or when confidence intervals are asymmetric) the second generation p-value becomes difficult to interpret. The second generation p-value is interpretable in a dichotomous manner (i.e., when the SGPV equals 0 or 1 because the confidence intervals lies completely within or outside of the equivalence range), but this dichotomous interpretation does not require calculations. We conclude that equivalence tests yield more consistent p-values, distinguish between datasets that yield the same second generation p-value, and allow for easier control of Type I and Type II error rates.

Details

ISSN :
20032714
Volume :
4
Database :
OpenAIRE
Journal :
Meta-Psychology
Accession number :
edsair.doi.dedup.....54ea6ce01fc7c03ccb366298a0e2499b
Full Text :
https://doi.org/10.15626/mp.2018.933