1. Using a Single Model Trained across Multiple Experiments to Improve the Detection of Treatment Effects
- Author
-
Patikorn, Thanaporn, Selent, Douglas, Heffernan, Neil T., Beck, Joseph E., and Zou, Jian
- Abstract
In this work, we describe a new statistical method to improve the detection of treatment effects in interventions. We call our method TAME (Trained Across Multiple Experiments). TAME takes advantage of multiple experiments with similar designs to create a single model. We use this model to predict the outcome of the dependent variable in unseen experiments. We use the predictive accuracy of the model on the conditions of the experiment to determine if the treatment had a statistically significant effect. We validated the effectiveness of our model using a large-scale simulation study, where we showed that our model can detect treatment effects with 10% more statistical power than an ANOVA in certain settings. We also applied our model to real data collected from the ASSISTments online learning platform and showed that the treatment effects detected by our model were comparable to the effects detected by the ANOVA. [For the full proceedings, see ED596512.]
- Published
- 2017