Search

We investigate two research questions using a recent statewide transition from paper to computer-based testing: first, the extent to which test mode effects found in prior studies can be eliminated in large-scale administration; and second, the degree to which online and paper assessments offer different information about underlying student ability. In contrast to the first test transition in Massachusetts, we find very small mode effects for a more recent transition, which may be attributable to an additional step matching on observable characteristics in the equating process. Second, we investigate the predictive evidence of validity for paper and online tests for predictions of future test scores and grades. We generally find minimal differences for the extent to which scores on paper tests can differentially predict future online versus paper test scores. Finally, online and paper test scores are similarly predictive of future grade point average. We conclude that the online test penalty can vary substantially by test and that extreme care should be taken when administering online tests to some students and paper tests to others.

The purpose of this feasibility study was to examine the potential impact of reading digital interactive e-books, Word Knowledge e-books (WKe-Books), on essential skills that support reading comprehension with third-fifth grade students. Students (N= 425) read two WKe-Books, that taught word learning and comprehension monitoring strategies in the service of learning difficult vocabulary and targeted science concepts about hurricanes. We investigated whether specific comprehension strategies -- 1) word learning and strategies that supported general reading comprehension, 2) summarization, and 3) question generation, show promise of effectiveness in building vocabulary knowledge and comprehension skills in the WKe-Books. Students were assigned to read one of three versions of each of the two WKe-Books, each version implemented one strategy. The books employed a choose-your-adventure format with embedded comprehension questions that provided students with immediate feedback on their responses. Paired samples t-tests were run to examine pre-to-post differences in learning the targeted vocabulary and science concepts taught in both WKe-Books. For both WKe-Books, students demonstrated significant gains in word learning and on the targeted hurricane concepts. Additionally, Hierarchical Linear Modeling (HLM) revealed that no one strategy was more associated with larger gains than the other. Performance on the embedded questions in the books was also associated with greater posttest outcomes for both WKe-Books. These findings suggest that the affordances offered by technology, which are unavailable in paper-based books, can effectively support students' development of reading-related skills, including strategy use. Further, this work discusses important considerations for implementation and future development of e-books that can enhance student engagement and improve reading comprehension. [This paper was published at "arXiv" 2024.]

Shifts in the visibility and recognition of LGBTQ+ identity have been accompanied by an evolution in understanding how educational policies, curricula, and environments impact well-being, health, and academic success. Since 2015, landmark decisions by the U.S. Supreme Court recognizing same-sex marriage and expansively defining sex under employment law have been joined by a retrenchment in public opinion as well as federal and state policy. This paradox of both increasing LGBTQ+ visibility and resistance toward LGBTQ+ acceptance has centered LGBTQ+ youth in political debates, with a particular focus on issues related to transgender and nonbinary youth. Historically, the literature on LGBTQ+ students in schools has focused on discrimination and poor social relationships, such as bullying, harassment, and victimization. While situated in a deficit-based framing, students' reports of negative school environments and their connection to poor academic and health outcomes provide the motivation for policymakers, educators, parents, and other educational stakeholders to invest in structural and social reform efforts. The law has played a prominent role in both the expansion and retrenchment of students' civil rights in schools, and this has been true for LGBTQ+ students. LGBTQ+ students have experienced many favorable but fluctuating rulings in many courts, so school officials would be wise to keep apprised of the evolving decisions in their jurisdictions. Educational stakeholders should familiarize themselves with the legal landscape, advocate for inclusive and protective state and local policies, ensure that local district practices protect LGBTQ+ students from discrimination and harassment in schools, leverage LGBTQ+-inclusive community organizations and resources, participate in trainings to improve inclusive school practices, and build LGBTQ+-inclusive facilities, teaching practices, and social supports for youth. [This paper was published.]

Purpose: A prior randomized trial found a school social intervention yielded significantly better outcomes (social and autism features) immediately following intervention compared to typical school programming (services-as-usual [SAU]) for children on the autism spectrum. In that study, children in the SAU condition subsequently completed a summer social intervention. This study tested longer-term maintenance of effects for children who completed both interventions. Methods: A total of 103 children (ages 6-12 years) on the autism spectrum enrolled and 102 completed the initial RCT. Following the summer social intervention, 90 children from the original RCT completed the longer-term follow-up study. In addition to baseline and posttest in the initial RCT, children from both groups were tested at three follow-up points (five total testing points). At the time of first longitudinal follow-up testing, the children were 1.25-4.25 years post-intervention (ages 8-15 years). Results: Longitudinal multilevel model analyses (and follow-up contrasts) revealed significant improvements for both groups post-intervention on measures of emotion recognition, autism features, and social skills, indicating maintenance of post-intervention improvements over the three follow-up testing points. No between-group differences were found for autism features or social skills over time; however, the school social intervention may have yielded somewhat better emotion recognition skills. Exploratory tests found that child IQ, language level, and length of time since completing the intervention did not moderate outcomes. Conclusion: Both social interventions yielded positive and durable longer-term improvements for children on the autism spectrum. [This paper will be published in "Journal of Autism and Development Disorders."]

Conditional process models, including moderated mediation models and mediated moderation models, are widely used in behavioral science research. However, few studies have examined approaches to conduct statistical power analysis for such models and there is also a lack of software packages that provide such power analysis functionalities. In this paper, we introduce new simulation-based methods for power analysis of conditional process models with a focus on moderated mediation models. These simulation-based methods provide intuitive ways for sample-size planning based on regression coefficients in a moderated mediation model as well as selected variance and covariance components. We demonstrate how the methods can be applied to five commonly used moderated mediation models using a simulation study, and we also assess the performance of the methods through the five models. We implement our approaches in the WebPower R package and also in Web apps to ease their application. [This is the online version of an article published in "Behavior Research Methods."]