1. Evaluation of the IDEA Public Schools Education Innovation and Research Grant [U411C190117]: Impact of IDEA Public Schools' Advanced Placement Computer Science Principles Curriculum Study
- Author
-
American Institutes for Research (AIR), Elizabeth Kurban, Dana Shaat, Mariesa Hawkins, and Yinmei Wan
- Abstract
Purpose: The purpose of the study was to evaluate the implementation and impact of a computer science-integrated math curriculum, the Beauty and Joy of Computing (BJC), combined with curriculum and professional development support for Computer Science Principles (CSP) teachers, funded by an Innovation and Research (EIR) grant. Methods: The study used a randomized controlled trial design where schools from the IDEA public schools were randomly assigned to use the BJC curriculum (treatment) or, the business as usual, Code.org (comparison). The study compared AP CSP test scores and student attitudes towards CSP between students in the treatment and comparison group. Results: The study found that the average AP CSP scores were low in both the treatment and comparison groups. About one-quarter of test takers (25%) earned a passing score of 3 or higher (compared to national average of 64%). The results of the analyses show that there were no statistically significant differences between the BJC and comparison groups. The study also showed that students in the treatment group responded more favorably on all student engagement in CSP constructs than comparison students, the size of the differences between the treatment and comparison condition were small and none were statistically significant. Implications: Since the evaluation examined student outcomes in the same year that the new curriculum was implemented for this first time, finding significant impacts on student outcomes may require more time. Nevertheless, the results of this evaluation inform IDEA staff, practitioners, and other researchers on the intervention's effectiveness, and they provide insights on how to improve curriculum use to further improve student outcomes.
- Published
- 2024