Search

When translating large-scale policy changes into educational practice, classroom-level implementation is crucial and dependent on teachers' capabilities. Most research underscores the importance of professional development (PD) as a proximal factor to achieve educational change. Connected to the recent Advanced Placement (AP) science examination reform, this large-scale quantitative study (N[subscript Teachers] = 9,096; N[subscript Students] = 197,589) investigates teacher participation in different PD formats (i.e., face-to-face, online, materials) and their associations with teacher- and student-level outcomes. We found that teacher characteristics (e.g., gender and administrative support) were associated with the choice of the PD format. We also found AP subscore differences between students of teachers who participated in different PD formats. Furthermore, teachers who participated in formal PD activities tended to report higher challenges with the AP reform. Thus, this study encourages PD providers to implement changes alongside a variety of PD programs to account for the potential differential benefits for teachers.

This mixed-methods observational study analyzes Advanced Placement (AP) Biology teachers' engagement in microblogging for professional learning. Data from three hashtag-based Twitter communities--#apbiochat, #apbioleaderacad, and #apbioleaderacademy (121 users; 2,253 tweets)--are analyzed using educational data mining, qualitative two-cycle content analysis, social network analysis, linear and logistic regression analyses, and hierarchical linear modeling. Results indicate that teachers' use of Twitter reflects aspects of high-quality professional development. Notably, Twitter's nonhierarchical organization affords shared content creation and distribution. Additionally, Twitter allows for different temporal participation patterns and supports the personalization of learning experiences aligned to teachers' needs and preferences. Furthermore, teachers frame their interactions on Twitter positively--thus, creating a supportive environment for professional learning that might reduce perceived professional isolation. Based on this analysis, policymakers and school leaders should feel comfortable encouraging teachers to use microblogging as part of their professional learning activities.

From 2012-2015, Advanced Placement (AP) science courses underwent a large-scale curricular reform to include more scientific inquiry and reasoning, reduce emphasis on broad content coverage, and focus on depth of understanding, with corresponding changes in high-stakes AP examinations. In this study, we explored how teachers prepared for and adapted to this reform over a three-year period. Data included four waves of individual interviews with 22 AP Biology and Chemistry teachers across the United States. Data were qualitatively analyzed using emic and etic coding. Four themes were developed from these data: (1) initial perceptions about the reform including uncertainty, anxiety, and excitement, (2) preparation for reform, (3) impact of time, and (4) intersection of affinity toward the reform with time and uncertainty. Although teachers faced a variety of implementation challenges, these did not always influence their professional development (PD) choices. Rather, choices were more often driven by the price and proximity of those activities, resulting in a jumbled mélange rather than a coherent, extended series of learning experiences. Despite a variety of attitudes, beliefs and instructional skills, teacher beliefs about the purpose and value of the reform--over and above their learning experiences--influenced the time needed to transition and to become comfortable with the redesigned course. This study has implications for how teachers may respond to large-scale, top-down, curriculum reforms (e.g., NGSS, Common Core) and how education leaders, policy makers, and PD providers might support teachers in their efforts to adapt efficiently and effectively.

This empirical study analyzed data from 638 teachers and 11,800 students in low-socioeconomic status (SES) urban schools (and schools with urban characteristics) exploring associations of school, teacher, teaching, and professional development characteristics toward student performance on the revised Advanced Placement (AP) Biology and AP Chemistry examinations. The analyses indicated that districts per-student funding allocations, the days of instruction, teachers' knowledge and experience, and some aspects of teachers' professional development participation were significantly associated with student performance on AP science examinations that was better than predicted by students' Preliminary Scholastic Aptitude Test (PSAT) scores.

Background: Many students enter into postsecondary education without the preparation to face the demands of postsecondary coursework in science. Increasingly, policymakers and educational researchers are responding to calls for reforming secondary education to provide more opportunity for all students to receive high-quality education and to become career and college ready. Purpose: This study attempts to identify levers to increase student learning in secondary education. In particular, it examines relationships between school, teaching, teacher, and teacher professional development characteristics and student scores on high-stakes Advanced Placement (AP) examinations in the sciences. Setting: This study is situated in the context of the large-scale, top-down, nationwide AP curriculum and examination reform in the sciences (biology, chemistry, physics) in the United States. This is an unprecedented opportunity to analyze changing educational landscapes in the United States with large-scale national student-, teacher-, school-, and district-level datasets across multiple science disciplines and different stages of the curriculum reform implementation connected to a standardized and high-stakes student outcome measure. Population: This study analyzes nationwide data samples of the AP Biology, AP Chemistry, and AP Physics population during the first, second, and third year of the curriculum reform implementation. Across disciplines and years, the analytical samples include a total of 113,603 students and 6,046 teachers. Research design: This empirical quantitative study uses data from web-based surveys sent to all AP science teachers. Additionally, the College Board provided student- and school-level data for all students taking AP examinations. Data preparation methods included exploratory and confirmatory factor analysis. Associations with student achievement were analyzed through a multilevel ordered logistic regression analysis, separately by science discipline and year of the curriculum reform implementation. Afterwards, results were aggregated through a meta-analysis. Findings: Even after controlling for student background variables, roughly 60% of the AP score variance could be explained at the teacher and school levels. In particular, teachers' perceived administrative support, self-efficacy, teaching experience, and elements of classroom instruction were related to student performance. Notably, teachers' professional development participation--which has been a major focus of interventions--has a small, mixed impact on student achievement. Conclusion: The identified levers for improving student achievement provide a strong rationale for the continued efforts of policymakers to improve school environments and to support science teachers, with the ultimate goal of improving student learning to help all students to be prepared for college and ready for their future careers.

This quantitative study describes how teachers responded to the large-scale, top-down, mandated curriculum and examination reform of the Advanced Placement (AP) program in chemistry. This study analyzed data from a nationwide sample of teachers (N = 1,062) teaching redesigned AP Chemistry courses in the first two years of the curriculum reform. Repeated measures analysis of covariance (RM-ANCOVA) indicated that teachers' perceived challenges about the AP redesign substantially decreased once they gained more experience teaching redesigned AP Chemistry courses. Teachers reported that inquiry laboratory investigations and changes in the AP examinations were the most challenging aspect of the curriculum reform, whereas the use of new textbooks and chemistry content was perceived as the least challenging. With respect to classroom practices, teachers more frequently enacted instructional elements directly related to the AP examination instead of incorporating references to core elements of the curriculum reform in their instruction. Similarly, though teachers reported frequently conducting laboratory investigations in their classrooms, only about 25% of the laboratory investigations included elements of student-generated inquiry, an important component of the redesigned AP Chemistry program. Surprisingly, teachers' self-reported classroom instruction remained similar in both the first year and the second year of the AP redesign. In general, this study suggests that school leaders and administrators should not be discouraged when teachers experience challenges during early phases of curriculum reforms. Adaptation to reform takes time. However, teachers may need special encouragement to adopt more in-depth aspects of curriculum reforms.

Over the past decade, the field of teacher professional learning has coalesced around core characteristics of high quality professional development experiences (e.g. Borko, Jacobs, & Koellner, 2010. Contemporary approaches to teacher professional development. In P. L. Peterson, E. Baker, & B. McGaw (Eds.), "International encyclopedia of education" (Vol. 7, pp. 548-556). Oxford: Elsevier.; Darling-Hammond, Hyler, & Gardner, 2017. "Effective teacher professional development." Palo Alto, CA: Learning Policy Institute). Many countries have found these advances of great interest because of a desire to build teacher capacity in science education and across the full curriculum. This paper continues this progress by examining the role and impact of an online professional development community within the top-down, large-scale curriculum and assessment revision of Advanced Placement (AP) Biology, Chemistry, and Physics. This paper is part of a five-year, longitudinal, U.S. National Science Foundation-funded project to study the relative effectiveness of various types of professional development in enabling teachers to adapt to the revised AP course goals and exams. Of the many forms of professional development our research has examined, preliminary analyses indicated that participation in the College Board's online AP Teacher Community (APTC)--where teachers can discuss teaching strategies, share resources, and connect with each other--had positive, direct, and statistically significant association with teacher self-reported shifts in practice and with gains in student AP scores (Fishman et al., 2014). This study explored how usage of the online APTC might be useful to teachers and examined a more robust estimate of these effects. Findings from the experience of AP teachers may be valuable in supporting other large-scale curriculum changes, such as the U.S. Next Generation Science Standards or Common Core Standards, as well as parallel curricular shifts in other countries.

This study explores how the relationship between college students' learning strategies and their grade point average (GPA) differs across two culturally different institutions. Surveys of 621 students at a South Korean university and 824 students at a university in the USA were used to assess four types of learning strategies: motivation-related, assignment/task-related, planning/time-related, and cognition-related strategies. The results show that all four types of learning strategies significantly predict students' GPA at the Korean university, whereas only motivation-related and assignment/task-related strategies predict students' GPA at the US university. The cognition-related learning strategy factor is the strongest predictor of GPA for Korean students, but it is unrelated to US students' GPA. The resulting differences in the learning strategies used to obtain high achievement are interpreted through the lens of cultural influence and institutional accountability with respect to the missions of higher education institutions.

This paper describes two studies that explore students' beliefs about critical and creative learning at two universities, and considers the implications of those beliefs in comparison to the universities' stated education goals. One is a mixed method study of students at a top university in Korea, and the second is a comparative study between the Korean university and a United States (US) university. The first study found that both high-achievers and the general population at a top Korean university perceived their critical and creative abilities as lower than their receptive learning abilities, and that higher achievers were neither more critical nor creative than lower achievers. The second study finds that the Korean university students, compared to US students, were more likely to rate their receptive learning ability as higher than their critical and creative learning abilities. Comparisons across year of higher education (HE) suggest that Korean students' perceptions did not significantly change with respect to year in school, while US students' perceptions of critical learning abilities significantly increased across school years. Results are discussed with respect to the impact of culture, epistemological beliefs, and HE instruction on critical and creative learning.

This commentary examines the rationale behind the use of participatory approaches to the design and development of educational interventions, particularly with respect to the inclusion of students in the process. The perspectives and claims put forth in this special issue are examined against an emerging approach to designing more usable educational interventions called design-based implementation research, or DBIR.

This chapter presents an introduction to design-based implementation research (DBIR). We describe the need for DBIR as a research approach that challenges educational researchers and practitioners to transcend traditional research/practice barriers to facilitate the design of educational interventions that are effective, sustainable, and scalable. We examine antecedents to DBIR, including evaluation research, community-based participatory research, design-based research, and implementation research. The four core principles of DBIR are explained: (1) a focus on persistent problems of practice from multiple stakeholders' perspectives; (2) a commitment to iterative, collaborative design; (3) a concern with developing theory and knowledge related to both classroom learning and implementation through systematic inquiry; and (4) a concern with developing capacity for sustaining change in systems. We close with an overview of the chapters contained in this NSSE Yearbook on DBIR and explain how each chapter contributes to the overall development of the DBIR approach.

The associations among second- and third-grade students' content-area knowledge, vocabulary, and reading gains and the science instruction they received were examined in this exploratory longitudinal study. We also asked whether there were child characteristics x instruction interaction effects on students' content-area literacy. Second graders (n = 88) were followed into third grade (n = 73). Classrooms were observed all day in the fall, winter, and spring, and amounts and types of science instruction and language arts instruction were recorded. Results revealed that specific types of science instruction were related to second- and third-grade students' gains in content-area literacy skills and that the relation of science instruction to outcomes depended on students' fall content-area knowledge, vocabulary, and reading skills. These results suggest that science instruction may promote students' developing content-area literacy growth and may be more effective when it is implemented taking individual student differences into account. (Contains 3 figures, 8 tables, and 2 notes.)

This article develops an argument that the type of intervention research most useful for improving science teaching and learning and leading to scalable interventions includes both research to develop and gather evidence of the efficacy of innovations and a different kind of research, "design-based implementation research" (DBIR). DBIR in education focuses on what is required to bring interventions and knowledge about learning to all students, wherever they might engage in science learning. This research focuses on implementation, both in the development and initial testing of interventions and in the scaling up process. In contrast to traditional intervention research that focuses principally on one level of educational systems, DBIR designs and tests interventions that cross levels and settings of learning, with the aim of investigating and improving the effective implementation of interventions. The article concludes by outlining four areas of DBIR that may improve the likelihood that new standards for science education will achieve their intended purpose of establishing an effective, equitable, and coherent system of opportunities for science learning in the United States. (Contains 1 table.)

This study examines factors related to the sustainability of SimCalc Mathworlds (SCMW), a technology-infused mathematics curriculum. We surveyed middle school teachers one year after their participation in a randomized trial where they were introduced to SCMW curriculum, to identify factors related to their continued use of the materials in ways congruent with the developers' intent. Fifty-two percent of teachers surveyed sustained their use of the SCMW curriculum. Factors related to sustained use included student SES, pre-intervention student mathematics ability, teachers' perceived coherence and perceived utility of the intervention, and the active nature of the SCMW professional development. (Contains 4 tables.)

This article describes elements of an approach to research and development called "design-based implementation research." The approach represents an expansion of design research, which typically focuses on classrooms, to include development and testing of innovations that foster alignment and coordination of supports for improving teaching and learning. As in policy research, implementation is a key focus of theoretical development and analysis. What distinguishes this approach from both traditional design research and policy research is the presence of four key elements: (a) a focus on persistent problems of practice from multiple stakeholders' perspectives; (b) a commitment to iterative, collaborative design; (c) a concern with developing theory related to both classroom learning and implementation through systematic inquiry; and (d) a concern with developing capacity for sustaining change in systems.

As people who were involved with drafting the 2010 National Educational Technology Plan (NETP), the authors have taken the opportunity to respond to the very interesting perspectives in this special issue. The thoughts here represent only their views and are not an official statement of either the US Department of Education or the NETP Technical Working Group.

Too many children fail to learn how to read proficiently with serious consequences for their overall well-being and long-term success in school. This may be because providing effective instruction is more complex than many of the current models of reading instruction portray; there are Child Characteristic x Instruction (CXI) interactions. Here we present efficacy results for a randomized control field trial of the Individualizing Student Instruction (ISI) intervention, which relies on dynamic system forecasting intervention models to recommend amounts of reading instruction for each student, taking into account CXI interactions that consider his or her vocabulary and reading skills. The study, conducted in seven schools with 25 teachers and 396 first graders, revealed that students in the ISI intervention classrooms demonstrated significantly greater reading skill gains by spring than did students in control classrooms. Plus, they were more likely to receive differentiated reading instruction based on CXI interaction guided recommended amounts than were students in control classrooms. The precision with which students received the recommended amounts of each type of literacy instruction, the distance from recommendation, also predicted reading outcomes. (Contains 7 figures and 6 tables.)

There is accumulating correlational evidence that the effect of specific types of reading instruction depends on children's initial language and literacy skills, called child characteristics x instruction (CxI) interactions. There is, however, no experimental evidence beyond first grade. This randomized control study examined whether CxI interactions might present an underlying and predictable mechanism for explaining individual differences in how students respond to third-grade classroom literacy instruction. To this end, we designed and tested an instructional intervention (Individualizing Student Instruction [ISI]). Teachers (n = 33) and their students (n = 448) were randomly assigned to the ISI intervention or a vocabulary intervention, which was not individualized. Teachers in both conditions received professional development. Videotaped classroom observations conducted in the fall, winter, and spring documented the instruction that each student in the classroom received. Teachers in the ISI group were more likely to provide differentiated literacy instruction that considered CxI interactions than were the teachers in the vocabulary group. Students in the ISI intervention made greater gains on a standardized assessment of reading comprehension than did students in the vocabulary intervention. Results indicate that CxI interactions likely contribute to students' varying response to literacy instruction with regard to their reading comprehension achievement and that the association between students' profile of language and literacy skills and recommended instruction is nonlinear and dependent on a number of factors. Hence, dynamic and complex theories about classroom instruction and environment impacts on student learning appear to be warranted and should inform more effective literacy instruction in third grade. (Contains 1 note, 9 tables, and 4 figures.)

Implementation of science curriculum materials has been a fundamental challenge in science education for decades. Policy researchers have argued that alignment of standards, curriculum, and assessment are the key to supporting implementation. This paper focuses on teachers' perceptions of curricular alignment and on curriculum implementation using empirical data from a statewide systemic inquiry science reform effort targeting students from kindergarten to eighth grade. We find that the success of alignment policies depends on teachers' construal of the relationship between standards and curriculum materials and on allocation of time for planning at the school level. (Contains 4 tables, 2 figures and 1 footnote.)

Recent findings demonstrate that the most effective reading instruction may vary with children's language and literacy skills. These Child x Instruction interactions imply that individualizing instruction would be a potent strategy for improving students' literacy. A cluster-randomized control field trial, conducted in 10 high-moderate poverty schools, examined effects of individualizing literacy instruction. The instruction each first grader received (n = 461 in 47 classrooms, mean age = 6.7 years) during fall, winter, and spring was recorded. Comparing intervention-recommended amounts of instruction with observed amounts revealed that intervention teachers individualized instruction more precisely than did comparison teachers. Importantly, the more precisely the children received recommended amounts of instruction, the stronger was their literacy skill growth. Results provide strong evidence of Child x Instruction interaction effects on literacy outcomes.

We examined the relations of teacher knowledge (n = 42 first-grade teachers), explicit decoding instruction provided, and students' (n = 437) word-reading gains. Results revealed an interaction between teacher knowledge and observed decoding instruction: For students of more knowledgeable teachers, more time in explicit instruction predicted stronger word-reading gains. For students of less knowledgeable teachers, more time in explicit instruction was associated with weaker skill gains. Findings highlight the importance of teachers' specialized body of knowledge about reading as it informs effective instruction. (Contains 2 figures, 8 tables and 1 footnote.)

In this rejoinder to Willis, Smagorinsky, and Douglas, the authors discuss how many of the points raised by Willis and Smagorinsky regarding their original article, which appeared in the March 2009 issue of Educational Researcher, are concerned less with the methods themselves than with different styles of science. The authors of this rejoinder examine their differing styles of science, using Stanovich's 2003 framework, and call for consilience and the understanding that multiple perspectives and methods are needed to solve the important and perplexing problems that students and teachers will face in the 21st century.

The Individualizing Student Instruction (ISI) classroom observation and coding system is designed to provide a detailed picture of the classroom environment at the level of the individual student. Using a multidimensional conceptualization of the classroom environment, foundational elements (teacher warmth and responsiveness to students, classroom management) and instructional elements (teacher-child interactions, context, and content) are described. The authors have used the ISI system to document that children who share the same classroom have very different learning opportunities, that instruction occurs through interactions among teachers and students, and that the effect of this instruction depends on children's language and literacy skills. This means that what is effective for one child may be ineffective for another with different skills. With improving classroom observation systems, the dynamics of the complex classroom environment as it affects student learning can be better understood. (Contains 6 figures and 2 tables.)

Considerable effort has been made over the past decade to address the needs of learners in large urban districts through scaleable reform initiatives. We examine the effects of a multifaceted scaling reform that focuses on supporting standards based science teaching in urban middle schools. The effort was one component of a systemic reform effort in the Detroit Public Schools, and was centered on highly specified and developed project-based inquiry science units supported by aligned professional development and learning technologies. Two cohorts of 7th and 8th graders that participated in the project units are compared with the remainder of the district population, using results from the high-stakes state standardized test in science. Both the initial and scaled up cohorts show increases in science content understanding and process skills over their peers, and significantly higher pass rates on the statewide test. The relative gains occur up to a year and a half after participation in the curriculum, and show little attenuation with in the second cohort when scaling occurred and the number of teachers involved increased. The effect of participation in units at different grade levels is independent and cumulative, with higher levels of participation associated with similarly higher achievement scores. Examination of results by gender reveals that the curriculum effort succeeds in reducing the gender gap in achievement experienced by urban African-American boys. These findings demonstrate that standards-based, inquiry science curriculum can lead to standardized achievement test gains in historically underserved urban students, when the curriculum is highly specified, developed, and aligned with professional development and administrative support. (Contains 2 tables, 4 figures, and 1 note.)

This study uses a sample of 454 teachers engaged in an inquiry science program to examine the effects of different characteristics of professional development on teachers' knowledge and their ability to implement the program. The authors analyzed results from a survey of teachers served by 28 professional development providers within a hierarchical linear modeling framework. Consistent with findings from earlier studies of effective professional development, this study points to the significance of teachers' perceptions about how coherent their professional development experiences were for teacher learning and program implementation. The authors also found that the incorporation of time for teachers to plan for implementation and provision of technical support were significant for promoting program implementation in the program. (Contains 4 tables.)