Search

The purpose of this article is to describe the methods and results used to establish the district capacity assessment's (DCA) content validity, response process validity, construct validity, internal consistency, and test-retest reliability. The DCA measures a district's ability to support school-level implementation of evidence-based practices (EBPs). Assessment results are then used to guide action planning. The DCA is grounded in the understanding that districts must develop knowledge and skills in the use of implementation science methods if they are to support successful use of an innovation. Specifically, three studies were conducted. The first study established the DCA's content validity, that is, the extent to which the DCA represents constructs comprising district-level implementation capacity. The second study established the DCA's internal structure, or the relationships among the items compared to the constructs being measured and how well the items measured the same construct. The third and final study assessed how the results of the DCA varied over time, thus establishing the instrument's test--retest reliability. District Implementation Teams, researchers, or facilitators who use the DCA can be confident that the assessment is founded on research drawing from implementation science practices and methods.

Coaching is a key driver supporting implementation of evidence-based instructional and behavioral practices (EBPs). The purposes of this study were to propose a model of coaching and examine the effects of two coaching mechanisms (prompting and performance feedback) on (a) teacher use of classroom management EBPs and (b) student classroom disruption. Using two counterbalanced, concurrent multiple-baseline designs across seven teachers, modest functional relations were found between highly efficient delivery of coaching using prompting alone and performance feedback alone on (a) an increase in teacher use of EBPs and (b) a decrease in classroom disruption. No consistent differences were observed in the order with which prompting versus performance feedback were introduced, nor were consistent benefits observed when adding combined versus individual use of prompting or performance feedback. Findings and implications for coaching research and practice are discussed.

We propose in this article that a central element in the large-scale implementation of evidence-based practices is the process by which initial investment in local demonstrations is leveraged into larger implementation efforts. We offer a definition of this "resource leveraging" and propose a process for both measuring and reporting the effects of leveraging. We suggest that resource leveraging become a valid focus of future research and that the intentional measurement, planning, and management of resource leveraging be used to improve the scaling-up of effective practices.

We report here the type of problems and solutions that 38 school teams reported during a randomized wait-list controlled trial of one problem-solving approach (Team Initiated Problem Solving [TIPS]). The experimental results from that analysis are reported elsewhere. The purpose of this article is to summarize companion descriptive data from this analysis and suggest implications for school personnel and education researchers. Data for this analysis come from direct observation of team meetings for 38 elementary school teams in Oregon and North Carolina as they each met on four different occasions over an 18-month period to manage the behavioral supports in their schools. Our focus was on the types of problems the teams identified, the precision with which problems were identified (what behavior, who, where, when, why), the features of solutions that were developed, the extent to which solutions were perceived as being implemented, and the extent to which solutions were perceived as resulting in improved student outcomes. The most common solutions focused on varying forms of changing organizational systems. Teams were not likely to measure if their solution had been implemented or was effective prior to receiving TIPS training.

Data-based problem solving is a hallmark of research-supported practices such as positive behavioral interventions and supports. In this study, we provided members of positive behavioral interventions and supports (PBIS) teams from 38 elementary schools with professional development focused on a research-supported problem-solving model (Team-Initiated Problem Solving). We used direct observations to document procedures, practices, and outcomes before and after participating in the professional development workshop. Within the context of a randomized waitlist controlled trial, team members in the Immediate Group demonstrated greater improvement in (a) problem-solving procedures, (b) decision-making practices, and (c) meeting outcomes than did members of PBIS teams in the Waitlist Group. Our findings extend what is known about team-based problem solving and provide a framework for future research and improved practice related to decision making by school teams.

We argue in this article that there are conditions in which publication of negative results can make a useful contribution. Three small-scale examinations of journal publication criteria for publishing negative results were conducted. We first reviewed 29 journals from education and school/counseling psychology to assess author submission guidelines for reporting negative results. We then reviewed the most recent issue of each of the 29 journals to determine whether articles reporting negative results were being published. Finally, we surveyed the editors of the 29 journals to examine conditions in which they perceived it appropriate to publish articles that did not demonstrate experimental effects. Results of these studies indicate that currently only one of the 29 journals provides formal guidance to authors about submitting papers with negative results. Two articles published in the 29 journals in their last issue of 2016 contained only negative results. And, of the 60% of the editors who responded to our survey, 96% indicated there were conditions in which publication of negative results was appropriate. In conclusion, we propose situations in which studies reporting negative results would make a valuable contribution.

In this 3-year prospective study, we tested the extent to which school-, practice-, and district-level variables predicted sustained implementation for schools in various stages of implementation of school-wide positive behavioral interventions and supports (SWPBIS) Tier 1 (universal) systems. Staff from 860 schools in 14 U.S. states completed a research-validated measure of factors associated with sustained implementation of school interventions during Year 1 of this study. Analyses included multigroup structural equation modeling of school and district implementation fidelity data. Results indicated that adequate implementation fidelity and better Team Use of Data for decision making in Study Year 1 were the strongest predictors of sustained implementation in Year 3. In addition, the number of other schools in the district adopting SWPBIS was a similarly strong predictor. A critical mass of schools implementing was also predictive, especially for schools earlier in implementation. School characteristics were not predictive, except for grade levels served, which was an inconsistent predictor by stage.

The success of function-based interventions depends not just on the quality of procedures but also on the extent to which procedures are implemented as planned. Too often in schools, effort is committed to functional assessment and behavior support plan design, only to be followed by weak implementation. This study used a multiple baseline across participants design to examine whether a functional relation exists between a treatment package consisting of (a) self-monitoring treatment fidelity, (b) collecting data on student behavior, (c) entering fidelity and student behavior data into an online data management application, and (d) reviewing those data weekly using graphs generated by the application. Results indicate improved treatment fidelity and student behavior were associated with the treatment package. Potential contributions are discussed in terms of establishing efficient systems for schools that provide the structure for effective implementation of function-based interventions.

The contextual fit of a behavior support plan refers to the extent that the procedures of the plan are consistent with the knowledge, values, skills, resources, and administrative support of those who are expected to implement the plan. This study used a concurrent multiple baseline design across four participants to assess the presence of a functional relation between introduction of the Contextual Fit Enhancement Protocol, an intervention designed to improve contextual fit, and (a) an increase in fidelity of support plan implementation and (b) improved student behavior. Results indicate that following implementation of the Contextual Fit Enhancement Protocol, support plan implementation fidelity increased and student problem behavior decreased. In addition, teachers participating in the study rated the contextual fit intervention process as effective and efficient. Limitations and implications for future research, practice, and training are discussed.

The use of restraint and seclusion in schools has been identified repeatedly as an approach that is overused, misused, and potentially dangerous. In this article, we emphasize the importance of an approach to supporting students with significant problem behavior that focuses on prevention, evidence-based intervention procedures, heightened levels of monitoring, and documented professional development. While the need for the use of restraint in emergency conditions will remain, the overall rate at which restraint and seclusion are used needs to be reduced and the quality of support for students with significant problem behavior needs to improve. An example of one district that is adopting a comprehensive alternative approach is provided.

Full and durable implementation of school-based interventions is supported by regular evaluation of fidelity of implementation. Multiple assessments have been developed to evaluate the extent to which schools are applying the core features of school-wide positive behavioral interventions and supports (SWPBIS). The "SWPBIS Tiered Fidelity Inventory" (TFI) was developed to be used as an initial assessment to determine the extent to which a school is using (or needs) SWPBIS, a measure of SWPBIS fidelity of implementation at all three tiers of support, and a tool to guide action planning for further implementation efforts. In this research, we evaluated the psychometric properties of the TFI in three studies: a content validity study, a usability and reliability study, and a large-scale validation study. Results showed strong construct validity for assessing fidelity at all three tiers, strong interrater and 2-week test-retest reliability, high usability for action planning, and strong relations with existing SWPBIS fidelity measures. Implications for accurate evaluation planning are discussed.

The policy decisions of state, district and school educators affect the extent to which students have access to high-quality practices. This is especially relevant for students with disabilities and their families. This article summarizes a presentation made at the 2019 AAIDD conference and proposes an operational role for policy makers. Two frequently cited advances in education are (a) the commitment to adopt "evidence-based practices," and (b) the impact of information technology and data systems on the active "use of data for decision making" in schools. This article reviews the integrative role that policy decisions make in transforming effective practices and good data systems into practical outcomes for children and families.

Positive behavior interventions and supports (PBIS) was first introduced with the reauthorization of the Individuals with Disabilities Education Act in 1997. In this article, we describe the 25-year history of the PBIS implementation experience, including the core features of PBIS as a multitiered framework and the process and outcomes for implementing PBIS across over 26,000 schools. We also summarize the national outcome data of PBIS implementation and conclude with a discussion of future directions and considerations, focusing on sustainability and scaling.

Extension of retribution- and incapacitation-based criminal justice policies and practices to schools has exacerbated racial and ethnic disproportionality in school discipline, a serious and unsolved threat to equity in education and social opportunity. Common approaches implemented to reduce discipline disproportionality have not been shown to be widely effective. A more comprehensive, theory-driven understanding of the factors associated with disproportionate discipline is needed to enhance equity. In this article, we propose a conceptual model of how racial and ethnic bias affects school discipline, with direct implications for practical interventions. The model includes a multidimensional view of bias, informed by research from the field of social psychology, with multiple points identified for intervention to reduce disproportionality over time. The authors conclude with a proposed multicomponent intervention that builds on a foundation of school-wide positive behavioral interventions and supports (SWPBIS) and includes specific strategies for reducing the effects of explicit and implicit bias on school discipline decision making.

Check-in/check-out (CICO) is an evidence-based multicomponent intervention widely implemented in elementary and middle schools. The purpose of this study was to evaluate whether an adapted CICO intervention, with CICO components designed to be more developmentally appropriate for adolescents and contextually relevant for high schools, could be implemented with procedural fidelity and improve outcomes for students with and at risk for disabilities. The study included three ninth-grade students (two with Individualized Education Programs) in one U.S. public high school. We used a non-concurrent multiple baseline design conducted over two academic years during the COVID-19 pandemic to experimentally evaluate the effects of CICO-Secondary on student academic engagement. Results demonstrated that students participated with adequate procedural fidelity and that there was a functional relation between implementation of CICO-Secondary and improved student academic engagement. Students and school personnel also perceived CICO-Secondary to be socially valid. Implications for both future research and practice are discussed. [ABSTRACT FROM AUTHOR]

A recently defined interconnected systems framework (ISF) provides explicit guidance on steps to align positive behavioral interventions and supports (PBIS) and expanded school mental health (SMH) within the multitiered system of support (MTSS). As PBIS and SMH strategies align, there are opportunities to expand and improve effective programs and services for students at all tiers of the MTSS. A prominent need is to improve programs and services for students presenting "internalizing" disorders such as those related to trauma, depression, and anxiety. In this article, we discuss relevant issues involved in improving multitiered systems/interventions for students presenting internalizing problems and provide guidance for this work in dimensions of cross-system collaboration (with major emphasis on effective teams), implementing evidence-based practices, and data-based decision making/quality improvement. The article concludes with recommendations for practice, research, and policy to improve MTSS for students presenting internalizing problems.

The central roles of science in the field of remedial and special education are to (a) identify basic laws of nature and (b) apply those laws in the design of practices that achieve socially valued outcomes. The scientific process is designed to allow demonstration of specific (typically positive) outcomes, and to assist in the attribution of those outcomes to controlled variables. Although growing recognition is being given to the importance of replication in this process, equal consideration should be given to the function of publishing studies that document negative (or null) results. In this manuscript, we outline the features of negative results in educational and psychological single-case intervention research. We also discuss the assessment, methodological, and statistical dimensions of negative results that should be considered when reporting negative results. The importance of replication studies (direct, systematic, and clinical) is also discussed within the context of negative-results research.

Soles of the Feet for Students (SOF) has demonstrated effectiveness at increasing academic engagement among general education students. This work intended to replicate and extend previous work by exploring the effectiveness and social validity of SOF among students receiving special education services, who had low levels of academic engagement and high levels of disruptive classroom behavior, in a public school setting. This study utilized a multiple baseline single-subject design. Four students (grades 4-7) were taught SOF over the course of five 20-30-min sessions. Direct observation data of student academically engaged behavior were collected during baseline and post intervention study phases. Students and teachers also completed social validity questionnaires. Following SOF training, all four students demonstrated improved mean levels of academically engaged behavior. Students and teachers also reported that SOF was an acceptable, feasible, and effective intervention. SOF offers a brief and effective manualized intervention to increase student academic engagement, and conversely reduce classroom disruptive behavior, for students receiving special education services.

Thousands of schools throughout the country are now implementing School-Wide Positive Behavior Support (SWPBS) as a way to improve school culture, safety, and climate. Research is needed to assess the effects of implementing SWPBS on (a) teacher stress and (b) teacher efficacy. The present pilot study provides a preliminary study of these variables by analyzing self-report measures conducted by 20 teachers within schools of differing levels of SWPBS implementation. Results indicated a statistically significant relationship between SWPBS implementation and teacher perception of educational efficacy. Results did not indicate a significant relationship, but rather a trend in the anticipated direction, between SWPBS implementation and reduced perception of teacher stress. Limitations of the study are discussed and directions for future research are recommended. (Contains 2 tables and 1 figure.)

We examined the extent to which state departments of education are including (a) goals for student social behavior in their mission statements; (b) criteria for individual student, classroom, and schoolwide behavior support in certification standards for general education teachers, special education teachers, and principals; and (c) state initiatives focused on improving student social behavior. Web-based information from state departments of education from all 50 states and from the District of Columbia were reviewed in the fall of 2004. Results indicated that only 16 states (31%) include a focus on student social behavior in their mission statements. Individual student behavior support practices were identified in the curriculum for general educators in 30 (59%) states and for special educators in 39 (76%) states. Classroom behavior support practices were required for general education teachers in 39 (76%) states and for special educators in 40 (78%) states. Schoolwide behavior support practices were most likely to be required for principal certification, and they were formally identified in 20 (39%) of the states surveyed. Character education was the most common state initiative cited for improving social behavior in schools.

This study examined how the composition of a behavior support team affected use of assessment information in the design of behavior support plans. Specifically, we examined if typical teams designed behavior support plans that differed in (a) technical adequacy and/or (b) contextual fit when (1) teams did not include behavior specialists, (2) teams included behavior specialists, or (3) behavior specialists worked alone. Fifty-eight school personnel on 12 behavior support teams from typical elementary schools and 6 behavior specialists participated in the study. Vignettes describing hypothetical students with functional behavior assessment outcome information were used to develop 36 behavior support plans (12 by teams alone, 12 by specialists alone, and 12 by teams with specialists). Results were assessed by 3 expert behavior analysts for technical adequacy and by all 64 team members for contextual fit. Technical adequacy tended to be rated high if specialists alone or teams including a specialist designed the plan. Contextual fit tended to be rated high when teams alone or teams including a specialist designed the plan. Team members ranked plans developed by the team alone and plans developed by the team with a specialist as preferred for implementation over plans developed by a specialist alone. Implications for the selection of behavior support team membership are discussed.