Search

Abstract Background Implementation strategies are key to enhancing the translation of new innovations but there is a need to systematically design and tailor strategies to match the targeted implementation context and address determinants. There are increasing methods to inform the development and tailoring of implementation strategies to maximize their usability, feasibility, and appropriateness in new settings such as the Cognitive Walkthrough for Implementation Strategies (CWIS) approach. The aim of the current project is to apply the CWIS approach to inform the redesign of a multifaceted selection-quality implementation toolkit entitled Adoption of Curricular supports Toolkit: Systematic Measurement of Appropriateness and Readiness for Translation in Schools (ACT SMARTS) for use in middle and high schools. Methods We systematically applied CWIS as the second part of a community-partnered iterative redesign of ACT SMARTS for schools to evaluate the usability and inform further toolkit redesign areas. We conducted three CWIS user testing sessions with key end users of school district administrators (n = 3), school principals (n = 6), and educators (n = 6). Results Our CWIS application revealed that end users found ACT SMARTS acceptable and relevant but anticipate usability issues engaging in the ACT SMARTS process. Results informed the identification of eleven usability issues and corresponding redesign solutions to enhance the usability of ACT SMARTS for use in middle and high schools. Conclusions Results indicated the utility of CWIS in assessing implementation strategy usability in service of informing strategy modification as part of our broader redesign to improve alignment with end user, end recipient, and setting needs. Recommendations regarding the use of this participatory approach are discussed.

Background School leaders play an integral role in the use of implementation strategies, which in turn support special education teachers in the implementation of evidence-based practices (EBPs). In this convergent mixed methods study, we explored school leaders’ perceptions of the facilitators and barriers to EBP implementation, particularly for students receiving special education, as well as the importance and feasibility of 15 implementation strategies. Method School leaders ( N = 22, principals, assistant principals, school psychologists, etc.) participated in a semistructured interview that included three parts—qualitative questions, quantitative ratings of strategies’ importance and feasibility, and discussion of the top three implementation strategies. Data strands were analyzed independently and then integrated to generate meta-inferences. Results The qualitative data identified facilitators such as access to resources about the intervention (e.g., professional development) and collaboration and teamwork, while barriers centered on lack of school supports, culture/climate, and organizational factors (e.g., lack of communication). The quantitative data indicated that the implementation strategy provide ongoing consultation/coaching was rated as important and feasible. Monitor the progress of the implementation effort was rated as important but less feasible, while conduct educational meetings and change the environment were rated as feasible, but less important. Build partnerships to support implementation was rated as less important and feasible. There was convergence and divergence in mixed methods findings. Conclusion This study underscores the critical need to increase school leaders’ knowledge and skills related to implementation science to better leverage implementation strategies that address the confluence of relevant implementation determinants.

IntroductionTo illustrate the landscape of community-based care for autistic youth in the United States, we identified transdisciplinary psychosocial intervention practice sets that community providers report utilizing to care for this population, and examined characteristics associated with provider-reported utilization.MethodsThe Usual Care for Autism Study (UCAS) Survey assessed provider demographics and provider-reported use of transdisciplinary practices for common ASD co-occurring problems: social difficulties, externalizing behaviors, and anxiety. Community practitioners (N = 701) from allied health, behavioral, education, medical, mental health and other disciplines who treat or work with autistic youth (7–22 years) participated.ResultsExploratory factor analysis yielded four factors: Consequence-Based Strategies (CBS), Cognitive-Behavioral and Therapy Strategies (CBTS), Antecedent-Based Strategies (ABS), and Teaching Strategies (TS). Providers across disciplines reported utilizing ABS more often than other sets. Providers from behavioral disciplines, with less than 4-year or Master degrees, or with more experience reported the most use of ABS, CBS and CBTS. Medical and behavioral providers reported the most use of TS. Setting and child characteristics were associated with practice set use, indicating variability by disability and client socioeconomic status.DiscussionFindings reflect the complexity and inconsistency of the service landscape for autistic youth across the U.S. Only by understanding the service landscape and predictors of practice utilization, can researchers, policymakers, provider groups, and the autistic community facilitate effective implementation strategy development and use to ultimately improve community-based care.

Abstract Background Implementation strategies are purported to facilitate adoption and use of evidence-based practices (EBPs) across settings. The use of tailored implementation strategies may be particularly effective, as they are selected with the explicit purpose of addressing setting-specific implementation determinants. However, methods to select and tailor implementation strategies, including in community settings, remain understudied. This project will identify and describe implementation strategy mapping methods (ISMMs) from extant peer-reviewed literature and pilot test a method to match implementation strategies with determinants in low-resourced community mental health (CMH) agencies that deliver services to children on the autism spectrum. Methods Aim 1: A scoping review, following PRISMA guidelines, will be conducted to identify implementation strategy mapping methods (ISMMs) utilized in child mental health settings. Data extraction will identify and describe each ISMM, including identifying methodological and procedural steps, analyzing the frequency of ISMM use, and identifying outcomes measured in eligible ISMM studies. Aim 2: Using scoping review findings, select and pilot test one ISMM within five community mental health agencies in Michigan that provide services to autistic children. We will recruit five directors/agency leaders, supervisors, and direct providers at each of the eligible agencies (expected N = 25). A sequential explanatory (QUAN➔ QUAL) mixed methods design will be used. Participants will complete a demographics and client survey, as well as a needs assessment to identify implementation determinants. The impact of the ISMM on organizational readiness for change (from pre- to post-ISMM), as well as implementation outcomes of the ISMM (feasibility, acceptability, appropriateness, usability), will be examined. Semi-structured interviews will elicit stakeholder perspectives on the mapping method. Discussion The current project aims to advance our knowledge of methods for selecting, tailoring, and mapping implementation strategies to address context-specific determinants to implementation. Additionally, this project will contribute to growing science found at the intersection of implementation science and autism research by utilizing the implementation determinants framework, the CFIR, to guide data collection, analysis, and interpretation of findings. Finally, these findings may support future EBP implementation efforts within low-resourced communities, with the ultimate goal of increasing equity in access to EBPs for autistic children.

ObjectiveTo examine patterns and predictors of familiarity with transdisciplinary psychosocial (e.g., non-pharmacologic) practices for practitioners treating youths with autism spectrum disorder (ASD) in the United States.MethodPractitioners (n = 701) from behavioral, education, medical, and mental health backgrounds who worked with youth (ages 7–22) with ASD completed the Usual Care for Autism Survey, which assessed provider demographics and self-reported familiarity with transdisciplinary treatment practices for the most common referral problems of ASD. We examined relations between provider-, setting-, and client-level characteristics with familiarity of key groups of the treatment practices (practice sets). Practice sets were identified using exploratory factor analysis (EFA), and demographic predictors of practice subsets were examined using generalized estimating equations (GEE).ResultsThe EFA yielded a three-factor solution: (1) environmental modifications/antecedent strategies; (2) behavior analytic strategies; and (3) cognitive strategies, with overall familiarity ranked in this order. Medical providers indicated the least familiarity across disciplines. More experience with ASD and treating those with intellectual disabilities predicted greater familiarity with only environmental modifications/antecedent strategies and behavior analytic, but not cognitive strategies. Experience treating low SES clients predicted familiarity with environmental modification and behavior analytic strategies while experience treating high SES clients predicted familiarity with behavior analytic and cognitive strategies.ConclusionThis is the first study to identify transdisciplinary, interpretable sets of practices for treating youth with ASD based on community providers’ reported familiarity. Results highlight factors associated with familiarity with practice sets, which is essential for mapping practice availability, and optimizing training and dissemination efforts for youth with ASD.

Abstract Background Evidence-based practices (EBPs) have been shown to improve behavioral and mental health outcomes for children diagnosed with autism spectrum disorder (ASD). Research suggests that the use of these practices in community-based organizations is varied; however, the utilization of implementation guides may bridge the gap between research and practice. The Autism Community Toolkit: Systems to Measure and Adopt Research-Based Treatments (ACT SMART) Implementation Toolkit is a web-based implementation toolkit developed to guide organization-based implementation teams through EBP identification, adoption, implementation, and sustainment in ASD community-based organizations. Methods This study examined the facilitators and barriers (collectively termed “determinants”) to the utilization of this toolkit, based on the perspectives of implementation teams at six ASD community-based organizations. Two independent coders utilized the adapted EPIS framework and the Technology Acceptance Model 3 to guide qualitative thematic analyses of semi-structured interviews with implementation teams. Results Salient facilitators (e.g., facilitation teams, facilitation meetings, phase-specific activities) and barriers (e.g., website issues, perceived lack of ease of use of the website, perceived lack of resources, inner context factors) were identified, highlighting key determinants to the utilization of this toolkit. Additionally, frequent determinants and determinants that differed across adapted EPIS phases of the toolkit were noted. Finally, analyses highlighted two themes: (a) Inner Context Determinants to use of the toolkit (e.g., funding) and (b) Innovation Determinants (e.g., all website-related factors), indicating an interaction between the two models utilized to guide study analyses. Conclusions Findings highlighted several factors that facilitated the utilization of this implementation guide. Additionally, findings identified key areas for improvement for future iterations of the ACT SMART Implementation Toolkit. Importantly, these results may inform the development, refinement, and utilization of implementation guides with the aim of increasing the uptake of EBPs in community-based organizations providing services to children with ASD and their families. Finally, these findings contribute to the implementation science literature by illustrating the joint use of the EPIS framework and Technology Acceptance Model 3 to evaluate the implementation of a web-based toolkit within community-based organizations.

Background Despite efforts to use standardized taxonomy and research reporting, documenting implementation strategies utilized in community settings remains challenging. This case study demonstrates a practical approach to gather use of and satisfaction with implementation strategies utilized within community-based sites to understand community providers’ perspectives of implementing an early intensive behavioral intervention (EIBI) for children on the autism spectrum across different settings. Methods Using a sequential explanatory mixed-methods design, survey and interview data were collected from directors/supervisors and direct providers ( n = 26) across three sites (one university and two community-based replication sites). The Implementation Strategies and Satisfaction Survey (ISSS) was administered to identify staff-reported implementation strategy use and satisfaction. Informed by quantitative results, follow-up semi-structured interviews were conducted with a subsample ( n = 13) to further understand staff experiences with endorsed implementation strategies and elicit recommendations for future efforts. Results Survey results were used to demonstrate frequencies of implementation strategies endorsed by site and role. Overall, staff felt satisfied with implementation strategies used within their agencies. Content analysis of qualitative data revealed three salient themes related to implementation strategy use—context, communication, and successes and challenges—providing in-depth detail on how strategies were utilized, and strategy effectiveness based on community providers’ experiences. Recommendations were also elicited to improve strategy use within “broader” community settings. Conclusions The project demonstrated a practical approach to identifying and evaluating implementation strategies used within sites delivering autism services. Reporting implementation strategies using the ISSS can provide insight into community providers’ perspectives and satisfaction with agency implementation strategy use that can generate more relevant and responsive strategies to address barriers in community settings. Plain language abstract Examining community providers’ preferences and experiences with implementation strategies used to facilitate evidence-based practice uptake can broaden our understanding of what, how, and why implementation strategies work in community-based settings ( Chaudoir et al., 2013 ; Leeman et al., 2017 ; Proctor et al., 2013 ). Such efforts have great potential to tailor implementation strategies to address barriers/facilitators typically found in community-based settings. This case study demonstrates a practical approach using mixed methodology to: (a) gather self-reported use of and satisfaction with implementation strategies to understand community providers’ perspectives of implementation strategy success. Using a new survey, the Implementation Strategies and Satisfaction Survey (ISSS) conjoined with interviews, the study demonstrated a practical approach using standardized language to report strategies used in one university-based site and two community-based replication sites that deliver an early intensive behavioral intervention (EIBI) for children on the autism spectrum. This paper contributes to one of the five priorities to enhance public health impact—improve tracking and reporting of implementation strategies utilized when translating research into practice ( Dingfelder & Mandell, 2011 ; Powell et al., 2019 ; Stahmer et al., 2019 ). This approach emphasizes the importance of understanding context (e.g., community organizations providing services to children on the autism spectrum) to develop strategies that work better for EIBI implementation and scale-up. Understanding community provider's preferences and experiences with implementation strategies can support use of implementation strategies that better fit usual care contexts, with the ultimate goal of improving implementation practice in community-based settings.

Autism spectrum disorder (ASD) is a highly prevalent neurodevelopmental disorder. ASD community-based organizations (ASD-CBOs) underutilize or inconsistently utilize evidence-based practices (ASD-EBPs) despite numerous available EBPs to treat ASD. Nonetheless, ASD-CBOs implement changes to practices regularly. Understanding ASD-CBO's implementation-as-usual (IAU) processes may assist to develop strategies to facilitate ASD-EBP adoption, implementation and sustainment. A convergent mixed methods (quan + QUAL) design was utilized. Twenty ASD-CBO agency leaders (ALs) and 26 direct providers (DPs), from 21 ASD-CBOs, completed the Autism Model of Implementation Survey Battery, including demographic and agency IAU process questions. Surveys were analyzed through descriptive and content analyses. A subset of 10 ALs provided qualitative interview data that were analyzed using coding, consensus and comparison methods to allow for a more comprehensive understanding of the IAU process within their ASD-CBOs. Quantitative analyses and qualitative coding were merged utilizing a joint display and compared. Results suggest that the IAU process follows some phases identified in the Exploration, Preparation, Implementation, Sustainment (EPIS) framework but were conducted in an informal manner--lacking specificity, structure and consistency across and within ASD-CBOs. Moreover, data suggest adding a specific "adoption decision phase" to the framework. Nonetheless, most ALs felt previous implementation efforts were successful. IAU processes were explored to determine whether the implementation process may be an area for intervention to increase ASD-EBP utilization in ASD-CBOs. Developing a systematized implementation process may facilitate broader utilization of high quality ASD-EBPs within usual care settings, and ultimately improve the quality of life for individuals with ASD and their families.