Search

This study aimed to explore the reciprocal relationships between implementation leadership and practitioner implementation citizenship behavior during the implementation of evidence-based practices (EBPs). Data were collected at two timepoints with a time lag of six months during a national implementation of evidence-based treatment for post-traumatic stress disorder in Norwegian mental health clinics. Data from 72 leaders and 346 practitioners were analyzed with a two-wave cross-lagged panel model, accounting for the nested structure and adjusting for demographic variables. Significant positive autoregressive effects for both implementation leadership and implementation citizenship behavior indicated some stability in ratings across time. Significant cross-lagged effects in both directions indicated that practitioners who experienced greater implementation leadership from their leaders demonstrated greater implementation citizenship behavior six months later, and vice versa. Findings hence supported both the social exchange hypothesis and the followership hypothesis, suggesting reciprocal associations between the constructs. The findings underscore the mutually influential relationship between leaders' behavior and practitioners' engagement in citizenship behavior during EBP implementation. The study emphasizes the importance of interventions focusing on leadership behaviors that encourage practitioner engagement and mutually beneficial behavior patterns, highlighting the reciprocal and vital roles that both leaders and practitioners play in successful EBP implementation., (© 2024. The Author(s).)

Introduction: Multi-level and cross-context implementation strategies are needed to support health systems, healthcare delivery organizations, and providers to adopt evidence-based practice (EBP) for substance use disorder (SUD) treatment. However, misalignment between state oversight agencies and healthcare organizations about which services to prioritize and which outcomes are reasonable to expect can hinder implementation success and widespread access to high-quality care. This study investigated the utility of the Leadership and Organizational Change for Implementation-System Level (LOCI-SL) strategy for supporting statewide EBP implementation for SUD treatment., Methods: Nine community mental health centers (CMHCs) contracted by a state agency participated in a combined motivational-enhancement therapy and cognitive behavioral therapy (MET/CBT) implementation effort. Five of the CMHCs also received the LOCI-SL strategy to obtain ongoing implementation support. We conducted 21 individual interviews and three small group interviews with 30 participants across CMHCs and state health agencies to investigate the utility of LOCI-SL in supporting their EBP implementation efforts. Deductive thematic analysis was guided by the Exploration, Preparation, Implementation, Sustainment Framework., Results: Five themes described CMHCs' LOCI-SL and broader contextual experiences implementing EBPs: (1) LOCI-SL supported executives in Preparation phase activities that holistically considered organizational needs and capacity to implement and sustain EBPs; (2) LOCI-SL facilitated trust and communication processes across Preparation, Implementation, and Sustainment phases to improve EBP uptake; (3) LOCI-SL increased CMHCs' use of implementation climate strengthening activities throughout the Implementation phase; (4) state contracts did not emphasize quality and thus were not sufficient bridging factors to enforce EBP fidelity during Implementation; and, (5) limited funding and low Medicaid reimbursement rates hindered EBP use throughout the Implementation and Sustainment phases., Conclusions: LOCI-SL was viewed as a favorable and useful implementation strategy for supporting statewide adoption of EBPs. However, outer context barriers, including limited financial investments in the treatment system, impeded implementation and sustainment efforts. While previous research suggests that contracts are viable alignment-promoting bridging factors, this study demonstrates the importance of articulating implementation outcome expectations to aid state-contracted organizations in achieving EBP implementation success. This study also highlights the need for multi-level implementation strategies to effectively align implementation expectations between outer- and inner-context entities., (Copyright © 2024 The Authors. Published by Elsevier Inc. All rights reserved.)

Background: Financial barriers in substance use disorder service systems have limited the widespread adoption-i.e., provider-level reach-of evidence-based practices (EBPs) for youth substance use disorders. Reach is essential to maximizing the population-level impact of EBPs. One promising, but rarely studied, type of implementation strategy for overcoming barriers to EBP reach is financing strategies, which direct financial resources in various ways to support implementation. We evaluated financing strategies for the Adolescent Community Reinforcement Approach (A-CRA) EBP by comparing two US federal grant mechanisms, organization-focused and state-focused grants, on organization-level A-CRA reach outcomes., Method: A-CRA implementation took place through organization-focused and state-focused grantee cohorts from 2006 to 2021. We used a quasi-experimental, mixed-method design to compare reach between treatment organizations funded by organization-focused versus state-focused grants (164 organizations, 35 states). Using administrative training records, we calculated reach as the per-organization proportion of trained individuals who received certification in A-CRA clinical delivery and/or supervision by the end of grant funding. We tested differences in certification rate by grant type using multivariable linear regression models that controlled for key covariates (e.g., time), and tested threats to internal validity from our quasi-experimental design through a series of sensitivity analyses. We also drew on interviews and surveys collected from the treatment organizations and (when relevant) interviews with state administrators to identify factors that influenced reach., Results: The overall certification rates were 27 percentage points lower in state-focused versus organization-focused grants (p = .01). Sensitivity analyses suggested these findings were not explained by confounding temporal trends nor by organizational or state characteristics. We did not identify significant quantitative moderators of reach outcomes, but qualitative findings suggested certain facilitating factors were more influential for organization-focused grants (e.g., strategic planning) and certain barrier factors were more impactful for state-focused grants (e.g., states finding it difficult to execute grant activities)., Discussion: As the first published comparison of EBP reach outcomes between financing strategies, our findings can help guide state and federal policy related to financing strategies for implementing EBPs that reduce youth substance use. Future work should explore contextual conditions under which different financing strategies can support the widespread implementation of EBPs for substance use disorder treatment., (© 2023. BioMed Central Ltd., part of Springer Nature.)

Organizational implementation climate is an important construct in implementation research to describe to what extent implementation is expected, supported, and rewarded. Efforts in bridging the research-practice gap by implementing evidence-based practice (EBP) can benefit from consideration of implementation climate. The Implementation Climate Scale (ICS) is a psychometrically strong measure assessing employees' perceptions of the implementation climate. The present cross-sectional study aimed at providing a German translation and investigating its psychometric properties. The translation followed standard procedures for adapting psychometric instruments. German psychotherapists (N = 425) recruited online completed the ICS, the Evidence Based Practice Attitudes Scale (EBPAS-36D) and the Intention Scale for Providers (ISP). We conducted standard item and reliability analyses. Factorial validity was assessed by comparing an independent cluster model of Confirmatory Factorial Analysis (ICM-CFA), a Bifactor CFA, a Second-order CFA and an (Bifactor) Exploratory Structural Equation Model (ESEM). Measurement invariance was tested using multiple-group CFA and ESEM, convergent validity with correlation analysis between the ICS and the ISP subjective norms subscale (ISP-D-SN). The mean item difficulty was p i  = .47, mean inter-item correlation r = .34, and mean item-total correlation r itc  = .55. The total scale (ω = 0.91) and the subscales (ω = .79-.92) showed acceptable to high internal consistencies. The model fit indices were comparable and acceptable (Second-order CFA: RMSEA [90% CI] = .077 [.069; .085], SRMR = .078, CFI = .93). Multiple-group CFA and ESEM indicated scalar measurement invariance across gender and presence of a psychotherapy license. Psychotherapists in training reported higher educational support for EBP than licensed psychotherapists (T = 2.09, p = .037, d = 0.25). The expected high correlation between the ICS and the ISP-D-SN was found (r = .59, p < .001). Results for the German ICS confirm good psychometric properties including validity., (© 2023. The Author(s).)

Background: Implementation science aims to accelerate the public health impact of evidence-based interventions. However, implementation science has had too little focus on the role of health policy - and its inseparable politics, polity structures, and policymakers - in the implementation and sustainment of evidence-based healthcare. Policies can serve as determinants, implementation strategies, the evidence-based "thing" to be implemented, or another variable in the causal pathway to healthcare access, quality, and patient outcomes. Research describing the roles of policy in dissemination and implementation (D&I) efforts is needed to resolve persistent knowledge gaps about policymakers' evidence use, how evidence-based policies are implemented and sustained, and methods to de-implement policies that are ineffective or cause harm. Few D&I theories, models, or frameworks (TMF) explicitly guide researchers in conceptualizing where, how, and when policy should be empirically investigated. We conducted and reflected on the results of a scoping review to identify gaps of existing Exploration, Preparation, Implementation, and Sustainment (EPIS) framework-guided policy D&I studies. We argue that rather than creating new TMF, researchers should optimize existing TMF to examine policy's role in D&I. We describe six recommendations to help researchers optimize existing D&I TMF. Recommendations are applied to EPIS, as one example for advancing TMF for policy D&I., Recommendations: (1) Specify dimensions of a policy's function (policy goals, type, contexts, capital exchanged). (2) Specify dimensions of a policy's form (origin, structure, dynamism, outcomes). (3) Identify and define the nonlinear phases of policy D&I across outer and inner contexts. (4) Describe the temporal roles that stakeholders play in policy D&I over time. (5) Consider policy-relevant outer and inner context adaptations. (6) Identify and describe bridging factors necessary for policy D&I success., Conclusion: Researchers should use TMF to meaningfully conceptualize policy's role in D&I efforts to accelerate the public health impact of evidence-based policies or practices and de-implement ineffective and harmful policies. Applying these six recommendations to existing D&I TMF advances existing theoretical knowledge, especially EPIS application, rather than introducing new models. Using these recommendations will sensitize researchers to help them investigate the multifaceted roles policy can play within a causal pathway leading to D&I success., (© 2022. The Author(s).)

Findings from research participants in effectiveness treatment trials (i.e., randomized control trials conducted in community rather than research settings) are considered more generalizable than those from participants in efficacy trials. This is especially true for clinician participants, whose characteristics like attitudes towards evidence-based practices (EBPs) may impact treatment implementation and the generalizability of research findings from effectiveness studies. This study compared background characteristics, attitudes toward EBPs, and attitudes towards measurement-based care (MBC) among clinicians participating in a National Institute of Mental-Health (NIMH) funded effectiveness trial, the Community Study of Outcome Monitoring for Emotional Disorders in Teens (COMET), to clinician data from nationally representative U.S. survey samples. Results indicated COMET clinicians were significantly younger, less clinically experienced, and were more likely to have a training background in psychology versus other disciplines compared to national survey samples. After controlling for demographics and professional characteristics, COMET clinicians held more positive attitudes towards EBPs and MBC compared to national survey samples. Implications for implementation efforts are discussed., (© 2022. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.)

The Leadership and Organizational Change for Implementation (LOCI) strategy is a multifaceted implementation strategy that aims to support successful evidence-based practice (EBP) implementation by fostering effective general leadership, implementation leadership, and implementation climate. How implementation strategies are experienced by participants is important for their utilization and effectiveness in supporting EBP implementation. The current study is the first in-depth qualitative study exploring first-level leaders' experiences of participating in the LOCI strategy. Data were collected as part of a trial where Norwegian child and adult mental health outpatient clinics implemented EBPs for posttraumatic stress disorder (PTSD). Eleven first-level leaders from adult and child clinics participated in semi-structured interviews after completing the LOCI strategy. Data were analyzed through reflexive thematic analysis. The analysis generated four themes related to leaders' experiences of participating in the LOCI strategy: (1) structuring the EBP implementation, (2) taking responsibility for the EBP implementation, (3) interacting with others about the EBP implementation, and (4) becoming aware of EBP implementation and their own leadership. Most participants experienced the LOCI strategy as beneficial for implementing EBPs for PTSD in their clinic. The strategy succeeded in raising awareness of leadership for EBP implementation, and simultaneously provided participants with tools and support for leading the implementation in their clinic. Two participants experienced LOCI as less beneficial than the others. Our results support the strategy's potential to engage and empower first-level leaders to get involved in implementation processes and point to important challenges for future research on implementation strategies., (© 2022. The Author(s).)

Introduction: Mechanisms explain how implementation strategies work. Implementation research requires careful operationalisation and empirical study of the causal pathway(s) by which strategies effect change, and factors that may amplify or weaken their effects. Understanding mechanisms is critically important to replicate findings, learn from negative studies or adapt an implementation strategy developed in one setting to another. Without understanding implementation mechanisms, it is difficult to design strategies to produce expected effects across contexts, which may have disproportionate effects on settings in which priority populations receive care. This manuscript outlines the protocol for an Agency for Healthcare Research and Quality-funded initiative to: (1) establish priorities for an agenda to guide research on implementation mechanisms in health and public health, and (2) disseminate the agenda to research, policy and practice audiences., Methods and Analysis: A network of scientific experts will convene in 'Deep Dive' meetings across 3 years. A research agenda will be generated through analysis and synthesis of information from six sources: (1) systematic reviews, (2) network members' approaches to studying mechanisms, (3) new proposals presented in implementation proposal feedback sessions, (4) working group sessions conducted in a leading implementation research training institute, (5) breakout sessions at the Society for Implementation Research Collaboration's (SIRC) 2019 conference and (6) SIRC conference abstracts. Two members will extract mechanism-relevant text segments from each data source and a third member will generate statements as an input for concept mapping. Concept mapping will generate unique clusters of challenges, and the network will engage in a nominal group process to identify priorities for the research agenda., Ethics and Dissemination: This initiative will yield an actionable research agenda to guide research to identify and test mechanisms of change for implementation strategies. The agenda will be disseminated via multiple channels to solicit feedback and promote rigorous research on implementation mechanisms., Competing Interests: Competing interests: None declared., (© Author(s) (or their employer(s)) 2021. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.)

Background: Bridging factors are relational ties, formal arrangements, and processes that connect outer system and inner organizational contexts. They may be critical drivers of evidence-based practice (EBP) implementation and sustainment. Yet, the complex interplay between outer and inner contexts is often not considered. Bridging factors were recently defined in the updated Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Further identification and specification of this construct will advance implementation models, measures, and methods. Our goal is to advance bridging factor research by identifying relevant dimensions and exemplifying these dimensions through illustrative case studies., Methods: We used a multiple case study design. Each case (n = 10) represented different contexts, EBPs, and bridging factor types. Inclusion criteria were the presence of clearly distinguishable outer and inner contexts, identifiable bridging factor, sufficient information to describe how the bridging factor affected implementation, and variation from other cases. We used an iterative qualitative inquiry process to develop and refine a list of dimensions. Case data were entered into a matrix. Dimensions comprised the rows and case details comprised the columns. After a review of all cases, we collectively considered and independently coded each dimension as function or form., Results: We drew upon the concepts of functions and forms, a distinction originally proposed in the complex health intervention literature. Function dimensions help define the bridging factor and illustrate its purpose as it relates to EBP implementation. Form dimensions describe the specific structures and activities that illustrate why and how the bridging factor has been customized to a local implementation experience. Function dimensions can help researchers and practitioners identify the presence and purpose of bridging factors, whereas form dimensions can help us understand how the bridging factor may be designed or modified to support EBP implementation in a specific context. We propose five function and three form bridging factor dimensions., Conclusions: Bridging factors are described in many implementation models and studies, but without explicit reference or investigation. Bridging factors are an understudied and critical construct that requires further attention to facilitate implementation research and practice. We present specific recommendations for a bridging factors research agenda.

Background: The majority of literature on evidence-based practice (EBP) adaptation focuses on changes to clinical practices without explicitly addressing how organizations must adapt to accommodate a new EBP. This study explores the process of organizational-rather than EBP-adaptation during implementation and sustainment. To the authors' knowledge, there are no previous implementation studies that focus on organizational adaptation in this way., Methods: This analysis utilizes a case study approach to examine longitudinal qualitative data from 17 community-based organizations (CBOs) in one state and seven county-based child welfare systems. The CBOs had sustained a child-neglect intervention EBP (SafeCare®) for 2 to 10 years. The unit of analysis was the organization, and each CBO represented a case. Organizational-level profiles were created to describe the organizational adaptation process., Results: Three organizational-level adaptation profiles were identified as follows: incorporators (n = 7), early investors (n = 6), and learners (n = 4). Incorporators adapted by integrating SafeCare into existing operations to meet contractual or EBP fidelity requirements. Early Investors made substantial organizational adaptations during the early implementation period, then operated relatively consistently as the EBP became embedded in the organization and service system. Learners were characterized by steady and continuous attention to new ways that the organization could adapt to support the EBP., Conclusion: The profiles demonstrated that there can be multiple effective paths to EBP sustainment. Organizational adaptation was calibrated to fit a CBO's operations (e.g., size of the program) and immediate environmental constraints (e.g., funding levels). Additionally, organizations fulfilled different functional roles in the network of entities involved in EBP implementation. Knowing organizational roles and adaptation profiles can guide implementation planning and help to structure contract designs that bridge the outer (system) and inner (organizational) contexts. Adaptation profiles can also inform the intensity of the implementation strategy tailoring process and the way that strategies are marketed to organizations.

Background: Bridging factors are relational ties (e.g. partnerships), formal arrangements (e.g. contracts or polices) and processes (e.g. data sharing agreements) linking outer and inner contexts and are a recent evolution of the Exploration-Preparation-Implementation-Sustainment (EPIS) framework. Bridging factor research can elucidate ways that service systems may influence and/or be influenced by organizations providing health services. This study used the EPIS framework and open systems and resource dependence theoretical approaches to examine contracting arrangements in U.S. public sector systems. Contracting arrangements function as bridging factors through which systems communicate, interact, and exchange resources with the organizations operating within them., Methods: The sample included 17 community-based organizations in eight service systems. Longitudinal data is derived from 113 contract documents and 88 qualitative interviews and focus groups involving system and organizational stakeholders. Analyses consisted of a document review using content analysis and focused coding of transcripts from the interviews and focus groups. A multiple case study analysis was conducted to identify patterns across service systems and organizations. The dataset represented service systems that had sustained the same EBP for between 2 and 10 years, which allowed for observation of bridging factors and outer-inner context interactions over time., Results: Service systems and organizations influenced each other in a number of ways through contracting arrangements. Service systems influenced organizations when contracting arrangements resulted in changes to organizational functioning, required organizational responses to insufficient funding, and altered interorganizational network relationships. Organizations influenced service systems when contract arrangements prompted organization-driven contract negotiation/tailoring, changes to system-level processes, and interorganizational collaboration. Service systems and organizations were dependent on each other as implementation progressed. Resources beyond funding emerged, including adequate numbers of eligible clients, expertise in the evidence-based practice, and training and coaching capacity., Conclusion: This study advances implementation science by expanding the range and definition of bridging factors and illustrating specific bi-directional influences between outer context service systems and inner context organizations. This study also identifies bi-directional dependencies over the course of implementation and sustainment. An analysis of influence, dependencies, and resources exchanged through bridging factors has direct implications for selecting and tailoring implementation strategies, especially those that require system-level coordination and change.

Background: Top managers' transformational leadership is associated with significant influence on subordinates. Yet little is known about the extent to which top managers' transformational leadership influences middle managers' implementation leadership and, ultimately, frontline staff delivery of evidence-based health care practices., Purpose: To test a multilevel leadership model examining the extent to which top managers' transformational leadership, as mediated by implementation leadership of middle managers (i.e., those who supervise direct clinical services), affects staff attitudes toward evidence-based practices (EBPs) and their implementation., Methodology/approach: We used data collected in 2013 from 427 employees in 112 addiction health services programs in Los Angeles County, California. We relied on hierarchical linear models with robust standard errors to analyze multilevel data, individuals nested in programs. We conducted two path models to estimate multilevel relationships with two EBPs: contingency management and medication-assisted treatment., Results: Findings partially supported our theory-driven multilevel leadership model. Specifically, results demonstrated that middle managers' implementation leadership mediated the relationship between top managers' transformational leadership and attitudes toward EBPs. At the same time, they showed the mediated relationship for delivery of contingency management treatment was only marginally significant (standardized indirect effect = .006, bootstrap p = .091). We did not find a mediation effect for medication-assisted treatment., Discussion: Findings advance leadership theory in health care, highlighting the importance of middle managers' implementation leadership in transmitting the influence of top managers' transformational leadership on staff attitudes toward EBPs. The full path model shows the extent to which transformational leadership may influence staff implementation of innovative practices as mediated through staff attitudes toward EBPs and middle managers' implementation leadership., Practice Implications: Our findings have implications for developing a multilevel leadership approach to implementation in health care. Leadership development should build on different competencies based on managers' level but align managers' priorities on the same implementation goals.

The organizational context in which substance use disorder treatment (SUDT) evidence-based practices (EBPs) are implemented plays a critical role in successful implementation. Employee behaviors that go above and beyond typical job requirements to support EBP implementation have been suggested to facilitate the likelihood of overall implementation success. The current study explored the psychometric properties of the Implementation Citizenship Behavior Scale (ICBS) within SUDT settings. Utilizing a sample of 322 direct service providers and 60 of their respective supervisors from three SUDT agencies, results from a confirmatory factor analysis and construct validity analysis support the use of the ICBS in the SUDT context. Validation of the ICBS provides a useful, pragmatic tool for both researchers and practitioners to assess employee citizenship behavior to support EBP implementation. The ICBS can provide critical insights into how providers respond to organizational context that may facilitate EBP implementation., Competing Interests: Declaration of competing interest None., (Copyright © 2020 Elsevier Inc. All rights reserved.)

Background: Frontline nurse managers influence the implementation of evidence-based practices (EBP); however, there is a need for valid and reliable instruments to measure their leadership behaviors for EBP implementation in acute care settings., Aim: The aim of this study was to evaluate the validity and reliability of the Implementation Leadership Scale (ILS) in acute care settings using two unique nurse samples., Methods: This study is a secondary analysis of ILS data obtained through two distinct multisite cross-sectional studies. Sample 1 included 200 registered nurses from one large Californian health system. Sample 2 was 284 registered nurses from seven Midwest and Northeast U.S. hospitals. Two separate studies by different research teams collected responses using written and electronic questionnaires. We analyzed each sample independently. Descriptive statistics described individual item, total, and subscale scores. We analyzed validity using confirmatory factor analysis and within-unit agreement (awg). We evaluated factorial invariance using multigroup confirmatory factor analyses and evaluating change in chi-square and comparative fit index values. We evaluated reliability using Cronbach's alpha., Results: Confirmatory factor analyses in both samples provided strong support for first- and second-order factor structure of the ILS. The factor structure did not differ between the two samples. Across both samples, internal consistency reliability was strong (Cronbach's alpha: 0.91-0.98), as was within-unit agreement (awg: 0.70-0.80)., Linking Evidence to Action: Frontline manager implementation leadership is a critical contextual factor influencing EBP implementation. This study provides strong evidence supporting the validity and reliability of the ILS to measure implementation leadership behaviors of nursing frontline managers in acute care. The ILS can help clinicians, researchers, and leaders in nursing contexts assess frontline manager implementation leadership, deliver interventions to target areas needing improvement, and improve implementation of EBP., (© 2019 Sigma Theta Tau International.)

Background: There has long been debate about the balance between fidelity to evidence-based interventions (EBIs) and the need for adaptation for specific contexts or particular patients. The debate is relevant to virtually all clinical areas. This paper synthesises arguments from both fidelity and adaptation perspectives to provide a comprehensive understanding of the challenges involved, and proposes a theoretical and practical approach for how fidelity and adaptation can optimally be managed., Discussion: There are convincing arguments in support of both fidelity and adaptations, representing the perspectives of intervention developers and internal validity on the one hand and users and external validity on the other. Instead of characterizing fidelity and adaptation as mutually exclusive, we propose that they may better be conceptualized as complimentary, representing two synergistic perspectives that can increase the relevance of research, and provide a practical way to approach the goal of optimizing patient outcomes. The theoretical approach proposed, the "Value Equation," provides a method for reconciling the fidelity and adaptation debate by putting it in relation to the value (V) that is produced. The equation involves three terms: intervention (IN), context (C), and implementation strategies (IS). Fidelity and adaptation determine how these terms are balanced and, in turn, the end product - the value it produces for patients, providers, organizations, and systems. The Value Equation summarizes three central propositions: 1) The end product of implementation efforts should emphasize overall value rather than only the intervention effects, 2) implementation strategies can be construed as a method to create fit between EBIs and context, and 3) transparency is vital; not only for the intervention but for all of the four terms of the equation. There are merits to arguments for both fidelity and adaptation. We propose a theoretical approach, a Value Equation, to reconciling the fidelity and adaptation debate. Although there are complexities in the equation and the propositions, we suggest that the Value Equation be used in developing and testing hypotheses that can help implementation science move toward a more granular understanding of the roles of fidelity and adaptation in the implementation process, and ultimately sustainability of practices that provide value to stakeholders.

Implementation of evidence-based practice (EBP) for autism spectrum disorder (ASD) in the education system is a public health priority. Leadership is a critical driver of EBP implementation but little is known about the types of leadership behaviors exhibited by school leaders and how this influences the context of EBP implementation, particularly for students with ASD. The objectives of this study were to determine (1) the leadership profiles of principals involved in EBP implementation for students with ASD and (2) how these leadership profiles related to school characteristics and implementation climate. The Exploration, Preparation, Implementation, Sustainment (EPIS) framework was used to guide the design and analysis of this study. Participants (n = 296) included principals, teachers, and classroom support staff. They provided demographic information and completed the Multifactor Leadership Questionnaire and Implementation Climate Scale. Using latent profile analysis, a three-pattern solution was identified: Disengaged (6% of sample), Undifferentiated (23% of sample), and Optimal (71% of sample). Principals in schools with higher proportions of students with an individualized education program were more likely to be classified as Undifferentiated than Optimal . The Optimal group was associated with more positive implementation climate than the Undifferentiated or Disengaged groups. Findings suggest that leadership behaviors rated by principals and their staff involved in implementation of common autism EBPs can be meaningfully clustered into three discernible profiles that are shaped by organizational context and linked to strategic implementation climate. Our study findings have implications for leadership training and service delivery in schools by underscoring the critical nature of school leadership during implementation of EBPs for children with autism and the interplay between specific leadership behaviors and strategic implementation climate.

Introduction: The patient-centred medical home (PCMH) is an important part of health care reform. While there is hope, the PCMH model can facilitate the provision of higher quality care, the extent to which organizational climate within the PCMH supports the implementation of evidence-based practices (EBPs) is unknown. Identifying and addressing factors that facilitate implementation and use of EBPs within the PCMH are crucial for improving the health and health care of the United States., Methods: This study used mixed methods to assess EBP implementation climate (ie, the extent to which organizational members perceive that the adoption and use of EBPs is expected, supported, and rewarded) and attitudes about EBPs in two PCMH clinics., Results: Staff and physicians from two Rhode Island PCMHs, the Family Care Centre (FCC; n = 39) and Internal Medicine Clinic (IMC; n = 21), participated in this study. Results identified differences between FCC and IMC with regard to attitudes toward EBPs and implementation climate. Compared with the IMC, FCC staff and physicians reported significantly more positive attitudes toward EBPs and greater willingness to adopt EBPs. FCC staff and physicians reported significantly greater educational support for EBPs than IMC staff and physicians. Analysis of in-depth interviews revealed themes regarding attitudes toward EBPs. Most physicians reported valuing EBPs, although a number of barriers to EBP use were identified including time pressure, disjointed coordination of services, complexity of patients' presenting health concerns, and patient choice., Conclusions: Understanding factors that facilitate EBP implementation in the PCMH is important given widespread adoption of the PCMH model. Barriers to EBP implementation in the PCMH must be addressed for the sustainable implementation of EBP in the PCMH. Improving implementation climate may be an effective strategy to aid in creating an organizational context conducive to consideration and use of EBPs., (© 2018 John Wiley & Sons, Ltd.)

Implementation and sustainment of evidence-based interventions (EBIs) is influenced by outer (e.g., broader environments in which organizations operate) and inner (e.g., organizations, their administrators, and staff) contexts. One important outer-context element that shapes the inner context is funding, which is complex and unpredictable. There is a dearth of knowledge on how funding arrangements affect sustainment of EBIs in human service systems and the organizations delivering them, including child welfare and behavioral health agencies. This study uses qualitative interview and focus group data with stakeholders at the system, organizational, and provider levels from 11 human service systems in two states to examine how stakeholders strategically negotiate diverse and shifting funding arrangements over time. Study findings indicate that, while diverse funding streams may contribute to flexibility of organizations and possible transformations in the human service delivery environment, a dedicated funding source for EBIs is crucial to their successful implementation and sustainment.

The objective of this paper was to compare attitudes towards evidence-based practice (EBP) of substance use disorder treatment (SUDT) center employees' serving American Indian and Alaskan Native (AIAN) populations to those serving non-AIAN populations. Survey data on the openness and divergence subscales of the Evidence-Based Practice Attitude Scale (EBPAS) were collected and analyzed. Independent samples T tests were performed to compare the two samples. For all comparisons, except the divergence subscale between counselors, the SUDT employees serving AIANs had significantly lower mean openness scores and higher mean divergence scores than those serving non-AIANs. This study suggests that employees of SUDT centers serving AIAN population hold less positive attitudes towards the adoption and use of EBP than non-AIAN.

Background: Little work investigates the effect of behavioral health system efforts to increase use of evidence-based practices or how organizational characteristics moderate the effect of these efforts. The objective of this study was to investigate clinician practice change in a system encouraging implementation of evidence-based practices over 5 years and how organizational characteristics moderate this effect. We hypothesized that evidence-based techniques would increase over time, whereas use of non-evidence-based techniques would remain static., Method: Using a repeated cross-sectional design, data were collected three times from 2013 to 2017 in Philadelphia's public behavioral health system. Clinicians from 20 behavioral health outpatient clinics serving youth were surveyed three times over 5 years (n = 340; overall response rate = 60%). All organizations and clinicians were exposed to system-level support provided by the Evidence-based Practice Innovation Center from 2013 to 2017. Additionally, approximately half of the clinicians participated in city-funded evidence-based practice training initiatives. The main outcome included clinician self-reported use of cognitive-behavioral and psychodynamic techniques measured by the Therapy Procedures Checklist-Family Revised., Results: Clinicians were 80% female and averaged 37.52 years of age (SD = 11.40); there were no significant differences in clinician characteristics across waves (all ps > .05). Controlling for organizational and clinician covariates, average use of CBT techniques increased by 6% from wave 1 (M = 3.18) to wave 3 (M = 3.37, p = .021, d = .29), compared to no change in psychodynamic techniques (p = .570). Each evidence-based practice training initiative in which clinicians participated predicted a 3% increase in CBT use (p = .019) but no change in psychodynamic technique use (p = .709). In organizations with more proficient cultures at baseline, clinicians exhibited greater increases in CBT use compared to organizations with less proficient cultures (8% increase vs. 2% decrease, p = .048)., Conclusions: System implementation of evidence-based practices is associated with modest changes in clinician practice; these effects are moderated by organizational characteristics. Findings identify preliminary targets to improve implementation.

Background: Effective implementation of evidence-based practices (EBPs) remains a significant challenge. Numerous existing models and frameworks identify key factors and processes to facilitate implementation. However, there is a need to better understand how individual models and frameworks are applied in research projects, how they can support the implementation process, and how they might advance implementation science. This systematic review examines and describes the research application of a widely used implementation framework, the Exploration, Preparation, Implementation, Sustainment (EPIS) framework., Methods: A systematic literature review was performed to identify and evaluate the use of the EPIS framework in implementation efforts. Citation searches in PubMed, Scopus, PsycINFO, ERIC, Web of Science, Social Sciences Index, and Google Scholar databases were undertaken. Data extraction included the objective, language, country, setting, sector, EBP, study design, methodology, level(s) of data collection, unit(s) of analysis, use of EPIS (i.e., purpose), implementation factors and processes, EPIS stages, implementation strategy, implementation outcomes, and overall depth of EPIS use (rated on a 1-5 scale)., Results: In total, 762 full-text articles were screened by four reviewers, resulting in inclusion of 67 articles, representing 49 unique research projects. All included projects were conducted in public sector settings. The majority of projects (73%) investigated the implementation of a specific EBP. The majority of projects (90%) examined inner context factors, 57% examined outer context factors, 37% examined innovation factors, and 31% bridging factors (i.e., factors that cross or link the outer system and inner organizational context). On average, projects measured EPIS factors across two of the EPIS phases (M = 2.02), with the most frequent phase being Implementation (73%). On average, the overall depth of EPIS inclusion was moderate (2.8 out of 5)., Conclusion: This systematic review enumerated multiple settings and ways the EPIS framework has been applied in implementation research projects, and summarized promising characteristics and strengths of the framework, illustrated with examples. Recommendations for future use include more precise operationalization of factors, increased depth and breadth of application, development of aligned measures, and broadening of user networks. Additional resources supporting the operationalization of EPIS are available.

Objective: The overall aim of this paper is to examine effectiveness of an evidence-based intervention in community settings, and the factors associated with effectiveness. Limited research in the area of HIV prevention has focused on evaluating intervention program effectiveness in real-world settings., Methods: We implemented an efficacious theory-based sexual risk reduction intervention for female sex workers (FSW) called Mujer Segura across 13 different clinics in 13 sites across Mexico. The overall design was a cluster randomized Type I design simultaneously testing intervention program effectiveness with an observational study of implementation factors. We aimed to examine the effectiveness of Mujer Segura at reducing HIV/STI incidence among FSW participants at each site, and to examine the client-, provider-, organization-, and structure-related factors associated with program effectiveness., Results: We found lower HIV/STI incidence density in the intervention relative to the control group in 5 sites we labeled as "program effective sites," but not in 8 sites we labeled as "program ineffective sites." Using generalized estimating equations controlling for site and computed mean difference effect sizes, we examined statistically and practically significant differences, respectively, between the two groups of sites along various client-, provider-, organization-, and structure-related characteristics. Results indicated that client-level HIV/AIDS related knowledge, and proficiency and engagement in the organizational social context were associated with program effectiveness., Conclusions: Enormous resources are required to systematically and adequately test the role of multilevel factors on program effectiveness. We successfully implemented Mujer Segura in 13 sites in Mexico. Results suggest that other measures may need to be included in future implementation studies than the ones included here. We were able to point to a few specific factors that should be targeted to increase effectiveness of similar evidence-based programs in low- and other middle-income countries like Mexico., Trial Registration: ClinicalTrials.gov NCT01465607., Competing Interests: The authors have declared that no competing interests exist.

Background: The Evidence-Based Practice Attitude Scale (EBPAS) is a widely used tool, but it has not been adapted and validated for use in schools, the most common setting where youth access behavioral health services. This study examined the factor structure, psychometric properties, and criterion-related validity of the school-adapted EBPAS in a sample of school-based behavioral health consultants., Method: A research team comprised of experts in implementation of evidence-based practices in schools along with the original developer adapted the EBPAS for the school setting. The adapted instrument was administered to a representative sample (n = 196) of school-based behavioral health consultants to assess the reliability and structural validity via a series of confirmatory factor analyses., Results: The original EBPAS factor structure was confirmed, with the final model supporting four first-order factors that load onto a second-order factor capturing general attitudes toward evidence-based practice. Correlations among the subscales indicated both unique and shared variance. Correlations between EBPAS scores and consultant variables demonstrated differential criterion-related validity, with the total score and the Requirements and Openness subscales demonstrating the strongest correlations., Conclusions: The adapted EBPAS performed well when administered to behavioral health consultants operating in the educator sector, supporting the relevance of assessing attitudes in school settings. Potential directions for future research and applications of the EBPAS in schools and other service sectors are discussed.

Background: Behavioral health organizations are characterized by multiple organizational climates, including molar climate, which encompasses clinicians' shared perceptions of how the work environment impacts their personal well-being, and strategic implementation climate, which includes clinicians' shared perceptions of the extent to which evidence-based practice implementation is expected, supported, and rewarded by the organization. Theory suggests these climates have joint, cross-level effects on clinicians' implementation of evidence-based practice and that these effects may be long term (i.e., up to 2 years); however, no empirical studies have tested these relationships. We hypothesize that molar climate moderates implementation climate's concurrent and long-term relationships with clinicians' use of evidence-based practice such that strategic implementation climate will have its most positive effects when it is accompanied by a positive molar climate., Methods: Hypotheses were tested using data collected from 235 clinicians in 20 behavioral health organizations. At baseline, clinicians reported on molar climate and implementation climate. At baseline and at a 2-year follow-up, all clinicians who were present in the organizations reported on their use of cognitive-behavioral psychotherapy techniques, an evidence-based practice for youth psychiatric disorders. Two-level mixed-effects regression models tested whether baseline molar climate and implementation climate interacted in predicting clinicians' evidence-based practice use at baseline and at 2-year follow-up., Results: In organizations with more positive molar climates at baseline, higher levels of implementation climate predicted increased evidence-based practice use among clinicians who were present at baseline and among clinicians who were present in the organizations at 2-year follow-up; however, in organizations with less positive molar climates, implementation climate was not related to clinicians' use of evidence-based practice at either time point., Conclusions: Optimizing clinicians' implementation of evidence-based practice in behavioral health requires attention to both molar climate and strategic implementation climate. Strategies that focus exclusively on implementation climate may not be effective levers for behavior change if the organization does not also engender a positive molar climate. These findings have implications for the development of implementation theory and effective implementation strategies.

Agency leaders and therapists are essential stakeholders in implementation of evidence-based practices (EBPs) within publicly-funded mental health services. Little is known about how these stakeholders differ in their perceptions of specific EBPs and which individual and organizational factors differentially influence these perceptions. Within the context of a system-driven implementation of multiple EBPs, survey data from 160 leaders and 720 therapists were examined to assess differences in perceptions of six EBPs. Findings indicated that leaders and therapists have unique perspectives and preferences regarding EBPs that are shaped by distinct sociodemographic and professional characteristics and aspects of organizational functioning.

Background: Integrated healthcare delivered by work groups in nontraditional service settings is increasingly common, yet contemporary implementation frameworks typically assume a single organization-or organizational unit-within which system-level processes influence service quality and implementation success. Recent implementation frameworks predict that inter-organizational alignment (i.e., similarity in values, characteristics, activities related to implementation across organizations) may facilitate the implementation of evidence-based practices (EBP), but few studies have evaluated this premise. This study's aims examine the impact of overlapping organizational contexts by evaluating the implementation contexts of externally employed mental health clinicians working in schools-the most common integrated service delivery setting for children and adolescents. Aim 1 is to estimate the effects of unique intra-organizational implementation contexts and combined inter-organizational alignment on implementation outcomes. Aim 2 is to examine the underlying mechanisms through which inter-organizational alignment facilitates or hinders EBP implementation., Methods/design: This study will conduct sequential, exploratory mixed-methods research to evaluate the intra- and inter-organizational implementation contexts of schools and the external community-based organizations that most often employ school-based mental health clinicians, as they relate to mental health EBP implementation. Aim 1 will involve quantitative surveys with school-based, externally-employed mental health clinicians, their supervisors, and proximal school-employed staff (total n = 120 participants) to estimate the effects of each organization's general and implementation-specific organizational factors (e.g., climate, leadership) on implementation outcomes (fidelity, acceptability, appropriateness) and assess the moderating role of the degree of clinician embeddedness in the school setting. Aim 2 will explore the mechanisms through which inter-organizational alignment influences implementation outcomes by presenting the results of Aim 1 surveys to school-based clinicians (n = 30) and conducting semi-structured qualitative interviews. Qualitative data will be evaluated using an integrative inductive and deductive approach., Discussion: The study aims are expected to identify intra- and inter-organizational constructs that are most instrumental to EBP implementation success in school-based integrated care settings and illuminate mechanisms that may account for the influence of inter-organizational alignment. In addition to improving school-based mental health, these findings will spur future implementation science that considers the relationships across organizations and optimize the capacity of implementation science to guide practice in increasingly complex systems of care.

Background: Despite our progress in understanding the organizational context for implementation and specifically the role of leadership in implementation, its role in sustainment has received little attention. This paper took a mixed-method approach to examine leadership during the sustainment phase of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Utilizing the Implementation Leadership Scale as a foundation, we sought to develop a short, practical measure of sustainment leadership that can be used for both applied and research purposes., Methods: Data for this study were collected as a part of a larger mixed-method study of evidence-based intervention, SafeCare®, sustainment. Quantitative data were collected from 157 providers using web-based surveys. Confirmatory factor analysis was used to examine the factor structure of the Sustainment Leadership Scale (SLS). Qualitative data were collected from 95 providers who participated in one of 15 focus groups. A framework approach guided qualitative data analysis. Mixed-method integration was also utilized to examine convergence of quantitative and qualitative findings., Results: Confirmatory factor analysis supported the a priori higher order factor structure of the SLS with subscales indicating a single higher order sustainment leadership factor. The SLS demonstrated excellent internal consistency reliability. Qualitative analyses offered support for the dimensions of sustainment leadership captured by the quantitative measure, in addition to uncovering a fifth possible factor, available leadership., Conclusions: This study found qualitative and quantitative support for the pragmatic SLS measure. The SLS can be used for assessing leadership of first-level leaders to understand how staff perceive leadership during sustainment and to suggest areas where leaders could direct more attention in order to increase the likelihood that EBIs are institutionalized into the normal functioning of the organization.

Background: A substantial literature has established the role of the inner organizational setting on the implementation of evidence-based practices in community contexts, but very little of this research has been extended to the education sector, one of the most common settings for the delivery of mental and behavioral health services to children and adolescents. The current study examined the factor structure, psychometric properties, and interrelations of an adapted set of pragmatic organizational instruments measuring key aspects of the organizational implementation context in schools: (1) strategic implementation leadership, (2) strategic implementation climate, and (3) implementation citizenship behavior., Method: The Implementation Leadership Scale (ILS), Implementation Climate Scale (ICS), and Implementation Citizenship Behavior Scale (ICBS) were adapted by a research team that included the original scale authors and experts in the implementation of evidence-based practices in schools. These instruments were then administered to a geographically representative sample (n = 196) of school-based mental/behavioral health consultants to assess the reliability and structural validity via a series of confirmatory factor analyses., Results: Overall, the original factor structures for the ILS, ICS, and ICBS were confirmed in the current sample. The one exception was poor functioning of the Rewards subscale of the ICS, which was removed in the final ICS model. Correlations among the revised measures, evaluated as part of an overarching model of the organizational implementation context, indicated both unique and shared variance., Conclusions: The current analyses suggest strong applicability of the revised instruments to implementation of evidence-based mental and behavioral practices in the education sector. The one poorly functioning subscale (Rewards on the ICS) was attributed to typical educational policies that do not allow for individual financial incentives to personnel. Potential directions for future expansion, revision, and application of the instruments in schools are discussed.

Background: Short and valid instruments for measuring factors facilitating or hindering implementation efforts are called for. This article describes (1) the adaptation of a shorter version of the Evidence-based Practice Attitude Scale (EBPAS-50 items), and (2) the psychometric properties of the shortened version in both US and Norwegian data., Methods: The US participants were mental health service providers (N = 418) recruited from clinics providing mental health services in San Diego County, California. The Norwegian participants were psychologists, psychiatric nurses, and psychology students (N = 838) recruited from the Norwegian Psychological Association and the Norwegian Nurses Organization. A confirmatory factor analysis (CFA) approach was used., Results: The reduction resulted in 36 items named EBPAS-36, and the original 12 factor model was maintained. The EBPAS-36 had acceptable model fit, as indicated by a low degree of misspecification errors in both the US (RMSEA = .045 (CI 90% .040-.049); SRMR = .05) and the Norwegian data (RMSEA = .052 (CI 90% .047-.056, SRMR = .07). Incremental model fit was fair in the US (CFI = .93, TLI = .91) and in the Norwegian samples (CFI = .91, TLI = .89). The internal consistency (Cronbach's α) in the US and the Norwegian samples were good for the total EBPAS-36 score (.79 and .86, respectively) and were ranged from adequate to excellent for the subscales (US .60-.91 and Norway .61-.92)., Conclusions: The EBPAS-36 has adequate psychometric properties both in US and Norwegian samples, hence indicating cross-cultural validity. It is a brief, pragmatic, and more user-friendly instrument than the EBPAS-50, yet maintains a broad scope by retaining the original 12 measurement domains.

Implementing behavioral health interventions is a complicated process. It has been suggested that implementation strategies should be selected and tailored to address the contextual needs of a given change effort; however, there is limited guidance as to how to do this. This article proposes four methods (concept mapping, group model building, conjoint analysis, and intervention mapping) that could be used to match implementation strategies to identified barriers and facilitators for a particular evidence-based practice or process change being implemented in a given setting. Each method is reviewed, examples of their use are provided, and their strengths and weaknesses are discussed. The discussion includes suggestions for future research pertaining to implementation strategies and highlights these methods' relevance to behavioral health services and research.

Objectives: Discrepancies, or perceptual distance, between leaders' self-ratings and followers' ratings of the leader are common but usually go unrecognized. Research on discrepancies is limited, but there is evidence that discrepancies are associated with organizational context. This study examined the association of leader-follower discrepancies in Implementation Leadership Scale (ILS) ratings of mental health clinic leaders and the association of those discrepancies with organizational climate for involvement and performance feedback. Both involvement and performance feedback are important for evidence-based practice (EBP) implementation in mental health., Methods: A total of 593 individuals-supervisors (leaders, N=80) and clinical service providers (followers, N=513)-completed surveys that included ratings of implementation leadership and organizational climate. Polynomial regression and response surface analyses were conducted to examine the associations of discrepancies in leader-follower ILS ratings with organizational involvement climate and performance feedback climate, aspects of climate likely to support EBP implementation., Results: Both involvement climate and performance feedback climate were highest where leaders rated themselves low on the ILS and their followers rated those leaders high on the ILS ("humble leaders")., Conclusions: Teams with "humble leaders" showed more positive organizational climate for involvement and for performance feedback, contextual factors important during EBP implementation and sustainment. Discrepancy in leader and follower ratings of implementation leadership should be a consideration in understanding and improving leadership and organizational climate for mental health services and for EBP implementation and sustainment in mental health and other allied health settings.

Our goal was to identify barriers and facilitators to the implementation of evidence-based practices from the perspectives of multiple stakeholders in a large publicly funded mental health system. We completed 56 interviews with three stakeholder groups: treatment developers (n = 7), agency administrators (n = 33), and system leadership (n = 16). The three stakeholder groups converged on the importance of inner (e.g., agency competing resources and demands, therapist educational background) and outer context (e.g., funding) factors as barriers to implementation. Potential threats to implementation and sustainability included the fiscal landscape of community mental health clinics and an evolving workforce. Intervention characteristics were rarely endorsed as barriers. Inner context, outer context, and intervention characteristics were all seen as important facilitators. All stakeholders endorsed the importance of coordinated collaboration across stakeholder groups within the system to successfully implement evidence-based practices.

If evidence-based interventions (EBIs) are not sustained, investments are wasted and public health impact is limited. Leadership has been suggested as a key determinant of implementation and sustainment; however, little empirical work has examined this factor. This mixed-methods study framed using the Exploration, Preparation, Implementation, Sustainment (EPIS) conceptual framework examines leadership in both the outer service system context and inner organizational context in eleven system-wide implementations of the same EBI across two U.S. states and 87 counties. Quantitative data at the outer context (i.e., system) and inner context (i.e., team) levels demonstrated that leadership predicted future sustainment and differentiated between sites with full, partial, or no sustainment. In the outer context positive sustainment leadership was characterized as establishing a project's mission and vision, early and continued planning for sustainment, realistic project plans, and having alternative strategies for project survival. Inner context frontline transformational leadership predicted sustainment while passive-avoidant leadership predicted non-sustainment. Qualitative results found that sustainment was associated with outer context leadership characterized by engagement in ongoing supportive EBI championing, marketing to stakeholders; persevering in these activities; taking action to institutionalize the EBI with funding, contracting, and system improvement plans; and fostering ongoing collaboration between stakeholders at state and county, and community stakeholder levels. For frontline leadership the most important activities included championing the EBI and providing practical support for service providers. There was both convergence and expansion that identified unique contributions of the quantitative and qualitative methods. Greater attention to leadership in both the outer system and inner organizational contexts is warranted to enhance EBI implementation and sustainment.

Sustainment of evidence-based interventions (EBIs) in human services depends on the inner context of community-based organizations (CBOs) that provide services and the outer context of their broader environment. Increasingly, public officials are experimenting with contracting models from for-profit industries to procure human services. In this case study, we conducted qualitative interviews with key government and CBO stakeholders to examine implementation of the Best Value-Performance Information Procurement System to contract for EBIs in a child welfare system. Findings suggest that stakeholder relationships may be compromised when procurement disregards local knowledge, communication, collaboration, and other factors supporting EBIs and public health initiatives.

The use of evidence-based practices (EBPs) is associated with favorable client outcomes, yet perceived burden of using EBPs may affect the adoption and implementation of such practices. Multilevel path analysis was used to examine the associations of transformational leadership with organizational climate, and their associations with perceived burden of using EBPs. Results indicated significant relationships between transformational leadership and empowering and demoralizing climates, and between demoralizing climate and perceived burden of EBPs. We found significant indirect associations of leadership and perceived burden through organizational climate. Findings suggest that further research is needed to examine the extent to which improving leadership and organizational climate may reduce perceived burden and use of EBPs with the ultimate goal of enhancing quality of care.

Staff turnover rates in publicly-funded mental health settings are high. We investigated staff and organizational predictors of turnover in a sample of individuals working in an urban public mental health system that has engaged in a system-level effort to implement evidence-based practices. Additionally, we interviewed staff to understand reasons for turnover. Greater staff burnout predicted increased turnover, more openness toward new practices predicted retention, and more professional recognition predicted increased turnover. Staff reported leaving their organizations because of personal, organizational, and financial reasons; just over half of staff that left their organization stayed in the public mental health sector. Implications include an imperative to focus on turnover, with a particular emphasis on ameliorating staff burnout.

There have been recent calls for pragmatic measures to assess factors that influence evidence-based practice (EBP) implementation processes and outcomes. The Implementation Leadership Scale (ILS) is a brief and efficient measure that can be used for research or organizational development purposes to assess leader behaviors and actions that actively support effective EBP implementation. The ILS was developed and validated in mental health settings. This study validates the ILS factor structure with providers in alcohol and other drug (AOD) use treatment agencies. Participants were 323 service providers working in 72 workgroups from three AOD use treatment agencies. Confirmatory factor analyses and reliability analyses were conducted to examine the psychometric properties of the ILS. Convergent and discriminant validity were also assessed. Confirmatory factor analyses demonstrated good fit to the hypothesized first and second order factor structure. Internal consistency reliability was excellent. Convergent and discriminant validity was supported. The ILS psychometric characteristics, reliability, and validity were supported in AOD use treatment agencies. The ILS is a brief and pragmatic measure that can be used for research and practice to assess leadership for EBP implementation in AOD use treatment agencies., (Copyright © 2016 Elsevier Inc. All rights reserved.)

The Implementation Leadership Scale (ILS) is a brief, pragmatic, and efficient measure that can be used for research or organizational development to assess leader behaviors and actions that actively support effective implementation of evidence-based practices (EBPs). The ILS was originally validated with mental health clinicians. This study validates the ILS factor structure with providers in community-based organizations (CBOs) providing child welfare services. Participants were 214 service providers working in 12 CBOs that provide child welfare services. All participants completed the ILS, reporting on their immediate supervisor. Confirmatory factor analyses were conducted to examine the factor structure of the ILS. Internal consistency reliability and measurement invariance were also examined. Confirmatory factor analyses showed acceptable fit to the hypothesized first- and second-order factor structure. Internal consistency reliability was strong and there was partial measurement invariance for the first-order factor structure when comparing child welfare and mental health samples. The results support the use of the ILS to assess leadership for implementation of EBPs in child welfare organizations., (© The Author(s) 2016.)

Background: Despite a solid research base supporting evidence-based practices (EBPs) for addiction treatment such as contingency management and medication-assisted treatment, these services are rarely implemented and delivered in community-based addiction treatment programs in the USA. As a result, many clients do not benefit from the most current and efficacious treatments, resulting in reduced quality of care and compromised treatment outcomes. Previous research indicates that addiction program leaders play a key role in supporting EBP adoption and use. The present study expanded on this previous work to identify strategies that addiction treatment program leaders report using to implement new practices., Methods: We relied on a staged and iterative mixed-methods approach to achieve the following four goals: (a) collect data using focus groups and semistructured interviews and conduct analyses to identify implicit managerial strategies for implementation, (b) use surveys to quantitatively rank strategy effectiveness, (c) determine how strategies fit with existing theories of organizational management and change, and (d) use a consensus group to corroborate and expand on the results of the previous three stages. Each goal corresponded to a methodological phase, which included data collection and analytic approaches to identify and evaluate leadership interventions that facilitate EBP implementation in community-based addiction treatment programs., Results: Findings show that the top-ranked strategies involved the recruitment and selection of staff members receptive to change, offering support and requesting feedback during the implementation process, and offering in vivo and hands-on training. Most strategies corresponded to emergent implementation leadership approaches that also utilize principles of transformational and transactional leadership styles. Leadership behaviors represented orientations such as being proactive to respond to implementation needs, supportive to assist staff members during the uptake of new practices, knowledgeable to properly guide the implementation process, and perseverant to address ongoing barriers that are likely to stall implementation efforts., Conclusions: These findings emphasize how leadership approaches are leveraged to facilitate the implementation and delivery of EBPs in publicly funded addiction treatment programs. Findings have implications for the content and structure of leadership interventions needed in community-based addiction treatment programs and the development of leadership interventions in these and other service settings.

There is increasing emphasis on the use of evidence-based practices (EBPs) in child welfare settings and growing recognition of the importance of the organizational environment, and the organization's climate in particular, for how employees perceive and support EBP implementation. Recently, Ehrhart, Aarons, and Farahnak (2014) reported on the development and validation of a measure of EBP implementation climate, the Implementation Climate Scale (ICS), in a sample of mental health clinicians. The ICS consists of 18 items and measures six critical dimensions of implementation climate: focus on EBP, educational support for EBP, recognition for EBP, rewards for EBP, selection or EBP, and selection for openness. The goal of the current study is to extend this work by providing evidence for the factor structure, reliability, and validity of the ICS in a sample of child welfare service providers. Survey data were collected from 215 child welfare providers across three states, 12 organizations, and 43 teams. Confirmatory factor analysis demonstrated good fit to the six-factor model and the alpha reliabilities for the overall measure and its subscales was acceptable. In addition, there was general support for the invariance of the factor structure across the child welfare and mental health sectors. In conclusion, this study provides evidence for the factor structure, reliability, and validity of the ICS measure for use in child welfare service organizations., (Copyright © 2015 Elsevier Ltd. All rights reserved.)

Background: The Evidence-Based Practice Attitude Scale (EBPAS) was developed in the United States to assess attitudes of mental health and welfare professionals toward evidence-based interventions. Although the EBPAS has been translated in different languages and is being used in several countries, all research on the psychometric properties of the EBPAS within youth care has been carried out in the United States. The purpose of this study was to investigate the psychometric properties of the Dutch version of the EBPAS., Methods: After translation into Dutch, the Dutch version of the EBPAS was examined in a diverse sample of 270 youth care professionals working in five institutions in the Netherlands. We examined the factor structure with both exploratory and confirmatory factor analyses and the internal consistency reliability. We also conducted multiple linear regression analyses to examine the association of EBPAS scores with professionals' characteristics. It was hypothesized that responses to the EBPAS items could be explained by one general factor plus four specific factors, good to excellent internal consistency reliability would be found, and EBPAS scores would vary by age, sex, and educational level., Results: The exploratory factor analysis suggested a four-factor solution according to the hypothesized dimensions: Requirements, Appeal, Openness, and Divergence. Cronbach's alphas ranged from 0.67 to 0.89, and the overall scale alpha was 0.72. The confirmatory factor analyses confirmed the factor structure and suggested that the lower order EBPAS factors are indicators of a higher order construct. However, Divergence was not significantly correlated with any of the subscales or the total score. The confirmatory bifactor analysis endorsed that variance was explained both by a general attitude towards evidence-based interventions and by four specific factors. The regression analyses showed an association between EBPAS scores and youth care professionals' age, sex, and educational level., Conclusions: The present study provides strong support for a structure with a general factor plus four specific factors and internal consistency reliability of the Dutch version of the EBPAS in a diverse sample of youth care professionals. Hence, the factor structure and reliability of the original version of the EBPAS seem generalizable to the Dutch version of the EBPAS.

Background: In line with recent research on the role of the inner context of organizations in implementation effectiveness, this study extends research on organizational citizenship behavior (OCB) to the domain of evidence-based practice (EBP) implementation. OCB encompasses those behaviors that go beyond what is required for a given job that contribute to greater organizational effectiveness. The goal of this study was to develop and test a measure of implementation citizenship behavior (ICB) or those behaviors that employees perform that go above and beyond what is required in order to support EBP implementation., Methods: The primary participants were 68 supervisors from ten mental health agencies throughout California. Items measuring ICB were developed based on past research on OCB and in consultation with experts on EBP implementation in mental health settings. Supervisors rated 357 of their subordinates on ICB and implementation success. In addition, 292 of the subordinates provided data on self-rated performance, attitudes towards EBPs, work experience, and full-time status. The supervisor sample was randomly split, with half used for exploratory factor analyses and the other half for confirmatory factor analyses. The entire sample of supervisors and subordinates was utilized for analyses assessing the reliability and construct validity of the measure., Results: Exploratory factor analyses supported the proposed two-factor structure of the Implementation Citizenship Behavior Scale (ICBS): (1) Helping Others and (2) Keeping Informed. Confirmatory factor analyses with the other half of the sample supported the factor structure. Additional analyses supported the reliability and construct validity for the ICBS., Conclusions: The ICBS is a pragmatic brief measure (six items) that captures critical behaviors employees perform to go above and beyond the call of duty to support EBP implementation, including helping their fellow employees on implementation-related activities and keeping informed about issues related to EBP and implementation efforts. The ICBS can be used by researchers to better understand the outcomes of improved organizational support for implementation (i.e., implementation climate) and the proximal predictors of implementation effectiveness. The ICBS can also provide insight for organizations, practitioners, and managers by focusing on key employee behaviors that should increase the probability of implementation success.

Rates of substance abuse remain high in American Indian and Alaska Native (AI/AN) populations. While there are many evidence-based treatments (EBTs) for substance use problems, no studies exist describing how directors of treatment programs serving AI/ANs perceive and use EBTs. Twenty-one key informant interviews with program administrators and 10 focus groups with clinicians were conducted at 18 treatment programs for AI/ANs with substance use problems. Demographic data were not collected to protect participant privacy. Transcripts were coded to identify relevant themes. A majority of participants correctly defined an EBT using the key terms "effective" and "research" found in standard definitions of the phrase. More detailed descriptions were uncommon. Prevalent themes related to attitudes about EBTs included concerns about cultural relevance, external mandates to use EBTs, and their reliance on western conceptualization of substance abuse. While most administrators and clinicians who treat AI/AN clients for substance abuse had a basic understanding of what constitutes an EBT, there was little consensus regarding their relevance for use with AI/ANs. Recognizing that broad geographic and tribal diversity among AI/AN populations may impact conclusions drawn about EBTs, several factors may enhance the abilities of program staff to identify EBTs most appropriate for local implementation. These include gaining a more detailed understanding of how an EBT is developed and how to assess its scientific grounding, as well as utilizing definitions of EBTs that include not only research evidence, but also clinical expertise and judgment, and fit with consumer choice, preference, and culture., ((c) 2015 APA, all rights reserved).)

Policymakers shape implementation and sustainment of evidence-based practices (EBPs), whether they are developing or responding to legislation and policies or negotiating public sector resource constraints. As part of a large mixed-method study, we conducted qualitative interviews with 24 policymakers involved in delivery of the same EBP in two U.S. states. We analyzed transcripts via open and focused coding techniques to identify the commonality, diversity, and complexity of implementation challenges; approaches to overcoming those challenges; and the importance of system-level contextual factors in ensuring successful implementation. Key findings centered on building support and leadership for EBPs; funding and contractual strategies; partnering with stakeholders; tackling challenges via proactive planning and problem solving; and the political, legal, and systemic pressures affecting EBP longevity. The policymaker perspectives offer guidance on nurturing system and organizational practice environments to achieve positive outcomes and for optimally addressing macro-level influences that bear upon the instantiation of EBPs in public sector child welfare systems., (© The Author(s) 2014.)

Background: Leadership is important in the implementation of innovation in business, health, and allied health care settings. Yet there is a need for empirically validated organizational interventions for coordinated leadership and organizational development strategies to facilitate effective evidence-based practice (EBP) implementation. This paper describes the initial feasibility, acceptability, and perceived utility of the Leadership and Organizational Change for Implementation (LOCI) intervention. A transdisciplinary team of investigators and community stakeholders worked together to develop and test a leadership and organizational strategy to promote effective leadership for implementing EBPs., Methods: Participants were 12 mental health service team leaders and their staff (n = 100) from three different agencies that provide mental health services to children and families in California, USA. Supervisors were randomly assigned to the 6-month LOCI intervention or to a two-session leadership webinar control condition provided by a well-known leadership training organization. We utilized mixed methods with quantitative surveys and qualitative data collected via surveys and a focus group with LOCI trainees., Results: Quantitative and qualitative analyses support the LOCI training and organizational strategy intervention in regard to feasibility, acceptability, and perceived utility, as well as impact on leader and supervisee-rated outcomes., Conclusions: The LOCI leadership and organizational change for implementation intervention is a feasible and acceptable strategy that has utility to improve staff-rated leadership for EBP implementation. Further studies are needed to conduct rigorous tests of the proximal and distal impacts of LOCI on leader behaviors, implementation leadership, organizational context, and implementation outcomes. The results of this study suggest that LOCI may be a viable strategy to support organizations in preparing for the implementation and sustainment of EBP.

We evaluated organizational factors associated with the implementation of contingency management treatment (CMT) and medication-assisted treatment (MAT) in substance abuse treatment (SAT) programs serving racial and ethnic minority communities. Analysis of cross-sectional data collected in 2010-2011 from a random sample of 148 publicly funded SAT programs showed that accepting private insurance was positively associated with CMT and MAT implementation, whereas larger programs were associated with greater implementation of MAT. Supervisorial openness to and expectations about implementing evidence-based practices (EBPs) and attributes for change were strongly associated with CMT, whereas the interactions between openness to EBPs and programs that accept private insurance and that are governed by parent organizations were positively associated with MAT. These external expectations and managerial attitudes supported the implementation of psychosocial and pharmacotherapy treatments in SAT. Implications for improving standards of care in minority communities are discussed.

Background: Although the importance of the organizational environment for implementing evidence-based practices (EBP) has been widely recognized, there are limited options for measuring implementation climate in public sector health settings. The goal of this research was to develop and test a measure of EBP implementation climate that would both capture a broad range of issues important for effective EBP implementation and be of practical use to researchers and managers seeking to understand and improve the implementation of EBPs., Methods: Participants were 630 clinicians working in 128 work groups in 32 US-based mental health agencies. Items to measure climate for EBP implementation were developed based on past literature on implementation climate and other strategic climates and in consultation with experts on the implementation of EBPs in mental health settings. The sample was randomly split at the work group level of analysis; half of the sample was used for exploratory factor analysis (EFA), and the other half was used for confirmatory factor analysis (CFA). The entire sample was utilized for additional analyses assessing the reliability, support for level of aggregation, and construct-based evidence of validity., Results: The EFA resulted in a final factor structure of six dimensions for the Implementation Climate Scale (ICS): 1) focus on EBP, 2) educational support for EBP, 3) recognition for EBP, 4) rewards for EBP, 5) selection for EBP, and 6) selection for openness. This structure was supported in the other half of the sample using CFA. Additional analyses supported the reliability and construct-based evidence of validity for the ICS, as well as the aggregation of the measure to the work group level., Conclusions: The ICS is a very brief (18 item) and pragmatic measure of a strategic climate for EBP implementation. It captures six dimensions of the organizational context that indicate to employees the extent to which their organization prioritizes and values the successful implementation of EBPs. The ICS can be used by researchers to better understand the role of the organizational context on implementation outcomes and by organizations to evaluate their current climate as they consider how to improve the likelihood of implementation success.

Implementation and scale-up of evidence-based practices (EBPs) is often portrayed as involving multiple stakeholders collaborating harmoniously in the service of a shared vision. In practice, however, collaboration is a more complex process that may involve shared and competing interests and agendas, and negotiation. The present study examined the scale-up of an EBP across an entire service system using the Interagency Collaborative Team approach. Participants were key stakeholders in a large-scale county-wide implementation of an EBP to reduce child neglect, SafeCare. Semistructured interviews and/or focus groups were conducted with 54 individuals representing diverse constituents in the service system, followed by an iterative approach to coding and analysis of transcripts. The study was conceptualized using the Exploration, Preparation, Implementation, and Sustainment framework. Although community stakeholders eventually coalesced around implementation of SafeCare, several challenges affected the implementation process. These challenges included differing organizational cultures, strategies, and approaches to collaboration; competing priorities across levels of leadership; power struggles; and role ambiguity. Each of the factors identified influenced how stakeholders approached the EBP implementation process. System-wide scale-up of EBPs involves multiple stakeholders operating in a nexus of differing agendas, priorities, leadership styles, and negotiation strategies. The term collaboration may oversimplify the multifaceted nature of the scale-up process. Implementation efforts should openly acknowledge and consider this nexus when individual stakeholders and organizations enter into EBP implementation through collaborative processes.

There has been a growing impetus to bridge the gap between basic science discovery, development of evidence-based practices (EBPs), and the availability and delivery of EBPs in order to improve the public health impact of such practices. To capitalize on factors that support implementation and sustainment of EBPs, it is important to consider that health care is delivered within the outer context of public health systems and the inner context of health care organizations and work groups. Leaders play a key role in determining the nature of system and organizational contexts. This article addresses the role of leadership and actions that leaders can take at and across levels in developing a strategic climate for EBP implementation within the outer (i.e., system) and inner (i.e., organization, work group) contexts of health care. Within the framework of Edgar Schein's "climate embedding mechanisms," we describe strategies that leaders at the system, organization, and work group levels can consider and apply to develop strategic climates that support the implementation and sustainment of EBP in health care and allied health care settings.

Objective: Although there has been a dramatic increase in the number of evidence-based practices (EBPs) to improve child and adolescent mental health, the poor uptake of these EBPs has led to investigations of factors related to their successful dissemination and implementation. The purpose of this systematic review was to identify key findings from empirical studies examining the dissemination and implementation of EBPs for child and adolescent mental health., Method: Of 14,247 citations initially identified, 73 articles drawn from 44 studies met inclusion criteria. The articles were classified by implementation phase (exploration, preparation, implementation, and sustainment) and specific implementation factors examined. These factors were divided into outer (i.e., system level) and inner (i.e., organizational level) contexts., Results: Few studies used true experimental designs; most were observational. Of the many inner context factors that were examined in these studies (e.g., provider characteristics, organizational resources, leadership), fidelity monitoring and supervision had the strongest empirical evidence. Albeit the focus of fewer studies, implementation interventions focused on improving organizational climate and culture were associated with better intervention sustainment as well as child and adolescent outcomes. Outer contextual factors such as training and use of specific technologies to support intervention use were also important in facilitating the implementation process., Conclusions: The further development and testing of dissemination and implementation strategies is needed to more efficiently move EBPs into usual care., (Copyright © 2013 American Academy of Child and Adolescent Psychiatry. Published by Elsevier Inc. All rights reserved.)