Search

Rates of substance abuse remain high in American Indian and Alaska Native (AI/AN) populations. While there are many evidence-based treatments (EBTs) for substance use problems, no studies exist describing how directors of treatment programs serving AI/ANs perceive and use EBTs. Twenty-one key informant interviews with program administrators and 10 focus groups with clinicians were conducted at 18 treatment programs for AI/ANs with substance use problems. Demographic data were not collected to protect participant privacy. Transcripts were coded to identify relevant themes. A majority of participants correctly defined an EBT using the key terms "effective" and "research" found in standard definitions of the phrase. More detailed descriptions were uncommon. Prevalent themes related to attitudes about EBTs included concerns about cultural relevance, external mandates to use EBTs, and their reliance on western conceptualization of substance abuse. While most administrators and clinicians who treat AI/AN clients for substance abuse had a basic understanding of what constitutes an EBT, there was little consensus regarding their relevance for use with AI/ANs. Recognizing that broad geographic and tribal diversity among AI/AN populations may impact conclusions drawn about EBTs, several factors may enhance the abilities of program staff to identify EBTs most appropriate for local implementation. These include gaining a more detailed understanding of how an EBT is developed and how to assess its scientific grounding, as well as utilizing definitions of EBTs that include not only research evidence, but also clinical expertise and judgment, and fit with consumer choice, preference, and culture.

ImportanceFew studies have examined the effects of individual and organizational characteristics on the use of evidence-based practices in mental health care. Improved understanding of these factors could guide future implementation efforts to ensure effective adoption, implementation, and sustainment of evidence-based practices.ObjectiveTo estimate the relative contribution of individual and organizational factors on therapist self-reported use of cognitive-behavioral, family, and psychodynamic therapy techniques within the context of a large-scale effort to increase use of evidence-based practices in an urban public mental health system serving youth and families.Design, setting, and participantsIn this observational, cross-sectional study of 23 organizations, data were collected from March 1 through July 25, 2013. We used purposive sampling to recruit the 29 largest child-serving agencies, which together serve approximately 80% of youth receiving publically funded mental health care. The final sample included 19 agencies with 23 sites, 130 therapists, 36 supervisors, and 22 executive administrators.Main outcomes and measuresTherapist self-reported use of cognitive-behavioral, family, and psychodynamic therapy techniques, as measured by the Therapist Procedures Checklist-Family Revised.ResultsIndividual factors accounted for the following percentages of the overall variation: cognitive-behavioral therapy techniques, 16%; family therapy techniques, 7%; and psychodynamic therapy techniques, 20%. Organizational factors accounted for the following percentages of the overall variation: cognitive-behavioral therapy techniques, 23%; family therapy techniques, 19%; and psychodynamic therapy techniques, 7%. Older therapists and therapists with more open attitudes were more likely to endorse use of cognitive-behavioral therapy techniques, as were those in organizations that had spent fewer years participating in evidence-based practice initiatives, had more resistant cultures, and had more functional climates. Women were more likely to endorse use of family therapy techniques, as were those in organizations employing more fee-for-service staff and with more stressful climates. Therapists with more divergent attitudes and less knowledge about evidence-based practices were more likely to use psychodynamic therapy techniques.Conclusions and relevanceThis study suggests that individual and organizational factors are important in explaining therapist behavior and use of evidence-based practices, but the relative importance varies by therapeutic technique.

Policymakers shape implementation and sustainment of evidence-based practices (EBPs), whether they are developing or responding to legislation and policies or negotiating public sector resource constraints. As part of a large mixed-method study, we conducted qualitative interviews with 24 policymakers involved in delivery of the same EBP in two U.S. states. We analyzed transcripts via open and focused coding techniques to identify the commonality, diversity, and complexity of implementation challenges; approaches to overcoming those challenges; and the importance of system-level contextual factors in ensuring successful implementation. Key findings centered on building support and leadership for EBPs; funding and contractual strategies; partnering with stakeholders; tackling challenges via proactive planning and problem solving; and the political, legal, and systemic pressures affecting EBP longevity. The policymaker perspectives offer guidance on nurturing system and organizational practice environments to achieve positive outcomes and for optimally addressing macro-level influences that bear upon the instantiation of EBPs in public sector child welfare systems.

ObjectiveThis study examined service provider perceptions of requirements for successful sustainment of an efficacious intervention for preventing HIV/AIDS and STIs in female sex workers (FSWs) in Mexico.MethodsSemi-structured interviews were conducted with 77 leaders and counselors from 12 community-based reproductive health clinics located throughout Mexico participating in a large hybrid effectiveness-implementation randomized controlled trial to scale-up the use of Mujer Segura, a psychoeducational intervention designed to promote condom use and enhance safer sex negotiation skills among FSWs.ResultsFive sets of requirements for sustainment were identified: 1) characteristics of the provider, including competence in delivering the intervention, need for continued technical support and assistance from outside experts, and satisfaction with addressing the needs of this population; 2) characteristics of the clients (i.e., FSWs), including client need and demand for services and incentives for participation; 3) characteristics of the organization, including its mission, benefits, and operations; 4) characteristics of the outer setting, including financial support and relationship with the community-based organization's central offices, and transportation and security in areas where FSWs live and work; and 5) outcomes associated with the intervention itself, including a reduction of risk through education and increased outreach through referrals from FSWs who received the intervention.ConclusionsAlthough the requirements for successful sustainment of interventions like Mujer Segura are consistent with the factors identified in many models of implementation, the results illustrate the importance of local context in assigning priority to these model elements and suggest that the five categories are not discrete entities but interconnected.

BackgroundGlobally, client-perpetrated violence against female sex workers (FSWs) has been associated with multiple health-related harms, including high-risk sexual behavior and increased exposure to HIV/STIs. This study examined correlates of client-perpetrated sexual, physical, and economic violence (e.g., robbery) against FSWs in 13 cities throughout Mexico.MethodsFSWs (N = 1,089) who were enrolled in a brief, evidence-based, sexual risk reduction intervention for FSWs (Mujer Segura) were interviewed about their work context, including experiences of violence perpetrated by clients, sexual risk and substance use practices, financial need, and social supports. Three broad categories of factors (sociodemographic, work context, behavioral and social characteristics of FSWs) were examined as correlates of sexual, physical, and economic violence.ResultsThe prevalence of different types of client-perpetrated violence against FSWs in the past 6 months was: sexual (11.7%), physical (11.8%), economic (16.9%), and any violence (22.6%). Greater financial need, self-identification as a street worker, and lower perceived emotional support were independently associated with all three types of violence. Alcohol use before or during sex with clients in the past month was associated with physical and sexual violence. Using drugs before or during sex with clients, injection drug use in the past month, and population size of city were associated with sexual violence only, and FSWs' alcohol use score (AUDIT-C) was associated with economic violence only.ConclusionsCorrelates of client-perpetrated violence encompassed sociodemographic, work context, and behavioral and social factors, suggesting that approaches to violence prevention for FSWs must be multi-dimensional. Prevention could involve teaching FSWs strategies for risk avoidance in the workplace (e.g., avoiding use of alcohol with clients), enhancement of FSWs' community-based supports, development of interventions that deliver an anti-violence curriculum to clients, and programs to address FSWs' financial need by increasing their economic opportunities outside of the sex trade.

Implementation is posited as a multiphasic process, influenced by a range of factors, within a multilevel context. While there appears to be a general consensus that every implementation initiative will have a unique combination of influences that vary in importance across the implementation phases, leadership is an essential tenant throughout implementation frameworks, models, and theories. The exploration, preparation, implementation, sustainment framework is used to explore leadership, at both the inner organizational level and the outer system level, and to guide a discussion regarding three critical issues involved in implementation (organizational climate/culture, collaborative relationships, and contracting). Finally, three implementation strategies focused on improving leadership are described in order to provide examples of these issues. [Paper presented at the Stockholm Conference on Behavioral and Social Intervention Research, 11-12 May, 2017.]

The Cultural Exchange Inventory (CEI) is a 15-item instrument designed to measure the process (7 items) and outcomes (8 items) of exchanges of knowledge, attitudes and practices between members of different organisations collaborating in implementing evidence-based practice. We conducted principal axis factor analyses and parallel analyses of data describing exchanges with intermediary organisations, treatment developers, other agencies in the same county, and agencies in other counties of 105 leaders of county youth-serving systems in California and Ohio participating in a randomised controlled trial of the effectiveness of community development teams in scaling up the use of an evidence-based practice for treatment of youth in foster care. The CEI scale demonstrates strong internal consistency and convergent and discriminant validity, and shows potential in understanding the role of cultural exchanges in evidence-based practice implementation.

BackgroundThis study examines sustainment of an EBI implemented in 11 United States service systems across two states, and delivered in 87 counties. The aims are to 1) determine the impact of state and county policies and contracting on EBI provision and sustainment; 2) investigate the role of public, private, and academic relationships and collaboration in long-term EBI sustainment; 3) assess organizational and provider factors that affect EBI reach/penetration, fidelity, and organizational sustainment climate; and 4) integrate findings through a collaborative process involving the investigative team, consultants, and system and community-based organization (CBO) stakeholders in order to further develop and refine a conceptual model of sustainment to guide future research and provide a resource for service systems to prepare for sustainment as the ultimate goal of the implementation process.MethodsA mixed-method prospective and retrospective design will be used. Semi-structured individual and group interviews will be used to collect information regarding influences on EBI sustainment including policies, attitudes, and practices; organizational factors and external policies affecting model implementation; involvement of or collaboration with other stakeholders; and outer- and inner-contextual supports that facilitate ongoing EBI sustainment. Document review (e.g., legislation, executive orders, regulations, monitoring data, annual reports, agendas and meeting minutes) will be used to examine the roles of state, county, and local policies in EBI sustainment. Quantitative measures will be collected via administrative data and web surveys to assess EBI reach/penetration, staff turnover, EBI model fidelity, organizational culture and climate, work attitudes, implementation leadership, sustainment climate, attitudes toward EBIs, program sustainment, and level of institutionalization. Hierarchical linear modeling will be used for quantitative analyses. Qualitative analyses will be tailored to each of the qualitative methods (e.g., document review, interviews). Qualitative and quantitative approaches will be integrated through an inclusive process that values stakeholder perspectives.DiscussionThe study of sustainment is critical to capitalizing on and benefiting from the time and fiscal investments in EBI implementation. Sustainment is also critical to realizing broad public health impact of EBI implementation. The present study takes a comprehensive mixed-method approach to understanding sustainment and refining a conceptual model of sustainment.

BackgroundIn healthcare and allied healthcare settings, leadership that supports effective implementation of evidenced-based practices (EBPs) is a critical concern. However, there are no empirically validated measures to assess implementation leadership. This paper describes the development, factor structure, and initial reliability and convergent and discriminant validity of a very brief measure of implementation leadership: the Implementation Leadership Scale (ILS).MethodsParticipants were 459 mental health clinicians working in 93 different outpatient mental health programs in Southern California, USA. Initial item development was supported as part of a two United States National Institutes of Health (NIH) studies focused on developing implementation leadership training and implementation measure development. Clinician work group/team-level data were randomly assigned to be utilized for an exploratory factor analysis (n = 229; k = 46 teams) or for a confirmatory factor analysis (n = 230; k = 47 teams). The confirmatory factor analysis controlled for the multilevel, nested data structure. Reliability and validity analyses were then conducted with the full sample.ResultsThe exploratory factor analysis resulted in a 12-item scale with four subscales representing proactive leadership, knowledgeable leadership, supportive leadership, and perseverant leadership. Confirmatory factor analysis supported an a priori higher order factor structure with subscales contributing to a single higher order implementation leadership factor. The scale demonstrated excellent internal consistency reliability as well as convergent and discriminant validity.ConclusionsThe ILS is a brief and efficient measure of unit level leadership for EBP implementation. The availability of the ILS will allow researchers to assess strategic leadership for implementation in order to advance understanding of leadership as a predictor of organizational context for implementation. The ILS also holds promise as a tool for leader and organizational development to improve EBP implementation.

BackgroundAlthough the importance of the organizational environment for implementing evidence-based practices (EBP) has been widely recognized, there are limited options for measuring implementation climate in public sector health settings. The goal of this research was to develop and test a measure of EBP implementation climate that would both capture a broad range of issues important for effective EBP implementation and be of practical use to researchers and managers seeking to understand and improve the implementation of EBPs.MethodsParticipants were 630 clinicians working in 128 work groups in 32 US-based mental health agencies. Items to measure climate for EBP implementation were developed based on past literature on implementation climate and other strategic climates and in consultation with experts on the implementation of EBPs in mental health settings. The sample was randomly split at the work group level of analysis; half of the sample was used for exploratory factor analysis (EFA), and the other half was used for confirmatory factor analysis (CFA). The entire sample was utilized for additional analyses assessing the reliability, support for level of aggregation, and construct-based evidence of validity.ResultsThe EFA resulted in a final factor structure of six dimensions for the Implementation Climate Scale (ICS): 1) focus on EBP, 2) educational support for EBP, 3) recognition for EBP, 4) rewards for EBP, 5) selection for EBP, and 6) selection for openness. This structure was supported in the other half of the sample using CFA. Additional analyses supported the reliability and construct-based evidence of validity for the ICS, as well as the aggregation of the measure to the work group level.ConclusionsThe ICS is a very brief (18 item) and pragmatic measure of a strategic climate for EBP implementation. It captures six dimensions of the organizational context that indicate to employees the extent to which their organization prioritizes and values the successful implementation of EBPs. The ICS can be used by researchers to better understand the role of the organizational context on implementation outcomes and by organizations to evaluate their current climate as they consider how to improve the likelihood of implementation success.

Implementation and scale-up of evidence-based practices (EBPs) is often portrayed as involving multiple stakeholders collaborating harmoniously in the service of a shared vision. In practice, however, collaboration is a more complex process that may involve shared and competing interests and agendas, and negotiation. The present study examined the scale-up of an EBP across an entire service system using the Interagency Collaborative Team approach. Participants were key stakeholders in a large-scale county-wide implementation of an EBP to reduce child neglect, SafeCare. Semistructured interviews and/or focus groups were conducted with 54 individuals representing diverse constituents in the service system, followed by an iterative approach to coding and analysis of transcripts. The study was conceptualized using the Exploration, Preparation, Implementation, and Sustainment framework. Although community stakeholders eventually coalesced around implementation of SafeCare, several challenges affected the implementation process. These challenges included differing organizational cultures, strategies, and approaches to collaboration; competing priorities across levels of leadership; power struggles; and role ambiguity. Each of the factors identified influenced how stakeholders approached the EBP implementation process. System-wide scale-up of EBPs involves multiple stakeholders operating in a nexus of differing agendas, priorities, leadership styles, and negotiation strategies. The term collaboration may oversimplify the multifaceted nature of the scale-up process. Implementation efforts should openly acknowledge and consider this nexus when individual stakeholders and organizations enter into EBP implementation through collaborative processes.

We evaluated organizational factors associated with the implementation of contingency management treatment (CMT) and medication-assisted treatment (MAT) in substance abuse treatment (SAT) programs serving racial and ethnic minority communities. Analysis of cross-sectional data collected in 2010-2011 from a random sample of 148 publicly funded SAT programs showed that accepting private insurance was positively associated with CMT and MAT implementation, whereas larger programs were associated with greater implementation of MAT. Supervisorial openness to and expectations about implementing evidence-based practices (EBPs) and attributes for change were strongly associated with CMT, whereas the interactions between openness to EBPs and programs that accept private insurance and that are governed by parent organizations were positively associated with MAT. These external expectations and managerial attitudes supported the implementation of psychosocial and pharmacotherapy treatments in SAT. Implications for improving standards of care in minority communities are discussed.

This study describes the development, field utility, reliability, and validity of the multidimensional Tool for Risk, Interventions, and Outcomes (TRIO) for use in Adult Protective Services (APS). The TRIO is designed to facilitate consistent APS practice and collect data related to multiple dimensions of typical interactions with APS clients, including the investigation and assessment of risks, the provision of APS interventions, and associated health and safety outcomes. Initial tests of the TRIO indicated high field utility, social worker "relevance and buy-in," and inter-rater reliability. TRIO concurrent validity was demonstrated via appropriate patterns of TRIO item differentiation based on the type of observed confirmed abuse or neglect; and predictive validity was demonstrated by prediction of the risk of actual APS recurrence. The TRIO is a promising new tool that can help meet the challenges of providing and documenting effective APS practices and identifying those at high risk for future APS recurrence.

The goal of this study was to examine the relationships of transformational leadership and organizational climate with working alliance, in a children's mental health service system. Using multilevel structural equation modeling, the effect of leadership on working alliance was mediated by organizational climate. These results suggest that supervisors may be able to impact quality of care through improving workplace climate. Organizational factors should be considered in efforts to improve public sector services. Understanding these issues is important for program leaders, mental health service providers, and consumers because they can affect both the way services are delivered and ultimately, clinical outcomes.

ObjectivesIdentifying depression is the first step in provision of treatment across service settings but can be challenging for non-mental health providers. This study examined how caseworker identification of depression among parents and other caregivers during the child welfare investigation or assessment process varies as a function of agency, caseworker, and case characteristics.MethodsData were drawn from the second National Survey of Child and Adolescent Well-Being (NSCAW II), a national probability sample of children referred to U.S. child welfare agencies between February 2008 and April 2009. The study sample comprised 889 parents and other caregivers whose children initially remained at home and whose confidential responses on the World Health Organization Composite International Diagnostic Interview Short Form indicated a major depressive episode within the past 12 months. Weighted logistic regression examined predictors of caseworker identification of caregiver depression at the agency, caseworker, and case levels.ResultsInvestigative caseworkers identified mental health needs of only 38% of caregivers. Caseworkers were more likely to identify caregiver mental health needs when child welfare agency policy specified use of a standardized mental health assessment and when the maltreatment report came from a health or mental health provider versus other sources, such as teachers or family members. Investigative caseloads were negatively associated with identifying depression.ConclusionsStructured mental health assessments may help non-mental health professionals identify mental health needs among vulnerable populations.

ObjectivesWe examined factors associated with readiness to coordinate mental health, public health, and HIV testing among community-based addiction health services programs.MethodsWe analyzed client and program data collected in 2011 from publicly funded addiction health services treatment programs in Los Angeles County, California. We analyzed a sample of 14 379 clients nested in 104 programs by using logistic regressions examining odds of service coordination with mental health and public health providers. We conducted a separate analysis to examine the percentage of clients receiving HIV testing in each program.ResultsMotivational readiness and organizational climate for change were associated with higher odds of coordination with mental health and public health services. Programs with professional accreditation had higher odds of coordinating with mental health services, whereas programs receiving public funding and methadone and residential programs (compared with outpatient) had a higher percentage of clients receiving coordinated HIV testing.ConclusionsThese findings provide an evidentiary base for the role of motivational readiness, organizational climate, and external regulation and funding in improving the capacity of addiction health services programs to develop integrated care.

BackgroundSystem-wide scale up of evidence-based practice (EBP) is a complex process. Yet, few strategic approaches exist to support EBP implementation and sustainment across a service system. Building on the Exploration, Preparation, Implementation, and Sustainment (EPIS) implementation framework, we developed and are testing the Interagency Collaborative Team (ICT) process model to implement an evidence-based child neglect intervention (i.e., SafeCare®) within a large children's service system. The ICT model emphasizes the role of local agency collaborations in creating structural supports for successful implementation.MethodsWe describe the ICT model and present preliminary qualitative results from use of the implementation model in one large scale EBP implementation. Qualitative interviews were conducted to assess challenges in building system, organization, and home visitor collaboration and capacity to implement the EBP. Data collection and analysis centered on EBP implementation issues, as well as the experiences of home visitors under the ICT model.ResultsSix notable issues relating to implementation process emerged from participant interviews, including: (a) initial commitment and collaboration among stakeholders, (b) leadership, (c) communication, (d) practice fit with local context, (e) ongoing negotiation and problem solving, and (f) early successes. These issues highlight strengths and areas for development in the ICT model.ConclusionsUse of the ICT model led to sustained and widespread use of SafeCare in one large county. Although some aspects of the implementation model may benefit from enhancement, qualitative findings suggest that the ICT process generates strong structural supports for implementation and creates conditions in which tensions between EBP structure and local contextual variations can be resolved in ways that support the expansion and maintenance of an EBP while preserving potential for public health benefit.

There has been a growing impetus to bridge the gap between basic science discovery, development of evidence-based practices (EBPs), and the availability and delivery of EBPs in order to improve the public health impact of such practices. To capitalize on factors that support implementation and sustainment of EBPs, it is important to consider that health care is delivered within the outer context of public health systems and the inner context of health care organizations and work groups. Leaders play a key role in determining the nature of system and organizational contexts. This article addresses the role of leadership and actions that leaders can take at and across levels in developing a strategic climate for EBP implementation within the outer (i.e., system) and inner (i.e., organization, work group) contexts of health care. Within the framework of Edgar Schein's "climate embedding mechanisms," we describe strategies that leaders at the system, organization, and work group levels can consider and apply to develop strategic climates that support the implementation and sustainment of EBP in health care and allied health care settings.

Public-sector mental health care providers are at high risk for burnout, which negatively affects not only provider well-being but also the quality of services for clients and the functioning of organizations. This study examines the influence of demographics, work characteristic, and organizational variables on levels of burnout among child and adolescent mental health service providers operating within a public-sector mental health service system. Additionally, given the dearth of research examining differences in burnout levels among mental health subdisciplines (e.g., social work, psychology, marital and family therapy) and mental health programs (e.g., outpatient, day treatment, wraparound, case management), analyses were conducted to compare levels of burnout among multiple mental health disciplines and program types. Surveys were completed by 285 providers across 49 mental health programs in a large urban public mental health system. Variables representing dimensions of organizational climate and transformational leadership accounted for the greatest amount of variance in provider reported burnout. Analyses demonstrated significantly lower levels of depersonalization among wraparound providers compared to traditional case managers. Age was the only demographic variable related to burnout. Additionally, no significant effects were found for provider discipline or for agency tenure and caseload size. Results suggest the need to consider organizational development strategies aimed at creating more functional and less stressful climates and increasing levels of transformational leadership behaviors in order to reduce levels of burnout among clinicians working in public mental health settings for youth and families.

Objective. In recent years, New Mexico has prioritized integrated treatment for cooccurring mental health and substance use disorders within its public behavioral health system. This report describes factors likely to be important when implementing evidence-based practices (EBPs) in community agencies. Methods. Our mixed-method research design consisted of observations, semistructured interviews, and surveys undertaken with employees at 14 agencies at baseline and after 18 months. We developed four-agency typologies based on iterative coding and analysis of observations and interviews. We then examined survey data from employees at the four exemplar agencies to validate qualitative findings. Results. Financial resources and strong leadership impacted agency capacity to train providers and implement EBPs. Quantitative analysis of service provider survey responses from these agencies (N = 38) supported qualitative findings and demonstrated significant mean score differences in leadership, organizational climate, and attitudes toward EBPs in anticipated directions. Conclusion. The availability of strong leadership and financial resources were key components to initial implementation success in this study of community agencies in New Mexico. Reliance only on external funding poses risks for sustainment when demoralizing work climates precipitate employee turnover. Strong agency leadership does not always compensate for deficient financial resources in vulnerable communities.

ObjectiveYouth substance use exacts costly consequences for a variety of important health outcomes. We examined and compared prevalence rates and a common set of psychosocial factors of lifetime and current substance use among child welfare-involved youths and community youths from two nationally representative data sets.MethodUsing the National Survey of Child and Adolescent Well-Being and the National Longitudinal Study of Adolescent Health, we compared prevalence rates and conducted logistic regression models for eight binary outcome measures of substance use: lifetime and current use of alcohol, inhalant, marijuana, and other illicit drugs to examine predictors of substance involvement in the two samples.ResultsSubstance use prevalence was higher among child welfare-involved youths than community youths for lifetime marijuana use, lifetime and current inhalant use, and lifetime and current other illicit drug use. Among both child welfare-involved and community youths, delinquency was the factor most strongly associated with all lifetime substance use outcomes. Notably, family structure and parental closeness were important protective factors against current substance use among child welfare-involved youths. For community youths, poorer emotional health was the strongest indicator of current substance use.ConclusionsSubstance use among all adolescents is a critical public health concern. Given the heightened vulnerability of child welfare-involved youths, it is particularly important to focus prevention and early intervention efforts on this population. Further research should explore additional factors associated with substance use among these youths so that child welfare and behavioral health systems may jointly target prevention and intervention efforts.

Objective: We examine how frontline workers and supervisors delivering a research-supported intervention (RSI) to reduce child neglect negotiated system-related challenges, the pragmatics of RSI implementation, and their professional identities and relationships with clients. Methods: We conducted semi-structured interviews, small group discussions, and focus groups with frontline workers and supervisors in one large county over two time periods. We used iterative coding to analyze qualitative data. Results: Frontline workers navigated several aspects of RSI implementation and sustainment: (1) contract requirements and information dissemination, (2) fidelity, (3) competing demands and crises, (4) structure versus creativity, and (5) relationships with clients. Conclusions: Workers dynamically negotiated multiple system- and provider-level (or outer- and inner-contextual) demands influencing RSI provision for clients with complex service needs. Results affirm the need to attend to the unintended consequences of implementing new contract, reimbursement, and other system or organizational processes and to address the "committed work" supporting RSI delivery.

ObjectiveAlthough there has been a dramatic increase in the number of evidence-based practices (EBPs) to improve child and adolescent mental health, the poor uptake of these EBPs has led to investigations of factors related to their successful dissemination and implementation. The purpose of this systematic review was to identify key findings from empirical studies examining the dissemination and implementation of EBPs for child and adolescent mental health.MethodOf 14,247 citations initially identified, 73 articles drawn from 44 studies met inclusion criteria. The articles were classified by implementation phase (exploration, preparation, implementation, and sustainment) and specific implementation factors examined. These factors were divided into outer (i.e., system level) and inner (i.e., organizational level) contexts.ResultsFew studies used true experimental designs; most were observational. Of the many inner context factors that were examined in these studies (e.g., provider characteristics, organizational resources, leadership), fidelity monitoring and supervision had the strongest empirical evidence. Albeit the focus of fewer studies, implementation interventions focused on improving organizational climate and culture were associated with better intervention sustainment as well as child and adolescent outcomes. Outer contextual factors such as training and use of specific technologies to support intervention use were also important in facilitating the implementation process.ConclusionsThe further development and testing of dissemination and implementation strategies is needed to more efficiently move EBPs into usual care.

Abstract Background The Implementation Research Institute (IRI) provides two years of training in mental health implementation science for 10 new fellows each year. The IRI is supported by a National Institute of Mental Health (NIMH) R25 grant and the Department of Veterans Affairs (VA). Fellows attend two annual week-long trainings at Washington University in St. Louis. Training is provided through a rigorous curriculum, local and national mentoring, a ‘learning site visit’ to a federally funded implementation research project, pilot research, and grant writing. Methods This paper describes the rationale, components, outcomes to date, and participant experiences with IRI. Results IRI outcomes include 31 newly trained implementation researchers, their new grant proposals, contributions to other national dissemination and implementation research training, and publications in implementation science authored by the Core Faculty and fellows. Former fellows have obtained independent research funding in implementation science and are beginning to serve as mentors for more junior investigators. Conclusions Based on the number of implementation research grant proposals and papers produced by fellows to date, the IRI is proving successful in preparing new researchers who can inform the process of making evidence-based mental healthcare more available through real-world settings of care and who are advancing the field of implementation science.

Abstract Background Evidence-based treatments (EBTs) are not widely available in community mental health settings. In response to the call for implementation of evidence-based treatments in the United States, states and counties have mandated behavioral health reform through policies and other initiatives. Evaluations of the impact of these policies on implementation are rare. A systems transformation about to occur in Philadelphia, Pennsylvania, offers an important opportunity to prospectively study implementation in response to a policy mandate. Methods/design Using a prospective sequential mixed-methods design, with observations at multiple points in time, we will investigate the responses of staff from 30 community mental health clinics to a policy from the Department of Behavioral Health encouraging and incentivizing providers to implement evidence-based treatments to treat youth with mental health problems. Study participants will be 30 executive directors, 30 clinical directors, and 240 therapists. Data will be collected prior to the policy implementation, and then at two and four years following policy implementation. Quantitative data will include measures of intervention implementation and potential moderators of implementation (i.e., organizational- and leader-level variables) and will be collected from executive directors, clinical directors, and therapists. Measures include self-reported therapist fidelity to evidence-based treatment techniques as measured by the Therapist Procedures Checklist-Revised, organizational variables as measured by the Organizational Social Context Measurement System and the Implementation Climate Assessment, leader variables as measured by the Multifactor Leadership Questionnaire, attitudes towards EBTs as measured by the Evidence-Based Practice Attitude Scale, and knowledge of EBTs as measured by the Knowledge of Evidence- Based Services Questionnaire. Qualitative data will include semi-structured interviews with a subset of the sample to assess the implementation experience of high-, average-, and low-performing agencies. Mixed methods will be integrated through comparing and contrasting results from the two methods for each of the primary hypotheses in this study. Discussion Findings from the proposed research will inform both future policy mandates around implementation and the support required for the success of these policies, with the ultimate goal of improving the quality of treatment provided to youth in the public sector.

UnlabelledABSTBACKGROUND: Evidence-based practices have not been routinely adopted in community mental health organizations despite the support of scientific evidence and in some cases even legislative or regulatory action. We examined the association of clinician attitudes toward evidence-based practice with organizational culture, climate, and other characteristics in a nationally representative sample of mental health organizations in the United States.MethodsIn-person, group-administered surveys were conducted with a sample of 1,112 mental health service providers in a nationwide sample of 100 mental health service institutions in 26 states in the United States. The study examines these associations with a two-level Hierarchical Linear Modeling (HLM) analysis of responses to the Evidence-Based Practice Attitude Scale (EBPAS) at the individual clinician level as a function of the Organizational Social Context (OSC) measure at the organizational level, controlling for other organization and clinician characteristics.ResultsWe found that more proficient organizational cultures and more engaged and less stressful organizational climates were associated with positive clinician attitudes toward adopting evidence-based practice.ConclusionsThe findings suggest that organizational intervention strategies for improving the organizational social context of mental health services may contribute to the success of evidence-based practice dissemination and implementation efforts by influencing clinician attitudes.

AbstractBackgroundStudies of implementation of efficacious human immunodeficiency virus (HIV) prevention interventions are rare, especially in resource-poor settings, but important, because they have the potential to increase the impact of interventions by improving uptake and sustainability. Few studies have focused on provider and organizational factors that may influence uptake and fidelity to core intervention components. Using a hybrid design, we will study the implementation of an efficacious intervention to reduce sexually transmitted infections (STIs) among female sex workers (FSWs) in 12 cities across Mexico. Our protocol will test a 'trainthe- trainer' implementation model for transporting the Mujer Segura (Healthy Woman) intervention into community-based organizations (CBOs).MethodsWe have partnered with Mexican Foundation for Family Planning (Mexfam), a nongovernmental organization that has CBOs throughout Mexico. At each CBO, trained ethnographers will survey CBO staff on characteristics of their organization and on their attitudes toward their CBO and toward the implementation of evidence-based interventions (EBIs). Then, after CBO staff recruit a sample of 80 eligible FSWs and deliver a standardcare, didactic intervention to 40 women randomly selected from that pool, a Mexfam staff person will be trained in the Mujer Segura intervention and will then train other counselors to deliver Mujer Segura to the 40 remaining participating FSWs. FSW participants will receive a baseline behavioral assessment and be tested for HIV and STIs (syphilis, gonorrhea, and chlamydia); they will be reassessed at six months post-intervention to measure for possible intervention effects. At the same time, both qualitative and quantitative data will be collected on the implementation process, including measures of counselors' fidelity to the intervention model. After data collection at each CBO is complete, the relative efficacy of the Mujer Segura intervention will be analyzed, and across CBOs, correlations will be examined between individual and organizational provider characteristics and intervention efficacy.DiscussionThis cooperative, bi-national research study will provide critical insights into barriers and facilitating factors associated with implementing interventions in CBOs using the 'train the trainer' model. Our work builds on similar scale-up strategies that have been effective in the United States. This study has the potential to increase our knowledge of the generalizability of such strategies across health issues, national contexts, and organizational contexts. Trial registration NCT01465607

Abstract Background Currently, 1 out of 88 children are diagnosed with an autism spectrum disorder (ASD), and the estimated cost for treatment services is $126 billion annually. Typically, ASD community providers (ASD-CPs) provide services to children with any severity of ASD symptoms using a combination of various treatment paradigms, some with an evidence-base and some without. When evidence-based practices (EBPs) are successfully implemented by ASD-CPs, they can result in positive outcomes. Despite this promise, EBPs are often implemented unsuccessfully and other treatments used by ASD-CPs lack supportive evidence, especially for school-age children with ASD. While it is not well understood why ASD-CPs are not implementing EBPs, organizational and individual characteristics likely play a role. As a response to this need and to improve the lives of children with ASD and their families, this study aims to develop and test the feasibility and acceptability of the Autism Model of Implementation (AMI) to support the implementation of EBPs by ASD-CPs. Methods/design An academic-community collaboration developed to partner with ASD-CPs will facilitate the development of the AMI, a process specifically for use by ASD community-based agencies. Using a mixed methods approach, the project will assess agency and individual factors likely to facilitate or hinder implementing EBPs in this context; develop the AMI to address identified barriers and facilitators; and pilot test the AMI to examine its feasibility and acceptability using a specific EBP to treat anxiety disorders in school-age children with ASD. Discussion The AMI will represent a data-informed approach to facilitate implementation of EBPs by ASD-CPs by providing an implementation model specifically developed for this context. This study is designed to address the real-world implications of EBP implementation in ASD community-based agencies. In doing so, the AMI will help to provide children with ASD the best and most effective services in their own community. Moreover, the proposed study will positively impact the field of implementation science by providing an empirically supported and tested model of implementation to facilitate the identification, adoption, and use of EBPs.

AbstractBackgroundAdaptations are often made to evidence-based practices (EBPs) by systems, organizations, and/or service providers in the implementation process. The degree to which core elements of an EBP can be maintained while allowing for local adaptation is unclear. In addition, adaptations may also be needed at the system, policy, or organizational levels to facilitate EBP implementation and sustainment. This paper describes a study of the feasibility and acceptability of an implementation approach, the Dynamic Adaptation Process (DAP), designed to allow for EBP adaptation and system and organizational adaptations in a planned and considered, rather than ad hoc, way. The DAP involves identifying core elements and adaptable characteristics of an EBP, then supporting implementation with specific training on allowable adaptations to the model, fidelity monitoring and support, and identifying the need for and solutions to system and organizational adaptations. In addition, this study addresses a secondary concern, that of improving EBP model fidelity assessment and feedback in real-world settings.MethodsThis project examines the feasibility, acceptability, and utility of the DAP; tests the degree to which fidelity can be maintained using the DAP compared to implementation as usual (IAU); and examines the feasibility of using automated phone or internet-enabled, computer-based technology to assess intervention fidelity and client satisfaction. The study design incorporates mixed methods in order to describe processes and factors associated with variations in both how the DAP itself is implemented and how the DAP impacts fidelity, drift, and adaptation. The DAP model is to be examined by assigning six regions in California (USA) to either the DAP (n = 3) or IAU (n = 3) to implement an EBP to prevent child neglect.DiscussionThe DAP represents a data-informed, collaborative, multiple stakeholder approach to maintain intervention fidelity during the implementation of EBPs in the field by providing support for intervention, system, and organizational adaptation and intervention fidelity to meet local needs. This study is designed to address the real-world implications of EBP implementation in public sector service systems and is relevant for national, state, and local service systems and organizations.

Abstract Background The goal of this study was to assess potential differences between administrators/policymakers and those involved in direct practice regarding factors believed to be barriers or facilitating factors to evidence-based practice (EBP) implementation in a large public mental health service system in the United States. Methods Participants included mental health system county officials, agency directors, program managers, clinical staff, administrative staff, and consumers. As part of concept mapping procedures, brainstorming groups were conducted with each target group to identify specific factors believed to be barriers or facilitating factors to EBP implementation in a large public mental health system. Statements were sorted by similarity and rated by each participant in regard to their perceived importance and changeability. Multidimensional scaling, cluster analysis, descriptive statistics and t-tests were used to analyze the data. Results A total of 105 statements were distilled into 14 clusters using concept-mapping procedures. Perceptions of importance of factors affecting EBP implementation varied between the two groups, with those involved in direct practice assigning significantly higher ratings to the importance of Clinical Perceptions and the impact of EBP implementation on clinical practice. Consistent with previous studies, financial concerns (costs, funding) were rated among the most important and least likely to change by both groups. Conclusions EBP implementation is a complex process, and different stakeholders may hold different opinions regarding the relative importance of the impact of EBP implementation. Implementation efforts must include input from stakeholders at multiple levels to bring divergent and convergent perspectives to light.

Abstract Background A variety of forces are now shaping a passionate debate regarding the optimal approaches to improving the quality of substance abuse services for American Indian and Alaska Native communities. While there have been some highly successful efforts to meld the traditions of American Indian and Alaska Native tribes with that of 12-step approaches, some American Indian and Alaska Natives remain profoundly uncomfortable with the dominance of this Euro-American approach to substance abuse treatment in their communities. This longstanding tension has now been complicated by the emergence of a number of evidence-based treatments that, while holding promise for improving treatment for American Indian and Alaska Natives with substance use problems, may conflict with both American Indian and Alaska Native and 12-step healing traditions. Discussion We convened a panel of experts from American Indian and Alaska Native communities, substance abuse treatment programs serving these communities, and researchers to discuss and analyze these controversies in preparation for a national study of American Indian and Alaska Native substance abuse services. While the panel identified programs that are using evidence-based treatments, members still voiced concerns about the cultural appropriateness of many evidence-based treatments as well as the lack of guidance on how to adapt them for use with American Indians and Alaska Natives. The panel concluded that the efforts of federal and state policymakers to promote the use of evidence-based treatments are further complicating an already-contentious debate within American Indian and Alaska Native communities on how to provide effective substance abuse services. This external pressure to utilize evidence-based treatments is particularly problematic given American Indian and Alaska Native communities' concerns about protecting their sovereign status. Summary Broadening this conversation beyond its primary focus on the use of evidence-based treatments to other salient issues such as building the necessary research evidence (including incorporating American Indian and Alaska Native cultural values into clinical practice) and developing the human and infrastructural resources to support the use of this evidence may be far more effective for advancing efforts to improve substance abuse services for American Indian and Alaska Native communities.

The goal of this study was to examine the degree to which youths and caregivers attend to different factors in evaluating their experiences with mental health programs. Youth (n = 251) receiving mental health services at community agencies and their caregivers (n = 275) were asked open-ended questions regarding the positive and negative aspects of the services. Qualitative analyses revealed some agreement but also divergence between youth and caregivers regarding the criteria by which services were evaluated and aspects of services that were valued most highly. Youths’ positive comments primarily focused on treatment outcomes while caregivers focused more on characteristics of the program and provider. Youths’ negative comments reflected dissatisfaction with the program, provider, and types of services offered while caregivers expressed dissatisfaction mainly with program characteristics. Results support the importance of assessing both youth and caregivers in attempts to understand the factors used by consumers to evaluate youth mental health services.

BackgroundThe goal of this study is to extend research on evidence-based practice (EBP) implementation by examining the impact of organizational type (public versus private) and organizational support for EBP on provider attitudes toward EBP and EBP use. Both organization theory and theory of innovation uptake and individual adoption of EBP guide the approach and analyses in this study. We anticipated that private sector organizations would provide greater levels of organizational support for EBPs leading to more positive provider attitudes towards EBPs and EBP use. We also expected attitudes toward EBPs to mediate the association of organizational support and EBP use.MethodsParticipants were mental health service providers from 17 communities in 16 states in the United States (n = 170). Path analyses were conducted to compare three theoretical models of the impact of organization type on organizational support for EBP and of organizational support on provider attitudes toward EBP and EBP use.ResultsConsistent with our predictions, private agencies provided greater support for EBP implementation, and staff working for private agencies reported more positive attitudes toward adopting EBPs. Organizational support for EBP partially mediated the association of organization type on provider attitudes toward EBP. Organizational support was significantly positively associated with attitudes toward EBP and EBP use in practice.ConclusionThis study offers further support for the importance of organizational context as an influence on organizational support for EBP and provider attitudes toward adopting EBP. The study demonstrates the role organizational support in provider use of EBP in practice. This study also suggests that organizational support for innovation is a malleable factor in supporting use of EBP. Greater attention should be paid to organizational influences that can facilitate the dissemination and implementation of EBPs in community settings.