Search

This article describes (a) key elements of a high-quality technical assistance (TA) system; (b) the operationalization of a high-quality TA system (Getting To Outcomes-Technical Assistance; GTO-TA) being implemented in a training and TA center (TTAC) interested in transforming its support services to include an evidence-informed approach to TA; and (c) key lessons learned in successfully transitioning from "TA-as-usual" to an evidence-informed TA system. GTO-TA is one operationalization of a systematic, proactive, evidence-informed approach to TA. GTO-TA includes best practices and core elements for a comprehensive TA system; it aims to increase the readiness (reduce barriers and increase facilitators) of an organization to deliver an innovation (program, policy, practice, process new to an organization) with quality. We describe the collaboration between the Wandersman Center and the Geographic Health Equity Alliance team to co-design and implement the GTO-TA system. Data from surveys, interviews, and consensus conversations led to important lessons learned, which are applicable to other TTACs seeking to develop a more proactive and systematic approach to TA. Lessons include: changing internal operations to facilitate TA providers making necessary changes in providing TA and understanding the relative advantage perceptions about a new TA system that influence adoption and must be considered., Competing Interests: Declaration of Conflicting InterestsThe author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Hundreds of millions of dollars are spent each year by U.S. federal agencies for training and technical assistance (TTA) to be delivered by training and technical assistance centers (TTACs) to "delivery system organizations" (e.g., federally qualified health centers, state departments of health, substance abuse treatment centers, schools, and healthcare organizations). TTACs are often requested to help delivery system organizations implement evidence-based interventions. Yet, counterintuitively, TTACs are rarely required to use evidence-based approaches when supporting delivery systems (in the use of evidence-based programs). In fact, evaluations of TTAC activities tend to be minimal; evaluation of technical assistance (if conducted at all) often emphasizes outputs (number of encounters), satisfaction, and self-reports of knowledge gained-more substantive outcomes are not evaluated. The gap between (a) the volume of TTA services being funded and provided and (b) the evaluation of those services is immense and has the potential to be costly. The basic question to be answered is: how effective are TTA services? This article introduces the special issue on Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers. The special issue promotes 1) knowledge of the state of the art of evaluation of TTACs and 2) advances in what to evaluate in TTA. A major goal of the issue is to improve the science and practice of implementation support, particularly in the areas of TTA., Competing Interests: Declaration of Conflicting InterestsThe author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

While the Department of Defense (DoD) has given increased attention and priority to preventing sexual assault and sexual harassment (SA/SH), it remains a problem. To build its prevention capacity, DoD piloted Getting To Outcomes ® (GTO ® ) from 2019 to 2022 at 10 military installations. GTO is an evidence-based planning and implementation support that has been used in many civilian contexts but has only recently been adapted for military SA/SH. The purpose of this study was to describe GTO use, identify its benefits and challenges, and discuss lessons the GTO effort yielded for prevention more broadly using a framework of organizational and program-level capacities needed for successful prevention in the military context, called the Prevention Evaluation Framework (PEF). GTO was piloted with 10 military installations ("sites") representing all Military Services, plus the Coast Guard and National Guard. GTO is comprised of a written guide, training, and ongoing coaching. The pilot's goal was for each site to use GTO to implement a SA/SH prevention program twice. Participants from each site were interviewed and data was collected on GTO steps completed, whether GTO spurred new evaluation activities and collaborations, and the degree of leadership support for GTO. Most sites completed all GTO steps at least once. Interviews showed that DoD participants believe GTO improved prevention understanding, planning, and evaluation capacity; strengthened confidence in chosen programs; and helped sites tailor programs to the military context. Barriers were the complexity of GTO, DoD personnel turnover, and the disruption that the COVID pandemic caused in sexual assault prevention program delivery. Many respondents were unsure if they would continue all of GTO after the coaching ended, but many believed they would continue at least some parts. According to the PEF, the GTO pilot revealed several additional prevention system gaps (e.g., need for leadership support) and changes needed to GTO (e.g., stronger leader and champion engagement), to support quality prevention. The military and other large organizations will need to focus on these issues to ensure prevention implementation and evaluation are conducted with quality., (© 2023. © RAND Corporation.)

Implementing evidence-based interventions remains slow in federally qualified health centers (FQHCs). The purpose of this study is to qualitatively examine the R = MC 2 (Readiness = motivation × innovation specific capacity × general capacity) heuristic subcomponents in the context of implementing general and colorectal cancer screening (CRCS)-related practice changes in FQHCs. We conducted 17 interviews with FQHC employees to examine (1) experiences with successful or unsuccessful practice change efforts, (2) using approaches to promote CRCS, and (3) opinions about R = MC 2 subcomponents. We conducted a rapid qualitative analysis to examine the frequency, depth, and spontaneity of subcomponents. Priority, compatibility, observability (motivation), intra- and interorganizational relationships (innovation-specific capacity), and organizational structure and resource utilization (general capacity) emerged as highly relevant. For example, organizational structure was described as related to an organization's open communication during meetings to help with scheduling procedures. The results contribute to understanding organizational readiness in the FQHC setting and can be helpful when identifying and prioritizing barriers and facilitators that affect implementation., (© 2023 Wiley Periodicals LLC.)

Technical assistance (TA) is a major capacity building strategy used by the government sector to promote health outcomes in the United States. However, there is minimal literature about how to develop TA provider capacities. This article describes a systematic and proactive approach for developing TA provider capacity, referred to as Technical Assistance for Technical Assistance Providers (TAFTAP), which draws on three implementation science frameworks (Interactive Systems Framework for Dissemination and Implementation, Getting To Outcomes, and R = MC 2 ). We present an application of TAFTAP within a federal agency providing a readiness-informed TA approach to health departments of states, territories, and tribal areas implementing comprehensive tobacco prevention control programs. Pilot data suggest that TAFTAP is a promising approach for improving the quality of TA delivery. At the end of the 2-year project period, TAFTAP recipients provided generally positive qualitative feedback about the support they received. They chose to sustain the readiness-informed TA by incorporating it into a future funding announcement. Downstream state-level TA grantee recipients reported positive outcomes (e.g., accelerated progress, enjoying more one-on-one time with TA providers) from receiving the TA innovation from TAFTAP recipients. We suggest that funding agencies and training and TA centers consider this approach to bolster the capacity and motivation of TA providers for downstream benefit to health and human services staff and their clients. Practical steps for employing TAFTAP to advance health outcomes are included in this article.

While the literature strongly supports the need for sustainability of evidence-based interventions (EBIs), we present a review of the literature that indicates only three articles discuss a health-focused sustainability strategy. The aims of our sustainability readiness strategy (SRS) are to increase infrastructure capacity and EBI advocacy to impact the level of sustainability readiness. In this article, we describe the development of an evidence-informed promising practice sustainability readiness strategy (SRS) with three evidence-based components. This strategy: 1) is based on an adaptation of the Getting To Outcomes® (GTO) evidence-based implementation process, 2) includes a logic model with documented evidence of the connection between targeted readiness factors and sustainability outcomes, and 3) describes resources considered necessary to support implementation of the readiness strategy, namely a step-by-step Toolkit, Excel™ Tools, webinar coaching and evaluation guides, and a coaching and evaluation training guide. The national SRS survey results are presented. Lessons learned and future dissemination and implementation plans are described., (Copyright © 2023 Elsevier Ltd. All rights reserved.)

Background: Organizational readiness is a key factor for successful implementation of evidence-based interventions (EBIs), but a valid and reliable measure to assess readiness across contexts and settings is needed. The R = MC 2 heuristic posits that organizational readiness stems from an organization's motivation, capacity to implement a specific innovation, and its general capacity. This paper describes a process used to examine the face and content validity of items in a readiness survey developed to assess organizational readiness (based on R = MC 2 ) among federally qualified health centers (FQHC) implementing colorectal cancer screening (CRCS) EBIs., Methods: We conducted 20 cognitive interviews with FQHC staff (clinical and non-clinical) in South Carolina and Texas. Participants were provided a subset of items from the readiness survey to review. A semi-structured interview guide was developed to elicit feedback from participants using "think aloud" and probing techniques. Participants were recruited using a purposive sampling approach and interviews were conducted virtually using Zoom and WebEx. Participants were asked 1) about the relevancy of items, 2) how they interpreted the meaning of items or specific terms, 3) to identify items that were difficult to understand, and 4) how items could be improved. Interviews were transcribed verbatim and coded in ATLAS.ti. Findings were used to revise the readiness survey., Results: Key recommendations included reducing the survey length and removing redundant or difficult to understand items. Additionally, participants recommended using consistent terms throughout (e.g., other units/teams vs. departments) the survey and changing pronouns (e.g., people, we) to be more specific (e.g., leadership, staff). Moreover, participants recommended specifying ambiguous terms (e.g., define what "better" means)., Conclusion: Use of cognitive interviews allowed for an engaged process to refine an existing measure of readiness. The improved and finalized readiness survey can be used to support and improve implementation of CRCS EBIs in the clinic setting and thus reduce the cancer burden and cancer-related health disparities., (© 2023. The Author(s).)

Improving health literacy is a national public health priority. Given the context of the COVID-19 pandemic, it is even more critical for health and medical information to be clear and understandable for patients and their families. Clinic-based programs to improve health literacy need to be pragmatic, feasible, and helpful for the implementing clinic and patients. This paper describes the development, implementation, and evaluation of a pragmatic, clinic-based health literacy intervention in a safety-net clinic that serves uninsured and indigent patients. Study methods are guided by a previous pilot study and components recommended for pragmatic interventions. An electronic readiness assessment was distributed to out-patient clinics affiliated with a statewide hospital association. The AskMe3 tool was used for the intervention as it is evidence informed and relatively easy to implement. Implementation included ongoing dialogue between the clinic and the academic research team. Within the implementing clinic, data collected from patients via verbally administered questionnaires was analyzed using descriptive statistics and chi-squares. Interview data collected from the clinic director was analyzed qualitatively for themes. The implementing clinic had some of the lowest average scores of the 34 clinics who participated in the initial readiness assessment. Despite this, they were able to successfully implement the health literacy intervention during a global pandemic. Eighty-eight participants completed patient questionnaires at this clinic. Most patients (96%) agreed the AskMe3 questions helped them talk with the doctor or nurse at their current appointment. Most (99%) also perceived the AskMe3 tool to be very helpful when used in a clinical setting. The clinic director offered that the staff initially thought the intervention would be difficult to implement. However, implementation by clinic volunteers with encouragement and prioritization of health literacy by the clinic director contributed to success. When considering interventions for clinical settings, a pragmatic approach can help with selection and implementation of a program that fits with the realities on the ground. Further, frequent technical assistance can help resolve implementation barriers. Interventions utilizing tools such as AskMe3, because of their simplicity, allow creative solutions to capacity issues for clinics who see a need for health literacy improvements., Competing Interests: Author DFe was employed by Chester County Literacy Council. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2022 Macauda, Arent, Sakhuja, Yelton, Noblet, Fedrick, Zona, New, Isenhower, Wandersman and Friedman.)

Schools and research partners are increasingly implementing complex, multicomponent interventions and school-wide frameworks to better meet students' social, emotional, behavioral, and academic needs; however, in the research and real-world contexts, implementation is often fraught with many challenges and barriers to success. This study explores implementation barriers encountered during a randomized controlled trial testing effects of one complex intervention strategy-the Interconnected Systems Framework-from the lens of a practical model for conceptualizing organizational readiness-the Interactive Systems Framework for Dissemination and Implementation. Implementation of the Interconnected Systems Framework was explored via focus group and key informant interviews with school and mental health professionals, and research team members responsible for implementing the intervention in randomly assigned study schools. Results from inductive thematic analysis of verbatim transcripts identified three primary implementation challenges: staff turnover, inadequate leadership buy-in, and insufficient time for training/planning. Each challenge is explored from interview participants' perspectives and the extant literature, then connected to recommendations from implementation science to help others avoid similar challenges in their well-intentioned efforts to address the mounting concern for students' wellbeing., (© 2022 Wiley Periodicals LLC.)

Background: Although the benefits of evidence-based practices (EBPs) for advancing community outcomes are well-recognized, challenges with the uptake of EBPs are considerable. Technical assistance (TA) is a core capacity building strategy that has been widely used to support EBP implementation and other community development and improvement efforts. Yet despite growing reliance on TA, no reviews have systematically examined the evaluation of TA across varying implementation contexts and capacity building aims. This study draws on two decades of peer-reviewed publications to summarize the evidence on the evaluation and effectiveness of TA., Methods: Guided by Arksey and O'Malley's six-stage methodological framework, we used a scoping review methodology to map research on TA evaluation. We included peer-reviewed articles published in English between 2000 and 2020. Our search involved five databases: Business Source Complete, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Education Resources Information Center (ERIC), PsycInfo, and PubMed., Results: A total of 125 evaluation research studies met the study criteria. Findings indicate that publications have increased over the last two decades, signaling a growth in the recognition and reporting of TA. Technical assistance is being implemented across diverse settings, often serving socially vulnerable and under-resourced populations. Most evaluation research studies involved summative evaluations, with TA outcomes mostly reported at the organizational level. Only 5% of the studies examined sustainability of TA outcomes. This review also demonstrates that there is a lack of consistent standards regarding the definition of TA and the level of reporting across relevant TA evaluation categories (e.g., cadence of contact, and directionality)., Conclusions: Advances in the science and practice of TA hinge on understanding what aspects of TA are effective and when, how, and for whom these aspects of TA are effective. Addressing these core questions requires (i) a standard definition for TA; (ii) more robust and rigorous evaluation research designs that involve comparison groups and assessment of direct, indirect, and longitudinal outcomes; (iii) increased use of reliable and objective TA measures; and (iv) development of reporting standards. We view this scoping review as a foundation for improving the state of the science and practice of evaluating TA., (© 2022. The Author(s).)

Organizational readiness is essential for high-quality implementation of innovations (programs, policies, practices, or processes). The R = MC 2 heuristic describes three readiness components necessary for implementation-the general functioning of the organization (general capacities), the ability to deliver a particular innovation (innovation-specific capacities), and the motivation to implement the innovation. In this article, we describe how we used the Readiness Building System (RBS) for assessing, prioritizing, and improving readiness and Implementation Mapping (IM) , a systematic process for planning implementation strategies, to build organizational readiness for implementation of sexual assault prevention evidence-based interventions (EBIs). While RBS provides an overarching approach for assessing and prioritizing readiness constructs (according to the R = MC 2 heuristic; Readiness = Motivation x general Capacity × innovation specific Capacity ), it does not provide specific guidance on the development and/or selection and tailoring of strategies to improve readiness. We used the five IM tasks to identify and prioritize specific readiness goals and develop readiness-building strategies to improve subcomponents described in the R = MC 2 heuristic. This article illustrates how IM can be used synergistically with the RBS in applied contexts to plan implementation strategies that will improve organizational readiness and implementation outcomes. Specifically, we provide an example of using these two frameworks as part of the process of building organizational readiness for implementation of sexual assault prevention EBIs., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2022 Watson, Hernandez, Kolodny-Goetz, Walker, Lamont, Imm, Wandersman and Fernandez.)

Background: The school is a key setting for the provision of mental health services to children, particularly those underserved through traditional service delivery systems. School-wide Positive Behavioral Interventions and Supports (PBIS) is a tiered approach to service delivery based on the public health model that schools use to implement universal (Tier 1) supports to improve school climate and safety. As our prior research has demonstrated, PBIS is a useful vehicle for implementing mental and behavioral health evidence-based practices (EBPs) at Tier 2 for children with, or at risk for, mental health disorders. Very little research has been conducted regarding the use of mental health EBPs at Tier 2 or how to sustain implementation in schools., Methods/design: The main aim of the study is to compare fidelity, penetration, cost-effectiveness, and student outcomes of Tier 2 mental health interventions across 2 sustainment approaches for school implementers in 12 K-8 schools. The study uses a 2-arm, cluster randomized controlled trial design. The two arms are: (a) Preparing for Sustainment (PS)-a consultation strategy implemented by school district coaches who receive support from external consultants, and (b) Sustainment as Usual (SAU)-a consultation strategy implemented by school district coaches alone. Participants will be 60 implementers and 360 students at risk for externalizing and anxiety disorders. The interventions implemented by school personnel are: Coping Power Program (CPP) for externalizing disorders, CBT for Anxiety Treatment in Schools (CATS) for anxiety disorders, and Check-in/Check-out (CICO) for externalizing and internalizing disorders. The Interactive Systems Framework (ISF) for Dissemination and Implementation guides the training and support procedures for implementers., Discussion: We expect that this study will result in a feasible, effective, and cost-effective strategy for sustaining mental health EBPs that is embedded within a multi-tiered system of support. Results from this study conducted in a large urban school district would likely generalize to other large, urban districts and have an impact on population-level child mental health. Trial registration ClinicalTrials.gov identifier number NCT04869657. Registered May 3, 2021., (© 2022. The Author(s).)

Sexual violence affects millions of Americans, and approximately one out of every three women and one out of every four men have experienced sexual violence during their lifetime. While prevention efforts have focused on implementing specific programmatic approaches, there has been relatively little focus on developing comprehensive and effective approaches to reduce sexual assault prevention across an organization. This study describes the development of the Prevention Evaluation Framework, an assessment targeting organizational best practices for comprehensive sexual assault prevention across multiple domains including human resources, collaborative relationships and infrastructure, use of evidence-informed approaches, quality implementation and continuous evaluation of programs/policies. Using the structured RAND/University of California, Los Angeles appropriateness method to develop the assessment, we conducted a literature review and solicited expert feedback about what a comprehensive organizational approach to sexual assault prevention should entail. We then pilot tested the assessment with 3 United States military service academies; and continued to improve and adapt the assessment to a range of organizations with input from 6 Department of Defense headquarters organizations, and 9 universities across the country. Given the nascent state of the evidence about what makes an effective organizational approach to sexual assault prevention, the assessment reflects one way of promoting quality in this evolving field. The consistency between the experts' ratings and the literature, and the relevance of the items across organizations suggest that the assessment provides important guidance to inform the development of comprehensive organizational approaches to sexual assault prevention and to the evaluation of ongoing efforts., Competing Interests: The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (© 2022 RAND Corporation.)

Background: Thailand has a rapidly aging population yet lacks evidence for effective and scalable evidence-based psychosocial interventions to support persons living with dementia and their family caregivers. In this study of a culturally adapted and evidence-based clinical program (Reducing Disabilities in Alzheimer's Disease [RDAD]), designed to reduce behavioral and psychological symptoms of dementia in older adults, the authors test the hypothesis that an implementation support strategy, Getting To Outcomes (GTO), would produce better implementation and clinical outcomes compared with usual implementation of RDAD in Thailand., Methods: The study uses a hybrid type III cluster-randomized design to compare eight geographical districts that receive training on both implementing the RDAD clinical intervention and on GTO implementation support strategies (intervention arm) with eight other districts that receive the same RDAD training but without training in GTO implementation support strategies (control arm). GTO is an evidence-based intervention designed to support implementers to better plan, implement, and evaluate innovative intervention programs in a novel setting. Primary outcomes, including implementation and clinical outcomes, will be assessed at baseline, month 3 (posttreatment), and month 6 (3-month follow-up)., Results: The research team anticipates that there will be significantly more improvements in the delivery of the RDAD intervention program in the experimental group than in the control group., Next Steps: If clinical trial findings are positive, the authors plan to replicate and scale up the proposed implementation science approach across Thailand to enhance and expand mental health services for older adults with dementia.

Effective implementation of evidence-based interventions is a persistent challenge across community settings. Organizational readiness - or, the motivation and collective capacity of an entity to adopt and sustain an innovation - is important to facilitate implementation. Drawing on the R = MC 2 readiness framework, we developed a readiness building process to tailor support for implementation. The process is composed of the following stages: assessment, feedback and prioritization, and strategize. In this article, we describe the application of the readiness building process through three case examples representing interventions at different ecological levels: local, state, and national. The case examples illuminate challenges and practical considerations for using the readiness building process, including the significance of on-going leadership engagement and collaboration between support system and delivery system staff. To further the research and practice of implementation readiness, we suggest examining the impact of readiness building on implementation outcomes and developing an empirically-informed repository of change management strategies matched to readiness constructs., (© 2021 Wiley Periodicals LLC.)

Disruptions of varying severity often occur in the course of an organization's work to implement new programs or projects. These disruptions may slow their progress or even derail the work altogether. Resilient organizations must be prepared to respond in a thoughtful and timely way to disruptions. Readiness, Resilience and Recovery is an adaptable readiness assessment tool that organizations can use to proceed with their work with insight about their readiness status and how their readiness has been impacted by a disruption. The resulting information can then be used to guide the development of solutions for recovery and build the organization's overall capacity for resilience. Based on our early experience, the Readiness, Resilience and Recovery approach is emerging as a tool that can be useful when organizations face significant disruptions. We have found it to be adaptable to different types of projects, at various points in the implementation cycle, and with multiple types of disruptions. To demonstrate its use, this illustrative paper provides five examples from different projects and settings: Substance Abuse Treatment Services, Multi-Site Sexual Assault Prevention Initiative, Serve and Connect (a Police-Community Relationships Initiative), Carolina Family Engagement Center (family engagement in schools), and Action for Equity (an equity intervention). Practical uses of the tool and conceptualizing it within important implementation science concepts are discussed., Supplementary Information: The online version contains supplementary material available at 10.1007/s43477-021-00011-6., (© The Author(s), under exclusive licence to Springer Nature Switzerland AG 2021.)

Transforming communities to be healthier and more equitable prosents a systemic challenge best addressed by those with native knowledge of the system. Community coalitions are a promising structure for tackling local health inequities, if they approach the change process with multiple local stakeholders and with systemic change in mind. Maturity models offer a framework for system assessment by defining sequential stages toward ideal development. Providing coalitions with a structure for self-assessing community change, the Community Transformation Map (CTM) is a maturity model that operationalizes concepts hypothesized to foster systemic change. This 40-item tool encourages self-assessment, dialogue, and reconciliation of community transformation priorities via an appreciative inquiry process. The CTM was created and applied with 18 community coalitions participating in the 100 Million Healthier Lives initiative. It was iteratively drafted with representatives from across the initiative. These coalitions self-administered the CTM four times over 24 months. Coalitions used the CTM to reconcile perspectives, identify priorities, and create transformation action plans. After the fourth administration, ten semistructured interviews were conducted with coalition members. Thematic analysis revealed good contextual validity. Coalitions saw value in the CTM's productive dialogue and the shared understanding it created, but reported perceived burden in conducting repeated administration. The CTM's value is in structuring community members' reflection on complex, systemic problems. The CTM is rooted in international improvement and change principles and continues to be adapted for other change initiatives. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Background: Organizational readiness is important for the implementation of evidence-based interventions. Currently, there is a critical need for a comprehensive, valid, reliable, and pragmatic measure of organizational readiness that can be used throughout the implementation process. This study aims to develop a readiness measure that can be used to support implementation in two critical public health settings: federally qualified health centers (FQHCs) and schools. The measure is informed by the Interactive Systems Framework for Dissemination and Implementation and R = MC 2 heuristic (readiness = motivation × innovation-specific capacity × general capacity). The study aims are to adapt and further develop the readiness measure in FQHCs implementing evidence-based interventions for colorectal cancer screening, to test the validity and reliability of the developed readiness measure in FQHCs, and to adapt and assess the usability and validity of the readiness measure in schools implementing a nutrition-based program., Methods: For aim 1, we will conduct a series of qualitative interviews to adapt the readiness measure for use in FQHCs. We will then distribute the readiness measure to a developmental sample of 100 health center sites (up to 10 staff members per site). We will use a multilevel factor analysis approach to refine the readiness measure. For aim 2, we will distribute the measure to a different sample of 100 health center sites. We will use multilevel confirmatory factor analysis models to examine the structural validity. We will also conduct tests for scale reliability, test-retest reliability, and inter-rater reliability. For aim 3, we will use a qualitative approach to adapt the measure for use in schools and conduct reliability and validity tests similar to what is described in aim 2., Discussion: This study will rigorously develop a readiness measure that will be applicable across two settings: FQHCs and schools. Information gained from the readiness measure can inform planning and implementation efforts by identifying priority areas. These priority areas can inform the selection and tailoring of support strategies that can be used throughout the implementation process to further improve implementation efforts and, in turn, program effectiveness.

Limited health literacy is associated with poor patient health outcomes and increased hospitalization rates. Patient-provider communication plays an important role in patient health literacy and the understanding of medical terminology. This study demonstrates how a collaboration between clinical, academic, and community partners was instrumental in the design and implementation of a clinic readiness assessment and a clinic-based pilot intervention to encourage patient-provider communication and improve patient health literacy. A state hospital association, academic research team, and community adult literacy center director collaborated to develop a 60-item clinic readiness assessment and an evidence-informed pilot intervention. The clinic readiness assessment captured clinics' motivation and capacity for pilot implementation and providers' current communication strategies. The intervention centered around AskMe3™ educational materials and involved 2 patient visits (initial and follow-up visits). Data collection instruments for the intervention were administered verbally and included questions about patient demographics and communication needs, and a single-item health literacy measure. Descriptive statistics (frequencies/percentages) were used to analyze results from the clinic readiness assessment and pilot intervention. Establishment of the partnership, and collaborative, iterative development of the clinic readiness assessment and pilot intervention are described. This pilot project resulted in important lessons learned which led to critical modifications that will inform future expansion of the intervention. Collaboration between healthcare leaders, researchers, and community partners is recommended for developing clinic-based health literacy initiatives.

Spreading Community Accelerators Through Learning and Evaluation (SCALE) was a Robert Wood Johnson Foundation-funded initiative from 2015 to 2017 to build capability of 24 community coalitions to advance health, well-being, and equity. The SCALE theory of change had three components: develop leadership capability, build relationships within and between communities, and create an intercommunity system to spread promising ideas. The theory was operationalized through training academies, coaching, and peer-to-peer learning that explicitly addressed equity and systems change. In this article, we describe how SCALE facilitated community transformation related to Collaborating for Equity and Justice Principles 1, 3, 4, and 6. We conducted a multiple-case study approach with two community coalitions including site visits, interviews, and observation to illuminate underlying mechanisms of change by exploring how and why change occurs. Skid Row Women worked with women experiencing homelessness in Los Angeles to address diabetes and food systems. Healthy Livable Communities of Cattaraugus County used a portfolio of projects in order to create system changes to improve population health and increase access to services for people with disabilities in rural New York State. Through our analysis, we describe how two coalitions used SCALE tools for collaborative coalition processes such as aim setting, relationship building, and shared decision making with community residents. Our findings suggest that advancing Collaborating for Equity and Justice principles requires self-reflection and courage; new ways of being in relationship; learning from failure; productive conflict to explicitly address power, racism, and other forms of oppression; and methods to test systems improvement ideas.

Organizational readiness for an innovation (a program, policy, or practice new to a setting) is important for successful implementation. The R = MC 2 heuristic focuses on capacity and motivation as a framework for readiness; it comprises 3 components and 18 subcomponents. A Delphi study with community coalition leaders was undertaken to assess when each subcomponent is most significant in the life cycle of implementing an innovation in a coalition. Results include that motivation is viewed as most important in the early stages of implementation and leadership, climate, program champions, and interorganizational relationships are relevant throughout the lifespan of implementation. Results have implications for the future of assessing and building coalition readiness., (© 2019 Wiley Periodicals, Inc.)

The gap between implementers and researchers of quality improvement (QI) has hampered the degree and speed of change needed to reduce avoidable suffering and harm in health care. Underlying causes of this gap include differences in goals and incentives, preferred methodologies, level and types of evidence prioritized and targeted audiences. The Salzburg Global Seminar on 'Better Health Care: How do we learn about improvement?' brought together researchers, policy makers, funders, implementers, evaluators from low-, middle- and high-income countries to explore how to increase the impact of QI. In this paper, we describe some of the reasons for this gap and offer suggestions to better bridge the chasm between researchers and implementers. Effectively bridging this gap can increase the generalizability of QI interventions, accelerate the spread of effective approaches while also strengthening the local work of implementers. Increasing the effectiveness of research and work in the field will support the knowledge translation needed to achieve quality Universal Health Coverage and the Sustainable Development Goals.

This special topic edition of E&PP presents the insights of luminaries in the field who have helped shape empowerment evaluation with their critiques, concerns, and congratulations. We celebrate their contributions to empowerment evaluation. This special topic edition of E&PP presents their comments about an evaluation approach that, according to president Stewart Donaldson, has "gone viral" across the globe (Donaldson, 2015). To set the stage for these critical friends' comments, additional context for their discussion is provided. In addition, this special topic edition concludes with a brief comment on their thoughts., (Copyright © 2016 Elsevier Ltd. All rights reserved.)

This study examines (1) coalition survival, (2) prevalence of evidence-based prevention interventions (EBPIs) to reduce substance abuse implemented as part of the Tennessee Strategic Prevention Framework (SPF) State Incentive Grant (SIG), (3) EBPI sustainability, and (4) factors that predict EBPI sustainability. Secondary data were collected on 27 SPF SIG-funded coalitions and 88 EBPI and non-EBPI implementations. Primary data were collected by a telephone interview/web survey five and one-half years after the SPF SIG ended. Results from secondary data show that 25 of the 27 coalitions survived beyond the SPF SIG for one to five and one-half years; 19 coalitions (70%) were still active five and one-half years later. Further, 88 EBPIs and non-EBPIs were implemented by 27 county SPF SIG coalitions. Twenty-one (21) of 27 coalitions (78%) implemented one to three EBPIs, totaling 37 EBPI implementations. Based on primary survey data on 29 of the 37 EBPI implementations, 28 EBPIs (97%) were sustained between two and five and one-half years while 22 EBPI implementations (76%) were sustained for five and one-half years. When controlling for variability among coalitions (nesting of EBPIs in coalitions), increases in data resources (availability of five types of prevention data) was a strong predictor of length of EBPI sustainability. Positive change in extramural funding resources and level of expertise during SPF SIG implementation, as well as level of coalition formalization at the end of the SPF SIG predicted EBPI sustainability length. One intervention attribute (trialability) also predicted length of sustainability. Implications are discussed.

Integration of behavioral health and primary care services is a promising approach for reducing health disparities. The growing national emphasis on care coordination has mobilized efforts to integrate behavioral health and primary care services across the United States. These efforts align with broader health care system goals of improving health care quality, health equity, utilization efficiency, and patient outcomes. Drawing from our work on a multiyear integrated care initiative (Integrated Care Leadership Program; ICLP) and an implementation science heuristic for organizational readiness (Readiness = Motivation x General Capacity and Innovation-Specific Capacity; R = MC2), this article describes the development and implementation of a tool to assess organizational readiness for integrated care, referred to as the Readiness for Integrated Care Questionnaire (RICQ). The tool was piloted with 11 health care practices that serve vulnerable, underprivileged populations. Initial results from the RICQ revealed that participating practices were generally high in motivation, innovation-specific capacities, and general capacities at the start of ICLP. Additionally, analyses indicated that practices particularly needed support with increasing staff capacities (general knowledge and skills), improving access to and use of resources, and simplifying the steps in integrating care so the effort appears less daunting and difficult to health care team members. We discuss insights from the initial use of RICQ and practical implications of the new tool for driving integrated care efforts that can contribute to health equity. (PsycINFO Database Record, ((c) 2017 APA, all rights reserved).)

This article describes how we used a formative multi-method evaluation approach to gather real-time information about the processes of a complex, multi-day training with 24 community coalitions in the United States. The evaluation team used seven distinct, evaluation strategies to obtain evaluation data from the first Community Health Improvement Leadership Academy (CHILA) within a three-prong framework (inquiry, observation, and reflection). These methods included: comprehensive survey, rapid feedback form, learning wall, observational form, team debrief, social network analysis and critical moments reflection. The seven distinct methods allowed for both real time quality improvement during the CHILA and long term planning for the next CHILA. The methods also gave a comprehensive picture of the CHILA, which when synthesized allowed the evaluation team to assess the effectiveness of a training designed to tap into natural community strengths and accelerate health improvement. We hope that these formative evaluation methods can continue to be refined and used by others to evaluate training., (Copyright © 2016. Published by Elsevier Ltd.)

Background: Schools present a context with great potential for the implementation of psychosocial evidence-based practices. Cognitive behavioral therapy (CBT) is an evidence-based practice that has been found to be very effective in treating anxiety in various community settings, including schools. Friends for Life (FRIENDS) is an efficacious group CBT protocol for anxiety. Unfortunately, evidence-based practices for anxiety are seldom employed in under-resourced urban schools, because many treatment protocols are not a good fit for the urban school context or the population, existing behavioral health staff do not receive adequate training or support to allow them to implement the treatment with fidelity, or school districts do not have the resources to contract with external consultants. In our prior work, we adapted FRIENDS to create a more culturally sensitive, focused, and feasible CBT protocol for anxiety disorders (CBT for Anxiety Treatment in Schools (CATS))., Methods/design: The aim of this 5-year study is to evaluate both the effectiveness of CATS for urban public schools compared to the original FRIENDS as well as compare the implementation strategies (train-the-trainer vs. train-the-trainer + ongoing consultation) by conducting a three-arm, parallel group, type 2 hybrid effectiveness-implementation trial in 18 K-8 urban public schools. We will also assess the cost-effectiveness and the mediators and moderators of fidelity. Ninety therapists, 18 agency supervisors, and 360 children will participate. The interactive systems framework for dissemination and implementation guides the training and support procedures for therapists and supervisors., Discussion: This study has the potential to demonstrate that agency therapists and supervisors who have had little to no prior exposure to evidence-based practices (EBPs) can implement an anxiety disorder EBP with fidelity. Comparisons of the implementation strategies would provide large urban mental health systems with data to make decisions about the adoption of EBPs., Trial Registration: ClinicalTrials.gov, NCT02651402.

Despite the availability of many evidence-based prevention interventions (EBIs), gaps exist in bringing these programs into widespread practice. Technical assistance (TA) is a strategy for enhancing the readiness of practitioners to implement EBIs. Although many millions of dollars are spent on TA each year, there is little consensus about what the essential features of TA are and how to provide TA with quality. A broad-based research synthesis methodology was used for analyzing the current evidence base for TA using three frames: (1) applying the Getting To Outcomes (GTO) model for categorizing evidence on TA that specifies tasks for planning, implementing, and evaluating TA; (2) understanding the relevance of a successful relationship between the TA provider and TA recipient; and (3) considering the extent to which TA fits the life cycle needs of the preventive intervention. Results indicated that an explicit model or organizing framework is rarely used to plan, implement, and/or evaluate TA; specific TA tasks performed vary widely across studies; TA is rarely delivered to recipients who are seeking to sustain innovations subsequent to adoption and implementation; however, there is systematic attention to relationships and relationship-building. Overall, this synthesis indicates that the extent to which TA is being delivered systematically is limited. We suggest that funders and other stakeholders develop and implement standards for TA quality in order to ensure that many of these limitations are addressed.

While the body of evidence-based healthcare interventions grows, the ability of health systems to deliver these interventions effectively and efficiently lags behind. Quality improvement approaches, such as the model for improvement, have demonstrated some success in healthcare but their impact has been lessened by implementation challenges. To help address these challenges, we describe the empowerment evaluation approach that has been developed by programme evaluators and a method for its application (Getting To Outcomes (GTO)). We then describe how GTO can be used to implement healthcare interventions. An illustrative healthcare quality improvement example that compares the model for improvement and the GTO method for reducing hospital admissions through improved diabetes care is described. We conclude with suggestions for integrating GTO and the model for improvement., (Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.)

Background: The "Positive Action for Today's Health" (PATH) trial tested an environmental intervention to increase walking in underserved communities., Methods: Three matched communities were randomized to a police-patrolled walking plus social marketing, a police-patrolled walking-only, or a no-walking intervention. The 24-month intervention addressed safety and access for physical activity (PA) and utilized social marketing to enhance environmental supports for PA. African-Americans (N=434; 62% females; aged 51±16 years) provided accelerometry and psychosocial measures at baseline and 12, 18, and 24 months. Walking attendance and trail use were obtained over 24 months., Results: There were no significant differences across communities over 24 months for moderate-to-vigorous PA. Walking attendance in the social marketing community showed an increase from 40 to 400 walkers per month at 9 months and sustained ~200 walkers per month through 24 months. No change in attendance was observed in the walking-only community., Conclusions: Findings support integrating social marketing strategies to increase walking in underserved African-Americans (ClinicalTrials.gov #NCT01025726).

There are many challenges when an innovation (i.e., a program, process, or policy that is new to an organization) is actively introduced into an organization. One critical component for successful implementation is the organization's readiness for the innovation. In this article, we propose a practical implementation science heuristic, abbreviated as R= MC 2 . We propose that organizational readiness involves: 1) the motivation to implement an innovation, 2) the general capacities of an organization, and 3) the innovation-specific capacities needed for a particular innovation. Each of these components can be assessed independently and be used formatively. The heuristic can be used by organizations to assess readiness to implement and by training and technical assistance providers to help build organizational readiness. We present an illustration of the heuristic by showing how behavioral health organizations differ in readiness to implement a peer specialist initiative. Implications for research and practice of organizational readiness are discussed.

Historically, there has been considerable variability in how formative evaluation has been conceptualized and practiced. FORmative Evaluation Consultation And Systems Technique (FORECAST) is a formative evaluation approach that develops a set of models and processes that can be used across settings and times, while allowing for local adaptations and innovations. FORECAST integrates specific models and tools to improve limitations in program theory, implementation, and evaluation. In the period since its initial use in a federally funded community prevention project in the early 1990s, evaluators have incorporated important formative evaluation innovations into FORECAST, including the integration of feedback loops and proximal outcome evaluation. In addition, FORECAST has been applied in a randomized community research trial. In this article, we describe updates to FORECAST and the implications of FORECAST for ameliorating failures in program theory, implementation, and evaluation., (Copyright © 2013 Elsevier Ltd. All rights reserved.)

Background: This study describes the development of a social marketing campaign for increasing walking in a low income, high crime community as part of the Positive Action for Today's Health (PATH) trial., Methods: Focus groups were conducted with 52 African American adults (ages 18 to 65 yrs), from two underserved communities to develop themes for a social marketing campaign to promote walking. Participants responded to questions concerning social marketing principles related to product, price, place, promotion, and positioning for increasing neighbourhood walking., Results: Focus group data informed the development of the campaign objectives that were derived from the "5 Ps" to promote physical and mental health, social connectedness, safety, and confidence in walking regularly. Focus group themes indicated that physical and mental health benefits of walking were important motivators. Walking for social reasons was also important for overcoming barriers to walking. Police support from trusted officers while walking was also essential to promoting safety for walking. Print materials were developed by the steering committee, with a 12-month calendar and door hangers delivered to residents' homes to invite them to walk. Pride Stride walks empowered community walkers to serve as peer leaders for special walking events to engage new walkers., Conclusions: Essential elements for developing culturally tailored social marketing interventions for promoting walking in underserved communities are outlined for future researchers.

The Interactive Systems Framework for Dissemination and Implementation (ISF) is a multi-system framework that can guide research-to-practice efforts by building and supporting the work of three interacting systems: the Prevention Delivery, Support, and Synthesis and Translation Systems. The Synthesis and Translation system is vital to bridging science and practice, yet how to develop it and train support system partners to use it is under-researched. This article bridges this gap by offering a case example of the planning, development, and use of a synthesis and translation product called Promoting Science-based Approaches to Teen Pregnancy Prevention using Getting To Outcomes. The case presented documents the process used for developing the synthesis and translation product, reports on efforts to engage the Prevention Support system to use the product, and how we approached building interaction between the Synthesis and Translation System and the Support System partners. Practice-oriented evaluation data are also presented. Implications for practice, policy and research are discussed.

According to the Interactive Systems Framework for Dissemination and Implementation, implementation is a major mechanism and concern in bridging research and practice. The growing number of implementation frameworks need to be synthesized and translated so that the science and practice of quality implementation can be furthered. In this article, we: (1) use the synthesis of frameworks developed by Meyers et al. (Am J Commun Psychol, 2012) and translate the results into a practical implementation science tool to use for improving quality of implementation (i.e., the Quality Implementation Tool; QIT), and (2) present some of the benefits and limitations of the tool by describing how the QIT was implemented in two different pilot projects. We discuss how the QIT can be used to guide collaborative planning, monitoring, and evaluation of how an innovation is implemented.

Bringing evidence based programs to scale was a major initial impetus for the development of the Interactive Systems Framework for Dissemination and Implementation (ISF). The ISF demonstrates the importance of the Support System in facilitating the uptake of innovations in the community (the Delivery System). Two strategies that members of the Support System commonly use are training-of-trainers (TOT) models and technical assistance (TA). In this article, we focus on the role of the Support System in bringing evidence-based programs (EBPs) to scale in the Delivery System using a case example, with special attention on two strategies employed by Support Systems-training-of-trainers (TOT) and proactive technical assistance. We then report on findings from a case example from the Promoting Science Based Approaches to Teen Pregnancy Prevention project that furthers our conceptualization of these strategies and the evidence base for them. We also report on the limitations in the literature regarding research on TOTs and proactive TA and provide suggestions for future research on TOTs and proactive TA that will enhance the science and practice of support in the ISF.

The need for new ways to bridge the gap between research and practice is clear; the use of evidence-based prevention programs and implementation with fidelity in practice are strikingly limited. The Interactive Systems Framework for Dissemination and Implementation (ISF) was created to help bridge research and practice by specifying the systems and processes required to support dissemination and implementation of evidence-based programs, processes, practices, and policies. The ISF identifies three key systems necessary for this process which include the Synthesis and Translation System, the Support System, and the Delivery System. The ISF was featured in a special issue of the American Journal of Community Psychology in 2008. This special issue extends that work by including both researchers who have applied an ISF lens to aspects of their current work and researchers who have proactively applied the ISF in a process that goes across the various systems of the ISF, i.e., Synthesis and Translation, Support, and Delivery. Content areas include: children's mental health, teen pregnancy prevention, HIV prevention, violence prevention, heart disease and stroke prevention, breast cancer prevention, and substance abuse prevention. In this introductory article, we provide a brief description of the history of the ISF and a summary of the articles in the special issue.

Implementation science is growing in importance among funders, researchers, and practitioners as an approach to bridging the gap between science and practice. We addressed three goals to contribute to the understanding of the complex and dynamic nature of implementation. Our first goal was to provide a conceptual overview of the process of implementation by synthesizing information from 25 implementation frameworks. The synthesis extends prior work by focusing on specific actions (i.e., the "how to") that can be employed to foster high quality implementation. The synthesis identified 14 critical steps that were used to construct the Quality Implementation Framework (QIF). These steps comprise four QIF phases: Initial Considerations Regarding the Host Setting, Creating a Structure for Implementation, Ongoing Structure Once Implementation Begins, and Improving Future Applications. Our second goal was to summarize research support for each of the 14 QIF steps and to offer suggestions to direct future research efforts. Our third goal was to outline practical implications of our findings for improving future implementation efforts in the world of practice. The QIF's critical steps can serve as a useful blueprint for future research and practice. Applying the collective guidance synthesized by the QIF to the Interactive Systems Framework for Dissemination and Implementation (ISF) emphasizes that accountability for quality implementation does not rest with the practitioner Delivery System alone. Instead, all three ISF systems are mutually accountable for quality implementation.

An individual or organization that sets out to implement an innovation (e.g., a new technology, program, or policy) generally requires support. In the Interactive Systems Framework for Dissemination and Implementation, a Support System should work with Delivery Systems (national, state and/or local entities such as health and human service organizations, community-based organizations, schools) to enhance their capacity for quality implementation of innovations. The literature on the Support System [corrected] has been underresearched and under-developedThis article begins to conceptualize theory, research, and action for an evidence-based system for innovation support (EBSIS). EBSIS describes key priorities for strengthening the science and practice of support. The major goal of EBSIS is to enhance the research and practice of support in order to build capacity in the Delivery System for implementing innovations with quality, and thereby, help the Delivery System achieve outcomes. EBSIS is guided by a logic model that includes four key support components: tools, training, technical assistance, and quality assurance/quality improvement. EBSIS uses the Getting To Outcomes approach to accountability to aid the identification and synthesis of concepts, tools, and evidence for support. We conclude with some discussion of the current status of EBSIS and possible next steps, including the development of collaborative researcher-practitioner-funder-consumer partnerships to accelerate accumulation of knowledge on the Support System.

Background: Ethnic minorities and lower-income adults have among the highest rates of obesity and lowest levels of regular physical activity (PA). The Positive Action for Today's Health (PATH) trial compares three communities that are randomly assigned to different levels of an environmental intervention to improve safety and access for walking in low income communities., Design and Setting: Three communities matched on census tract information (crime, PA, ethnic minorities, and income) were randomized to receive either: an intervention that combines a police-patrolled-walking program with social marketing strategies to promote PA, a police-patrolled-walking only intervention, or no-walking intervention (general health education only). Measures include PA (7-day accelerometer estimates), body composition, blood pressure, psychosocial measures, and perceptions of safety and access for PA at baseline, 6, 12, 18, and 24 months., Intervention: The police-patrolled walking plus social marketing intervention targets increasing safety (training community leaders as walking captains, hiring off-duty police officers to patrol the walking trail, and containing stray dogs), increasing access for PA (marking a walking route), and utilizes a social marketing campaign that targets psychosocial and environmental mediators for increasing PA. MAIN HYPOTHESES/OUTCOMES: It is hypothesized that the police-patrolled walking plus social marketing intervention will result in greater increases in moderate-to-vigorous PA as compared to the police-patrolled-walking only or the general health intervention after 12 months and that this effect will be maintained at 18 and 24 months., Conclusions: Implications of this community-based trial are discussed., (Copyright © 2010. Published by Elsevier Inc.)

Demands on community-based prevention programs for performance accountability and positive outcomes are ever increasing in the face of constrained resources. Relatively little is known about how technical assistance (TA) should be structured to benefit community-based organizations and to lead to better outcomes. In this study, data from multiple sources were used to describe an effective TA model designed to improve the capacity of community-based organizations to plan, implement, and evaluate prevention programming. This article is the first of its kind to provide detailed analyses of the TA delivered to community-based organizations to build substance abuse prevention capacity. The results of this study describe the range of TA services provided and the importance of two-way communication between the TA provider and recipient. TA recipients reported high satisfaction and an improved understanding of targeted TA activities. However, achieving these benefits requires significant program staff time, and not all skills were successfully transferred. Results from this study suggest how TA may be structured to be effective in supporting quality prevention programming in community settings.

Communities face challenges implementing evidence-based prevention programs. To help, policymakers are exploring how to build community-level capacity for prevention for thousands of organizations or communities across the United States. This article reports on a formative evaluation within 2 states' prevention systems of an Internet system designed to build capacity on a large scale, interactive Getting To Outcomes(R) (iGTO). In Tennessee, 30 coalitions were randomly assigned to receive either the iGTO system or nothing. In Missouri, 18 coalitions receiving iGTO were compared with 8 like coalitions who did not receive iGTO. The primary outcome was iGTO's impact on the performance of the coalitions' programs, assessed through interviews at baseline and after a year of iGTO implementation. Analyses suggest that iGTO-programs improved their performance of prevention practices over non-iGTO programs. Semi-structured interviews of iGTO users and state-level stakeholders showed that iGTO was adopted by most iGTO-assigned coalitions, albeit in mostly an elementary fashion. Perceptions of the iGTO system were mixed. The findings suggest that more comprehensive integration requires that state leadership also use iGTO and provide more support for its use at the local level., ((c) 2009 APA, all rights reserved.)

In this article, I attempt to merge two themes. First, there is often a large gap between high hopes about impacts of policies or programs and the demonstrated results. I describe four keys/threats to success in any social problem area: theory, implementation, evaluation, and resource/system support. Second, I present theory and research from over 30 years of work on participation, conducted by my colleagues and myself that can illuminate and be illuminated by theory, implementation, evaluation, and resource/system support. I offer ideas for solutions that increase the probability of success. I conclude with the need to have high hopes tempered by theory and research to develop realistically ambitious solutions to social problems.

Capacity is a complex construct that lacks definitional clarity. Little has been done to define capacity, explicate components of capacity, or explore the development of capacity in prevention. This article represents an attempt to operationalize capacity and distinguish among types and levels of capacity as they relate to dissemination and implementation through the use of a taxonomy of capacity. The development of the taxonomy was informed by the capacity literature from two divergent models in the field: research-to-practice (RTP) models and community-centered (CC) models. While these models differ in perspective and focus, both emphasize the importance of capacity to the dissemination and sustainability of prevention innovations. Based on the review of the literature, the taxonomy differentiates the concepts of capacity among two dimensions: level (individual, organizational, and community levels) and type (general capacity and innovation-specific capacity). The proposed taxonomy can aid in understanding the concept of capacity and developing methods to support the implementation and sustainability of prevention efforts in novel settings.

Communities are increasingly being required by state and federal funders to achieve outcomes and be accountable, yet are often not provided the guidance or the tools needed to successfully meet this challenge. To improve the likelihood of achieving positive outcomes, the Getting To Outcomes (GTO) intervention (manual, training, technical assistance) is designed to provide the necessary guidance and tools, tailored to community needs, in order to build individual capacity and program performance. GTO is an example of a Prevention Support System intervention, which as conceptualized by the Interactive Systems Framework, plays a key role in bridging the gap between prevention science (Prevention Synthesis and Translation System) and prevention practice (Prevention Delivery System). We evaluated the impact of GTO on individual capacity and program performance using survey- and interview-based methods. We tracked the implementation of GTO and gathered user feedback about its utility and acceptability. The evaluation of GTO suggests that it can build individual capacity and program performance and as such demonstrates that the Prevention Support System can successfully fulfill its intended role. Lessons learned from the implementation of GTO relevant to illuminating the framework are discussed.

This article illustrates ideas for bridging science and practice generated during the Division of Violence Prevention's (DVP) dissemination/implementation planning process. The difficulty of moving what is known about what works into broader use is near universal, and this planning process pushed us to look beyond the common explanations (e.g., providers were resistant/unwilling to change practice) and think about the multiple layers and systems involved. As part of this planning process, the Interactive Systems Framework for Dissemination and Implementation (ISF) was developed and then applied to the fields of child maltreatment and youth violence prevention. Challenges for each of the three systems in the ISF are discussed as well as and action and research ideas to address the challenges. Also described are actions taken by DVP in response to the planning process to illustrate how a funder can use the ISF to bridge science and practice.

There is a well-known gap between science and practice. To address this gap in the areas of Child Maltreatment (CM) and Youth Violence (Y/V), the Division of Violence Prevention (DVP) at the Centers for Disease Control and Prevention (CDC) embarked on a Dissemination/Implementation (D/I) planning project. The project was aimed at identifying better ways to connect research and practice through reviews of the literature as well as through discussions with experts on violence prevention and research utilization. This introductory article sets the stage for the rest of the special issue by defining terms, providing a rationale for the planning project, describing the planning process, and summarizing what is to come in the rest of the issue.

The purpose of this exploratory study is to investigate organizational-level mechanisms in the Prevention Delivery System (PDS) and their influence on implementing comprehensive programming frameworks (e.g., Communities that Care-CtC) as the innovation. The PDS is part of the Interactive Systems Framework for Dissemination and Implementation (ISF) and describes key characteristics of innovation implementation and dissemination. The study addresses two research questions: (1) What types of organizational characteristics are related to successful use of each of the programming processes (i.e., planning, implementation, evaluation, and sustainability) that are part of comprehensive programming frameworks?; and (2) What are the similarities and differences in the organizational patterns correlated with use of each of the programming processes? Surveys, interview data, and other documents designed to assess organizational characteristics and extent of use of a comprehensive programming framework over time, were collected from 8 Community boards and 23 provider agencies. These organizations were responsible for planning and delivering substance abuse prevention services as part of a statewide initiative in Ohio. Data were analyzed using Spearman rho (and rank-biserial) correlations, with an emphasis on effect sizes. Results indicated that leadership, shared vision, process advocates, and technical assistance were common correlates of use across programming processes. However, the role played by these organizational variables differed for each programming process, pointing to complex interactions of the organizational infrastructure with other variables (i.e., characteristics of the innovation itself and external macro-level factors). This exploratory study provides preliminary data on the organizational-level mechanisms of the PDS and the complexity of their relationships with the other Systems in the Interactive Systems Framework.

In the field of teen pregnancy prevention many efficacious prevention programs are available but adoption of these programs is slow at the community level. In this article, we present a multi-site, capacity-building effort called the Promoting Science-based Approaches to Teen Pregnancy Prevention project (PSBA) as a case example of a proactive application of the Interactive System Framework (ISF) for dissemination and implementation. The ISF is a multi-system model leading to dissemination and implementation of science-based prevention programming through the work of three interactive systems: The "Prevention Delivery," "Prevention Support," and "Prevention Synthesis & Translation" Systems. This article describes the proactive use of the ISF to conceptualize and bolster the PSBA program's goal of assisting local prevention partners in the use of science-based approaches (SBA) to prevent teen pregnancy. PSBA uses all three systems of the ISF to facilitate practice improvements and offers valuable research opportunities to investigate factors related to dissemination and implementation processes across these systems. Describing our application of this framework highlights the feasibility of actively using the ISF to build prevention infrastructure and to guide large-scale prevention promotion strategies in the area of teen pregnancy prevention. The program's ongoing evaluation is presented as an example of early efforts to develop an evidence base around the ISF. Research implications are discussed.