Search

BACKGROUND: Despite the increased risk of cervical cancer (CC) among women living with HIV (WLHIV), CC screening and treatment (CCST) rates remain low in Africa. The integration of CCST services into established HIV programs in Africa can improve CC prevention and control. However, the paucity of evidence on effective implementation strategies (IS) has limited the success of integration in many countries. In this study, we seek to identify effective IS to enhance the integration of CCST services into existing HIV programs in Nigeria. METHODS: Our proposed study has formative and experimental activities across the four phases of the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework. Through an implementation mapping conducted with stakeholders in the exploration phase, we identified a core package of IS (Core) and an enhanced package of IS (Core+) mostly selected from the Expert Recommendations for Implementing Change. In the preparation phase, we refined and tailored the Core and Core+ IS with the implementation resource teams for local appropriateness. In the implementation phase, we will conduct a cluster-randomized hybrid type III trial to assess the comparative effectiveness of Core versus Core+. HIV comprehensive treatment sites (k = 12) will be matched by region and randomized to Core or Core+ in the ratio of 1:1 stratified by region. In the sustainment phase, we will assess the sustainment of CCST at each site. The study outcomes will be assessed using RE-AIM: reach (screening rate), adoption (uptake of IS by study sites), IS fidelity (degree to which the IS occurred according to protocol), clinical intervention fidelity (delivery of CC screening, onsite treatment, and referral according to protocol), clinical effectiveness (posttreatment screen negative), and sustainment (continued integrated CCST service delivery). Additionally, we will descriptively explore potential mechanisms, including organizational readiness, implementation climate, CCST self-efficacy, and implementation intentions. DISCUSSION: The assessment of IS to increase CCST rates is consistent with the global plan of eliminating CC as a public health threat by 2030. Our study will identify a set of evidence-based IS for low-income settings to integrate evidence-based CCST interventions into routine HIV care in order to improve the health and life expectancy of WLHIV. TRIAL REGISTRATION: Prospectively registered on November 7, 2023, at ClinicalTrials.gov no. NCT06128304. https://classic. CLINICALTRIALS: gov/ct2/show/study/NCT06128304.

BACKGROUND: A myriad of federal, state, and organizational policies are designed to improve access to evidence-based healthcare, but the impact of these policies likely varies due to contextual determinants of, reinterpretations of, and poor compliance with policy requirements throughout implementation. Strategies enhancing implementation and compliance with policy intent can improve population health. Critically assessing the multi-level environments where health policies and their related health services are implemented is essential to designing effective policy-level implementation strategies. California passed a 2019 health insurance benefit mandate requiring coverage of fertility preservation services for individuals at risk of infertility due to medical treatments, in order to improve access to services that are otherwise cost prohibitive. Our objective was to document and understand the multi-level environment, relationships, and activities involved in using state benefit mandates to facilitate patient access to fertility preservation services. METHODS: We conducted a mixed-methods study and used the policy-optimized exploration, preparation, implementation, and sustainment (EPIS) framework to analyze the implementation of Californias fertility preservation benefit mandate (SB 600) at and between the state insurance regulator, insurer, and clinic levels. RESULTS: Seventeen publicly available fertility preservation benefit mandate-relevant documents were reviewed. Interviews were conducted with four insurers; 25 financial, administrative, and provider participants from 16 oncology and fertility clinics; three fertility pharmaceutical representatives; and two patient advocates. The mandate and insurance regulator guidance represented two Big P (system level) policies that gave rise to a host of little p (organizational) policies by and between the regulator, insurers, clinics, and patients. Many little p policies were bridging factors to support implementation across levels and fertility preservation service access. Characterizing the mandates functions (i.e., policy goals) and forms (i.e., ways that policies were enacted) led to identification of (1) intended and unintended implementation, service, and patient outcomes, (2) implementation processes by level and EPIS phase, (3) actor-delineated key processes and heterogeneity among them, and (4) inner and outer context determinants that drove adaptations. CONCLUSIONS: Following the midstream and downstream implementation of a state health insurance benefit mandate, data generated will enable development of policy-level implementation strategies, evaluation of determinants and important outcomes of effective implementation, and design of future mandates to improve fit and fidelity.

SMART DAPPER is an implementation science study responding to mental health treatment gaps for depression and trauma-related disorders in Sub-Saharan Africa (SSA). We report on patient experiences in a study using a Sequential, Multiple Assignment Randomized Trial (SMART) design to test first and second line non-specialist treatment using psychotherapy (Interpersonal Psychotherapy [IPT] or medication (fluoxetine [FLX]), integrated within public sector primary care in western Kenya. An embedded qualitative study conducted in-depth interviews (n = 17) and three (n = 3) focus group discussions with participants (May to October 2021). Audio-recorded interviews were transcribed and translated into English; we deductively and inductively analyzed transcripts guided by grounded theoretical approaches and content analysis. We drew on the health belief model and socio-ecological framework to present findings, including perceived severity (motivations for taking part in the intervention), impacts of the intervention at the individual, interpersonal, and community and health systems levels as well as barriers and facilitators. Participants discussed family and marital conflict, loss of a child, loss of income or a job, and traumatic events such as a death or illness. Impacts at the individual level included reduced headaches, improved appetite and weight management, increased energy, improved sleep, better self-efficacy, and improved concentration, which was reported to lead to increased economic opportunities. At the interpersonal level, participants noted a reduction in conflict, better conflict management and resolution, increased harmony with family and community members, and improved relationships with their partners and children. Perceived challenges included balancing the intervention with livelihoods, preference for traditional medicines, actual or anticipated side effects with medication (FLX), mental health stigma, major life events, and perceived inadequate counseling and challenges with providers. The findings demonstrate the potential of the SMART DAPPER intervention for depression and trauma-related disorder treatments and underscore the challenges and barriers that must be addressed when scaling similar interventions. Trial registration: ClinicalTrials.gov identifier: NCT03466346.

BACKGROUND: This studys aims are to: (1) Compare the acceptability and feasibility of five types of implementation strategies that could be deployed to increase the reach of evidence-based practices (EBPs) with revenue from policies that earmark taxes for behavioral health services, and (2) Illustrate how definitions of implementation strategies and measures of acceptability and feasibility can be used in policy-focused implementation science research. METHODS: Web-based surveys of public agency and community organization professionals involved with earmarked tax policy implementation were completed in 2022-2023 (N = 211, response rate = 24.9%). Respondents rated the acceptability and feasibility of five types of implementation strategies (dissemination, implementation process, integration, capacity-building, and scale-up). Aggregate acceptability and feasibility scores were calculated for each type of strategy (scoring range 4-20). Analyses of variance compared scores across strategies and between organizational actor types. FINDINGS: For acceptability, capacity-building strategies had the highest rating (M = 16.3, SD = 3.0), significantly higher than each of the four other strategies, p ≤ . 004), and scale-up strategies had the lowest rating (M = 15.6). For feasibility, dissemination strategies had the highest rating (M = 15.3, significantly higher than three of the other strategies, p ≤ .002) and scale-up strategies had the lowest rating (M = 14.4). CONCLUSIONS: Capacity-building and dissemination strategies may be well-received and readily deployed by policy implementers to support EBPs implementation with revenue from taxes earmarked for behavioral health services. Adapting definitions of implementation strategies for policy-focused topics, and applying established measures of acceptability and feasibility to these strategies, demonstrates utility as an approach to advance research on policy-focused implementation strategies.

BackgroundCross-system interventions that integrate health, behavioral health, and social services can improve client outcomes and expand community impact. Successful implementation of these interventions depends on the extent to which service partners can align frontline services and organizational operations. However, collaboration strategies linking multiple implementation contexts have received limited empirical attention. This study identifies, describes, and specifies multi-level collaboration strategies used during the implementation of Ohio Sobriety Treatment and Reducing Trauma (Ohio START), a cross-system intervention that integrates services across two systems (child welfare and evidence-based behavioral health services) for families that are affected by co-occurring child maltreatment and parental substance use disorders.MethodsIn phase 1, we used a multi-site qualitative design with 17 counties that implemented Ohio START. Qualitative data were gathered from 104 staff from child welfare agencies, behavioral health treatment organizations, and regional behavioral health boards involved in implementation via 48 small group interviews about collaborative approaches to implementation. To examine cross-system collaboration strategies, qualitative data were analyzed using an iterative template approach and content analysis. In phase 2, a 16-member expert panel met to validate and specify the cross-system collaboration strategies identified in the interviews. The panel was comprised of key child welfare and behavioral health partners and scholars.ResultsIn phase 1, we identified seven cross-system collaboration strategies used for implementation. Three strategies were used to staff the program: (1) contract for expertise, (2) provide joint supervision, and (3) co-locate staff. Two strategies were used to promote service access: (4) referral protocols and (5) expedited access agreements. Two strategies were used to align case plans: (6) shared decision-making meetings, and (7) sharing data. In phase 2, expert panelists specified operational details of the cross-system collaboration strategies, and explained the processes by which strategies were perceived to improve implementation and service system outcomes.ConclusionsWe identified a range of cross-system collaboration strategies that show promise for improving staffing, service access, and case planning. Leaders, supervisors, and frontline staff used these strategies during all phases of implementation. These findings lay the foundation for future experimental and quasi-experimental studies that test the effectiveness of cross-system collaboration strategies.

There are numerous frameworks for implementing evidence-based practices (EBPs) in novel settings to achieve "fidelity." However, identifying appropriate referents for fidelity poses a challenge. The Core Functions and Forms paradigm offers a model that can inform adaptation decisions throughout all phases of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. We applied the Core Functions-Forms paradigm throughout the Exploration and Preparation phases of EPIS in the design of two EBPs targeting family protective factors among Latinos in San Diego, as well as describe plans for its use in Implementation and Sustainment. We employed a distinct approach for each intervention element to contrast adaptation decisions that prioritize adherence to either form or function fidelity. We describe our application of the functions-forms paradigm within the EPIS framework, focusing on the Preparation phase. We also provide functions-forms matrices that map out the relationship between individual intervention components (forms) and the essential processes (functions) by which components are theorized to exert their impact. This case study of how the core functions-forms framework can be mapped onto EPIS can support a conceptual shift from prioritizing form fidelity to also focusing on function fidelity. This might allow interventionists to target appropriate fidelity referents when adapting an EBP, rather than defaulting to maintaining fidelity to forms as described in the protocol. We see great promise for using this framework for guiding actions throughout all EPIS phases and informing future applications of this paradigm to foster more robust fidelity to function.

ObjectiveThe authors sought to characterize perceptions of the impacts, attributes, and support for taxes earmarked for behavioral health services and to compare perceptions of the taxes among professionals in California and Washington, two states differing in earmarked tax designs.MethodsSurveys were completed by 155 public agency and community organization professionals involved in tax implementation in California (N=87) and Washington State (N=68) during 2022-2023 (29% response rate). Respondents indicated their perceptions of the taxes' impacts, attributes, and support. Responses were summed as aggregate scores and were also analyzed as individual items. Bivariate analyses were used to compare responses of professionals in California versus Washington State.ResultsEarmarked taxes were generally regarded positively. Of the respondents, >80% strongly agreed that the taxes increased funding for services and were helpful, and only 10% strongly agreed that the taxes decreased behavioral health funding from other sources. Substantially more respondents in California than in Washington State strongly agreed that taxes' reporting requirements were complicated (45% vs. 5%, p

BACKGROUND: Financial barriers in substance use disorder service systems have limited the widespread adoption-i.e., provider-level reach-of evidence-based practices (EBPs) for youth substance use disorders. Reach is essential to maximizing the population-level impact of EBPs. One promising, but rarely studied, type of implementation strategy for overcoming barriers to EBP reach is financing strategies, which direct financial resources in various ways to support implementation. We evaluated financing strategies for the Adolescent Community Reinforcement Approach (A-CRA) EBP by comparing two US federal grant mechanisms, organization-focused and state-focused grants, on organization-level A-CRA reach outcomes. METHOD: A-CRA implementation took place through organization-focused and state-focused grantee cohorts from 2006 to 2021. We used a quasi-experimental, mixed-method design to compare reach between treatment organizations funded by organization-focused versus state-focused grants (164 organizations, 35 states). Using administrative training records, we calculated reach as the per-organization proportion of trained individuals who received certification in A-CRA clinical delivery and/or supervision by the end of grant funding. We tested differences in certification rate by grant type using multivariable linear regression models that controlled for key covariates (e.g., time), and tested threats to internal validity from our quasi-experimental design through a series of sensitivity analyses. We also drew on interviews and surveys collected from the treatment organizations and (when relevant) interviews with state administrators to identify factors that influenced reach. RESULTS: The overall certification rates were 27 percentage points lower in state-focused versus organization-focused grants (p = .01). Sensitivity analyses suggested these findings were not explained by confounding temporal trends nor by organizational or state characteristics. We did not identify significant quantitative moderators of reach outcomes, but qualitative findings suggested certain facilitating factors were more influential for organization-focused grants (e.g., strategic planning) and certain barrier factors were more impactful for state-focused grants (e.g., states finding it difficult to execute grant activities). DISCUSSION: As the first published comparison of EBP reach outcomes between financing strategies, our findings can help guide state and federal policy related to financing strategies for implementing EBPs that reduce youth substance use. Future work should explore contextual conditions under which different financing strategies can support the widespread implementation of EBPs for substance use disorder treatment.

BACKGROUND: Half of child-welfare-involved children and adolescents meet the criteria for at least one mental health diagnosis. This project proposes to improve successful mental health service linkage in child welfare services (CWS) by adapting and testing the after-action review (AAR) team effectiveness intervention to augment the child and family team (CFT) services intervention. Despite being both required and a collaborative approach to service planning, CFT meetings are implemented with questionable fidelity and consistency, rarely including the voice of children and families as intended. METHODS: Using a parallel group trial design, with non-equivalent comparison groups, and qualitative and quantitative methodology, this study will tailor and assess the impact of the AAR on enhancing CFT outcomes. The authors will conduct a qualitative needs assessment targeting the ongoing implementation of the CFT services intervention in a large, publicly funded, CWS system. A qualitative inquiry consisting of interviews and focus groups with key stakeholders will result in the preparation of an action plan to address identified gaps between the current and desired CFT services intervention outcomes. The AAR implementation strategy will be adapted and tailored to address the CFT services intervention needs. To test the effectiveness of the AAR on improving outcomes associated with the CFT services intervention, we will utilize blocked randomization of four CWS caseworkers from two CWS system regions to either the intervention condition (CFT + AAR) or standard implementation (CFT as usual). The authors will collect data from the CWS caseworkers and additional CFT members via web-based surveys. Mechanisms of the AAR team effectiveness intervention for CFT implementation will be assessed. DISCUSSION: By inclusion of child and family voice, the AAR-enhanced CFT should lead to increased fidelity to the CFT intervention and greater levels of parental satisfaction with the service and shared decision-making, thus resulting in enhanced follow-through with service plans and linkage to mental health treatment services for children. The knowledge gained by this randomized clinical trial has the potential to benefit service delivery and integration for CWS leaders, caseworkers, formal and informal CFT member support persons, parents/caregivers, and children with open cases. Improving intervention effectiveness, both at the system and family levels, is crucial for practice efficiencies and improved child and family outcomes. TRIAL REGISTRATION: NCT05629013. Approval date: November 28, 2022 (version 1). TRIAL SPONSOR: University of California, San Diego. RESPONSIBLE PARTY: Danielle Fettes.

BACKGROUND: A key question in implementation science is how to balance adaptation and fidelity in translating interventions to new settings. There is growing consensus regarding the importance of planned adaptations to deliver interventions in contextually sensitive ways. However, less research has examined ad-hoc adaptations, or those that occur spontaneously in the course of intervention delivery. A key question is whether ad-hoc adaptations ultimately contribute to or detract from intervention goals. This study aimed to (a) identify ad-hoc adaptations made during delivery of a family therapy intervention and (b) assess whether they promoted or interrupted intervention goals. METHODS: Tuko Pamoja (Swahili: We are Together) is an evidence-informed family therapy intervention aiming to improve family dynamics and mental health in Kenya. Tuko Pamoja employs a task-shifting model, delivered by lay counselors who are afforded a degree of flexibility in presenting content and in practices they use in sessions. We used transcripts of therapy sessions with 14 families to examine ad-hoc adaptations used by counselors. We first identified and characterized ad-hoc adaptations through a team-based code development, coding, and code description process. Then, we evaluated to what extent ad-hoc adaptations promoted the principles and strategies of the intervention (TP-promoting), disrupted them (TP-interrupting), or neither (TP-neutral). To do this, we first established inter-coder agreement on application of these categories with verification by the intervention developer. Then, coders categorized ad-hoc adaptation text segments as TP-promoting, TP-interrupting, or TP-neutral. RESULTS: Ad-hoc adaptations were frequent and included (in decreasing order): incorporation of religious content, exemplars/role models, community dynamics and resources, self-disclosure, and metaphors/proverbs. Ad-hoc adaptations were largely TP-promoting (49%) or neutral (39%), but practices were TP-interrupting 12% of the time. TP-interrupting practices most often occurred within religious content and exemplars/role models, which were also the most common practices overall. CONCLUSION: Extra attention is needed during planned adaptation, training, and supervision to promote intervention-aligned use of common ad-hoc adaptation practices. Discussing them in trainings can provide guidance for lay providers on how best to incorporate ad-hoc adaptations during delivery. Future research should evaluate whether well-aligned ad-hoc adaptations improve therapeutic outcomes. TRIAL REGISTRATION: Pilot trial registered at clinicaltrials.gov (C0058).

Premature dropout from posttraumatic stress disorder treatment (PTSD) hinders treatment response. Studies have primarily used quantitative methodology to identify factors that contribute to Veterans' premature dropout, which has yielded mixed results. Qualitative methods provide rich data and generate additional hypotheses about why Veterans discontinue PTSD treatment. This study aimed to understand Veterans' reasons for dropping out of prolonged exposure therapy (PE) and to examine if there are differences in reasons for dropout between three delivery modalities: in-home, in-person (IHIP), office-based telehealth (OBT), or home-based telehealth (HBT). Twenty-two Veterans who dropped out of PE from a parent randomized clinical trial participated in individual qualitative interviews about potential contextual and individual factors related to discontinuation. Team-based coding was used to conduct open and focused coding. Themes were generated that described factors that influenced Veterans' dropout from PE and constant comparison was used to explore differences in reasons between the three modalities. Most Veterans had multiple reasons for dropping out and reasons were similar across delivery modalities with few differences. Practical barriers (e.g., scheduling difficulties), attitudes toward mental health providers and therapy (e.g., stigma), psychological and physical health factors (e.g., perceived worsening of symptoms, pain), and the therapeutic context (e.g., disliking aspects of PE) contributed to Veterans' decisions to drop out from PE. Veterans in OBT reported more types of practical barriers than Veterans in HBT and IHIP. These findings can help generate hypotheses about interventions that may promote engagement and future studies should continue to study how to reduce dropout. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

During the COVID-19 pandemic, pre-exposure prophylaxis (PrEP) access and adherence decreased nationwide. This study examined pandemic-related disruptions to PrEP access and adherence among clients of a health center (Center) in Los Angeles, California. Clients (n = 25) and Center personnel (n = 11) completed qualitative interviews from March to July 2021. Although the Center provided options for remote PrEP care (i.e., telehealth, STI self-testing kits, and prescription delivery), clients experienced difficulty navigating services or lacked equipment for telehealth. More than half (n = 13) of clients discontinued PrEP during COVID-19 due to decreased sexual partners, relocation, or insurance status changes. Among those who continued PrEP, the majority reported no change in adherence, while a minority reported worsening adherence due to distractions/forgetting, prescription refill issues, lack of insurance coverage, and fear of completing in-person visits. Findings highlight the challenges of navigating PrEP services during COVID-19 and suggest PrEP services enhancement to adapt to crisis events.

BackgroundLeaders can improve implementation outcomes by developing an organizational climate conducive to the implementation of evidence-based practices (EBP). This study tested the lagged associations between individual-level perceptions of implementation leadership, implementation climate, and three anticipated implementation outcomes, that is EBP acceptability, appropriateness, and feasibility.MethodsScreening tools and treatment methods for posttraumatic stress disorder were implemented in 43 Norwegian mental health services. A sample of 494 child and adult mental health care professionals (M = 43 years, 78% female) completed surveys addressing perceptions of first-level leaders' (n = 47) implementation leadership and their clinics' implementation climate. Single-level structural equation models estimating both direct, indirect, and total effects were used to investigate whether perceived implementation climate mediated the association between perceived implementation leadership and perceived acceptability, appropriateness, and feasibility of screening tools and treatment methods.ResultsRegarding the treatment methods, implementation leadership was associated with therapists' perceptions of acceptability, appropriateness, and feasibility. Implementation climate also mediated between implementation leadership and the outcomes. Regarding the screening tools, implementation leadership was not associated with the outcomes. However, implementation climate mediated between implementation leadership and therapists' perceptions of acceptability and feasibility, but not appropriateness. Analyses with the implementation climate subscales showed stronger associations for therapists' perceptions of the treatment methods than of screening tools.ConclusionsLeaders may promote positive implementation outcomes, both directly and through implementation climate. With regard to the effect sizes and explained variance, results indicated that both implementation leadership and implementation climate were more strongly associated with the therapists' perceptions of the treatment methods, implemented by one group of therapists, than the screening tools, implemented by all therapists. This may imply that implementation leadership and climate may have stronger effects for smaller implementation teams within a larger system than for system-wide implementations or when the clinical interventions being implemented are more complex rather than simple ones.Trial registrationClinicalTrials NCT03719651, 25 October 2018.

Organizational implementation climate is an important construct in implementation research to describe to what extent implementation is expected, supported, and rewarded. Efforts in bridging the research-practice gap by implementing evidence-based practice (EBP) can benefit from consideration of implementation climate. The Implementation Climate Scale (ICS) is a psychometrically strong measure assessing employees' perceptions of the implementation climate. The present cross-sectional study aimed at providing a German translation and investigating its psychometric properties. The translation followed standard procedures for adapting psychometric instruments. German psychotherapists (N = 425) recruited online completed the ICS, the Evidence Based Practice Attitudes Scale (EBPAS-36D) and the Intention Scale for Providers (ISP). We conducted standard item and reliability analyses. Factorial validity was assessed by comparing an independent cluster model of Confirmatory Factorial Analysis (ICM-CFA), a Bifactor CFA, a Second-order CFA and an (Bifactor) Exploratory Structural Equation Model (ESEM). Measurement invariance was tested using multiple-group CFA and ESEM, convergent validity with correlation analysis between the ICS and the ISP subjective norms subscale (ISP-D-SN). The mean item difficulty was pi = .47, mean inter-item correlation r = .34, and mean item-total correlation ritc = .55. The total scale (ω = 0.91) and the subscales (ω = .79-.92) showed acceptable to high internal consistencies. The model fit indices were comparable and acceptable (Second-order CFA: RMSEA [90% CI] = .077 [.069; .085], SRMR = .078, CFI = .93). Multiple-group CFA and ESEM indicated scalar measurement invariance across gender and presence of a psychotherapy license. Psychotherapists in training reported higher educational support for EBP than licensed psychotherapists (T = 2.09, p = .037, d = 0.25). The expected high correlation between the ICS and the ISP-D-SN was found (r = .59, p

BackgroundInsufficient funding is frequently identified as a critical barrier to the implementation and sustainment of evidence-based practices (EBPs). Thus, increasing access to funding is recognized as an implementation strategy. Policies that create earmarked taxes-defined as taxes for which revenue can only be spent on specific activities-are an increasingly common mental health financing strategy that could improve the reach of EBPs. This project's specific aims are to (1) identify all jurisdictions in the USA that have implemented earmarked taxes for mental health and catalogue information about tax design; (2) characterize experiences implementing earmarked taxes among local (e.g., county, city) mental health agency leaders and other government and community organization officials and assess their perceptions of the acceptability and feasibility of different types of policy implementation strategies; and (3) develop a framework to guide effect earmarked tax designs, inform the selection of implementation strategies, and disseminate the framework to policy audiences.MethodsThe project uses the Exploration, Preparation, Implementation, Sustainment (EPIS) framework to inform data collection about the determinants and processes of tax implementation and Leeman's typology of implementation strategies to examine the acceptability and feasibility strategies which could support earmarked tax policy implementation. A legal mapping will be conducted to achieve aim 1. To achieve aim 2, a survey will be conducted of 300 local mental health agency leaders and other government and community organization officials involved with the implementation of earmarked taxes for mental health. The survey will be followed by approximately 50 interviews with these officials. To achieve aim 3, quantitative and qualitative data will be integrated through a systematic framework development and dissemination process.DiscussionThis exploratory policy implementation process study will build the evidence base for outer-context implementation determinants and strategies by focusing on policies that earmarked taxes for mental health services.

BackgroundResearch centers and programs focused on dissemination and implementation science (DIS) training, mentorship, and capacity building have proliferated in recent years. There has yet to be a comprehensive inventory of DIS capacity building program (CBP) cataloging information about activities, infrastructure, and priorities as well as opportunities for shared resources, collaboration, and growth. The purpose of this systematic review is to provide the first inventory of DIS CBPs and describe their key features and offerings.MethodsWe defined DIS CBPs as organizations or groups with an explicit focus on building practical knowledge and skills to conduct DIS for health promotion. CBPs were included if they had at least one capacity building activity other than educational coursework or training alone. A multi-method strategy was used to identify DIS CBPs. Data about the characteristics of DIS CBPs were abstracted from each program's website. In addition, a survey instrument was developed and fielded to gather in-depth information about the structure, activities, and resources of each CBP.ResultsIn total, 165 DIS CBPs met our inclusion criteria and were included in the final CBP inventory. Of these, 68% are affiliated with a United States (US) institution and 32% are internationally based. There was one CBP identified in a low- and middle-income country (LMIC). Of the US-affiliated CBPs, 55% are embedded within a Clinical and Translational Science Award program. Eighty-seven CBPs (53%) responded to a follow-up survey. Of those who completed a survey, the majority used multiple DIS capacity building activities with the most popular being Training and Education (n=69, 79%) followed by Mentorship (n=58, 67%), provision of DIS Resources and Tools (n=57, 66%), Consultation (n=58, 67%), Professional Networking (n=54, 62%), Technical Assistance (n=46, 52%), and Grant Development Support (n=45, 52%).ConclusionsTo our knowledge, this is the first study to catalog DIS programs and synthesize learnings into a set of priorities and sustainment strategies to support DIS capacity building efforts. There is a need for formal certification, accessible options for learners in LMICs, opportunities for practitioners, and opportunities for mid/later stage researchers. Similarly, harmonized measures of reporting and evaluation would facilitate targeted cross-program comparison and collaboration.

PurposeTeams play a central role in the implementation of new practices in settings providing team-based care. However, the implementation science literature has paid little attention to potentially important team-level constructs. Aspects of teamwork, including team interdependence, team functioning, and team performance, may affect implementation processes and outcomes. This cross-sectional study tests associations between teamwork and implementation antecedents and outcomes in a statewide initiative to implement a standardized mental health screening/referral protocol in Child Advocacy Centers (CACs).MethodsMultidisciplinary team members (N = 433) from 21 CACs completed measures of team interdependence; affective, behavioral, and cognitive team functioning; and team performance. Team members also rated the acceptability, appropriateness, and feasibility of the screening/referral protocol and implementation climate. The implementation outcomes of days to adoption and reach were independently assessed with administrative data. Associations between team constructs and implementation antecedents and outcomes were tested with linear mixed models and regression analyses.ResultsTeam task interdependence was positively associated with implementation climate and reach, and outcome interdependence was negatively correlated with days to adoption. Task and outcome interdependence were not associated with acceptability, appropriateness, or feasibility of the screening/referral protocol. Affective team functioning (i.e., greater liking, trust, and respect) was associated with greater acceptability, appropriateness, and feasibility. Behavioral and cognitive team functioning were not associated with any implementation outcomes in multivariable models. Team performance was positively associated with acceptability, appropriateness, feasibility, and implementation climate; performance was not associated with days to adoption or reach.ConclusionsWe found associations of team interdependence, functioning, and performance with both individual- and center-level implementation outcomes. Implementation strategies targeting teamwork, especially task interdependence, affective functioning, and performance, may contribute to improving implementation outcomes in team-based service settings.

BackgroundPolicy is a powerful tool for systematically altering healthcare access and quality, but the research to policy gap impedes translating evidence-based practices into public policy and limits widespread improvements in service and population health outcomes. The US opioid epidemic disproportionately impacts Medicaid members who rely on publicly funded benefits to access evidence-based treatment including medications for opioid use disorder (MOUD). A myriad of misaligned policies and evidence-use behaviors by policymakers across federal agencies, state Medicaid agencies, and managed care organizations limit coverage of and access to MOUD for Medicaid members. Dissemination strategies that improve policymakers' use of current evidence are critical to improving MOUD benefits and reducing health disparities. However, no research describes key determinants of Medicaid policymakers' evidence use behaviors or preferences, and few studies have examined data-driven approaches to developing dissemination strategies to enhance evidence-informed policymaking. This study aims to identify determinants and intermediaries that influence policymakers' evidence use behaviors, then develop and test data-driven tailored dissemination strategies that promote MOUD coverage in benefit arrays.MethodsGuided by the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework, we will conduct a national survey of state Medicaid agency and managed care organization policymakers to identify determinants and intermediaries that influence how they seek, receive, and use research in their decision-making processes. We will use latent class methods to empirically identify subgroups of agencies with distinct evidence use behaviors. A 10-step dissemination strategy development and specification process will be used to tailor strategies to significant predictors identified for each latent class. Tailored dissemination strategies will be deployed to each class of policymakers and assessed for their acceptability, appropriateness, and feasibility for delivering evidence about MOUD benefit design.DiscussionThis study will illuminate key determinants and intermediaries that influence policymakers' evidence use behaviors when designing benefits for MOUD. This study will produce a critically needed set of data-driven, tailored policy dissemination strategies. Study results will inform a subsequent multi-site trial measuring the effectiveness of tailored dissemination strategies on MOUD benefit design and implementation. Lessons from dissemination strategy development will inform future research about policymakers' evidence use preferences and offer a replicable process for tailoring dissemination strategies.

Accreditation is gaining ground in human services as leaders find ways to demonstrate the quality and legitimacy of services. This study examined site-level accreditation for SafeCare®, an evidence-based practice designed to prevent and reduce child maltreatment. We leveraged two waves of qualitative data to explore the perspectives of trainers, organizational and system leaders, and program developers who participated in an initial rollout of a site-level accreditation process for SafeCare. Institutional theory was used to frame accreditations potential benefits, burden, and impact. Findings highlight specific considerations for the human service environment, including the inherent resource scarcity, interdependence among organizations, and the impact of cost and slow-moving bureaucratic processes.

BackgroundAlthough healthcare is delivered in inherently multilevel contexts, implementation science has no widely endorsed methodological standards defining the characteristics of rigorous, multilevel implementation research. We identify and describe eight characteristics of high-quality, multilevel implementation research to encourage discussion, spur debate, and guide decision-making around study design and methodological issues.RecommendationsImplementation researchers who conduct rigorous multilevel implementation research demonstrate the following eight characteristics. First, they map and operationalize the specific multilevel context for defined populations and settings. Second, they define and state the level of each construct under study. Third, they describe how constructs relate to each other within and across levels. Fourth, they specify the temporal scope of each phenomenon at each relevant level. Fifth, they align measurement choices and construction of analytic variables with the levels of theories selected (and hypotheses generated, if applicable). Sixth, they use a sampling strategy consistent with the selected theories or research objectives and sufficiently large and variable to examine relationships at requisite levels. Seventh, they align analytic approaches with the chosen theories (and hypotheses, if applicable), ensuring that they account for measurement dependencies and nested data structures. Eighth, they ensure inferences are made at the appropriate level. To guide implementation researchers and encourage debate, we present the rationale for each characteristic, actionable recommendations for operationalizing the characteristics in implementation research, a range of examples, and references to make the characteristics more usable. Our recommendations apply to all types of multilevel implementation study designs and approaches, including randomized trials, quantitative and qualitative observational studies, and mixed methods.ConclusionThese eight characteristics provide benchmarks for evaluating the quality and replicability of multilevel implementation research and promote a common language and reference points. This, in turn, facilitates knowledge generation across diverse multilevel settings and ensures that implementation research is consistent with (and appropriately leverages) what has already been learned in allied multilevel sciences. When a shared and integrated description of what constitutes rigor is defined and broadly communicated, implementation science is better positioned to innovate both methodologically and theoretically.

BackgroundCervical cancer constitutes a huge burden among women in Nigeria, particularly HIV-infected women. However, the provision and uptake of cervical cancer screening and treatment is limited in Nigeria. Understanding implementation determinants is essential for the effective translation of such evidence-based interventions into practice, particularly in low-resource settings. COVID-19 pandemic necessitated online collaboration making implementation mapping challenging in some ways, while providing streamlining opportunities. In this study, we describe the use of a virtual online approach for implementation mapping (steps 1-3) to identify implementation determinants, mechanisms, and strategies to implement evidence-based cervical cancer screening and treatment in existing HIV infrastructure in Nigeria.MethodsThis study used a mixed methods study design with a virtual modified nominal group technique (NGT) process aligning with Implementation Mapping steps 1-3. Eleven stakeholders (six program staff and five healthcare providers and administrators) participated in a virtual NGT process which occurred in two phases. The first phase utilized online surveys, and the second phase utilized an NGT and implementation mapping process. The Exploration, Preparation, Implementation and Sustainment (EPIS) framework was used to elicit discussion around determinants and strategies from the outer context (i.e., country and regions), inner organizational context of existing HIV infrastructure, bridging factors that relate to bi-directional influences, and the health innovation to be implemented (in this case cervical cancer screening and treatment). During the NGT, the group ranked implementation barriers and voted on implementation strategies using Mentimeter.ResultsEighteen determinants to integrating cervical cancer screening and treatment into existing comprehensive HIV programs were related to human resources capacity, access to cervical cancer services, logistics management, clinic, and client-related factors. The top 3 determinants included gaps in human resources capacity, poor access to cervical cancer services, and lack of demand for services resulting from lack of awareness about the disease and servicesA set of six core implementation strategies and two enhanced implementation strategies were identified.ConclusionsRapid Implementation Mapping is a feasible and acceptable approach for identifying and articulating implementation determinants, mechanisms, and strategies for complex healthcare interventions in LMICs.

BackgroundAdherence to intervention training implementation strategies is at the foundation of fidelity; however, few studies have linked training adherence to trainee attitudes and leadership behaviors to identify what practically matters for the adoption and dissemination of evidence-based practices. Through the conduct of this hybrid type 3 effectiveness-implementation cluster randomized controlled trial, we collected Exploration, Preparation, Implementation, and Sustainment (EPIS) data and merged it with tailored motivational interviewing training adherence data, to elucidate the relationship between provider attitudes toward evidence-based practices, leadership behaviors, and training implementation strategy (e.g., workshop attendance and participation in one-on-one coaching) adherence.MethodOur sample included data from providers who completed baseline (pre-intervention) surveys that captured inner and outer contexts affecting implementation and participated in tailored motivational interviewing training, producing a dataset that included training implementation strategies adherence and barriers and facilitators to implementation (N = 77). Leadership was assessed by two scales: the director leadership scale and implementation leadership scale. Attitudes were measured with the evidence-based practice attitude scale (EBPAS-50). Adherence to training implementation strategies was modeled as a continuous outcome with a Gaussian distribution. Analyses were conducted in SPSS.ResultsOf the nine general attitudes toward evidence-based practice, openness was associated with training adherence (estimate [EST] = 0.096, p

The UC San Diego Altman Clinical and Translational Research Institute Dissemination and Implementation Science Center (DISC) launched in 2020 to provide dissemination and implementation science (DIS) training, technical assistance, community engagement, and research advancement. DISC developed a program-wide logic model to inform a process evaluation of member engagement and impact related to DISC services. The DISC Logic Model (DLM) served as the framework for a process evaluation capturing quantitative and qualitative information about scientific activities, outputs, and outcomes. The evaluation involved a multimethod approach with surveys, attendance tracking, feedback forms, documentation of grant outcomes, and promotions metrics (e.g., Twitter engagement). There were 540 DISC Members at the end of year 2 of the DISC. Engagement in the DISC was high with nearly all members endorsing at least one scientific activity. Technical assistance offerings such as DISC Journal Club and consultation were most frequently used. The most common scientific outputs were grant submission (65, 39%), formal mentoring for career award (40, 24%), and paper submission (34, 21%). The DLM facilitated a comprehensive process evaluation of our center. Actionable steps include prioritizing technical assistance, strengthening networking opportunities, identifying streamlined approaches to facilitate DIS grant writing through writing workshops, as well as office hours or organized writing leagues.

BACKGROUND: Effective teams are essential to high-quality healthcare. However, teams, team-level constructs, and team effectiveness strategies are poorly delineated in implementation science theories, models, and frameworks (TMFs), hindering our understanding of how teams may influence implementation. The Exploration, Preparation, Implementation, Sustainment (EPIS) framework is a flexible and accommodating framework that can facilitate the application of team effectiveness approaches in implementation science. MAIN TEXT: We define teams and provide an overview of key constructs in team effectiveness research. We describe ways to conceptualize different types of teams and team constructs relevant to implementation within the EPIS framework. Three case examples illustrate the application of EPIS to implementation studies involving teams. Within each study, we describe the structure of the team and how team constructs influenced implementation processes and outcomes. CONCLUSIONS: Integrating teams and team constructs into the EPIS framework demonstrates how TMFs can be applied to advance our understanding of teams and implementation. Implementation strategies that target team effectiveness may improve implementation outcomes in team-based settings. Incorporation of teams into implementation TMFs is necessary to facilitate application of team effectiveness research in implementation science.

BackgroundChildren's Advocacy Centers (CACs) use multidisciplinary teams to investigate and respond to maltreatment allegations. CACs play a critical role in connecting children with mental health needs to evidence-based mental health treatment, especially in low-resourced rural areas. Standardized mental health screening and referral protocols can improve CACs' capacity to identify children with mental health needs and encourage treatment engagement. In the team-based context of CACs, teamwork quality is likely to influence implementation processes and outcomes. Implementation strategies that target teams and apply the science of team effectiveness may enhance implementation outcomes in team-based settings.MethodsWe will use Implementation Mapping to develop team-focused implementation strategies to support the implementation of the Care Process Model for Pediatric Traumatic Stress (CPM-PTS), a standardized screening and referral protocol. Team-focused strategies will integrate activities from effective team development interventions. We will pilot team-focused implementation in a cluster-randomized hybrid type 2 effectiveness-implementation trial. Four rural CACs will implement the CPM-PTS after being randomized to either team-focused implementation (n = 2 CACs) or standard implementation (n = 2 CACs). We will assess the feasibility of team-focused implementation and explore between-group differences in hypothesized team-level mechanisms of change and implementation outcomes (implementation aim). We will use a within-group pre-post design to test the effectiveness of the CPM-PTS in increasing caregivers' understanding of their child's mental health needs and caregivers' intentions to initiate mental health services (effectiveness aim).ConclusionsTargeting multidisciplinary teams is an innovative approach to improving implementation outcomes. This study will be one of the first to test team-focused implementation strategies that integrate effective team development interventions. Results will inform efforts to implement evidence-based practices in team-based service settings.Trial registrationClinicaltrials.gov, NCT05679154 . Registered on January 10, 2023.

BackgroundUnderstanding the barriers and facilitators of implementation completion is critical to determining why some implementation efforts fail and some succeed. Such studies provide the foundation for developing further strategies to support implementation completion when scaling up evidence-based practices (EBPs) such as Motivational Interviewing.MethodThis mixed-methods study utilized the Exploration, Preparation, Implementation, and Sustainment framework in an iterative analytic design to compare adolescent HIV clinics that demonstrated either high or low implementation completion in the context of a hybrid Type III trial of tailored motivational interviewing. Ten clinics were assigned to one of three completion categories (high, medium, and low) based on percentage of staff who adhered to three components of implementation strategies. Comparative analysis of staff qualitative interviews compared and contrasted the three high-completion clinics with the three low-completion clinics.ResultsResults suggested several factors that distinguished high-completion clinics compared to low-completion clinics including optimism, problem-solving barriers, leadership, and staff stress and turnover.ConclusionsImplementation strategies targeting these factors can be added to EBP implementation packages to improve implementation success.Plain language summaryWhile studies have begun to address adherence to intervention techniques, this is one of the first studies to address organizational adherence to implementation strategies. Youth HIV providers from different disciplines completed interviews about critical factors in both the inner and outer context that can support or hinder an organization's adherence to implementation strategies. Compared to less adherent clinics, more adherent clinics reported more optimism, problem-solving, and leadership strengths and less staff stress and turnover. Implementation strategies addressing these factors could be added to implementation packages to improve implementation success.

We propose that common elements approaches can advance implementation research and practice and facilitate pragmatic use of intervention and implementation evidence. Common elements are practices or processes frequently shared by interventions or implementations. Traditional common elements methodologies use synthesis, distillation, and statistics to describe and evaluate the merit of common ingredients in effective interventions. Recent developments include identifying and testing common configurations of elements, processes, and context variables across the literature of effective interventions and implementations. While common elements thinking has grown popular in intervention science, it has rarely been utilized in implementation science, and specifically, combined with the intervention literature. The goals of this conceptual methodology paper are to (1) provide an overview of the common elements concept and how it may advance implementation research and usability for practice, (2) give a step-by-step guide to systematic common elements reviews that synthesizes and distills the intervention and implementation literature together, and (3) offer recommendations for advancing element-level evidence in implementation science. A narrative review of the common elements literature was conducted with attention to applications to implementation research. A six-step guide to using an advanced common elements methodology was provided. Examples of potential results are presented, along with a review of the implications for implementation research and practice. Finally, we reviewed methodological limitations in current common elements approaches, and identified steps towards realizing their potential. Common elements methodologies can (a) synthesize and distill the implementation science literature into practical applications, (b) generate evidence-informed hypotheses about key elements and determinants in implementation and intervention processes and mechanisms, and (c) promote evidence-informed precision tailoring of intervention and implementation to context. To realize this potential, common elements approaches need improved reporting of details from both successful and unsuccessful intervention and implementation research, more data availability, and more testing and investigation of causal processes and mechanisms of change from diverse theories.Supplementary informationThe online version contains supplementary material available at 10.1007/s43477-023-00077-4.

Despite advances in evidence-based practices (EBP) to support HIV prevention and treatment, youth ages 13-24 experience significant disparities in HIV risk and outcomes. An important factor in this disparity is poor EBP implementation, yet implementation research is limited, particularly in youth-serving settings. This study used the Exploration, Preparation, Implementation, Sustainment (EPIS) framework to guide the implementation of four Motivational Interviewing (MI) and MI-framed interventions into youth-serving HIV prevention and treatment settings. Key stakeholders (n = 153) across 13 sites completed pre-implementation interviews. Stakeholders comments identified two critical factors for effective implementation: fit with the patient population and provider receptivity, including concerns about scope of practice, buy-in, and time. Stakeholders recommended strategies for structuring training, fidelity monitoring, and facilitating implementation including engaging informal leaders, collaboratively developing the implementation strategy, and site-wide implementation. Results highlight the importance of pre-implementation contextual assessment and strategic planning for identifying provider concerns and developing responsive implementation strategies.

Lay abstractChildren with autism frequently experience co-occurring mental health needs. The "Access to Tailored Autism Integrated Care (ATTAIN)" model was co-created with caregivers, pediatric providers, and health care leaders to identify mental health needs and link to mental health care for autistic children. This article describes outcomes from a pilot study of Access to Tailored Autism Integrated Care with 36 pediatric primary care providers from seven clinics within three healthcare systems. Providers participated in an initial Access to Tailored Autism Integrated Care training and received ongoing online support over 4 months with autistic patients ages 4-16 years old. Survey and interview assessments measured provider perceptions of feasibility, acceptability, and intentions to continue using Access to Tailored Autism Integrated Care after the pilot. Providers reported that Access to Tailored Autism Integrated Care was feasible, acceptable, that the initial training was helpful in their implementation but that more specific and tailored implementation support was needed. Results show that Access to Tailored Autism Integrated Care is a promising model to support mental health screening and linkage for children with autism in primary care. Findings provide information on specific areas of the Access to Tailored Autism Integrated Care model that could be benefit from additional refinement to support more widespread use in primary care settings.

Lay abstractChildren with autism experience high rates of co-occurring mental health conditions like challenging behaviors and anxiety. However, these co-occurring mental health needs are often not identified when they first become problematic. Pediatricians and their care staff are in a good position to identify mental health needs early and support families to connect to needed services. This study describes a project focused on mental health screening for children with autism in pediatric primary care clinics. Over half of eligible patients were screened using the Pediatric Symptom Checklist-17. Many children with autism had clinically elevated scores, suggesting the need for mental health assessment or services. In particular, children with positive screens had clinical elevations on the challenging behavior and attention subscales of the Pediatric Symptom Checklist-17. This finding is consistent with typical trends in co-occurring challenging behavior presentations in children with autism. Mental health screening in primary care is feasible and offers a promising opportunity to identify co-occurring mental health needs for children with autism early. Screening rates varied between clinics, suggesting tailored to improve routine screening in pediatric primary care for children with autism.

There is limited capacity and infrastructure in sub-Saharan Africa to conduct clinical trials for the identification of efficient and effective new prevention, diagnostic and treatment modalities to address the disproportionate burden of disease. This paper reports on the process to establish locally driven infrastructure for multicentre research and trials in Nigeria known as the Nigeria Implementation Science Alliance Model Innovation and Research Centres (NISA-MIRCs). We used a participatory approach to establish a research network of 21 high-volume health facilities selected from all 6 geopolitical zones in Nigeria capable of conducting clinical trials, implementation research using effectiveness-implementation hybrid designs and health system research. The NISA-MIRCs have a cumulative potential to recruit 60 000 women living with HIV and an age-matched cohort of HIV-uninfected women. We conducted a needs assessment, convened several stakeholder outreaches and engagement sessions, and established a governance structure. Additionally, we selected and trained a core research team, developed criteria for site selection, assessed site readiness for research and obtained ethical approval from a single national institutional review board. We used the Exploration, Preparation, Implementation, Sustainment framework to guide our reporting of the process in the development of this network. The NISA-MIRCs will provide a nationally representative infrastructure to initiate new studies, support collaborative research, inform policy decisions and thereby fill a significant research infrastructure gap in Africa's most populous country.

OBJECTIVE: Our objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four information technology (IT) life cycle phases: planning, development, implementation, and operation. METHODS: The evaluation framework was developed based on a review of existing evaluation frameworks from health informatics and other domains (human factors engineering, software engineering, and social sciences); expert consensus; and real-world testing in multiple EHR-integrated innovation studies. RESULTS: The resulting Evaluation in Life Cycle of IT (ELICIT) framework covers four IT life cycle phases and three measure levels (society, user, and IT). The ELICIT framework recommends 12 evaluation steps: (1) business case assessment; (2) stakeholder requirements gathering; (3) technical requirements gathering; (4) technical acceptability assessment; (5) user acceptability assessment; (6) social acceptability assessment; (7) social implementation assessment; (8) initial user satisfaction assessment; (9) technical implementation assessment; (10) technical portability assessment; (11) long-term user satisfaction assessment; and (12) social outcomes assessment. DISCUSSION: Effective evaluation requires a shared understanding and collaboration across disciplines throughout the entire IT life cycle. In contrast with previous evaluation frameworks, the ELICIT framework focuses on all phases of the IT life cycle across the society, user, and IT levels. Institutions seeking to establish evaluation programs for EHR-integrated innovations could use our framework to create such shared understanding and justify the need to invest in evaluation. CONCLUSION: As health care undergoes a digital transformation, it will be critical for EHR-integrated innovations to be systematically evaluated. The ELICIT framework can facilitate these evaluations.

ObjectiveTo characterize pre-implementation organizational factors associated with Access To Tailored Autism Integrated Care (ATTAIN), an integrated care model for children with autism and identified or suspected co-occurring mental health needs.MethodsPediatric primary care providers (n=36) completed surveys as part of a pilot study testing ATTAIN feasibility. Measures assessed: background characteristics; implementation climate; organizational readiness; evidence-based practice (EBP) attitudes; knowledge, confidence and comfort caring for children with autism.ResultsCompared to providers from a network of primary care practices and an integrated healthcare system, providers from a Federally Qualified Health Center (FQHC) reported less positive perceptions of climate supportive of EBP implementation and, specifically, selection for openness and rewards for EBPs. Implementation climate was associated with autism knowledge, comfort with mental health referral and follow up, and organizational change efficacy.ConclusionsFindings advance understanding of pre-implementation organizational context factors important to assess for EBP implementation in diverse pediatric care settings.

Adverse Childhood Experiences (ACEs) are defined as traumatic events occurring before age 18, such as maltreatment, life-threatening accidents, harsh migration experiences, or violence. Screening for ACEs includes asking questions about an individuals early exposure to these types of events. ACEs screenings have potential value in identifying children exposed to chronic and significant stress that produces elevated cortisol levels (i.e., toxic stress), and its associated physical and mental health conditions, such as heart disease, diabetes, depression, asthma, ADHD, anxiety, and substance dependence. However, ACEs screenings are seldom used in primary care settings. The Surgeon General of California has addressed this care gap by introducing ACEs Aware, an ACEs screening fee-for-service healthcare policy signed into law by Gov. Gavin Newsom. Since January 2020, Medi-Cal, Californias Medicaid health care program, has reimbursed primary care providers for using the Pediatric ACEs and Related Life-events Screener (PEARLS) tool to screen children and adults for ACEs during wellness visits. To achieve the goals set by the ACEs Aware state policy, it is essential to develop and test implementation strategies that are informed by the values, priorities, and resources of clinical settings, healthcare professionals, and end-users. To address this need, we partnered with a system of federally qualified health centers in Southern California on a pilot study to facilitate the implementation of ACEs screenings in five community-based clinics. The health centers had broad ideas for an implementation strategy, as well as best practices to improve adoption of screenings, such as focusing on staff training to improve clinic workflow. This knowledge was incorporated into the development of an implementation strategy template, used at the outset of this study. We used the Exploration, Preparation, Implementation and Sustainment (EPIS) framework to guide the study and inform a participatory planning process called Implementation Mapping. In this paper, we describe how Implementation Mapping was used to engage diverse stakeholders and guide them through a systematic process that resulted in the development of the implementation strategy. We also detail how the EPIS framework informed each Implementation Mapping Task and provide recommendations for developing implementation strategies using EPIS and Implementation Mapping in health-care settings.

BackgroundMost justice-involved youth are supervised in community settings, where assessment and linkage to substance use (SU) treatment services are inconsistent and fragmented. Only 1/3 of youth with an identified SU need receive a treatment referral and even fewer initiate services. Thus, improving identification and linkage to treatment requires coordination across juvenile justice (JJ) and behavioral health (BH) agencies. The current study examines the comparative effectiveness of two bundled implementation intervention strategies for improving SU treatment initiation, engagement, and continuing care among justice-involved youth supervised in community settings. Exploration, Preparation, Implementation, Sustainment (EPIS) served as the conceptual framework for study design and selection/timing of implementation intervention components, and the BH Services Cascade served as the conceptual and measurement framework for identifying and addressing gaps in service receipt.MethodsPart of a larger Juvenile-Justice Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS) Cooperative, this study involved a multisite, cluster-randomized control trial where sites were paired then randomly assigned to receive Core (training teams on the BH Services Cascade and data-driven decision making; supporting goal selection) or Core+Enhanced (external facilitation of implementation teams) intervention components. Youth service records were collected from 20 JJ community supervision agencies (in five states) across five study phases (baseline, pre-randomization, early experiment, late experiment, maintenance). Implementation teams comprised of JJ and BH staff collaboratively identified goals along the BH Cascade and used data-driven decision-making to implement change.ResultsResults suggest that Core intervention components were effective at increasing service receipt over time relative to baseline, but differences between Core and Core+Enhanced conditions were non-significant. Time to service initiation was shorter among Core+Enhanced sites, and deeper Cascade penetration occurred when external facilitation (of implementation teams) was provided. Wide variation existed in the degree and nature of change across service systems.ConclusionsFindings demonstrate the criticality of early EPIS phases, demonstrating that strategies provided during the formative exploration and preparation phases produced some improvement in service receipt, whereas implementation-focused activities produced incremental improvement in moving youth farther along the Cascade.

BackgroundImplementation climate is an organizational construct theorized to facilitate the adoption and delivery of evidence-based practices. Within schools, teachers often are tasked with implementing universal prevention programs. Therefore, they are ideal informants when assessing school implementation climate for initial and continuous implementation improvement efforts. The purpose of this study was to examine the construct validity (i.e., factor structure and convergent/divergent validity) of a school-adapted measure of strategic implementation climate called the School Implementation Climate Scale (SICS).MethodsConfirmatory factor analyses of SICS data, collected from 441 teachers in 52 schools, were used to compare uncorrelated and correlated first-order factor models and a second-order hierarchical model. Correlations with other school measures were examined to assess SICS convergent and divergent validities.ResultsResults demonstrated acceptable internal consistency for each SICS subscale (αs > 0.80 for all subscales) and construct validity of the hypothesized factor structure of the SICS with three new scales. The hierarchical second-order factor structure with eight first-order factors was found to best model the SICS data. Correlations with other school measures were in the expected direction and magnitude.ConclusionsResults from this study provide psychometric evidence that supports the use of the SICS to inform the implementation research and practice in schools.Plain language summarySchools are busy trying to implement various universal programs and systems to help support kids in their growth. Beginning and sustaining these efforts is quite challenging, and there is need for tools and ideas to help those implementation efforts. One concept is implementation climate, which is broadly the school staff's perception of the implementation support for a given practice. However, no measure currently exists to help schools assess their implementation climate. The goal of our study was to adapt a measure of implementation climate used in other settings to the school environment. We used feedback from educational experts to make changes and used various analyses to determine if the newly adapted measure was psychometrically sound. Findings suggest the new measure is usable to guide implementation efforts in schools.

Increasing calls within the field of implementation science (IS) research seek to promote active engagement of diverse and often disenfranchised stakeholder voices to increase buy-in, fidelity, outcome relevance, and sustainment of evidence-based practices (EBPs). Including such voices requires cultural humility and the integration of multiple perspectives and values among organizations, groups, and individuals. However, the IS field lacks guidance for researchers on structuring collaborative approaches to promote a co-created process (i.e., synergistic approach to goal attainment). We contend that improved operationalization of co-created implementation collaborations is critical to sparking synergy and addressing differentials based on power, privilege, knowledge, and access to resources among stakeholders. These differentials can undermine future implementation and sustainment efforts if not addressed early in the research effort. An insufficient understanding of the guiding principles of co-created implementation collaborations may limit the scientific value of evaluation processes, and researchers' ability to replicate outcomes. We propose a perspective foregrounded in the concept of co-creation to guide the structuring of implementation collaboratives through five principles. We offer three case examples informed by the Exploration, Preparation, Implementation, Sustainment (EPIS) Framework to illustrate the application of these co-creation principles. Lastly, we offer recommendations for promoting co-creation in IS research moving forward.

BackgroundImplementation science aims to accelerate the public health impact of evidence-based interventions. However, implementation science has had too little focus on the role of health policy - and its inseparable politics, polity structures, and policymakers - in the implementation and sustainment of evidence-based healthcare. Policies can serve as determinants, implementation strategies, the evidence-based "thing" to be implemented, or another variable in the causal pathway to healthcare access, quality, and patient outcomes. Research describing the roles of policy in dissemination and implementation (D&I) efforts is needed to resolve persistent knowledge gaps about policymakers' evidence use, how evidence-based policies are implemented and sustained, and methods to de-implement policies that are ineffective or cause harm. Few D&I theories, models, or frameworks (TMF) explicitly guide researchers in conceptualizing where, how, and when policy should be empirically investigated. We conducted and reflected on the results of a scoping review to identify gaps of existing Exploration, Preparation, Implementation, and Sustainment (EPIS) framework-guided policy D&I studies. We argue that rather than creating new TMF, researchers should optimize existing TMF to examine policy's role in D&I. We describe six recommendations to help researchers optimize existing D&I TMF. Recommendations are applied to EPIS, as one example for advancing TMF for policy D&I.Recommendations(1) Specify dimensions of a policy's function (policy goals, type, contexts, capital exchanged). (2) Specify dimensions of a policy's form (origin, structure, dynamism, outcomes). (3) Identify and define the nonlinear phases of policy D&I across outer and inner contexts. (4) Describe the temporal roles that stakeholders play in policy D&I over time. (5) Consider policy-relevant outer and inner context adaptations. (6) Identify and describe bridging factors necessary for policy D&I success.ConclusionResearchers should use TMF to meaningfully conceptualize policy's role in D&I efforts to accelerate the public health impact of evidence-based policies or practices and de-implement ineffective and harmful policies. Applying these six recommendations to existing D&I TMF advances existing theoretical knowledge, especially EPIS application, rather than introducing new models. Using these recommendations will sensitize researchers to help them investigate the multifaceted roles policy can play within a causal pathway leading to D&I success.

ObjectiveTo examine differences in caregiver and youth reported mental health symptoms for youth initiating mental health treatment through phases of the Coronavirus Disease (COVID-19) pandemic, compared with symptomology reported the prior year.Study designThis retrospective study analyzes group differences in mental health symptoms (Pediatric Symptom Checklist; PSC-35) based on 7874 youth seeking treatment in publicly funded mental health treatment programs during California's Stay-At-Home order (March-May, 2020) and the prolonged pandemic (May-December, 2020) phases of the COVID-19 pandemic as compared with matching groups in 2019.ResultsYouth entering mental health treatment services, and their caregivers, reported significantly increased internalizing, externalizing, and attention-related symptoms during the prolonged pandemic phase, but not during the acute stay-at-home phase of the COVID-19 pandemic, and with small effect sizes. Group comparison analyses did not detect a significantly larger effect for Sexual and Gender Diverse (SGD) youth who identify as lesbian, gay, bisexual, asexual, transgender, Two-Spirit, queer, and/or intersex, and Black, Indigenous, People of Color (BIPOC).ConclusionsA large-scale comparison of youth mental health symptoms before and during the COVID-19 pandemic suggests that mental health was disrupted for youth seeking treatment as the pandemic prolonged throughout 2020.

BACKGROUND: As an evidence-based intervention to prevent maternal and neonatal morbidity and mortality, cesarean birth at rates of under 2%, which is the case in rural Southwest Ethiopia, is an unacceptable public health problem and represents an important disparity in the use of this life-saving treatment compared to more developed regions. The objective of this study is to explore an innovative clinical solution (a mobile cesarean birth center) to low cesarean birth rates resulting from the Three Delays to emergency obstetric care in isolated and underserved regions of Ethiopia, and the world. METHODS: We will use mixed but primarily qualitative methods to explore and prepare the mobile cesarean birth center for subsequent implementation in communities in Bench Sheko and West Omo Zones. This will involve interviews and focus groups with key stakeholders and retreat settings for user-centered design activities. We will present stakeholders with a prototype surgical truck that will help them conceive of the cesarean birth center concept and discuss implementation issues related to staffing, supplies, referral patterns, pre- and post-operative care, and relationship to locations for vaginal birth. DISCUSSION: Completion of our study aims will allow us to describe participants perceptions about barriers and facilitators to cesarean birth and their attitudes regarding the appropriateness, acceptability, and feasibility of a mobile cesarean birth center as a solution. It will also result in a specific, measurable, attainable, relevant, and timely (SMART) implementation blueprint(s), with implementation strategies defined, as well as recruitment plans identified. This will include the development of a logic model and process map, a timeline for implementation with strategies selected that will guide implementation, and additional adaptation/adjustment of the mobile center to ensure fit for the communities of interest. TRIAL REGISTRATION: There is no healthcare intervention on human participants occurring as part of this research, so the study has not been registered.

BackgroundThe COVID-19 pandemic has remarkably altered community mental health service delivery through the rapid implementation of telehealth. This study reports provider perspectives on the impact that COVID-19 and the transition to telehealth had on their work and their ability to deliver evidence-based practices (EBPs).MethodsProviders (n = 93) completed online surveys with quantitative measures and open-ended items exploring their reactions to COVID-19 and to the transition to providing services via telehealth.ResultsPerceptions of personal risk and rumination around COVID-19 were low, while telehealth was viewed positively by providers. Three major themes emerged regarding the major impacts of COVID-19 on work: (1) the altered nature of interactions between patient/client and provider due to telehealth implementation, (2) changes in provider expectations regarding productivity, and (3) challenges maintaining work-life balance. In regard to the major impacts of COVID-19 on EBP delivery, three themes emerged: (1) increased difficulty delivering certain therapies via telehealth, (2) potential limitations to session confidentiality, and (3) challenge of engaging children in telehealth.ConclusionsIn the context of the COVID-19 pandemic, community mental health providers continued to engage with clients and deliver EBPs while navigating a number of changes related to the rapid transition to and implementation of telehealth. This study highlights the need for further work on what supports providers need to effectively engage with clients and deliver EBPs via telehealth, and has implications for how telehealth is sustained or de-implemented post-COVID-19.