Search

BackgroundSuicide is the 12th leading cause of death in the United States. Health care provider training is a top research priority identified by the National Action Alliance for Suicide Prevention; however, evidence-based approaches that target skill building are resource intensive and difficult to implement. Novel computer technologies harnessing artificial intelligence are now available, which hold promise for increasing the feasibility of providing trainees opportunities across a range of continuing education contexts to engage in skills practice with constructive feedback on performance. ObjectiveThis pilot study aims to evaluate the feasibility and acceptability of an eLearning training in suicide safety planning among nurses serving patients admitted to a US level 1 trauma center for acute or intensive care. The training included a didactic portion with demonstration, practice of microcounseling skills with a web-based virtual patient (Client Bot Emily), role-play with a patient actor, and automated coding and feedback on general counseling skills based on the role-play via a web-based platform (Lyssn Advisor). Secondarily, we examined learning outcomes of knowledge, confidence, and skills in suicide safety planning descriptively. MethodsAcute and intensive care nurses were recruited between November 1, 2021, and May 31, 2022, to participate in a formative evaluation using pretraining, posttraining, and 6-month follow-up surveys, as well as observation of the nurses’ performance in delivering suicide safety planning via standardized patient role-plays over 6 months and rated using the Safety Plan Intervention Rating Scale. Nurses completed the System Usability Scale after interacting with Client Bot Emily and reviewing general counseling scores based on their role-play via Lyssn Advisor. ResultsA total of 18 nurses participated in the study; the majority identified as female (n=17, 94%) and White (n=13, 72%). Of the 17 nurses who started the training, 82% (n=14) completed it. On average, the System Usability Scale score for Client Bot Emily was 70.3 (SD 19.7) and for Lyssn Advisor was 65.4 (SD 16.3). On average, nurses endorsed a good bit of knowledge (mean 3.1, SD 0.5) and confidence (mean 2.9, SD 0.5) after the training. After completing the training, none of the nurses scored above the expert-derived cutoff for proficiency on the Safety Plan Intervention Rating Scale (≥14); however, on average, nurses were above the cutoffs for general counseling skills per Lyssn Advisor (empathy: mean 4.1, SD 0.6; collaboration: mean 3.6, SD 0.7). ConclusionsFindings suggest the completion of the training activities and use of novel technologies within this context are feasible. Technologic modifications may enhance the training acceptability and utility, such as increasing the virtual patient conversational abilities and adding automated coding capability for specific suicide safety planning skills. International Registered Report Identifier (IRRID)RR2-10.2196/33695

Purpose Globally, the number of children/adolescents exposed to HIV but uninfected (HIV-exposed uninfected, HEU) is growing. The HEU outcomes: population-evaluation and screening strategies study was designed to provide population-level evidence of the impact of HIV and recent antiretroviral therapy regimen exposure on neurodevelopmental, hearing and mental health outcomes from infancy to adolescence.Participants The study includes a prospective mother–infant cohort and cross-sectional child/youth–caregiver cohorts conducted in Kenya.Between 2021 and 2022, the study enrolled 2000 mother–infant pairs (1000 HEU and 1000 HIV-unexposed uninfected (HUU)) for longitudinal follow-up. Infants were eligible if they were aged 4–10 weeks and healthy. Mothers were eligible if their HIV status was known and were ≥18 years. Study visits are 6 monthly until the child reaches age 3 years.Cross-sectional cohorts spanning ages 3–18 years started enrolment in 2022. Target enrolment is 4400 children/youth (4000 HEU and 400 HUU). Children and youth are eligible if they are HIV negative, maternal HIV status and timing of diagnosis is known, and caregivers are ≥18 years.Data on infant/child/youth growth, neurodevelopment, mental health, morbidity and hearing are collected at enrolment using standardised tools. Dry blood spots samples are collected for telomere length assessment at baseline and yearly for the longitudinal cohort. Growth z-scores, neurodevelopmental scores, telomere length and prevalence of developmental and hearing problems will be compared between HEU/HUU populations.Findings to date Full cohort enrolment for the longitudinal cohort is complete and participants are in follow-up. At 1 year of age, comparing HEU to HUU neurodevelopment using the Malawi developmental assessment tool, we found that HEU infants had higher language scores and comparable scores in fine motor, gross motor and social scores. The cross-sectional cohort has enrolled over 2000 participants and recruitment is ongoing.Future plans Longitudinal cohort follow-up and enrolment to the cross-sectional study will be completed in June 2024.

Implementation science and human-centered design (HCD) offer useful frameworks and methods for considering and designing for individuals' needs and preferences when implementing new interventions or technologies in global health. When used in tandem, the two approaches may blend creative and partnered research methods with a focus on the factors necessary to design, implement, and sustain interventions. However, research is needed that describes the process of blending these two approaches and explores the experiences of community partners. This study builds from a stepped-wedge cluster-randomized trial in Western Kenya, wherein teachers and community health volunteers have been trained to provide trauma-focused cognitive behavioral therapy (TF-CBT). Mobile phones emerged as a tool to supervise lay counselors from afar; however, their use was characterized by unique challenges. Informed by human-centered design and implementation science, we first engaged lay counselors (n = 24) and supervisors (n = 3) in individual semi-structured interviews then hosted an in-person participatory workshop to “co-design” solutions to optimize the use of mobile phone supervision. Lay counselors participated in focus group discussions regarding their experiences in the workshop. Focus group transcripts were analyzed using thematic analysis. We describe our approach as well as focus group discussion results. Counselors felt the workshop was a valuable experience to learn new strategies from their colleagues, and they enjoyed the “collaborative spirit” that emerged as they worked together. Counselors felt that varying small and large group discussions fostered participation by creating opportunities for more people to engage and share their thoughts. Counselors suggested the approach be improved by providing more tangible materials (e.g., hand-outs) and more closely following a schedule of activities. It is important to also center stakeholders’ experiences as partners in the research process. Though counselors largely expressed positive sentiments, they also shared valuable suggestions for how to improve participatory research practices in the future.

Abstract Background For youth receiving care in community mental health centers, comorbidities are the rule rather than the exception. Using measurement-based care (MBC), or the routine evaluation of symptoms to inform care decisions, as the foundation of treatment for youth with comorbid problems significantly improves the impact of psychotherapy by focusing care and building engagement and alliance. MBC increases the rate of symptom improvement, detects clients who would otherwise deteriorate, and alerts clinicians to non-responders. Despite its demonstrated utility, MBC is rarely implemented with fidelity; less than 15% of providers report using MBC per recommendations. Previous efforts to support MBC implementation have yielded suboptimal outcomes, in part, due to organizations’ challenges with identifying and prioritizing barriers and selecting and developing strategies to overcome them. New methods are needed for identifying and prioritizing barriers, and matching strategies to barriers to optimize MBC implementation and treatment quality to improve youth mental health outcomes in community settings. Methods Pragmatic implementation methods will be piloted in four diverse community mental health centers. Methods include (a) rapid evidence synthesis; (b) rapid ethnography; (c) design kits (e.g., kits with disposable cameras, journals, maps); (d) barrier prioritization, and (e) causal pathway diagramming. These activities will generate actionable barriers; subsequently, we will use facilitated group processes to prioritize barriers and develop causal pathway diagrams to match strategies to barriers to create implementation plans that optimize MBC fidelity (Aim 1). We will track strategy deployment for 6 months, then compare MBC fidelity for another 6 months post-implementation with data from 2 years of historical controls (Aim 2). Finally, we will co-design a toolkit for design kit methods with youth and the practice and scientific communities (Aim 3). Discussion Optimizing MBC implementation in community mental health centers could transform youth mental health care by ensuring the most pressing symptoms are targeted early in treatment. The discussion section highlights expected challenges and limits to using the five methods, including recruitment and engagement given the high pressure on community mental health settings. Trial registration Clinicaltrials.gov. NCT05644756 . Registered on 18 November 2022. This trial was retrospectively registered.

This study describes an alternative to face-to-face training method for community health volunteers (CHVs) as used by a collaborative group from the University of Nairobi, University of Washington and the Nairobi Metropolitan Mental Health Team during the COVID-19 lockdown in Kenya. This qualitative study describes the experiences of 17 CHVs enrolled in a training study, required to utilize different digital platforms (Google Meet or Jitsi) as a training forum for the first time. Verbatim extracts of the participants’ daily experiences are extracted from a series of write-ups in the group WhatsApp just before the training. Daily failures and success experiences in joining a Google meet or Jitsi are recorded. Then, 17 participants, 10 women and 7 men, aged between 21 and 51 years (mean = 33), owning a smartphone, were enrolled in the study. None had used Jitsi or Google meet before. Different challenges were reported in login to either and a final decision to use Jitsi, which became the training platform. Training CHVs to deliver a psychosocial intervention using smartphones is possible. However, the trainer must establish appropriate and affordable methods when resources are constrained.

Introduction A mental health provider's perception of how well an intervention can be carried out in their context (i.e., feasibility) is an important implementation outcome. This article aims to identify determinants of feasibility of trauma-focused cognitive behavioral therapy (TF-CBT) through a case-based causal approach. Method Data come from an implementation-effectiveness study in which lay counselors (teachers and community health volunteers) implemented a culturally adapted manualized mental health intervention, TF-CBT, delivered to teens who were previously orphaned and were experiencing posttraumatic stress symptoms and prolonged grief in Western Kenya. The intervention team identified combinations of determinants that led to feasibility among teacher- and community health volunteer-counselors through coincidence analysis. Results Among teacher-counselors, organizational-level factors (implementation climate, implementation leadership) determined moderate and high levels of feasibility. Among community health volunteer-counselors, a strong relationship between a clinical supervisor and the supervisee was the most influential determinant of feasibility. Conclusion Methodology and findings from this article can guide the assessment of determinants of feasibility and the development of implementation strategies for manualized mental health interventions in contexts like Western Kenya. Plain Language Summary A mental health provider's perception of how easy a therapy is to use in their work setting (i.e., feasibility) can impact whether the provider uses the therapy in their setting. Implementation researchers have recommended finding practices and constructs that lead to important indicators that a therapy will be used. However, limited research to our knowledge has searched and found practices and constructs that might determine feasibility of a therapy. This article uses existing data from a large trial looking at the continued use of a trauma-focused therapy to find practices and constructs that lead to moderate and high levels of feasibility. We found that in settings with a strong organizational structure that organization and leadership support for the therapy led to teachers in Kenya to perceive the therapy as easy to use. On the other hand, in settings with a weaker organizational structure, outside support from a clinical supervisor led to community health volunteers in Kenya perceiving the therapy as easy to use. The findings from this article can guide context-specific recommendations for increasing perceived therapy feasibility at the provider-, organization-, and policy levels.

Screening for suicide risk in primary care settings is a recommended strategy worldwide for suicide prevention. However, few studies examine which clinical behaviors on the part of primary care providers are most predictive of competency in suicide risk assessment and management. The current study used ratings on the Enhancing Assessment of Common Therapeutic Factors (ENACT) tool during observations of provider-patient role plays (N = 91) to understand how primary care providers’ use of emotional validation and invalidation strategies associate with competency in assessing for and managing suicide risk. Structural equation modeling revealed that emotional validation by primary care providers (β = 0.63, p

BackgroundKenyan adolescent girls and young women (AGYW) experience a dual burden of HIV and common mental disorders (CMD). HIV clinics are a key entry point for AGYW in need of integrated CMD and HIV care; however, rates of screening and referral for CMDs are low. Our objective was to test an evidence-based provider training strategy, simulated patient encounters (SPEs), on CMD service delivery for AGYW in a Kenyan HIV clinic.MethodsThis pilot study was conducted in a public HIV clinic in Thika, Kenya from January to November 2021. The simulated patient encounter (SPE) implementation strategy included case script development from prior qualitative work, patient actor training, and a three-day SPE training including four standardized mock clinical encounters followed by quantitative surveys assessing provider competencies for each encounter. We abstracted medical record data related to HIV and CMDs such as HIV status, reason for visit, CMD screening test performed, and counselling or referral information. We conducted an interrupted time series analysis using abstracted HIV and CMD screening rates from AGYW ages 16–25 years visiting the clinic 7 months before and 3 months after SPE training. We used generalized linear models to assess changes in CMD screening rates after training.ResultsA total of 10 providers participated in the training. Competency ratings improved across four mock encounters (mean score from 8.1 to 13.7) between first and fourth encounters. We abstracted all medical records (n = 1,154) including from 888 (76%) AGYW seeking HIV treatment, 243 (21%) seeking prevention services, and 34 (3%) seeking other services. CMD screening rates increased immediately following training from 8 to 21% [relative risk (RR) = 2.57, 95% confidence interval (CI) = 1.34–4.90, p

Background Interdisciplinary collaboration and stakeholder engagement are key ingredients in implementation science research. However, effective and efficient collaboration can be limited by the complexity of implementation science terms. In this article, we argue that the development and use of plain language implementation science terms is an essential step to facilitate collaboration and engagement. Method We present an example of plain language development to portray the process and the potential benefits plain language can have on implementation science research. Implementation scientists and intervention experts codeveloped plain language implementation terms as a part of an implementation-effectiveness trial in western Kenya and in preparation for a stakeholder collaborative design meeting. Results The developed plain language terms facilitated wider stakeholder understanding and integration of implementation science findings that could inform the design of a stakeholder-led implementation coaching program. Conclusions We encourage the use of the plain language terms presented in this article, further translation, and additional development of other plain language terms for implementation science constructs.

Abstract Background Implementation science is at a sufficiently advanced stage that it is appropriate for the field to reflect on progress thus far in achieving its vision, with a goal of charting a path forward. In this debate, we offer such reflections and report on potential threats that might stymie progress, as well as opportunities to enhance the success and impact of the field, from the perspective of a group of US-based researchers. Main body Ten mid-career extramurally funded US-based researchers completed a “pre-mortem” or a group brainstorming exercise that leverages prospective hindsight to imagine that an event has already occurred and to generate an explanation for it — to reduce the likelihood of a poor outcome. We came to consensus on six key themes related to threats and opportunities for the field: (1) insufficient impact, (2) too much emphasis on being a “legitimate science,” (3) re-creation of the evidence-to-practice gap, (4) difficulty balancing accessibility and field coherence, (5) inability to align timelines and priorities with partners, and (6) overly complex implementation strategies and approaches. Conclusion We submit this debate piece to generate further discussion with other implementation partners as our field continues to develop and evolve. We hope the key opportunities identified will enhance the future of implementation research in the USA and spark discussion across international groups. We will continue to learn with humility about how best to implement with the goal of achieving equitable population health impact at scale.

Abstract Background Initial training and ongoing post-training consultation (i.e., ongoing support following training, provided by an expert) are among the most common implementation strategies used to change clinician practice. However, extant research has not experimentally investigated the optimal dosages of consultation necessary to produce desired outcomes. Moreover, the degree to which training and consultation engage theoretical implementation mechanisms—such as provider knowledge, skills, and attitudes—is not well understood. This study examined the effects of a brief online training and varying dosages of post-training consultation (BOLT+PTC) on implementation mechanisms and outcomes for measurement-based care (MBC) practices delivered in the context of education sector mental health services. Methods A national sample of 75 clinicians who provide mental health interventions to children and adolescents in schools were randomly assigned to BOLT+PTC or control (services as usual). Those in BOLT+PTC were further randomized to 2-, 4-, or 8-week consultation conditions. Self-reported MBC knowledge, skills, attitudes, and use (including standardized assessment, individualized assessment, and assessment-informed treatment modification) were collected for 32 weeks. Multilevel models were used to examine main effects of BOLT+PTC versus control on MBC use at the end of consultation and over time, as well as comparisons among PTC dosage conditions and theorized mechanisms (skills, attitudes, knowledge). Results There was a significant linear effect of BOLT+PTC over time on standardized assessment use (b = .02, p < .01), and a significant quadratic effect of BOLT+PTC over time on individualized assessment use (b = .04, p < .001), but no significant effect on treatment modification. BOLT + any level of PTC resulted in higher MBC knowledge and larger growth in MBC skill over the intervention period as compared to control. PTC dosage levels were inconsistently predictive of outcomes, providing no clear evidence for added benefit of higher PTC dosage. Conclusions Online training and consultation in MBC had effects on standardized and individualized assessment use among clinicians as compared to services as usual with no consistent benefit detected for increased consultation dosage. Continued research investigating optimal dosages and mechanisms of these established implementation strategies is needed to ensure training and consultation resources are deployed efficiently to impact clinician practices. Trial registration ClinicalTrials.gov NCT05041517 . Retrospectively registered on 10 September 2021.

Abstract Background There is a pervasive mental health treatment gap for children across the globe. Engaging stakeholders in child mental health evidence-based treatment (EBT) implementation projects may increase the likelihood of successful EBT implementation, thereby better addressing the treatment gap. However, little is known about the extent of stakeholder engagement to inform the implementation of child mental health EBTs. Methods We conducted a scoping review to characterize stakeholder engagement in child mental health EBT implementation projects, including what stakeholders are engaged, how they are engaged, when they are engaged, where they are engaged (i.e., location of projects), why they are engaged, and the reported impacts of stakeholder engagement. We searched seven databases: MEDLINE, PsycInfo, Embase, ERIC, CINAHL Complete, Scopus, and Web of Science Core Collection. To be included, studies had to report on some form of stakeholder engagement that was undertaken to inform or explain the implementation of a child mental health EBT. We performed data extraction and synthesis to describe key study and stakeholder characteristics, stakeholder engagement methods and rationales, reported impacts of stakeholder engagement, and quality of reporting on stakeholder engagement. Results In total, 122 manuscripts met our inclusion criteria, from which we identified a total of 103 unique child mental health EBT implementation projects. Projects spanned 22 countries, which included low-, lower-middle, upper-middle, and high-income countries. The largest number of projects was in the USA and conducted in public mental health settings. Most projects engaged EBT providers during the active implementation phase and with limited depth, often gathering information from stakeholders without sharing decision-making power in implementation efforts. Across projects, impacts of stakeholder engagement spanned all of Proctor and colleague’s implementation outcomes. Conclusions Given that stakeholder engagement is often shallow and with limited shared decision-making, additional effort should be made to increase engagement to preempt challenges to EBT implementation and ensure implementation success. Such efforts may ensure the just distribution of power in EBT implementation efforts. Trial registration All procedures were pre-registered on the Open Science Framework prior to conducting the literature search (DOI 10.17605/OSF.IO/GR9AP ).

BackgroundHIV treatment engagement is critical for people with HIV; however, behavioral health comorbidities and HIV-related stigma are key barriers to engagement. Treatments that address these barriers and can be readily implemented in HIV care settings are needed. ObjectiveWe presented the process for adapting transdiagnostic cognitive behavioral psychotherapy, the Common Elements Treatment Approach (CETA), for people with HIV receiving HIV treatment at a Southern US HIV clinic. Behavioral health targets included posttraumatic stress, depression, anxiety, substance use, and safety concerns (eg, suicidality). The adaptation also included ways to address HIV-related stigma and a component based on Life-Steps, a brief cognitive behavioral intervention to support patient HIV treatment engagement. MethodsWe applied principles of the Assessment, Decision, Administration, Production, Topical Experts, Integration, Training, Testing model, a framework for adapting evidence-based HIV interventions, and described our adaptation process, which included adapting the CETA manual based on expert input; conducting 3 focus groups, one with clinic social workers (n=3) and 2 with male (n=3) and female (n=4) patients to obtain stakeholder input for the adapted therapy; revising the manual according to this input; and training 2 counselors on the adapted protocol, including a workshop held over the internet followed by implementing the therapy with 3 clinic patients and receiving case-based consultation for them. For the focus groups, all clinic social workers were invited to participate, and patients were referred by clinic social workers if they were adults receiving services at the clinic and willing to provide written informed consent. Social worker focus group questions elicited reactions to the adapted therapy manual and content. Patient focus group questions elicited experiences with behavioral health conditions and HIV-related stigma and their impacts on HIV treatment engagement. Transcripts were reviewed by 3 team members to catalog participant commentary according to themes relevant to adapting CETA for people with HIV. Coauthors independently identified themes and met to discuss and reach a consensus on them. ResultsWe successfully used principles of the Assessment, Decision, Administration, Production, Topical Experts, Integration, Training, Testing framework to adapt CETA for people with HIV. The focus group with social workers indicated that the adapted therapy made conceptual sense and addressed common behavioral health concerns and practical and cognitive behavioral barriers to HIV treatment engagement. Key considerations for CETA for people with HIV obtained from social worker and patient focus groups were related to stigma, socioeconomic stress, and instability experienced by the clinic population and some patients’ substance use, which can thwart the stability needed to engage in care. ConclusionsThe resulting brief, manualized therapy is designed to help patients build skills that promote HIV treatment engagement and reduce symptoms of common behavioral health conditions that are known to thwart HIV treatment engagement.

BackgroundTask shifting is an effective model for increasing access to mental health treatment via lay counselors with less specialized training that deliver care under supervision. Mobile phones may present a low-technology opportunity to replace or decrease reliance on in-person supervision in task shifting, but important technical and contextual limitations must be examined and considered. ObjectiveGuided by human-centered design methods, we aimed to understand how mobile phones are currently used when supervising lay counselors, determine the acceptability and feasibility of mobile phone supervision, and generate solutions to improve mobile phone supervision. MethodsParticipants were recruited from a large hybrid effectiveness implementation study in western Kenya wherein teachers and community health volunteers were trained to provide trauma-focused cognitive behavioral therapy. Lay counselors (n=24) and supervisors (n=3) participated in semistructured interviews in the language of the participants’ choosing (ie, English or Kiswahili). Lay counselor participants were stratified by supervisor-rated frequency of mobile phone use such that interviews included high-frequency, average-frequency, and low-frequency phone users in equal parts. Supervisors rated lay counselors on frequency of phone contact (ie, calls and SMS text messages) relative to their peers. The interviews were transcribed, translated when needed, and analyzed using thematic analysis. ResultsParticipants described a range of mobile phone uses, including providing clinical updates, scheduling and coordinating supervision and clinical groups, and supporting research procedures. Participants liked how mobile phones decreased burden, facilitated access to clinical and personal support, and enabled greater independence of lay counselors. Participants disliked how mobile phones limited information transmission and relationship building between supervisors and lay counselors. Mobile phone supervision was facilitated by access to working smartphones, ease and convenience of mobile phone supervision, mobile phone literacy, and positive supervisor-counselor relationships. Limited resources, technical difficulties, communication challenges, and limitations on which activities can be effectively performed via mobile phone were barriers to mobile phone supervision. Lay counselors and supervisors generated 27 distinct solutions to increase the acceptability and feasibility of mobile phone supervision. Strategies ranged in terms of the resources required and included providing phones and airtime to support supervision, identifying quiet and private places to hold mobile phone supervision, and delineating processes for requesting in-person support. ConclusionsLay counselors and supervisors use mobile phones in a variety of ways; however, there are distinct challenges to their use that must be addressed to optimize acceptability, feasibility, and usability. Researchers should consider limitations to implementing digital health tools and design solutions alongside end users to optimize the use of these tools. International Registered Report Identifier (IRRID)RR2-10.1186/s43058-020-00102-9

Opportunities exist to leverage mobile phones to replace or supplement in-person supervision of lay counselors. However, contextual variables, such as network connectivity and provider preferences, must be considered. Using an iterative and mixed methods approach, we co-developed implementation guidelines to support the implementation of mobile phone supervision with lay counselors and supervisors delivering a culturally adapted trauma-focused cognitive behavioral therapy in Western Kenya. Guidelines were shared and discussed with lay counselors in educational outreach visits led by supervisors. We evaluated the impact of guidelines and outreach on the acceptability, feasibility, and usability of mobile phone supervision. Guidelines were associated with significant improvements in acceptability and usability of mobile phone supervision. There was no evidence of a significant difference in feasibility. Qualitative interviews with lay counselors and supervisors contextualized how guidelines impacted acceptability and feasibility – by setting expectations for mobile phone supervision, emphasizing importance, increasing comfort, and sharing strategies to improve mobile phone supervision. Introducing and discussing co-developed implementation guidelines significantly improved the acceptability and usability of mobile phone supervision. This approach may provide a flexible and scalable model to address challenges with implementing evidence-based practices and implementation strategies in lower-resourced areas.

ObjectiveObservational studies of practices used in clinical supervision-as-usual can be leveraged to advance the limited research on workplace-based supervision as an evidence-based treatment (EBT) implementation strategy. This exploratory observational study examined the presence of supervision approaches (comprised of supervision techniques) and whether these predicted clinicians’ EBT technique delivery.MethodsParticipants included 28 supervisors, 70 clinician supervisees, and 60 youth clients and guardians from 17 public mental health organizations. Data included audio recorded supervision-as-usual sessions over 1 year, audio recorded Trauma-focused Cognitive Behavioral Therapy (TF-CBT) treatment sessions with youth for 6 months, and youth-reported post-traumatic stress severity scores. Audio recordings of 438 supervision sessions were coded for session duration and the presence of 13 supervision techniques and intensity of their coverage. Audio recordings of 465 treatment sessions were coded for presence and intensity of coverage of TF-CBT practice elements. Agglomerative hierarchical cluster analysis examined the presence of clusters of supervision technique use, termed supervision approaches. Generalized estimating equations estimated the relation between supervision approaches and delivery of TF-CBT elements.ResultsTwo supervision approaches were identified– Supportive–Directive and Supportive– that discriminated between use of five supervision techniques. Clinicians who received a higher proportion of supportive–directive supervision sessions had greater odds of delivering the trauma narrative with a client.ConclusionFindings suggest that patterns of supervision techniques can be identified and may shape EBT delivery. Supervision approaches show some evidence of being tailored to individual clinicians. Implications for the development of supervision implementation strategies and future directions are discussed.

Abstract Background First-level leadership is uniquely positioned to support evidence-based practice (EBP) implementation for behavioral health due to first-level leaders’ access to and relationship with service providers. First-level leaders are individuals who directly supervise and manage frontline employees who do not manage others. However, first-level leadership is underrepresented in existing reviews of the impact of leadership on EBP implementation. This review describes the relationship between first-level leadership and implementation determinants and outcomes. Methods A scoping review was performed to synthesize the literature on the relationship between first-level leadership and inner-context and implementation outcomes. A literature search was conducted in PubMed, Eric, PsycINFO, CINAHL, Scopus, and Web of Science. To be eligible, studies had to examine first-level leadership, be conducted in settings providing behavioral health services, and examine the relationship between first-level leadership and an implementation or inner-context outcome. Data extraction and synthesis were performed to describe study characteristics, leader-outcome relationships, and overlap in leadership frameworks. Results Twenty-one records met our inclusion criteria. Studies primarily relied on observational designs and were often cross-sectional. Studies more often examined general leadership rather than leadership strategically focused on EBP implementation (i.e., strategic implementation leadership). Our findings suggest that several forms of first-level leadership are inconsistently related to a broad set of implementation determinants, with infrequent examination of specific implementation outcomes. The broad set of implementation determinants studied, limited number of replications, and inconsistent findings have resulted in sparse evidence for any specific leadership-outcome relationship. The greatest accumulation of evidence exists for general leadership’s positive relationship with providers’ EBP attitudes, most notably in the form of transformational leadership. This was followed by evidence for strategic implementation leadership facilitating general implementation. Our synthesis revealed moderate conceptual overlap of strategic implementation leadership behaviors described in the theory of implementation leadership and theory of middle managers’ role in implementation. Conclusions Our findings suggest that first-level leadership may play an important role in shaping implementation determinants and outcomes, but consistent empirical support is sparse and confidence dampened by methodological issues. To advance the field, we need studies that adopt stronger methodological rigor, address the conceptual overlap in leadership frameworks, examine a broader set of implementation outcomes, and examine conditions under which leadership impacts implementation. Trial registration This review was not registered.

Abstract Background Implementation strategies have flourished in an effort to increase integration of research evidence into clinical practice. Most strategies are complex, socially mediated processes. Many are complicated, expensive, and ultimately impractical to deliver in real-world settings. The field lacks methods to assess the extent to which strategies are usable and aligned with the needs and constraints of the individuals and contexts who will deliver or receive them. Drawn from the field of human-centered design, cognitive walkthroughs are an efficient assessment method with potential to identify aspects of strategies that may inhibit their usability and, ultimately, effectiveness. This article presents a novel walkthrough methodology for evaluating strategy usability as well as an example application to a post-training consultation strategy to support school mental health clinicians to adopt measurement-based care. Method The Cognitive Walkthrough for Implementation Strategies (CWIS) is a pragmatic, mixed-methods approach for evaluating complex, socially mediated implementation strategies. CWIS includes six steps: (1) determine preconditions; (2) hierarchical task analysis; (3) task prioritization; (4) convert tasks to scenarios; (5) pragmatic group testing; and (6) usability issue identification, classification, and prioritization. A facilitator conducted two group testing sessions with clinician users (N = 10), guiding participants through 6 scenarios and 11 associated subtasks. Clinicians reported their anticipated likelihood of completing each subtask and provided qualitative justifications during group discussion. Following the walkthrough sessions, users completed an adapted quantitative assessment of strategy usability. Results Average anticipated success ratings indicated substantial variability across participants and subtasks. Usability ratings (scale 0–100) of the consultation protocol averaged 71.3 (SD = 10.6). Twenty-one usability problems were identified via qualitative content analysis with consensus coding, and classified by severity and problem type. High-severity problems included potential misalignment between consultation and clinical service timelines as well as digressions during consultation processes. Conclusions CWIS quantitative usability ratings indicated that the consultation protocol was at the low end of the “acceptable” range (based on norms from the unadapted scale). Collectively, the 21 resulting usability issues explained the quantitative usability data and provided specific direction for usability enhancements. The current study provides preliminary evidence for the utility of CWIS to assess strategy usability and generate a blueprint for redesign.

Background The current gold standard for measuring fidelity (specifically, adherence) to cognitive behavioral therapy (CBT) is direct observation, a costly, resource-intensive practice that is not feasible for many community organizations to implement regularly. Recent research indicates that behavioral rehearsal (i.e., role-play between clinician and individual with regard to session delivery) and chart-stimulated recall (i.e., brief structured interview between clinician and individual about what they did in session; clinicians use the client chart to prompt memory) may provide accurate and affordable alternatives for measuring adherence to CBT in such settings, with behavioral rehearsal yielding greater correspondence with direct observation. Methods Drawing on established causal theories from social psychology and leading implementation science frameworks, this study evaluates stakeholders’ intention to use behavioral rehearsal and chart-stimulated recall. Specifically, we measured attitudes, self-efficacy, and subjective norms toward using each, and compared these factors across the two methods. We also examined the relationship between attitudes, self-efficacy, subjective norms, and intention to use each method. Finally, using an integrated approach we asked stakeholders to discuss their perception of contextual factors that may influence beliefs about using each method. These data were collected from community-based supervisors ( n = 17) and clinicians ( n = 66). Results Quantitative analyses suggest moderately strong intention to use both methods across stakeholders. There were no differences in supervisors’ or clinicians’ attitudes, self-efficacy, subjective norms, or intention across methods. More positive attitudes and greater reported subjective norms were associated with greater reported intention to use either measure. Qualitative analyses identified participants’ specific beliefs about using each fidelity measure in their organization, and results were organized using the Consolidated Framework for Implementation Research. Conclusions Strategies are warranted to overcome or minimize potential barriers to using fidelity measurement methods and to further increase the strength of intention to use them. Plain Language Summary: The best way to measure fidelity, or how closely a clinician follows the protocol, to Cognitive Behavioral Therapy (CBT) is watching the session. This is an expensive practice that is not feasible for many community organizations to do regularly. Recent research indicates that behavioral rehearsal, or a role-play between the clinician and individual with regard to session delivery, and chart-stimulated recall, or a brief discussion between an individual and the clinician about what they did in session with the clinician having access to the chart to help them remember, may provide accurate and affordable alternatives for measuring fidelity to CBT. We just completed a study demonstrating that both methods are promising, with behavioral rehearsal offering scores that are the most similar to watching the session. Drawing on established theories from social psychology and leading implementation science frameworks, this study evaluates future supervisor and clinician motivation to use these fidelity measurement methods. Specifically, we measured supervisor (n = 17) and clinician (n = 66) attitudes, norms, self-efficacy, intentions, and anticipated barriers and facilitators to using each of these fidelity measurement tools. Quantitative and qualitative analyses suggest similar intention to use both methods, and concerns about barriers to using each method. Further research is warranted to minimize the burden associated with implementing fidelity measurement methods and deploying strategies to increase use.

Background Strategies to implement evidence-based interventions (EBIs) in children’s mental health services have complex direct and indirect causal impacts on multiple outcomes. Ripple effects are outcomes caused by EBI implementation efforts that are unplanned, unanticipated, and/or more salient to stakeholders other than researchers and implementers. The purpose of the current paper is to provide a compilation of possible ripple effects associated with EBI implementation strategies in children’s mental health services, to be used for implementation planning, research, and quality improvement. Methods Participants were identified via expert nomination and snowball sampling. Online surveys were completed by 81 participants, each representing one of five roles: providers of mental health services to children or youth, researchers, policy makers, caregivers, and youth. A partially directed conventional content analysis with consensus decision making was used to code ripple effects. Results Four hundred and four unique responses were coded into 66 ripple effects and 14 categories. Categories include general knowledge, skills, attitudes, and confidence about using EBIs; general job-related ripple effects; EBI treatment adherence, fidelity, and alignment; gaming the system; equity and stigma; shifting roles, role clarity, and task shifting; economic costs and benefits; EBI treatment availability, access, participation, attendance, barriers, and facilitators; clinical process and treatment quality; client engagement, therapeutic alliance, and client satisfaction; clinical organization structure, relationships in the organization, process, and functioning; youth client and caregiver outcomes; and use of EBI strategies and insights in one’s own life. Conclusions This research advances the field by providing children’s mental health implementers, researchers, funders, policy makers, and consumers with a menu of potential ripple effects. It can be a practical tool to ensure compliance with guidance from Quality Improvement/Quality Assurance, Complexity Science, and Diffusion of Innovation Theory. Future phases will match potential ripple effects with salient children’s mental health implementation strategies for each participant role. Plain Language Summary: This qualitative study of multiple stakeholders in children’s mental health services identifies several possible ripple effects of implementation strategies, opening a new area of study for implementation science. Ripple effects can be positive, negative, or neutral within the full balance of implementation quality and impact. The list of ripple effects will provide implementation scientists, developers, and others with a useful tool during implementation planning and evaluation. This expert-informed methodology can provide a model for other fields for exploring possible ripple effects within implementation science.

Background There is a substantial mental health treatment gap globally. Increasingly, mental health treatments with evidence of effectiveness in western countries have been adapted and tested in culturally and contextually distinct countries. Findings from these studies have been promising, but to better understand treatment outcome results and consider broader scale up, treatment acceptability needs to be assessed and better understood. This mixed methods study aimed to examine child and guardian acceptability of trauma-focused cognitive behavioral therapy (TF-CBT) in two regions in Tanzania and Kenya and to better understand how TF-CBT was perceived as helpful for children and guardians. Methods Participants were 315 children (7–13), who experienced the death of one or both parents and 315 guardians, both of whom participated in TF-CBT as part of a randomized controlled trial conducted in Tanzania and Kenya. The study used mixed methods, with quantitative evaluation from guardian perspective ( N =315) using the Treatment Acceptability Questionnaire (TAQ) and the Client Satisfaction Questionnaire-8 (CSQ-8). Acceptability was assessed qualitatively from both guardian and child perspectives. Qualitative evaluation involved analysis using stratified selection to identify 160 child and 160 guardian interviews, to allow exploration of potential differences in acceptability by country, setting (urban/rural), and youth age (younger/older). Results Guardians reported high acceptability on the TAQ and, using an interpretation guide from U.S.-based work, medium acceptability on the CSQ-8. Guardians and children noted high acceptability in the qualitative analysis, noting benefits that correspond to TF-CBT’s therapeutic goals. Analyses exploring differences in acceptability yielded few differences by setting or child age but suggested some potential differences by country. Conclusion Quantitative and qualitative data converged to suggest high acceptability of TF-CBT from guardian and child perspectives in Tanzania and Kenya. Findings add to accumulating evidence of high TF-CBT acceptability from Zambia and other countries (United States, Norway, Australia). Plain Language Summary: Evidence-based treatments have been shown to be effective in countries and regions that are contextually and culturally distinct from where they were developed. But, perspectives of consumers on these treatments have not been assessed regularly or thoroughly. We used open-ended questions and rating scales to assess guardian and youth perspectives on a group-based, cognitive behavioral treatment for children impacted by parental death, in regions within Tanzania and Kenya. Our findings indicate that both guardians and youth found the treatment to be very acceptable. Nearly all guardians talked about specific benefits for the child, followed by benefits for the family and themselves. Eighty percent of youth mentioned benefits for themselves and all youth said they would recommend the program to others. Benefits mentioned by guardians and youth corresponded to treatment goals (improved mood/feelings or behavior, less distress when thinking about the parent/s’ death). Both guardians and children named specific aspects of the treatment that they liked and found useful. Dislikes and challenges of the treatment were less frequently mentioned, but point to areas where acceptability could be further improved. Recommendations from participants also offer areas where acceptability could be improved, namely guardians’ recommendation that the treatment also address non-mental health needs and offer some follow-up or opportunity to participate in the program again. Our study provides an example of how to assess acceptability and identify places to further enhance acceptability.

Abstract Background More than two-thirds of youth experience trauma during childhood, and up to 1 in 5 of these youth develops posttraumatic stress symptoms that significantly impair their functioning. Although trauma-focused cognitive behavior therapy (TF-CBT) has a strong evidence base, it is rarely adopted, delivered with adequate fidelity, or evaluated in the most common setting where youth access mental health services—schools. Given that individual behavior change is ultimately required for successful implementation, even when organizational factors are firmly in place, focusing on individual-level processes represents a potentially parsimonious approach. Beliefs and Attitudes for Successful Implementation in Schools (BASIS) is a pragmatic, motivationally focused multifaceted strategy that augments training and consultation and is designed to target precise mechanisms of behavior change to produce enhanced implementation and youth clinical outcomes. This study protocol describes a hybrid type 2 effectiveness-implementation trial designed to concurrently evaluate the main effects, mediators, and moderators of both the BASIS implementation strategy on implementation outcomes and TF-CBT on youth mental health outcomes. Methods Using a cluster randomized controlled design, this trial will assign school-based mental health (SMH) clinicians and schools to one of three study arms: (a) enhanced treatment-as-usual (TAU), (b) attention control plus TF-CBT, or (c) BASIS+TF-CBT. With a proposed sample of 120 SMH clinicians who will each recruit 4–6 youth with a history of trauma (480 children), this project will gather data across 12 different time points to address two project aims. Aim 1 will evaluate, relative to an enhanced TAU condition, the effects of TF-CBT on identified mechanisms of change, youth mental health outcomes, and intervention costs and cost-effectiveness. Aim 2 will compare the effects of BASIS against an attention control plus TF-CBT condition on theoretical mechanisms of clinician behavior change and implementation outcomes, as well as examine costs and cost-effectiveness. Discussion This study will generate critical knowledge about the effectiveness and cost-effectiveness of BASIS—a pragmatic, theory-driven, and generalizable implementation strategy designed to enhance motivation—to increase the yield of evidence-based practice training and consultation, as well as the effectiveness of TF-CBT in a novel service setting. Trial registration ClinicalTrials.gov registration number NCT04451161 . Registered on June 30, 2020.

Abstract Background Although research continues to support task-shifting as an effective model of delivering evidence-based practices (EBPs), little scholarship has focused how to scale up and sustain task-shifting in low- and middle-income countries, including how to sustainably supervise lay counselors. Ongoing supervision is critical to ensure EBPs are delivered with fidelity; however, the resources and expertise required to provide ongoing supervision may limit the potential to scale up and sustain task shifting. Opportunities may exist to leverage mobile technology to replace or supplement in-person supervision in low-resource contexts, but contextual variables, such as network connectivity and lay counselor preferences surrounding mobile technology, must be examined and considered when designing and implementing mobile technology supervision. Methods This study builds from an existing randomized trial in Kenya, wherein teachers and community health volunteers have been trained to provide trauma-focused cognitive behavioral therapy as lay counselors. The study will use an iterative and mixed methods approach, with qualitative interviews and a Human-Centered Design (HCD) workshop informing a non-randomized pilot trial. Semi-structured interviews will be conducted with lay counselors and supervisors to understand how mobile technology is currently being used for supervision and determine the barriers and facilitators to mobile technology supervision. Data from these interviews will inform an HCD workshop, where lay counselors and supervisors “re-design” supervision to most effectively leverage mobile technology. Workshop participants will also participate in focus groups to gather perceptions on the use of HCD techniques. The final outcome of the workshop will be a set of refined workflows, which will be tested in a mixed method, nonrandomized pilot with newly trained lay counselors and existing supervisors. The pilot trial will evaluate the acceptability, feasibility, and usability of mobile technology supervision through self-report questionnaires as well as perceptions of effectiveness through qualitative interviews with a subset of lay counselors and all supervisors. Discussion This study will provide a launching point for future research on supervision and methods to engage stakeholders to design and tailor interventions and implementation supports to fit low-resourced contexts. Trial registration The parent trial from which this study builds was registered on ClinicalTrials.gov on August 9, 2017 ( NCT03243396 ).

Abstract Background The mental health treatment gap—the difference between those with mental health need and those who receive treatment—is high in low- and middle-income countries. Task-shifting has been used to address the shortage of mental health professionals, with a growing body of research demonstrating the effectiveness of mental health interventions delivered through task-shifting. However, very little research has focused on how to embed, support, and sustain task-shifting in government-funded systems with potential for scale up. The goal of the Building and Sustaining Interventions for Children (BASIC) study is to examine implementation policies and practices that predict adoption, fidelity, and sustainment of a mental health intervention in the education sector via teacher delivery and the health sector via community health volunteer delivery. Methods BASIC is a Hybrid Type II Implementation-Effectiveness trial. The study design is a stepped wedge, cluster randomized trial involving 7 sequences of 40 schools and 40 communities surrounding the schools. Enrollment consists of 120 teachers, 120 community health volunteers, up to 80 site leaders, and up to 1280 youth and one of their primary guardians. The evidence-based mental health intervention is a locally adapted version of Trauma-focused Cognitive Behavioral Therapy, called Pamoja Tunaweza. Lay counselors are trained and supervised in Pamoja Tunaweza by local trainers who are experienced in delivering the intervention and who participated in a Train-the-Trainer model of skills transfer. After the first sequence completes implementation, in-depth interviews are conducted with initial implementing sites’ counselors and leaders. Findings are used to inform delivery of implementation facilitation for subsequent sequences’ sites. We use a mixed methods approach including qualitative comparative analysis to identify necessary and sufficient implementation policies and practices that predict 3 implementation outcomes of interest: adoption, fidelity, and sustainment. We also examine child mental health outcomes and cost of the intervention in both the education and health sectors. Discussion The BASIC study will provide knowledge about how implementation of task-shifted mental health care can be supported in government systems that already serve children and adolescents. Knowledge about implementation policies and practices from BASIC can advance the science of implementation in low-resource contexts. Trial registration Trial Registration: ClinicalTrials.gov Identifier: NCT03243396. Registered 9th August 2017, https://clinicaltrials.gov/ct2/show/NCT03243396

BackgroundSuicide is the 10th leading cause of death in the United States, with >47,000 deaths in 2019. Most people who died by suicide had contact with the health care system in the year before their death. Health care provider training is a top research priority identified by the National Action Alliance for Suicide Prevention; however, evidence-based approaches that target skill-building are resource intensive and difficult to implement. Advances in artificial intelligence technology hold promise for improving the scalability and sustainability of training methods, as it is now possible for computers to assess the intervention delivery skills of trainees and provide feedback to guide skill improvements. Much remains to be known about how best to integrate these novel technologies into continuing education for health care providers. ObjectiveIn Project WISE (Workplace Integrated Support and Education), we aim to develop e-learning training in suicide safety planning, enhanced with novel skill-building technologies that can be integrated into the routine workflow of nurses serving patients hospitalized for medical or surgical reasons or traumatic injury. The research aims include identifying strategies for the implementation and workflow integration of both the training and safety planning with patients, adapting 2 existing technologies to enhance general counseling skills for use in suicide safety planning (a conversational agent and an artificial intelligence–based feedback system), observing training acceptability and nurse engagement with the training components, and assessing the feasibility of recruitment, retention, and collection of longitudinal self-report and electronic health record data for patients identified as at risk of suicide. MethodsOur developmental research includes qualitative and observational methods to explore the implementation context and technology usability, formative evaluation of the training paradigm, and pilot research to assess the feasibility of conducting a future cluster randomized pragmatic trial. The trial will examine whether patients hospitalized for medical or surgical reasons or traumatic injury who are at risk of suicide have better suicide-related postdischarge outcomes when admitted to a unit with nurses trained using the skill-building technology than those admitted to a unit with untrained nurses. The research takes place at a level 1 trauma center, which is also a safety-net hospital and academic medical center. ResultsProject WISE was funded in July 2019. As of September 2021, we have completed focus groups and usability testing with 27 acute care and 3 acute and intensive care nurses. We began data collection for research aims 3 and 4 in November 2021. All research has been approved by the University of Washington institutional review board. ConclusionsProject WISE aims to further the national agenda to improve suicide prevention in health care settings by training nurses in suicide prevention with medically hospitalized patients using novel e-learning technologies. International Registered Report Identifier (IRRID)DERR1-10.2196/33695

Background Most evidence-based treatments (EBTs) for posttraumatic stress disorder (PTSD) and anxiety disorders include exposure; however, in community settings, the implementation of exposure lags behind other EBT components. Clinician-level determinants have been consistently implicated as barriers to exposure implementation, but few organizational determinants have been studied. The current study examines an organization-level determinant, implementation climate, and clinician-level determinants, clinician demographic and background factors, as predictors of attitudes toward exposure and changes in attitudes following training. Method Clinicians ( n = 197) completed a 3-day training with 6 months of twice-monthly consultation. Clinicians were trained in cognitive behavioral therapy (CBT) for anxiety, depression, behavior problems, and trauma-focused CBT (TF-CBT). Demographic and background information, implementation climate, and attitudes toward exposure were assessed in a pre-training survey; attitudes were reassessed at post-consultation. Implementation climate was measured at the aggregated/group-level and clinician-level. Results Attitudes toward exposure significantly improved from pre-training to post-consultation ( t (193) = 9.9, p .05) but did predict more positive attitudes at post-consultation (ß = −2.46; p .05). Higher frequency of self-reported CBT use was associated with more positive attitudes at pre-training (ß = −0.81; p .05) or with changes in attitudes (all p > .05). Conclusions Clinician perceptions of implementation climate predicted greater improvement of attitudes toward exposure following EBT training and consultation. Findings suggest that organizational determinants outside of training impact changes in clinicians’ attitudes. Training in four EBTs, only two of which include exposure as a component, resulted in positive changes in clinicians’ attitudes toward exposure, which suggests non-specialty trainings can be effective at changing attitudes, which may enable scale-up.

Abstract Background Despite the known benefits of early, specialized intervention for toddlers with Autism Spectrum Disorder (ASD), access to such intervention remains limited. This pragmatic trial examines a novel healthcare delivery model (Screen-Refer-Treat [SRT]), which capitalizes upon existing health care and early intervention (EI) infrastructure to increase community capacity for ASD detection and treatment before age 3, when it is likely to have the greatest impact. This model comprises three components: (1) universal use of Stage 1 ASD screening by primary care providers (PCPs) at 18-month well-child visits (i.e., Screen); (2) immediate referral of positive screens to a community-based EI program (i.e., Refer); and (3) provision of an inexpensive, evidence-based ASD-specialized treatment by EI providers, after verifying ASD risk with a Stage 2 screen (i.e., Treat). This paper describes our research design and the initial successes, challenges, and adaptations made during the early implementation phase. Method/design A stepped-wedge cluster RCT was used to implement the SRT model sequentially in four diverse Washington State counties (“clusters”). Counties are randomly assigned to the time of receipt of the SRT intervention, which comprises training workshops and technical assistance focused on the use of evidence-based ASD screening and intervention tools. Separate cohorts of families with toddlers (16–35 months old) with and without ASD concerns are recruited before and after the SRT intervention from participating PCP practices and EI programs. PCPs and EI providers complete measures on their screening, referral, and intervention practices before and after the SRT intervention. Each family cohort completes surveys about their well-being, parenting efficacy, health care satisfaction, and toddler’s social-communicative behaviors. Conclusion This trial is the first of its kind to work simultaneously with two service delivery systems with the goal of improving early detection and treatment for ASD. Our approach was successful in attaining buy-in from PCPs and EI providers, building and maintaining partnerships with providers, and achieving high levels of retention and survey completion. Fostering provider engagement and problem-solving issues together as partners were integral to overcoming the main challenges. Numerous lessons have been learned thus far, which have applicability for implementation researchers in ASD and those in other fields. Trial registration The registration number for this trial is NCT02409303 and it was posted on ClinicalTrials.gov on April 6, 2015.

Abstract Background Children with autism receive most of their intervention services in public schools, but implementation of evidence-based practices (EBPs) for autism varies. Studies suggest that individual (attitudes) and organizational characteristics (implementation leadership and climate) may influence providers’ use of EBPs, but research is relatively limited in this area. This study examined individual and organizational factors associated with implementation of three EBPs—discrete trial training, pivotal response training, and visual schedules—for children with autism in special education classrooms in public elementary schools. Methods Participants included 67 autism support teachers and 85 other classroom staff from 52 public elementary schools in the northeastern United States. Participants reported their attitudes toward EBPs (e.g., intuitive appeal, willingness if required, openness, and divergence), implementation leadership and climate of their school, and the frequency with which they deliver each of three EBPs. Linear regression was used to estimate the association of attitudes about EBPs with organizational characteristics and intensity of EBP use. Demographic covariates with a bivariate association with EBP use significant at p

Background: Developing pragmatic assessment tools to measure clinician use of evidence-based practices is critical to advancing implementation of evidence-based practices in mental health. This case study details our community-partnered process of developing the Therapy Process Observation Coding Scale-Self-Reported Therapist Intervention Fidelity for Youth (TPOCS-SeRTIFY), a pragmatic, clinician-report instrument to measure cognitive behavioral therapy (CBT) delivery. Approach: We describe a five-step community-partnered development process. Initial goals were to create a self-report instrument that paralleled an existing direct observation measure of clinician delivery of CBT use to facilitate later assessment of measure performance. Cognitive interviews with community clinicians ( n = 6) and consultation with CBT experts ( n = 6) were used to enhance interpretability and usability as part of an iterative refinement process. The instrument was administered to 247 community clinicians along with an established self-reported measure of clinician delivery of CBT and other treatments to assess preliminary psychometric performance. Preliminary psychometrics were promising. Conclusion: Our community-partnered development process showed promising success and can guide future development of pragmatic implementation measures both to facilitate measurement of ongoing implementation efforts and future research aimed at building learning mental health systems. Plain language summary Developing brief, user-friendly, and accurate tools to measure how therapists deliver cognitive behavioral therapy (CBT) in routine practice is important for advancing the reach of CBT into community settings. To date, developing such “pragmatic” measures has been difficult. There is little known about how researchers can best develop these types of assessment tools so that they (1) are easy for clinicians in practice to use and (2) provide valid and useful information about implementation outcomes. As a result, there are few well-validated measures in existence that measure therapist use of CBT that are feasible for use in community practice. This paper contributes to the literature by describing our community-partnered process for developing a measure of therapist use of CBT (Therapy Process Observation Coding Scale -Self-Reported Therapist Intervention Fidelity for Youth; TPOCS-SeRTIFY). This descriptive case study outlines the community-partnered approach we took to develop this measure. This case study will contribute to future research by serving as a guide to others aiming to develop pragmatic implementation measures. In addition, the TPOCS-SeRTIFY is a pragmatic measure of clinician use of CBT that holds promise for its use by both researchers and clinicians to measure the success of CBT implementation efforts.

AbstractBackgroundGlobally, nearly 140 million children have experienced the death of one or both parents, and as a result many experience higher rates of mental health problems. Trauma-focused cognitive behavioral therapy (TF-CBT) delivered by lay counselors has been shown to improve mental health outcomes for children experiencing traumatic grief due to parental loss; however, challenges with treatment attendance limit the public health impact of mental health services. This study used qualitative methods to assess barriers and facilitators of child and guardian attendance of school-based lay counselor delivered TF-CBT.MethodsSemi-structured interviews were conducted with 36 lay counselors (18 teachers; 18 community health volunteers) who delivered TF-CBT to explore their perceptions of barriers of facilitators of child and guardian attendance of group-based sessions delivered in schools.ResultsCounselors identified attendance barriers and facilitators related to the delivery setting, resources, participant characteristics, intervention characteristics and counselor behaviors. The findings revealed a greater number of facilitators than barriers. Common facilitators included participant and counselor resources, counselor commitment behaviors and communication efforts to encourage attendance. Barriers were less frequently endorsed, with participant resources, child or guardian illness and communication challenges most commonly mentioned.ConclusionsAttention to barriers and facilitators of attendance in the context in which mental health interventions are delivered allows for identification of ways to improve attendance and treatment engagement and achieve the potential promise of providing accessible mental health services.

The global mental health treatment gap has increasingly been addressed using task-shifting; however, very little research has focused on lay counselors’ perspectives on the acceptability, feasibility, and appropriateness of mental health interventions in specific government-supported sectors that might scale up and sustain mental health care for children and adolescents. In western Kenya, these sectors include Education and Health. Data come from a large hybrid effectiveness-implementation study examining implementation practices and policies in either or both sectors that support successful implementation of a child-focused intervention, Trauma-focused Cognitive Behavioral Therapy (TF-CBT), for children and adolescents who had experienced parental death. We examined lay counselors’ self-report of acceptability, feasibility, and appropriateness of TF-CBT. Lay counselors were teachers (n = 30) from the Education sector and Community Health Volunteers (CHVs; n = 30) from the Health sector, who were part of Sequence 1 of a large stepped-wedge, cluster randomized trial. Lay counselor self-report surveys included reflective and formative measurement of acceptability, feasibility, and appropriateness administered after lay counselors in both sectors had experience delivering the locally-adapted, group-based TF-CBT intervention. Descriptive statistics (means, standard deviations) were used to understand counselors’ perspectives stratified by sector. Both teachers and CHVs endorsed high acceptability, feasibility, and appropriateness of TF-CBT, with lay counselors’ responses on items from the formative measures providing some insight into specific aspects of acceptability, feasibility, and appropriateness that may be important to consider when planning for implementation support. These early findings suggest that both sectors may hold promise for task-shifting of mental health care for children and adolescents but also underline the importance of considering the multiple facets of these three implementation outcomes as well as lay counselor context (Education vs. Health).

Abstract Background Mental illness is a major public health concern. Despite progress understanding which treatments work, a significant treatment gap remains. An ongoing concern is treatment length. Modular, flexible, transdiagnostic approaches have been offered as one solution to scalability challenges. The Common Elements Treatment Approach (CETA) is one such approach and offers the ability to treat a wide range of common mental health problems. CETA is supported by two randomized trials from low- and middle-income countries showing strong effectiveness and implementation outcomes. Methods/design This trial evaluates the effectiveness and implementation of two versions of CETA using a non-inferiority design to test two primary hypotheses: (1) a brief five-session version of CETA (Brief CETA) will provide similar effectiveness for reducing the severity of common mental health problems such as depression, post-traumatic stress, impaired functioning, anxiety, and substance use problems compared with the standard 8–12-session version of CETA (Standard CETA); and (2) both Brief and Standard CETA will have superior impact on the outcomes compared to a wait-list control condition. For both hypotheses, the main effect will be assessed using longitudinal data and mixed-effects regression models over a 6-month period post baseline. A secondary aim includes exploration of implementation factors. Additional planned analyses will include exploration of: moderators of treatment impact by disorder severity and comorbidity; the impact of individual therapeutic components; and trends in symptom change between end of treatment and 6-month assessment for all participants. Discussion This trial is the first rigorous study comparing a standard-length (8–12 sessions) modular, flexible, transdiagnostic, cognitive-behavioral approach to a shortened version of the approach (five sessions). Brief CETA entails “front-loading” with elements that research suggests are strong mechanisms of change. The study design will allow us to draw conclusions about the effects of both Brief and Standard CETA as well as which elements are integral to their mechanisms of action, informing future implementation and fidelity efforts. The results from this trial will inform future dissemination, implementation and scale-up of CETA in Ukraine and contribute to our understanding of the effects of modular, flexible, transdiagnostic approaches in similar contexts. Trial registration ClinicalTrials.gov, ID: NCT03058302 (U.S. National Library of Medicine). Registered on 20 February 2017.

Abstract Background A model for statewide dissemination of evidence-based treatment (EBT) for traumatized youth was piloted and taken to scale across North Carolina (NC). This article describes the implementation platform developed, piloted, and evaluated by the NC Child Treatment Program to train agency providers in Trauma-Focused Cognitive Behavioral Therapy using the National Center for Child Traumatic Stress Learning Collaborative (LC) Model on Adoption & Implementation of EBTs. This type of LC incorporates adult learning principles to enhance clinical skills development as part of training and many key implementation science strategies while working with agencies and clinicians to implement and sustain the new practice. Methods Clinicians (n = 124) from northeastern NC were enrolled in one of two TF-CBT LCs that lasted 12 months each. During the LC clinicians were expected to take at least two clients through TF-CBT treatment with fidelity and outcomes monitoring by trainers who offered consultation by phone and during trainings. Participating clinicians initiated treatment with 281 clients. The relationship of clinician and client characteristics to treatment fidelity and outcomes was examined using hierarchical linear regression. Results One hundred eleven clinicians completed general training on trauma assessment batteries and TF-CBT. Sixty-five clinicians met all mastery and fidelity requirements to meet roster criteria. One hundred fifty-six (55%) clients had fidelity-monitored assessment and TF-CBT. Child externalizing, internalizing, and post-traumatic stress symptoms, as well as parent distress levels, decreased significantly with treatment fidelity moderating child PTSD outcomes. Since this pilot, 11 additional cohorts of TF-CBT providers have been trained to these roster criteria. Conclusion Scaling up or outcomes-oriented implementation appears best accomplished when training incorporates: 1) practice-based learning, 2) fidelity coaching, 3) clinical assessment and outcomes-oriented treatment, 4) organizational skill-building to address barriers for agencies, and 5) linking clients to trained clinicians via an online provider roster. Demonstrating clinician performance and client outcomes in this pilot and subsequent cohorts led to legislative support for dissemination of a service array of EBTs by the NC Child Treatment Program.

Abstract Background Workplace-based clinical supervision as an implementation strategy to support evidence-based treatment (EBT) in public mental health has received limited research attention. A commonly provided infrastructure support, it may offer a relatively cost-neutral implementation strategy for organizations. However, research has not objectively examined workplace-based supervision of EBT and specifically how it might differ from EBT supervision provided in efficacy and effectiveness trials. Methods Data come from a descriptive study of supervision in the context of a state-funded EBT implementation effort. Verbal interactions from audio recordings of 438 supervision sessions between 28 supervisors and 70 clinicians from 17 public mental health organizations (in 23 offices) were objectively coded for presence and intensity coverage of 29 supervision strategies (16 content and 13 technique items), duration, and temporal focus. Random effects mixed models estimated proportion of variance in content and techniques attributable to the supervisor and clinician levels. Results Interrater reliability among coders was excellent. EBT cases averaged 12.4 min of supervision per session. Intensity of coverage for EBT content varied, with some discussed frequently at medium or high intensity (exposure) and others infrequently discussed or discussed only at low intensity (behavior management; assigning/reviewing client homework). Other than fidelity assessment, supervision techniques common in treatment trials (e.g., reviewing actual practice, behavioral rehearsal) were used rarely or primarily at low intensity. In general, EBT content clustered more at the clinician level; different techniques clustered at either the clinician or supervisor level. Conclusions Workplace-based clinical supervision may be a feasible implementation strategy for supporting EBT implementation, yet it differs from supervision in treatment trials. Time allotted per case is limited, compressing time for EBT coverage. Techniques that involve observation of clinician skills are rarely used. Workplace-based supervision content appears to be tailored to individual clinicians and driven to some degree by the individual supervisor. Our findings point to areas for intervention to enhance the potential of workplace-based supervision for implementation effectiveness. Trial registration NCT01800266 , Clinical Trials, Retrospectively Registered (for this descriptive study; registration prior to any intervention [part of phase II RCT, this manuscript is only phase I descriptive results])

Objective: Children infrequently receive evidence-based treatments (EBTs) for mental health problems due to a science-to-practice implementation gap. Workplace-based clinical supervision, in which supervisors provide oversight, feedback, and training on clinical practice, may be a method to support EBT implementation. Our prior research suggests that the intensity of supervisory focus on EBT (i.e., thoroughness of coverage) during workplace-based supervision varies. This study explores predictors of supervisory EBT intensity.Methods: Participants were twenty-eight supervisors and 70 clinician supervisees. They completed a baseline survey, and audio recorded supervision sessions over 1 year. Four hundred and thirty eight recordings were coded for supervision content. We chose to explore predictors of two EBT content elements due to their strong evidence for effectiveness and sufficient variance to permit testing. These included a treatment technique (“exposure”) and a method to structure treatment (“assessment”). We also explored predictors of non-EBT content (“other topics”). Mixed-effects models explored predictors at organizational/supervisor, clinician, and session levels.Results: Positive implementation climate predicted greater intensity of EBT content coverage for assessment (coefficient = 0.82, p = 0.004) and exposure (coefficient = 0.87, p = 0.001). Intensity of exposure coverage was also predicted by more time spent discussing each case (coefficient = 0.04, p < 0.001). Predictors of greater non-EBT content coverage included longer duration of supervision sessions (coefficient = 0.05, p < 0.001) and lower levels of supervisor EBT knowledge (coefficient = −0.17, p = 0.013). No other supervisor- or clinician-level variables were significant predictors in the mixed effects models.Conclusion: This was the first study to explore multi-level predictors of objectively coded workplace-based supervision content. Results suggest that organizations that expect, support and reward EBT are more likely to have greater intensity of EBT supervision coverage, which in turn may positively impact clinician EBT fidelity and client outcomes. There was evidence that supervisor knowledge of the EBT contributes to greater coverage, although robust supervisor and clinician factors that drive supervision are yet to be identified. Findings highlight the potential effectiveness of implementation strategies that simultaneously address organizational implementation climate and supervisor practices. More research is needed to identify mechanisms that support integration of EBT into supervision.

BackgroundExposure to violence has negative consequences on mental health. Armed-conflict in Colombia has widely affected Afro-descendants in the Pacific region. Evidence regarding effectiveness of mental health interventions is lacking in low-income settings, especially in areas with active conflict. The objective of this study is to evaluate an individualized Common Elements Treatment Approach (CETA), a transdiagnostic psychotherapy model based on Cognitive-Behavioral Therapy, for adult trauma survivors.Methods and findingsA referred sample of 521 adult Afro-descendants from Buenaventura and Quibdó, Colombia, experiencing significant sadness, suffering or fear (score>0.77 in Total Mental Health Symptoms), with history of traumatic experiences, and with associated functional impairment were randomly allocated to CETA intervention, standby group without intervention, but under monthly monitoring, or a Narrative Community-Based Group Therapy. CETA was provided by trained Lay Psychosocial Community Workers without previous mental health experience, supervised by psychologists, during 12-14 weekly, 1.5-hour sessions. Symptoms were assessed with a locally validated survey built based on the Hopkins Symptom Checklist, the Harvard Trauma Questionnaire, the PTSD CheckList-Civilian Version, a qualitative study for additional general symptoms and a gender-specific functional impairment scale. CETA was compared with the control group and the intervention effects were calculated with mixed models using intention to treat analysis. Participant completion of follow-up was 75.1% and 13.2% voluntarily withdrew. Reduction in post-traumatic stress symptoms was significant in both municipalities when comparing intervention and control groups (mean difference), with a with a moderate effect size in Buenaventura (Cohen's d = 0.70) and a small effect size in Quibdó (d = 0.31). In Buenaventura, the intervention also had significant effects on depression (large effect size d = 1.03), anxiety (large effect size d = 0.80) and functional impairment (moderate effect size d = 0.70). In Quibdó, it had no significant effect on these outcomes. Changes in Total Mental Health Symptoms were not significant in neither city.ConclusionsThis trial suggests that CETA, can be effective in improving depression, anxiety, post-traumatic stress and function among victims of systematized violence in low-income and active conflict settings. Nonetheless, the difference of effectiveness between the two cities of intervention may indicate that we cannot assume that a mental health intervention known to be effective in one setting will be effective in another, even in similar circumstances and population. This may have special importance when implementing and reproducing these types of intervention in non-controlled circumstances. Further research should address these concerns. Results can be of use by governmental decision-makers when defining mental health programs for survivors.Trial registrationClinicalTrials.gov NCT01856673 (https://clinicaltrials.gov/ct2/show/NCT01856673).

Existing studies of mental health interventions in low-resource settings have employed highly structured interventions delivered by non-professionals that typically do not vary by client. Given high comorbidity among mental health problems and implementation challenges with scaling up multiple structured evidence-based treatments (EBTs), a transdiagnostic treatment could provide an additional option for approaching community-based treatment of mental health problems. Our objective was to test such an approach specifically designed for flexible treatments of varying and comorbid disorders among trauma survivors in a low-resource setting.We conducted a single-blinded, wait-list randomized controlled trial of a newly developed transdiagnostic psychotherapy, Common Elements Treatment Approach (CETA), for low-resource settings, compared with wait-list control (WLC). CETA was delivered by lay workers to Burmese survivors of imprisonment, torture, and related traumas, with flexibility based on client presentation. Eligible participants reported trauma exposure and met severity criteria for depression and/or posttraumatic stress (PTS). Participants were randomly assigned to CETA (n = 182) or WLC (n = 165). Outcomes were assessed by interviewers blinded to participant allocation using locally adapted standard measures of depression and PTS (primary outcomes) and functional impairment, anxiety symptoms, aggression, and alcohol use (secondary outcomes). Primary analysis was intent-to-treat (n = 347), including 73 participants lost to follow-up. CETA participants experienced significantly greater reductions of baseline symptoms across all outcomes with the exception of alcohol use (alcohol use analysis was confined to problem drinkers). The difference in mean change from pre-intervention to post-intervention between intervention and control groups was -0.49 (95% CI: -0.59, -0.40) for depression, -0.43 (95% CI: -0.51, -0.35) for PTS, -0.42 (95% CI: -0.58, -0.27) for functional impairment, -0.48 (95% CI: -0.61, -0.34) for anxiety, -0.24 (95% CI: -0.34, -0.15) for aggression, and -0.03 (95% CI: -0.44, 0.50) for alcohol use. This corresponds to a 77% reduction in mean baseline depression score among CETA participants compared to a 40% reduction among controls, with respective values for the other outcomes of 76% and 41% for anxiety, 75% and 37% for PTS, 67% and 22% for functional impairment, and 71% and 32% for aggression. Effect sizes (Cohen's d) were large for depression (d = 1.16) and PTS (d = 1.19); moderate for impaired function (d = 0.63), anxiety (d = 0.79), and aggression (d = 0.58); and none for alcohol use. There were no adverse events. Limitations of the study include the lack of long-term follow-up, non-blinding of service providers and participants, and no placebo or active comparison intervention.CETA provided by lay counselors was highly effective across disorders among trauma survivors compared to WLCs. These results support the further development and testing of transdiagnostic approaches as possible treatment options alongside existing EBTs.ClinicalTrials.gov NCT01459068 Please see later in the article for the Editors' Summary.