Search

The precise measurement of treatment fidelity (quantity and quality in the delivery of treatment strategies in an intervention) is essential for intervention development, evaluation, and implementation. Various informants are used in fidelity assessment (e.g., observers, practitioners [clinicians, teachers], clients), but these informants often do not agree on ratings. This scoping review aims to ascertain the state of science around multi-informant assessment of treatment fidelity.A literature search of articles published through December 2021 identified 673 articles. Screening reduced the number of articles to 44, and the final study set included 35 articles.There was substantial variability across studies regarding study design, how fidelity was operationalized, and how reliability was defined and assessed. Most studies evaluated the agreement between independent observers and practitioner-report, though several other informant pairs were assessed. Overall, findings suggest that concordance across fidelity informants was low to moderate, with a few key exceptions.It is difficult to draw clear conclusions about the degree to which single versus multiple informant assessment is needed to produce an accurate and complete picture of treatment fidelity. The field needs to take steps to determine how to leverage multi-informant assessment to accurately assess treatment fidelity.

Efforts to improve mental health treatment delivery come at a time of rising inequality and cuts or insufficient increases to mental health funding. Public mental health clinicians face increased demands, experience economic stress, and treat underresourced patients disproportionately burdened by trauma. The authors sought to understand clinicians' current economic and psychological conditions and the relationship of these conditions to the delivery of an evidence-based intervention (EBI) designed to treat posttraumatic stress disorder among youths.In July 2020, 49 public mental health clinicians from 16 Philadelphia clinics who were trained in an EBI, trauma-focused cognitive-behavioral therapy (TF-CBT), were surveyed by e-mail. Respondents reported on their economic precarity, financial strain, burnout, secondary traumatic stress (i.e., the stress response associated with caring for people exposed to trauma), and TF-CBT use. Associations between clinicians' job-related stressors and their use of TF-CBT were examined with mixed models. Content coding was used to organize clinicians' open-ended responses to questions regarding financial strain related to the COVID-19 pandemic.Clinicians' economic precarity, financial strain, and job-related stress were high; 37% of clinicians were independent contractors, 44% of whom wanted a salaried position. Of 37 clinicians with education debt, 38% reported owing ≥$100,000. In the past year, 29% of clinicians reported lack of personal mental health care because of cost, and 22% met the cutoff for experiencing secondary traumatic stress symptoms. Education debt was negatively associated with use of TF-CBT (p0.001).The stress of providing care in underresourced clinical settings may interfere with efforts to integrate scientific evidence into mental health care.

The novel coronavirus (COVID-19) pandemic has caused widespread disruption to our traditional way of life and mental health therapy has not been spared. A combination of increased anxiety, diminished social opportunities, and the shift to telehealth service provision presents particular challenges for the treatment of social anxiety in youth, which relies heavily on exposures to social situations with peers, adults, or other feared social stimuli. The objective of this commentary is to provide guidance to clinicians working with youth with social anxiety on how to maintain ethical, evidence-informed provision of exposure therapy in light of these unusual circumstances. We first present an overview of how COVID-19 may uniquely impact youth with social anxiety and highlight the importance of continuing to provide exposure-based treatments during this time. We then discuss guiding principles for delivering exposure therapy during COVID-19. We focus on providing practical examples of how common social anxiety exposures can be adapted and delivered successfully through telehealth while abiding by COVID-19 social distancing guidelines. Finally, we discuss key recommendations to assist clinicians in moving treatment forward while considering changing safety guidelines pertaining to COVID-19.

Clinicians' self-efficacy with regard to delivering evidence-based interventions (EBIs) to youth is an important target for both improving EBI use in the community and mitigating the risk of clinician burnout and turnover. Examining predictors of clinician self-efficacy to treat trauma-exposed youth is, therefore, an important step for informing the design of implementation strategies to enhance the mental health workforce's capacity to deliver EBIs in this population. We examined predictors of clinician self-efficacy in working with trauma-exposed youth in a sample of practicing mental health clinicians (N = 258, M age = 34.4 years, 85.0% female). Clinicians were recruited and surveyed as part of a larger study examining how clients' exposure to potentially traumatic events influences clinician decision-making. Results of regression models indicated that training in any trauma treatment model, being trained via a variety of formats (e.g., in-person training, online, supervision), and training in a variety of treatment models were all associated with higher perceived self-efficacy regarding effectively treating trauma-exposed youth. Of the treatment models and training formats examined, receiving in-person training, R2 = .10, and training in trauma-focused cognitive behavioral therapy, R2 = .10, were the strongest predictors of higher self-efficacy ratings. Clinician discipline, R2 = .04, and clinical practice factors, R2 = .20, were also related to self-efficacy. Collectively, the R2 indicated a large effect, with the predictors explaining 25.4% of the variance in self-efficacy ratings. Implications for designing implementation strategies targeting clinician self-efficacy and future research are discussed.

Exposure therapy for anxiety and related disorders is the psychological intervention with the strongest support for its efficacy and effectiveness to date. Yet, it is the least used evidence-based intervention in routine clinical practice, with a long-acknowledged public relations problem. Despite a wealth of research aimed at improving uptake of exposure, exposure's marketing and branding remains an untapped target. We first introduce principles from the marketing literature to propose that the field take steps toward a rebranding and repackaging of exposure therapy to support efforts to implement it widely. Second, we present preliminary data on clinician preferences for the use of alternative terminology developed to be more palatable and marketable - "Supported Approach of Feared Experiences - Cognitive Behavioral Therapy (SAFE-CBT)" - compared to traditional terminology. This initial survey indicated that most clinicians preferred use of the SAFE-CBT term when talking to patients, whereas only a minority preferred it for use among training clinicians. We conclude by discussing implications of these results for future efforts to implement exposure therapy more widely and set an agenda for future research in this space.

Supervision in community mental health (CMH) settings is critically important for supporting clinical competency and optimizing clinical outcomes. However, CMH supervision is hindered by numerous administrative and fiscal challenges, which makes aligning supervision practices with gold-standard recommendations notoriously difficult. This article describes a case example of one multicomponent supervision approach within a CMH clinic used to support the delivery of exposure therapy ("exposure") to youth with publicly funded insurance. We first review current recommendations for supervision and highlight the primary barriers to the use of these supervisory practices in CMH settings. We then present three low-burden supervisory approaches used to supplement traditional individual supervision. Each strategy presented aims to mitigate known barriers and maximize alignment with gold-standard supervision practices for exposure while being sustainable within a community setting. Finally, we review the strengths and limitations of each supervision strategy. The multicomponent strategies presented represent a creative approach to CMH supervision that maximizes the limited resources and infrastructure in CMH settings to support the delivery of gold-standard supervision. We conclude by offering insights into how these strategies could support supervision for a broader range of evidence-based practices (EBPs) and make recommendations for future research. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Self-report measures can improve evidence-based assessment practices in substance use disorder treatment, but many measures are burdensome and costly, limiting their utility in community practice and non-specialty healthcare settings. This systematic review identified and evaluated the psychometric properties of brief, free, and readily accessible self-report measures of substance use and related factors.We searched two electronic databases (PsycINFO and PubMed) in May 2021 for published literature on scales, measures, or instruments related to substance use, substance use treatment, and recovery, and extracted the names of all measures. Measures were included if they were: (1) brief (25 items or fewer), (2) freely accessible in a ready-to-use format, and (3) had published psychometric data.An initial search returned 411 measures, of which 73 (18%) met criteria for inclusion. Included measures assessed a variety of substances (e.g., alcohol, nicotine, opioids, cannabinoids, cocaine) and measurement domains (e.g., use, severity, expectancies, withdrawal). Among these measures, 14 (19%) were classified as psychometrically "excellent," 27 (37%) were rated as "good," 32 (44%) were "adequate."Despite the shift toward evidence-based assessment in substance use disorder treatment in the last twenty years, key areas of public health concern are lacking pragmatic, psychometrically valid measures. Among the brief measures we reviewed, less than a fifth met criteria for psychometric "excellence" and most of these instruments fell into one measurement domain: screening for problematic substance use. Future research should focus both on improving the evidence base for existing brief self-report measures and creating new low-burden measures for specific substances and treatment constructs.

BACKGROUND: Current approaches to increasing the rates of clinician use of exposure therapy for anxiety disorders in community settings are limited. Research underscores the importance of addressing contextual variables to facilitate clinician use of evidence-based practices; however, no studies have identified the innovation-specific organizational capacity necessary to implement exposure therapy. Such work is critical to ensure that treatment-seeking individuals with anxiety receive effective care. METHODS: We used a two-step process to identify the innovation-specific organizational capacity necessary to deliver exposure. First, 24 leaders of specialty anxiety clinics in the United States (50% female, mean [M]age = 47.7 years) completed a survey about the organizational innovation-specific capacity (e.g., policies and procedures) they employ to support their providers in delivering exposure therapy. Second, 19 community clinicians (79% female, M age = 42.9 years) reported on the extent to which these characteristics were present in their settings. RESULTS: In Step 1, specialty clinic leaders unanimously endorsed six organizational characteristics as essential and five as important within the areas of organizational policies, supervisory support, and peer clinician support. These characteristics were present in more than 90% of specialty clinics. In Step 2, therapists in community clinics reported these characteristics were minimally present in their organizations. CONCLUSIONS: Specialty clinic leaders exhibited consensus on the innovation-specific organizational capacity necessary to implement exposure therapy. Identified characteristics were largely absent from community clinics. Developing fiscal, policy, or organizational strategies that enhance the organizational capacity within community settings may improve the patients’ access to effective treatment for anxiety disorders.

There is growing recognition that it is important to involve youth and caregivers in the implementation of evidence-based treatments (EBTs). This study explored how youth and caregivers who received trauma-focused cognitive-behavioral therapy (TF-CBT) in a public behavioral health system perceived the concept of EBT, their experience with treatment, their perceptions of TF-CBT, and whether their perceptions varied as a function of clinical improvement. Participants were eight youth (aged 10–17) and nine caregivers/legal guardians who received TF-CBT in community mental health centers. Semi-structured interviews were conducted post-treatment and symptoms were assessed at pre- and post-treatment. An integrated approach was used to analyze the interview data and the reliable change index was used to assess whether youth and caregivers’ impressions varied as a function of clinical improvement. Participants rarely had exposure to the term “evidence-based” and often had the misconception that evidence referred to personal experience. Youth and caregivers found the concept of receiving treatment supported by research appealing but did not like the specific term “evidence-based” and worried that treatment guided by research alone may not individualize to their needs. Personal stories were noted as a good way to market TF-CBT and the therapist emerged as an important advocate for promoting this treatment approach. Clinical improvement was associated with the perception of therapists as collaborative and with trauma narrative completion. Findings suggest that language and how therapists communicate EBTs to youth and caregivers may be important for targeted implementation strategies.

The Knowledge of Evidence-Based Services Questionnaire (KEBSQ) is an objective measure of therapist knowledge of practices derived from the evidence base for the treatment of youth psychopathology. However, the length of this measure (i.e., 40 items) and respondent demands associated with each item makes it burdensome for researchers and clinicians. This study developed and validated a Short Form of the KEBSQ using Item Response Theory (IRT) measurement models. The Short Form consists of 17 items and generates two separate scores: Correct Endorsements and Correct Rejections. The Short Form was found to correlate highly with and perform similarly to the Full Form, providing preliminary validity evidence.

Evidence-based assessment (EBA) is foundational to high-quality mental health care for youth and is a critical component of evidence-based practice delivery, yet is underused in the community. Administration time and measure cost are barriers to use; thus, identifying and disseminating brief, free, and accessible measures are critical. This Evidence Base Update evaluates the empirical literature for brief, free, and accessible measures with psychometric support to inform research and practice with youth. A systematic review using PubMed and PsycINFO identified measures in the following domains: overall mental health, anxiety, depression, disruptive behavior, traumatic stress, disordered eating, suicidality, bipolar/mania, psychosis, and substance use. To be eligible for inclusion, measures needed to be brief (50 items or less), free, accessible, and have psychometric support for their use with youth. Eligible measures were evaluated using adapted criteria established by De Los Reyes and Langer (2018) and were classified as having excellent, good, or adequate psychometric properties. A total of 672 measures were identified; 95 (14%) met inclusion criteria. Of those, 21 (22%) were "excellent," 34 (36%) were "good," and 40 (42%) were "adequate." Few measures had support for their use to routinely monitor progress in therapy. Few measures with excellent psychometric support were identified for disordered eating, suicidality, psychosis, and substance use. Future research should evaluate existing measures for use with routine progress monitoring and ease of implementation in community settings. Measure development is needed for disordered eating, suicidality, psychosis, and substance use to increase availability of brief, free, accessible, and validated measures.

Clinician fidelity to cognitive behavioral therapy (CBT) is an important mechanism by which desired clinical outcomes are achieved and is an indicator of care quality. Despite its importance, there are few fidelity measurement methods that are efficient and have demonstrated reliability and validity. Using a randomized trial design, we compared three methods of assessing CBT adherence-a core component of fidelity-to direct observation, the gold standard. Clinicians recruited from 27 community mental health agencies (n = 126; M age = 37.69 years, SD = 12.84; 75.7% female) were randomized 1:1:1 to one of three fidelity conditions: self-report (n = 41), chart-stimulated recall (semistructured interviews with the chart available; n = 42), or behavioral rehearsal (simulated role-plays; n = 43). All participating clinicians completed fidelity assessments for up to three sessions with three different clients that were recruited from clinicians' caseloads (n = 288; M age = 13.39 years SD = 3.89; 41.7% female); sessions were also audio-recorded and coded for comparison to determine the most accurate method. All fidelity measures had parallel scales that yielded an adherence maximum score (i.e., the highest-rated intervention in a session), a mean of techniques observed, and a count total of observed techniques. Results of three-level mixed effects regression models indicated that behavioral rehearsal produced comparable scores to observation for all adherence scores (all ps gt; .01), indicating no difference between behavioral rehearsal and observation. Self-report and chart-stimulated recall overestimated adherence compared to observation (ps lt; .01). Overall, findings suggested that behavioral rehearsal indexed CBT adherence comparably to direct observation, the gold-standard, in pediatric populations. Behavioral rehearsal may at times be able to replace the need for resource-intensive direct observation in implementation research and practice.

We identified common and unique barriers and facilitators of evidence-based suicide prevention practices across primary care practices with integrated behavioral health services and specialty mental health settings to identify generalizable strategies for enhancing future implementation efforts.Twenty-six clinicians and practice leaders from behavioral health (There were a number of similar themes associated with implementation of suicide prevention practices across settings and clinician types, such as the benefits of inter-professional collaboration and uncertainties about managing suicidality once risk was disclosed. Clinicians also highlighted barriers unique to their settings. For primary care settings, time constraints and competing demands were consistently described as barriers. For specialty mental health settings, difficulties coordinating care with schools and other providers in the community made implementation of suicide prevention practices challenging.Findings can inform the development and testing of implementation strategies that are generalizable across primary care and specialty mental health settings, as well as those tailored for unique site needs, to enhance use of evidence-based suicide prevention practices in settings where individuals at risk for suicide are especially likely to present.HIGHLIGHTSWe examined barriers and facilitators to suicide prevention across health settings.Common and unique barriers and facilitators across health-care settings emerged.Findings can enhance suicide prevention implementation across health-care settings.

OBJECTIVE: We examined whether in the presence of trauma exposure, non-traumatic stress-related symptoms are interpreted by mental health clinicians as less salient than the trauma exposure and are de-emphasized as a treatment target, consistent with a diagnostic overshadowing bias. METHODS: Using an adapted version of a diagnostic overshadowing bias experimental paradigm, mental health clinicians (N = 266, M age = 34.4 years, 82% female) were randomly assigned to receive two of six clinical vignette variations. Vignette 1 described an adolescent with obsessive-compulsive disorder (OCD). Vignette 2 described a pre-adolescent with oppositional defiant disorder (ODD). Vignettes were identical except for whether the youth reported exposure to a potentially traumatic event (PTE; no PTE, sexual PTE, or physical PTE). Clinicians received one vignette with a PTE and one without, counterbalancing order. Clinicians rated the likelihood the youth met criteria for various diagnoses and the appropriateness of various treatments on 7-point scales. RESULTS: Across both vignettes, clinicians rated the target diagnosis (OCD in Vignette 1, ODD in Vignette 2) as less likely for vignettes with a PTE than for the same vignettes without a PTE. Clinicians also rated evidence-based treatment modalities for target diagnoses as less appropriate in the presence of a PTE than when a PTE was present. CONCLUSIONS: Consistent with possible bias, clinicians may under-recognize and under-treat non-traumatic stress-related mental health symptoms in youth with a co-occurring trauma history. Future work to validate this bias in real-world practice is indicated.

Frontline health care workers (HCWs) are experiencing a range of emotional responses to the COVID-19 pandemic, including anxiety, traumatic stress, and burnout. As many as half of all HCWs will exhibit clinically significant distress. This distress may endure for years, and health care institutions must respond to these emotional needs. We propose the Matched Emotional Supports in Health Care (MESH) Framework to guide institutions in implementing a tiered, or "stepped care" model for deploying sustainable emotional support programs for HCWs for COVID-19 and beyond. Recognizing the variability in HCWs' response to stress, MESH outlines a continuum of services, including universal (e.g., self-help), selected (e.g., support from trained volunteers), and indicated (e.g., professional therapy, psychotropic medication management) interventions matched to individual need. We provide a targeted review of evidence-based resources available at each level of care and potential processes for determining when higher levels of care are needed. Finally, we delineate key implementation factors for institutions to consider in developing, implementing, and sustaining services for HCWs. Employing the MESH Framework may also facilitate health care institutions' ability to meet the fourth aim of the Quadruple Aims of Health Care to ensure a healthy workforce for this and future crises. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

OBJECTIVES: Promoting safe firearm storage in pediatric primary care is one way to address youth suicide by firearm. The study objective is to determine perspectives of primary care physicians (PCPs) and leaders of primary care practices regarding acceptability and use of screening, counseling, and firearm locks, three components of an adapted evidence-based intervention, the Firearm Safety Check. METHODS: In 2016, an online survey was conducted in two large United States health systems. PCPs (n = 204) and leaders (n = 57) from 83 clinics were invited to participate. Respondents included 71 clinics (86%), 103 PCPs (50%), and 40 leaders (70%). Main outcomes included acceptability (1-6 Likert with higher scores indicating better acceptability) and use of the three intervention components (1-4 Likert with higher scores indicating more use) measured by an adapted validated instrument. RESULTS: Analyses were conducted in 2017. PCP acceptability of screening (M = 4.28, SD = 1.12) and counseling (M = 4.56, SD = .89) were high while acceptability for firearm lock provision was more neutral (M = 3.78, SD = 1.16). Most PCPs endorsed sometimes screening (85%) and counseling (80%). Few PCPs offered firearm locks to caregivers (15%). Leaders reported consistent information. CONCLUSION: Acceptability of screening for firearms and safe storage counseling was high; both components were used commonly but not routinely. The acceptability of providing firearm locks was neutral and use was rarely endorsed. This study provides important insights about areas of focus for future implementation efforts from policy and research perspectives. WHAT’S NEW: Evidence-based practices for safe firearm storage endorsed by the American Academy of Pediatrics are variably considered to be acceptable and are inconsistently implemented in pediatric primary care, highlighting the importance of efforts to actively increase the use of these intervention components as a universal suicide prevention strategy.

Background: Efforts to increase the implementation of evidence-based interventions come at a time of rising inequality and cuts to public mental health funding. Clinicians in publicly funded mental health clinics face increased demands, work long hours, experience financial stress, and treat clinically severe, under-resourced patients. A detailed understanding of clinicians' economic precarity, financial strain, and job-related stressors, and an understanding of how these factors relate to treatment delivery, is needed. Methods: In July 2020, we surveyed 49 clinicians working in Philadelphia’s public mental health system who participated in a large-scale trauma-focused cognitive behavioral therapy (TF-CBT) training initiative. Respondents reported on professional burnout, economic precarity, financial strain, secondary traumatic stress, and self-reported use of TF-CBT. We examined associations between clinicians’ economic precarity, job-related stressors, and their TF-CBT use with mixed models. We used content coding to organize open-ended responses into themes.Results: Economic precarity, financial strain, burnout, and secondary traumatic stress among respondents was high. Thirty-seven percent of clinicians were independent contractors, and of those, 44% reported desiring a salaried position. Most clinicians (76%) had outstanding education loans, and of those, 38% reported over $100,000 in education debt. In the last year, 29% of clinicians went without personal mental healthcare due to cost. Most clinicians (73%) endorsed at least one symptom of secondary traumatic stress, with 22% scoring above the clinical cutoff. Education debt was negatively associated with TF-CBT use (p

Background: Developing pragmatic assessment tools to measure clinician use of evidence-based practices is critical to advancing implementation of evidence-based practices in mental health. This case study details our community-partnered process of developing the Therapy Process Observation Coding Scale-Self-Reported Therapist Intervention Fidelity for Youth (TPOCS-SeRTIFY), a pragmatic, clinician-report instrument to measure cognitive behavioral therapy (CBT) delivery. Approach: We describe a five-step community-partnered development process. Initial goals were to create a self-report instrument that paralleled an existing direct observation measure of clinician delivery of CBT use to facilitate later assessment of measure performance. Cognitive interviews with community clinicians ( n = 6) and consultation with CBT experts ( n = 6) were used to enhance interpretability and usability as part of an iterative refinement process. The instrument was administered to 247 community clinicians along with an established self-reported measure of clinician delivery of CBT and other treatments to assess preliminary psychometric performance. Preliminary psychometrics were promising. Conclusion: Our community-partnered development process showed promising success and can guide future development of pragmatic implementation measures both to facilitate measurement of ongoing implementation efforts and future research aimed at building learning mental health systems. Plain language summary Developing brief, user-friendly, and accurate tools to measure how therapists deliver cognitive behavioral therapy (CBT) in routine practice is important for advancing the reach of CBT into community settings. To date, developing such “pragmatic” measures has been difficult. There is little known about how researchers can best develop these types of assessment tools so that they (1) are easy for clinicians in practice to use and (2) provide valid and useful information about implementation outcomes. As a result, there are few well-validated measures in existence that measure therapist use of CBT that are feasible for use in community practice. This paper contributes to the literature by describing our community-partnered process for developing a measure of therapist use of CBT (Therapy Process Observation Coding Scale -Self-Reported Therapist Intervention Fidelity for Youth; TPOCS-SeRTIFY). This descriptive case study outlines the community-partnered approach we took to develop this measure. This case study will contribute to future research by serving as a guide to others aiming to develop pragmatic implementation measures. In addition, the TPOCS-SeRTIFY is a pragmatic measure of clinician use of CBT that holds promise for its use by both researchers and clinicians to measure the success of CBT implementation efforts.

Background:Despite evidence for its efficacy, exposure therapy for anxiety is rarely used in routine care settings. Efforts to address one major barrier to its use – therapists’ negative beliefs about exposure – have included therapist-level implementation strategies, such as training and consultation. Experiential training, in which therapists themselves undergo exposures, has recently demonstrated feasibility, acceptability and preliminary effectiveness for increasing exposure use.Aims:This study aimed to assess: (1) therapists’ perceptions of experiential training and (2) barriers and facilitators to implementing exposure following training.Method:Therapists who underwent experiential training (n=12) completed qualitative interviews and quantitative questionnaires. Interviews were coded using an integrated approach, combining both inductive and deductive approaches. Mixed methods analyses examined how themes varied by practice setting (community mental health versus private practice) and exposure use.Results:Results highlight how therapist-level factors, such as clinician self-efficacy, interact with inner- and outer-setting factors. Participants reported positive perceptions of exposure after training; they noted that directly addressing myths about exposure and experiencing exposures themselves improved their attitudes toward exposure. Consistent with prior literature, issues such as insufficient supervisory support, organizational constraints, and client characteristics made it challenging to implement exposures.Discussion:Results highlight the benefits of experiential training, while also highlighting the need to consider contextual determinants. Differences in responses across practice settings highlight areas for intervention and the importance of tailoring implementation strategies. Barriers that were specific to therapists who did not use exposure (e.g. hesitancy about its appropriateness for most clients) point to directions for future implementation efforts.

A lack of effective therapist training is a major barrier to evidence-based intervention (EBI) delivery in the community. Systematic reviews published nearly a decade ago suggested that traditional EBI training leads to higher knowledge but not more EBI use, indicating that more work is needed to optimize EBI training and implementation. This systematic review synthesizes the training literature published since 2010 to evaluate how different training models (workshop, workshop with consultation, online training, train-the-trainer, and intensive training) affect therapists' knowledge, beliefs, and behaviors. Results and limitations for each approach are discussed. Findings show that training has advanced beyond provision of manuals and brief workshops; more intensive training models show promise for changing therapist behavior. However, methodological issues persist, limiting conclusions and pointing to important areas for future research.

Background Suicide is a global health issue. There are a number of evidence-based practices for suicide screening, assessment, and intervention that are not routinely deployed in usual care settings. The goal of this study is to develop and test implementation strategies to facilitate evidence-based suicide screening, assessment, and intervention in two settings where individuals at risk for suicide are especially likely to present: primary care and specialty mental health care. We will leverage methods from behavioral economics, which involves understanding the many factors that influence human decision making, to inform strategy development. Methods We will identify key mechanisms that limit implementation of evidence-based suicide screening, assessment, and intervention practices in primary care and specialty mental health through contextual inquiry involving behavioral health and primary care clinicians. Second, we will use contextual inquiry results to systematically design a menu of behavioral economics-informed implementation strategies that cut across settings, in collaboration with an advisory board composed of key stakeholders (i.e., behavioral economists, clinicians, implementation scientists, and suicide prevention experts). Finally, we will conduct rapid-cycle trials to test and refine the menu of implementation strategies. Primary outcomes include clinician-reported feasibility and acceptability of the implementation strategies. Discussion Findings will elucidate ways to address common and unique barriers to evidence-based suicide screening, assessment, and intervention practices in primary care and specialty mental health care. Results will yield refined, pragmatically tested strategies that can inform larger confirmatory trials to combat the growing public health crisis of suicide.

Background Implementation theory suggests that first-level leaders, sometimes referred to as middle managers, can increase clinicians’ use of evidence-based practice (EBP) in healthcare settings by enacting specific leadership behaviors (i.e., proactive, knowledgeable, supportive, perseverant with regard to implementation) that develop an EBP implementation climate within the organization; however, longitudinal and quasi-experimental studies are needed to test this hypothesis. Methods Using data collected at three waves over a 5-year period from a panel of 30 outpatient children’s mental health clinics employing 496 clinicians, we conducted a quasi-experimental difference-in-differences study to test whether within-organization change in implementation leadership predicted within-organization change in EBP implementation climate, and whether change in EBP implementation climate predicted within-organization change in clinicians’ use of EBP. At each wave, clinicians reported on their first-level leaders’ implementation leadership, their organization’s EBP implementation climate, and their use of both EBP and non-EBP psychotherapy techniques for childhood psychiatric disorders. Hypotheses were tested using econometric two-way fixed effects regression models at the organization level which controlled for all stable organizational characteristics, population trends in the outcomes over time, and time-varying covariates. Results Organizations that improved from low to high levels of implementation leadership experienced significantly greater increases in their level of EBP implementation climate (d = .92, p = .017) and within-organization increases in implementation leadership accounted for 11% of the variance in improvement in EBP implementation climate beyond all other covariates. In turn, organizations that improved from low to high levels of EBP implementation climate experienced significantly greater increases in their clinicians’ average EBP use (d = .55, p = .007) and within-organization improvement in EBP implementation climate accounted for 14% of the variance in increased clinician EBP use. Mediation analyses indicated that improvement in implementation leadership had a significant indirect effect on clinicians’ EBP use via improvement in EBP implementation climate (d = .26, 95% CI [.02 to .59]). Conclusions When first-level leaders increase their frequency of implementation leadership behaviors, organizational EBP implementation climate improves, which in turn contributes to increased EBP use by clinicians. Trials are needed to test strategies that target this implementation leadership–EBP implementation climate mechanism.

Objectives Although turnover, defined as when a therapist leaves his/her organization, occurs frequently in public mental health organizations, its impact on clients is understudied. This study examined the effects of turnover on client engagement among youth receiving services in one public mental health agency. Methods Data were abstracted through a retrospective chart review of 76 clients who initiated outpatient trauma-focused treatment with 30 therapists between June 2013 and January 2016 at one agency in Philadelphia. Client demographic information, client session attendance, and therapist for each session was abstracted from each chart. The dependent variable (i.e., client engagement) was operationalized as client attendance to scheduled sessions. Mixed-effects regression analyses were used. Results Youth who experienced therapist turnover were 86% more likely to miss a future scheduled therapy session. When exploring this effect by diagnosis, youth without a Post-Traumatic Stress Disorder (PTSD) diagnosis were more likely to miss a scheduled session following therapist turnover than those with a PTSD diagnosis (p Conclusions Therapist turnover is a strong predictor of client engagement among youth receiving trauma-focused treatment, and a PTSD diagnosis may be a protective factor against missing sessions. Implications for treatment planning in the face of therapist turnover are discussed.