Search

BACKGROUND: Thailand has a rapidly aging population yet lacks evidence for effective and scalable evidence-based psychosocial interventions to support persons living with dementia and their family caregivers. In this study of a culturally adapted and evidence-based clinical program (Reducing Disabilities in Alzheimers Disease [RDAD]), designed to reduce behavioral and psychological symptoms of dementia in older adults, the authors test the hypothesis that an implementation support strategy, Getting To Outcomes (GTO), would produce better implementation and clinical outcomes compared with usual implementation of RDAD in Thailand. METHODS: The study uses a hybrid type III cluster-randomized design to compare eight geographical districts that receive training on both implementing the RDAD clinical intervention and on GTO implementation support strategies (intervention arm) with eight other districts that receive the same RDAD training but without training in GTO implementation support strategies (control arm). GTO is an evidence-based intervention designed to support implementers to better plan, implement, and evaluate innovative intervention programs in a novel setting. Primary outcomes, including implementation and clinical outcomes, will be assessed at baseline, month 3 (posttreatment), and month 6 (3-month follow-up). RESULTS: The research team anticipates that there will be significantly more improvements in the delivery of the RDAD intervention program in the experimental group than in the control group. NEXT STEPS: If clinical trial findings are positive, the authors plan to replicate and scale up the proposed implementation science approach across Thailand to enhance and expand mental health services for older adults with dementia.

Abstract We present a simple method to produce giant lipid pseudo-vesicles (vesicles with an oily cap on the top), trapped in an agarose gel. The method can be implemented using only a regular micropipette and relies on the formation of a water/oil/water double droplet in liquid agarose. We characterize the produced vesicle with fluorescence imaging and establish the presence and integrity of the lipid bilayer by the successful insertion of $$\alpha $$ α -Hemolysin transmembrane proteins. Finally, we show that the vesicle can be easily mechanically deformed, non-intrusively, by indenting the surface of the gel.

Abstract Background Organizational readiness is a key factor for successful implementation of evidence-based interventions (EBIs), but a valid and reliable measure to assess readiness across contexts and settings is needed. The R = MC2 heuristic posits that organizational readiness stems from an organization’s motivation, capacity to implement a specific innovation, and its general capacity. This paper describes a process used to examine the face and content validity of items in a readiness survey developed to assess organizational readiness (based on R = MC2) among federally qualified health centers (FQHC) implementing colorectal cancer screening (CRCS) EBIs. Methods We conducted 20 cognitive interviews with FQHC staff (clinical and non-clinical) in South Carolina and Texas. Participants were provided a subset of items from the readiness survey to review. A semi-structured interview guide was developed to elicit feedback from participants using “think aloud” and probing techniques. Participants were recruited using a purposive sampling approach and interviews were conducted virtually using Zoom and WebEx. Participants were asked 1) about the relevancy of items, 2) how they interpreted the meaning of items or specific terms, 3) to identify items that were difficult to understand, and 4) how items could be improved. Interviews were transcribed verbatim and coded in ATLAS.ti. Findings were used to revise the readiness survey. Results Key recommendations included reducing the survey length and removing redundant or difficult to understand items. Additionally, participants recommended using consistent terms throughout (e.g., other units/teams vs. departments) the survey and changing pronouns (e.g., people, we) to be more specific (e.g., leadership, staff). Moreover, participants recommended specifying ambiguous terms (e.g., define what “better” means). Conclusion Use of cognitive interviews allowed for an engaged process to refine an existing measure of readiness. The improved and finalized readiness survey can be used to support and improve implementation of CRCS EBIs in the clinic setting and thus reduce the cancer burden and cancer-related health disparities.

Abstract Background Although the benefits of evidence-based practices (EBPs) for advancing community outcomes are well-recognized, challenges with the uptake of EBPs are considerable. Technical assistance (TA) is a core capacity building strategy that has been widely used to support EBP implementation and other community development and improvement efforts. Yet despite growing reliance on TA, no reviews have systematically examined the evaluation of TA across varying implementation contexts and capacity building aims. This study draws on two decades of peer-reviewed publications to summarize the evidence on the evaluation and effectiveness of TA. Methods Guided by Arksey and O’Malley’s six-stage methodological framework, we used a scoping review methodology to map research on TA evaluation. We included peer-reviewed articles published in English between 2000 and 2020. Our search involved five databases: Business Source Complete, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Education Resources Information Center (ERIC), PsycInfo, and PubMed. Results A total of 125 evaluation research studies met the study criteria. Findings indicate that publications have increased over the last two decades, signaling a growth in the recognition and reporting of TA. Technical assistance is being implemented across diverse settings, often serving socially vulnerable and under-resourced populations. Most evaluation research studies involved summative evaluations, with TA outcomes mostly reported at the organizational level. Only 5% of the studies examined sustainability of TA outcomes. This review also demonstrates that there is a lack of consistent standards regarding the definition of TA and the level of reporting across relevant TA evaluation categories (e.g., cadence of contact, and directionality). Conclusions Advances in the science and practice of TA hinge on understanding what aspects of TA are effective and when, how, and for whom these aspects of TA are effective. Addressing these core questions requires (i) a standard definition for TA; (ii) more robust and rigorous evaluation research designs that involve comparison groups and assessment of direct, indirect, and longitudinal outcomes; (iii) increased use of reliable and objective TA measures; and (iv) development of reporting standards. We view this scoping review as a foundation for improving the state of the science and practice of evaluating TA.

Abstract Background The school is a key setting for the provision of mental health services to children, particularly those underserved through traditional service delivery systems. School-wide Positive Behavioral Interventions and Supports (PBIS) is a tiered approach to service delivery based on the public health model that schools use to implement universal (Tier 1) supports to improve school climate and safety. As our prior research has demonstrated, PBIS is a useful vehicle for implementing mental and behavioral health evidence-based practices (EBPs) at Tier 2 for children with, or at risk for, mental health disorders. Very little research has been conducted regarding the use of mental health EBPs at Tier 2 or how to sustain implementation in schools. Methods/design The main aim of the study is to compare fidelity, penetration, cost-effectiveness, and student outcomes of Tier 2 mental health interventions across 2 sustainment approaches for school implementers in 12 K-8 schools. The study uses a 2-arm, cluster randomized controlled trial design. The two arms are: (a) Preparing for Sustainment (PS)—a consultation strategy implemented by school district coaches who receive support from external consultants, and (b) Sustainment as Usual (SAU)—a consultation strategy implemented by school district coaches alone. Participants will be 60 implementers and 360 students at risk for externalizing and anxiety disorders. The interventions implemented by school personnel are: Coping Power Program (CPP) for externalizing disorders, CBT for Anxiety Treatment in Schools (CATS) for anxiety disorders, and Check-in/Check-out (CICO) for externalizing and internalizing disorders. The Interactive Systems Framework (ISF) for Dissemination and Implementation guides the training and support procedures for implementers. Discussion We expect that this study will result in a feasible, effective, and cost-effective strategy for sustaining mental health EBPs that is embedded within a multi-tiered system of support. Results from this study conducted in a large urban school district would likely generalize to other large, urban districts and have an impact on population-level child mental health. Trial registration ClinicalTrials.gov identifier number NCT04869657. Registered May 3, 2021.

Background: Federal agencies and other funders seeking to maximise their impact aim to understand factors associated with implementing evidence-based interventions (EBIs) to address health problems. Challenges exist, however, in synthesising information from different disciplines and reaching agreement about these factors due to different terminology, frameworks, and measures being used in different fields. Methods: A mixed-methods approach was used to identifying a set of implementation constructs helpful for selecting, monitoring, and supporting federal grantees in health and human service settings. Three phases of research were conducted: a literature review, structured expert interviews, and consensus building. Interviews with implementation experts were used to validate a set of implementation constructs identified in the literature review as strongly and consistently related to successful implementation of EBIs in international contexts. A modified Delphi approach was used with a technical working group (TWG) of federal staff to agree on the constructs most relevant for federally funded EBIs. Findings: This process yielded 11 constructs related to either the intervention, the intersection between the invention and context, or the implementation process. These constructs are areas of interest when integrating research evidence into routine practice. Expert interviewees recommended establishing clear, consistent construct definitions before developing valid, feasible measures of the constructs. In contrast to the numerous and specific constructs advanced by researchers, federal TWG members favoured fewer constructs with more generalisability. Discussion and conclusions: This article demonstrates the translation work required for policy contexts and highlights a successful approach to translate evidence from implementation science research for federal staff.

Sustainable community health improvement often requires the implementation of complex interventions in complex systems. Drawing from the "Four Keys to Success" frame (theory, implementation, support, and evaluation), this article describes how we used a formative evaluation approach to foster a learning system capable of monitoring and addressing emerging community needs within the Spreading Community Accelerators Through Learning and Evaluation (SCALE) initiative--a national capacity-building effort to support 24 community coalitions' progress toward a Culture of Health. The formative evaluation approach resulted in critical advancements to the theory, implementation, and nature of supports provided in SCALE. These improvements enabled the SCALE evaluation team to shift from the initial focus on program implementation issues to a greater emphasis on downstream factors (community-level outcomes). The ability of formative evaluation to grapple with the emerging challenges of implementing complex interventions in complex systems makes it particularly valuable for community health improvement initiatives.

Improving health literacy is a national public health priority. Given the context of the COVID-19 pandemic, it is even more critical for health and medical information to be clear and understandable for patients and their families. Clinic-based programs to improve health literacy need to be pragmatic, feasible, and helpful for the implementing clinic and patients. This paper describes the development, implementation, and evaluation of a pragmatic, clinic-based health literacy intervention in a safety-net clinic that serves uninsured and indigent patients. Study methods are guided by a previous pilot study and components recommended for pragmatic interventions. An electronic readiness assessment was distributed to out-patient clinics affiliated with a statewide hospital association. The AskMe3 tool was used for the intervention as it is evidence informed and relatively easy to implement. Implementation included ongoing dialogue between the clinic and the academic research team. Within the implementing clinic, data collected from patients via verbally administered questionnaires was analyzed using descriptive statistics and chi-squares. Interview data collected from the clinic director was analyzed qualitatively for themes. The implementing clinic had some of the lowest average scores of the 34 clinics who participated in the initial readiness assessment. Despite this, they were able to successfully implement the health literacy intervention during a global pandemic. Eighty-eight participants completed patient questionnaires at this clinic. Most patients (96%) agreed the AskMe3 questions helped them talk with the doctor or nurse at their current appointment. Most (99%) also perceived the AskMe3 tool to be very helpful when used in a clinical setting. The clinic director offered that the staff initially thought the intervention would be difficult to implement. However, implementation by clinic volunteers with encouragement and prioritization of health literacy by the clinic director contributed to success. When considering interventions for clinical settings, a pragmatic approach can help with selection and implementation of a program that fits with the realities on the ground. Further, frequent technical assistance can help resolve implementation barriers. Interventions utilizing tools such as AskMe3, because of their simplicity, allow creative solutions to capacity issues for clinics who see a need for health literacy improvements.

Organizational readiness is essential for high-quality implementation of innovations (programs, policies, practices, or processes). The R = MC2 heuristic describes three readiness components necessary for implementation—the general functioning of the organization (general capacities), the ability to deliver a particular innovation (innovation-specific capacities), and the motivation to implement the innovation. In this article, we describe how we used the Readiness Building System (RBS) for assessing, prioritizing, and improving readiness and Implementation Mapping (IM), a systematic process for planning implementation strategies, to build organizational readiness for implementation of sexual assault prevention evidence-based interventions (EBIs). While RBS provides an overarching approach for assessing and prioritizing readiness constructs (according to the R = MC2 heuristic; Readiness = Motivation x general Capacity × innovation specific Capacity), it does not provide specific guidance on the development and/or selection and tailoring of strategies to improve readiness. We used the five IM tasks to identify and prioritize specific readiness goals and develop readiness-building strategies to improve subcomponents described in the R = MC2 heuristic. This article illustrates how IM can be used synergistically with the RBS in applied contexts to plan implementation strategies that will improve organizational readiness and implementation outcomes. Specifically, we provide an example of using these two frameworks as part of the process of building organizational readiness for implementation of sexual assault prevention EBIs.

Spreading Community Accelerators Through Learning and Evaluation (SCALE) was a Robert Wood Johnson Foundation-funded initiative from 2015 to 2017 to build capability of 24 community coalitions to advance health, well-being, and equity. The SCALE theory of change had three components: develop leadership capability, build relationships within and between communities, and create an intercommunity system to spread promising ideas. The theory was operationalized through training academies, coaching, and peer-to-peer learning that explicitly addressed equity and systems change. In this article, we describe how SCALE facilitated community transformation related to Collaborating for Equity and Justice Principles 1, 3, 4, and 6. We conducted a multiple-case study approach with two community coalitions including site visits, interviews, and observation to illuminate underlying mechanisms of change by exploring how and why change occurs. Skid Row Women worked with women experiencing homelessness in Los Angeles to address diabetes and food systems. Healthy Livable Communities of Cattaraugus County used a portfolio of projects in order to create system changes to improve population health and increase access to services for people with disabilities in rural New York State. Through our analysis, we describe how two coalitions used SCALE tools for collaborative coalition processes such as aim setting, relationship building, and shared decision making with community residents. Our findings suggest that advancing Collaborating for Equity and Justice principles requires self-reflection and courage; new ways of being in relationship; learning from failure; productive conflict to explicitly address power, racism, and other forms of oppression; and methods to test systems improvement ideas.

Abstract Background Organizational readiness is important for the implementation of evidence-based interventions. Currently, there is a critical need for a comprehensive, valid, reliable, and pragmatic measure of organizational readiness that can be used throughout the implementation process. This study aims to develop a readiness measure that can be used to support implementation in two critical public health settings: federally qualified health centers (FQHCs) and schools. The measure is informed by the Interactive Systems Framework for Dissemination and Implementation and R = MC 2 heuristic (readiness = motivation × innovation-specific capacity × general capacity). The study aims are to adapt and further develop the readiness measure in FQHCs implementing evidence-based interventions for colorectal cancer screening, to test the validity and reliability of the developed readiness measure in FQHCs, and to adapt and assess the usability and validity of the readiness measure in schools implementing a nutrition-based program. Methods For aim 1, we will conduct a series of qualitative interviews to adapt the readiness measure for use in FQHCs. We will then distribute the readiness measure to a developmental sample of 100 health center sites (up to 10 staff members per site). We will use a multilevel factor analysis approach to refine the readiness measure. For aim 2, we will distribute the measure to a different sample of 100 health center sites. We will use multilevel confirmatory factor analysis models to examine the structural validity. We will also conduct tests for scale reliability, test-retest reliability, and inter-rater reliability. For aim 3, we will use a qualitative approach to adapt the measure for use in schools and conduct reliability and validity tests similar to what is described in aim 2. Discussion This study will rigorously develop a readiness measure that will be applicable across two settings: FQHCs and schools. Information gained from the readiness measure can inform planning and implementation efforts by identifying priority areas. These priority areas can inform the selection and tailoring of support strategies that can be used throughout the implementation process to further improve implementation efforts and, in turn, program effectiveness.

Sexual violence affects millions of Americans, and approximately one out of every three women and one out of every four men have experienced sexual violence during their lifetime. While prevention efforts have focused on implementing specific programmatic approaches, there has been relatively little focus on developing comprehensive and effective approaches to reduce sexual assault prevention across an organization. This study describes the development of the Prevention Evaluation Framework, an assessment targeting organizational best practices for comprehensive sexual assault prevention across multiple domains including human resources, collaborative relationships and infrastructure, use of evidence-informed approaches, quality implementation and continuous evaluation of programs/policies. Using the structured RAND/University of California, Los Angeles appropriateness method to develop the assessment, we conducted a literature review and solicited expert feedback about what a comprehensive organizational approach to sexual assault prevention should entail. We then pilot tested the assessment with 3 United States military service academies; and continued to improve and adapt the assessment to a range of organizations with input from 6 Department of Defense headquarters organizations, and 9 universities across the country. Given the nascent state of the evidence about what makes an effective organizational approach to sexual assault prevention, the assessment reflects one way of promoting quality in this evolving field. The consistency between the experts’ ratings and the literature, and the relevance of the items across organizations suggest that the assessment provides important guidance to inform the development of comprehensive organizational approaches to sexual assault prevention and to the evaluation of ongoing efforts.

Characterizing the mechanical properties of tissues is key for the understanding of fundamental biological processes such as morphogenesis or tumor progression. In particular, the intercellular adhesion forces, mediated by transmembrane proteins like cadherins, are expected to control the topology and viscoelastic behavior of tissues under mechanical stress. In order to understand the influence of adhesion in tissues, we use biomimetic emulsions in which droplets mimic cells and adhere to each other through specific bonds. Here, we tune both the binding energy of the adhesive inter-droplets contacts as well as the fraction of contacts that are adhesive, thereby defining a so-called adhesiveness. Our experimental results show that adhesion prevents the emergence of local order in emulsions even at high packing fractions by preventing energetically costly droplet rearrangements. By studying the deformation of droplets within packings with different average adhesiveness values, we reveal the existence of a threshold value of adhesiveness above which all droplets in a packing are deformed as adhesive ones irrespective of their local adhesive properties. We show that this critical adhesiveness coincides with the threshold for percolation of adhesive structures throughout the tissue. From a biological point of view, this indicates that only a fraction of adhesive cells would be sufficient to tune the global mechanical properties of a tissue, which would be critical during processes such as morphogenesis.

Traditional methods of evaluation are limited in their ability to answer key questions often of interest to process evaluators, such as heterogeneity in the ways individuals adopt new programs. In this article, we demonstrate how a statistical approach, Latent Class Analysis, can help improve the quality of process evaluations and illustrate its use in an evaluation of an educational technology integration program in a large school district. In this illustration, we were interested in detecting variability in the ways teachers adopted the new program. We defined classes based on a set of innovative teaching strategies associated with educational technology. Results showed five distinct subgroups of teachers, based on level of program adoption. Results also demonstrate that specific school support strategies (professional development and personalized computing devices) facilitated program adoption. These findings can help to inform individualized support for teachers to optimize the ease and quality with which they are able to adopt new skills in the classroom.